Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

support transfer llama hf weight to megatron weight #246

Open
wants to merge 10 commits into
base: main
Choose a base branch
from
Open

support transfer llama hf weight to megatron weight #246

wants to merge 10 commits into from

Commits on Sep 12, 2023

  1. [feature]add weight transfer script for llama2

    fengyu05 committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    8993968 View commit details
    Browse the repository at this point in the history

  2. [feature]add weight transfer script for llama2

    fengyu05 committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    83cb7eb View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2023

  1. add llama transfer script

    fengyu05 committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    4c3b28a View commit details
    Browse the repository at this point in the history

  2. [feature]add weight transfer script for llama2 

    [feature]add weight transfer script for llama2
    fengyu05 committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    d6bb32a View commit details
    Browse the repository at this point in the history

  3. add readme 

    add llama transfer script
    fengyu05 committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    6c46b17 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'fy/hf2megatron' of github.com:uygnef/Megatron-DeepSpeed… 

    … into fy/hf2megatron
    fengyu05 committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    86dcc48 View commit details
    Browse the repository at this point in the history

Commits on Sep 14, 2023

  1. reformat llama transfer script, retrieve model info from LlamaConfig

    fengyu05 committed Sep 14, 2023
    Configuration menu
    Copy the full SHA
    fbb2ef9 View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2023

  1. Merge branch 'main' into fy/hf2megatron

    @uygnef
    uygnef authored Sep 20, 2023
    Configuration menu
    Copy the full SHA
    41d3fa5 View commit details
    Browse the repository at this point in the history

Commits on Oct 11, 2023

  1. Merge branch 'microsoft:main' into fy/hf2megatron

    @uygnef
    uygnef authored Oct 11, 2023
    Configuration menu
    Copy the full SHA
    f39eaaf View commit details
    Browse the repository at this point in the history

Commits on Oct 12, 2023

  1. add Convert DeepSpeed to Huggingface transformers version script

    fengyu05 committed Oct 12, 2023
    Configuration menu
    Copy the full SHA
    ac1be7b View commit details
    Browse the repository at this point in the history