Skip to content
This repository was archived by the owner on Apr 23, 2025. It is now read-only.
This repository was archived by the owner on Apr 23, 2025. It is now read-only.

Add a DistilGPT2 variant #549

@texasmichelle

Description

@texasmichelle

There's a very cool post here (HT @BradLarson) with benchmarks for PyTorch XLA. It would be great to see how x10 compares by adding a DistilGPT2 variant and DistilGPT2-WikiText2 example.

Metadata

Metadata

Assignees

No one assigned

    Labels

    help wantedExtra attention is needed

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions