Issues

• Why is deepspeed enabled in the Bloom training script?

  bigscience-workshop/bigscience#71 · Filter by author robertLiuLinFeng opened on Nov 1, 2023

• Where can I download the training script for bloom-7b1?

  bigscience-workshop/bigscience#69 · Filter by author robertLiuLinFeng opened on May 30, 2023

• Files for bias evaluation

  bigscience-workshop/bigscience#68 · Filter by author yu202147657 opened on Mar 13, 2023

• where can we get a bloomz-7b1 finetuned checkpoint

  bigscience-workshop/bigscience#67 · Filter by author zhangyipin opened on Feb 21, 2023

• How to get train-splits.txt and valid-splits.txt before training tr11-176B-ml

  bigscience-workshop/bigscience#66 · Filter by author robinfang7 opened on Dec 26, 2022
  1

• eval opt-175B

  bigscience-workshop/bigscience#63 · Filter by author henan991201 opened on Oct 26, 2022
  1

• Requirements to perform inference over the BigScience Bloom model

  bigscience-workshop/bigscience#62 · Filter by author celsofranssa opened on Oct 10, 2022

• mC4 sampling & pre-processing

  bigscience-workshop/bigscience#61 · Filter by author sbmaruf opened on Aug 17, 2022
  1

• Running Bloom

  bigscience-workshop/bigscience#52 · Filter by author kamalkraj opened on Jul 7, 2022
  5

• Zero_Stage=1 results in higher TFLOPS?

  bigscience-workshop/bigscience#48 · Filter by author lhb8125 opened on Jun 28, 2022
  1

• Sharing the 1.3B-Pile@300B model

  bigscience-workshop/bigscience#46 · Filter by author BlinkDL opened on Jun 21, 2022

• can you share the slurm.conf you are using?

  bigscience-workshop/bigscience#37 · Filter by author OhadRubin opened on Mar 27, 2022
  3

• Is the 13B - unmodified Megatron gpt2 - baseline available? ( tr1-13B-base)

  bigscience-workshop/bigscience#21 · Filter by author ViktorThink opened on Dec 4, 2021
  1