Skip to content

Commit baa9f91

Browse files
authored
Update llm nightly
1 parent 9b44bcc commit baa9f91

File tree

3 files changed

+3
-3
lines changed

3 files changed

+3
-3
lines changed

README.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -56,7 +56,7 @@ We are excited to announce initial support for performant LLM inference in DeepS
5656

5757
Install (requires Linux):
5858
```bash
59-
pip install -U deepsparse-nightly[transformers]==1.6.0.20231007
59+
pip install -U deepsparse-nightly[llm]
6060
```
6161

6262
Run inference:

docs/llms/text-generation-pipeline.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -23,7 +23,7 @@ This user guide explains how to run inference of text generation models with Dee
2323
DeepSparse support for LLMs is available on DeepSparse's nightly build on PyPi:
2424

2525
```bash
26-
pip install -U deepsparse-nightly[transformers]==1.6.0.20231007
26+
pip install -U deepsparse-nightly[llm]
2727
```
2828

2929
#### **System Requirements**

research/mpt/README.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -43,7 +43,7 @@ While GSM is a "toy" math dataset, it serves as an example of how LLMs can be ad
4343
Install the DeepSparse Nightly build (requires Linux):
4444

4545
```bash
46-
pip install deepsparse-nightly[transformers]==1.6.0.20231007
46+
pip install -U deepsparse-nightly[llm]
4747
```
4848

4949
The models generated in the paper are hosted on [SparseZoo](https://sparsezoo.neuralmagic.com/?ungrouped=true&sort=null&datasets=gsm8k&architectures=mpt) and [Hugging Face](https://huggingface.co/collections/neuralmagic/sparse-finetuning-mpt-65241d875b29204d6d42697d).

0 commit comments

Comments
 (0)