sjaipuriyar/phi3_model_testing
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Update README.md

Browse source
This commit is contained in:
sjaipuriyar 2024-08-23 15:24:22 -07:00
parent 13e13ef246
commit b364373ae9
1 changed files with 10 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

10
README.md
View file

@ -20,5 +20,15 @@ Phi-3 generation with Go code:
Granite 3b generation with Go code:
`curl -X POST -H "Content-Type: application/x-www-form-urlencoded" -d"query=Write me an example of Go programming code." http://169.231.231.109:5000/query/granite`
#How to run this on your own
- Start by setting up an env within the directory of your choice.
`python -m venv env`
`source env/bin//activate`
- You will need to (pip) install torch, transformers, accelerator, and flask in order to properly run the application
`pip freeze > requirements.txt` will help setup a requirements text file as shown in the repo
- If you haven't as yet, also make sure to fork Phi-3: https://huggingface.co/microsoft/Phi-3-mini-4k-instruct#sample-inference-code$0 and IBM Granite 3b: https://huggingface.co/ibm-granite/granite-3b-code-instruct#generation$0 from huggingface and change the `@app.route` in the testing.py file to match the locations where you host those models.
Overall the Phi-3 model can be better used as a way to generate text and the Granite model might be better at developing code and generating software solutions