Shipping w/ Error code

Successfully creates the docker image and commencers training however somethings wrong about 3/4 way in. pushing as is

Author: karpatic

langdrive.yaml

@@ -22,11 +22,30 @@ huggingface:
   baseModel: vilsonrodrigues/falcon-7b-instruct-sharded
   hfModelPath: karpathic/falcon-7b-instruct-tuned
   deployToHf: true 
+  hfTrainPath: karpathic/auto-trainer
+  isPrivate: true
 
 train: 
   input:
     path: ./tests/midjourney_prompt.csv
     value: input
   output:
     path: ./tests/midjourney_prompt.csv
-  outputValue: output
+  outputValue: output
+  settings:
+    PROJECT_NAME: my_test_llm
+    MODEL_NAME: abhishek/llama-2-7b-hf-small-shards
+    PUSH_TO_HUB: false
+    LEARNING_RATE: 2e-4
+    NUM_EPOCHS: 1
+    BATCH_SIZE: 1
+    BLOCK_SIZE: 1024
+    WARMUP_RATIO: 0.1
+    WEIGHT_DECAY: 0.01
+    GRADIENT_ACCUMULATION: 4
+    MIXED_PRECISION: fp16
+    PEFT: true
+    QUANTIZATION: int4
+    LORA_R: 16
+    LORA_ALPHA: 32
+    LORA_DROPOUT: 0.05

markdown/docs/api/cli.md

@@ -12,7 +12,8 @@ Here are your Args:
 - `hfToken`: An API key provided by Hugging Face with `write` permissions. Get one [here](https://huggingface.co/docs/hub/security-tokens).
 - `baseModel`: The original model to train. This can be one of the models in our supported models shown at the bottom of this page
 - `deploy`: Weather training weights should be hosted in a hosting service. Default False. 
-- `deployToHf`: Whether traiing weights should be stored in huggingface specifically. Either true | false
+- `deployToHf`: Whether traiing weights should be stored in huggingface specifically. default true
+- `isPrivate`: Whether created services should be publicly visible. default false
 - `hfModelPath`: The full path to your hugging face model repo where the model should be deployed. Format: hugging face username/model 
 - `inputValue`: The input value to extract from the data retrieved, default: 'input'
 - `outputValue`: The output value to extract from the data retrieved, default: 'output'

markdown/docs/getting-started.md

@@ -26,6 +26,8 @@ The command `langdrive train` is used to train the LLM, please see how to config
 - `deploy`: Weather training weights should be hosted in a hosting service. Default False. 
 - `deployToHf`: Whether traiing weights should be stored in huggingface specifically. Either true | false
 - `hfModelPath`: The full path to your hugging face model repo where the model should be deployed. Format: hugging face username/model
+- `hfTrainPath`: The full path for training environment to be created. Format: hugging face username/spaces_name
+- `isPrivate`: Whether the training service and model should be publicly visible.
 - `csv`: Path to shared csv training data.
 - `path`: Path to shared training data.
 - `inputPath`: Path to input training data if not shared.

package-lock.json

@@ -7,11 +7,11 @@
     "langdrive": "./main.js"
   },
   "scripts": {
-    "start": "nodemon ./src/start_server.js", 
+    "start": "nodemon ./src/start_server.js",
     "serveDocs": "cd markdown && npm run start",
     "serveDocsw": "cd markdown; npm run start",
-    "buildDocs": "rm ./docs/* -r && cd markdown && npm run build && mv build/* ../docs/ && cp CNAME ../docs/", 
-    "buildDocsw": "rm ./docs/* -r; cd markdown; npm run build; mv build/* ../docs/; cp CNAME ../docs/", 
+    "buildDocs": "rm ./docs/* -r && cd markdown && npm run build && mv build/* ../docs/ && cp CNAME ../docs/",
+    "buildDocsw": "rm ./docs/* -r; cd markdown; npm run build; mv build/* ../docs/; cp CNAME ../docs/",
     "version": "npm version patch",
     "testCli": "./tests/test_cli.bash",
     "testChatbot": "node ./src/server/test.mjs"
@@ -32,8 +32,10 @@
     "express": "^4.18.2",
     "express-session": "^1.17.3",
     "faiss-node": "^0.2.3",
+    "fetch-blob": "^4.0.0",
     "firebase-admin": "^11.11.0",
     "firebase-functions": "^4.3.1",
+    "form-data": "^4.0.0",
     "googleapis": "^123.0.0",
     "js-yaml": "^4.1.0",
     "langchain": "^0.0.124",