You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: LLM/MLOps/comet.com/Readme.md
+25Lines changed: 25 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -2,6 +2,26 @@ Readme by Hari Thapliyal
2
2
3
3
# comet.ml
4
4
5
+
## What is Comet.ml
6
+
[Comet]((https://www.comet.com/site/)) Automatically track all your prompt engineering work. Run automated evaluations on your LLM responses to optimize your applications before and after they hit production.
7
+
8
+
Debug and evaluate your LLM applications with Opik (Opik Open Source LLM Evaluation)
9
+
- Automatically track all your prompt engineering work. Run automated evaluations on your LLM responses to optimize your applications before and after they hit production.
10
+
11
+
12
+
Track and visualize your model training runs with Experiment Management (Commet Experiment Management)
13
+
- Log all your machine learning iteration to a single system of record. Make it easy to reproduce a previous experiment and compare the performances of training runs.
14
+
15
+
Monitor ML model performance in production with Comet MPM (Commet Model Monitoring)
16
+
- Track data drift on your input and output features after your model is deployed to production. Set customized alerts to capture model performance degradation in real time.
17
+
18
+
Store and manage your models with Model Registry (Commet Model Registry)
19
+
- Create a centralized repository of all your model versions with immediate access to how they were trained. Promote models to downstream production systems with webhooks
20
+
21
+
Create and version datasets with Artifacts (Commet Artifacts)
22
+
- Know which exact dataset version a model was trained on for auditing and governance purposes. Leverage remote pointers to reference data already stored in the cloud.
23
+
24
+
## Experiments Run
5
25
To reduce the friction caused by disconnected ML tech stacks and to help companies realize value from ML, Comet focuses on the three core elements of development:
0 commit comments