Skip to content

Commit 1801de1

Browse files
scosmanscosman
authored
Merge pull request #257 from Kiln-AI/main
update docs for new 0.13 release.
2 parents c2ade0b + fca8d7c commit 1801de1

78 files changed

Lines changed: 6063 additions & 2198 deletions

File tree

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

‎.cursorrules‎

Lines changed: 6 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,9 @@
1+
- call me "boss"
12
- Always assume pydantic 2 (not pydantic 1)
2-
- Always use pytest for tests
33
- The project supports Python 3.10 and above
4+
- When writing tests:
5+
1) Always use pytest for tests in python code
6+
2) assume an appriopirate test file already exists, find it, and suggest tests get appended to that file. If no such file exists, ask me before assuming a new test file is the correct route.
7+
3) Test brevity is important. Use approaches for re-use and brevity including using fixtures for repeated code, and using pytest parameterize for similar tests
8+
49

‎.github/workflows/build_and_test.yml‎

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -12,6 +12,7 @@ jobs:
1212
- "3.10"
1313
- "3.11"
1414
- "3.12"
15+
- "3.13"
1516

1617
steps:
1718
- uses: actions/checkout@v4

‎.github/workflows/build_desktop.yml‎

Lines changed: 2 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -25,14 +25,13 @@ jobs:
2525
with:
2626
enable-cache: true
2727

28-
# Use 3.12 - 3.13 not working yet (Numpy verion too old)
2928
- uses: actions/setup-python@v5
3029
with:
31-
python-version: 3.12
30+
python-version: 3.13
3231

3332
# Use GH python version (includes TK/TCL)
3433
- name: Set up Python using GH python version
35-
run: uv venv --python 3.12 --python-preference only-system
34+
run: uv venv --python 3.13 --python-preference only-system
3635

3736
- name: Install the project
3837
run: uv sync

‎.github/workflows/build_docs.yml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -24,7 +24,7 @@ jobs:
2424
enable-cache: true
2525

2626
- name: Set up Python
27-
run: uv python install 3.12
27+
run: uv python install 3.13
2828

2929
- name: Install the project
3030
run: uv sync --all-extras --dev

‎.github/workflows/test_count.yml‎

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -18,7 +18,7 @@ jobs:
1818
enable-cache: true
1919

2020
- name: Set up Python
21-
run: uv python install 3.12
21+
run: uv python install 3.13
2222

2323
- name: Install the project
2424
run: uv sync --all-extras --dev
@@ -57,8 +57,9 @@ jobs:
5757
color: brightgreen
5858

5959
- name: Run library coverage
60+
# n0 disables parallel execution
6061
run: |
61-
uv run coverage run -m pytest -q ./libs/
62+
uv run coverage run -m pytest -q ./libs/ -n0
6263
TOTAL_LIB_COVERAGE=$(uv run coverage report | grep TOTAL | awk {'print $4'})
6364
echo "TOTAL_LIB_COVERAGE=$TOTAL_LIB_COVERAGE" >> $GITHUB_ENV
6465

‎.github/workflows/windows_release_build.yml‎

Lines changed: 2 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -16,14 +16,13 @@ jobs:
1616
with:
1717
enable-cache: true
1818

19-
# Use 3.12 - 3.13 not working yet (Numpy verion too old)
2019
- uses: actions/setup-python@v5
2120
with:
22-
python-version: 3.12
21+
python-version: 3.13
2322

2423
# Use GH python version (includes TK/TCL)
2524
- name: Set up Python using GH python version
26-
run: uv venv --python 3.12 --python-preference only-system
25+
run: uv venv --python 3.13 --python-preference only-system
2726

2827
- name: Install the project
2928
run: uv sync

‎README.md‎

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -21,14 +21,15 @@
2121
| Package | [![PyPI - Version](https://img.shields.io/pypi/v/kiln-ai.svg?logo=pypi&label=PyPI&logoColor=gold)](https://pypi.org/project/kiln-ai/) [![PyPI - Python Version](https://img.shields.io/pypi/pyversions/kiln-ai.svg?logo=python&label=Python&logoColor=gold)](https://pypi.org/project/kiln-ai/) |
2222
| Meta | [![uv](https://img.shields.io/endpoint?url=https://raw.githubusercontent.com/astral-sh/uv/main/assets/badge/v0.json)](https://github.com/astral-sh/uv) [![linting - Ruff](https://img.shields.io/endpoint?url=https://raw.githubusercontent.com/astral-sh/ruff/main/assets/badge/v2.json)](https://github.com/astral-sh/ruff) [![Hatch project](https://img.shields.io/badge/%F0%9F%A5%9A-Hatch-4051b5.svg)](https://github.com/pypa/hatch) [![types - Pyright](https://img.shields.io/badge/types-pyright-blue.svg)](https://github.com/microsoft/pyright) [![Docs](https://img.shields.io/badge/docs-pdoc-blue)](https://kiln-ai.github.io/Kiln/kiln_core_docs/index.html) |
2323
| Apps | [![MacOS](https://img.shields.io/badge/MacOS-black?logo=apple)](https://github.com/Kiln-AI/Kiln/releases/latest) [![Windows](https://img.shields.io/badge/Windows-0067b8.svg?logo=data:image/svg%2bxml;base64,PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz4KPHN2ZyBmaWxsPSIjZmZmIiB2aWV3Qm94PSIwIDAgMzIgMzIiIHZlcnNpb249IjEuMSIgeG1sbnM9Imh0dHA6Ly93d3cudzMub3JnLzIwMDAvc3ZnIj4KPHBhdGggZD0iTTE2Ljc0MiAxNi43NDJ2MTQuMjUzaDE0LjI1M3YtMTQuMjUzek0xLjAwNCAxNi43NDJ2MTQuMjUzaDE0LjI1NnYtMTQuMjUzek0xNi43NDIgMS4wMDR2MTQuMjU2aDE0LjI1M3YtMTQuMjU2ek0xLjAwNCAxLjAwNHYxNC4yNTZoMTQuMjU2di0xNC4yNTZ6Ij48L3BhdGg+Cjwvc3ZnPg==)](https://github.com/Kiln-AI/Kiln/releases/latest) [![Linux](https://img.shields.io/badge/Linux-444444?logo=linux&logoColor=ffffff)](https://github.com/Kiln-AI/Kiln/releases/latest) ![Github Downsloads](https://img.shields.io/github/downloads/kiln-ai/kiln/total) |
24-
| Connect | [![Discord](https://img.shields.io/badge/Discord-Kiln_AI-blue?logo=Discord&logoColor=white)](https://discord.gg/sVJEzDGu) [![Newsletter](https://img.shields.io/badge/Newsletter-kilnai-blue?logo=Substack&logoColor=white)](https://kilnai.substack.com) |
24+
| Connect | [![Discord](https://img.shields.io/badge/Discord-Kiln_AI-blue?logo=Discord&logoColor=white)](https://discord.gg/Q5QwFeGTDh) [![Newsletter](https://img.shields.io/badge/Newsletter-kilnai-blue?logo=Substack&logoColor=white)](https://kilnai.substack.com) |
2525

2626
[<img width="220" alt="Download button" src="https://github.com/user-attachments/assets/a5d51b8b-b30a-4a16-a902-ab6ef1d58dc0">](https://github.com/Kiln-AI/Kiln/releases/latest) [<img width="220" alt="Quick start button" src="https://github.com/user-attachments/assets/aff1b35f-72c0-4286-9b28-40a415558359">](https://docs.getkiln.ai/getting-started/quickstart)
2727

2828
## Key Features
2929

3030
- 🚀 **Intuitive Desktop Apps**: One-click apps for Windows, MacOS, and Linux. Truly intuitive design.
31-
- 🎛️ **Fine Tuning**: Zero-code fine-tuning for Llama, GPT4o, and Mixtral. Automatic serverless deployment of models.
31+
- 🎛️ **Fine Tuning**: Zero-code fine-tuning for Llama, GPT-4o, and more. Automatic serverless deployment of models.
32+
- 📊 **Evals:** Evaluate the quality of your models/tasks using state of the art evaluators.
3233
- 🤖 **Synthetic Data Generation**: Generate training data with our interactive visual tooling.
3334
- 🧠 **Reasoning Models**: Train or distill your own custom reasoning models.
3435
- 🤝 **Team Collaboration**: Git-based version control for your AI datasets. Intuitive UI makes it easy to collaborate with QA, PM, and subject matter experts on structured data (examples, prompts, ratings, feedback, issues, etc.).

‎app/desktop/.python-version‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1 +1 @@
1-
3.12
1+
3.13

‎app/desktop/README.md‎

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -5,15 +5,15 @@
55
UV python doesn't include TK/TCL [yet](https://github.com/astral-sh/uv/issues/7036). Instead, we install system python including TK/TCL, and tell UV venv to use system python.
66

77
```
8-
# Install python 3.12 and python-tk 3.12 with homebrew
9-
brew install python-tk@3.12
10-
brew install python@3.12
8+
# Install python 3.13 and python-tk 3.13 with homebrew
9+
brew install python-tk@3.13
10+
brew install python@3.13
1111
1212
# check uv can see it hoembrew version
1313
uv python list --python-preference only-system
1414
15-
# setup 3.12 uv-managed venv with system (homebrew) python 3.12
16-
uv venv --python 3.12 --python-preference only-system
15+
# setup 3.13 uv-managed venv with system (homebrew) python 3.13
16+
uv venv --python 3.13 --python-preference only-system
1717
1818
# Check it worked
1919
uv run python --version

‎app/desktop/studio_server/eval_api.py‎

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -507,6 +507,9 @@ async def get_eval_config_score_summary(
507507
# Check if we should count this eval_run. Not every eval_run has to go into the stats:
508508
# - a dataset_id can be removed from the dataset filter (removed a tag)
509509
# - this dataset_id was already counted (not great there are dupes, but shouldn't be double counted if there are)
510+
if run_config_id not in remaining_expected_dataset_ids:
511+
# This run_config is not in the eval config, so we should not count it
512+
continue
510513
if eval_run.dataset_id not in remaining_expected_dataset_ids[run_config_id]:
511514
continue
512515
else:

0 commit comments

Comments
 (0)