You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+19-4Lines changed: 19 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -22,10 +22,10 @@
22
22
Apache TVM FFI is an open ABI and FFI for machine learning systems. It is a minimal, framework-agnostic,
23
23
yet flexible open convention with the following systems in mind:
24
24
25
-
-**Kernel libraries** - ship one wheel to support multiple frameworks, Python versions, and different languages.
26
-
-**Kernel DSLs** - reusable open ABI for JIT and AOT kernel exposure frameworks and runtimes.
27
-
-**Frameworks and runtimes** - a uniform extension point for ABI-compliant libraries and DSLs.
28
-
-**ML infrastructure** - out-of-the-box bindings and interop for Python, C++, and Rust.
25
+
-**Kernel libraries** - ship one wheel to support multiple frameworks, Python versions, and different languages.[[FlashInfer](https://docs.flashinfer.ai/)]
26
+
-**Kernel DSLs** - reusable open ABI for JIT and AOT kernel exposure frameworks and runtimes.[[TileLang](https://tilelang.com/)][[cuteDSL](https://docs.nvidia.com/cutlass/latest/media/docs/pythonDSL/cute_dsl_general/compile_with_tvm_ffi.html)]
27
+
-**Frameworks and runtimes** - a uniform extension point for ABI-compliant libraries and DSLs.[[PyTorch](https://tvm.apache.org/ffi/get_started/quickstart.html#ship-to-pytorch)][[JAX](https://tvm.apache.org/ffi/get_started/quickstart.html#ship-to-jax)][[NumPy/CuPy](https://tvm.apache.org/ffi/get_started/quickstart.html#ship-to-numpy)]
28
+
-**ML infrastructure** - out-of-box bindings and interop across languages. [[Python](https://tvm.apache.org/ffi/get_started/quickstart.html#ship-to-python)][[C++](https://tvm.apache.org/ffi/get_started/quickstart.html#ship-to-cpp)][[Rust](https://tvm.apache.org/ffi/get_started/quickstart.html#ship-to-rust)]
29
29
-**Coding agents** - a unified mechanism for shipping generated code in production.
30
30
31
31
## Features
@@ -37,6 +37,21 @@ yet flexible open convention with the following systems in mind:
37
37
38
38
These enable broad **interoperability** across frameworks, libraries, DSLs, and agents; the ability to **ship one wheel** for multiple frameworks and Python versions (including free-threaded Python); and consistent infrastructure across environments.
39
39
40
+
## Getting Started
41
+
42
+
Install TVM-FFI with pip, uv or from source:
43
+
44
+
```bash
45
+
pip install apache-tvm-ffi
46
+
pip install torch-c-dlpack-ext # compatibility package for torch <= 2.9
47
+
```
48
+
49
+
Visit our [documentation](https://tvm.apache.org/ffi/) to learn more.
0 commit comments