Skip to content

feat: support CPU thread count in C, Python, and Swift EmbeddingEngine - #3550

Open
copybara-service[bot] wants to merge 1 commit into
mainfrom
litert_lm_pr_979300636
Open

feat: support CPU thread count in C, Python, and Swift EmbeddingEngine#3550
copybara-service[bot] wants to merge 1 commit into
mainfrom
litert_lm_pr_979300636

Conversation

@copybara-service

@copybara-service copybara-service Bot commented Sep 10, 2026

Copy link
Copy Markdown
Contributor

feat: support CPU thread count in C, Python, and Swift EmbeddingEngine

  • Expose litert_lm_embedding_engine_settings_set_num_threads in the C API.
  • Forward backend=interfaces.CPU(thread_count=N) in Python EmbeddingEngine.
  • Pass backend = .cpu(threadCount: N) in Swift EmbeddingEngine.

@copybara-service
copybara-service Bot force-pushed the litert_lm_pr_979300636 branch from d9a7e30 to b3aee04 Compare September 10, 2026 21:53
@copybara-service copybara-service Bot changed the title feat: add main CPU thread count setting to EmbeddingEngine C API feat: support CPU thread count in C, Python, and Swift EmbeddingEngine Sep 10, 2026
@copybara-service
copybara-service Bot force-pushed the litert_lm_pr_979300636 branch from b3aee04 to 0ea6e2a Compare September 10, 2026 21:56
- Expose `litert_lm_embedding_engine_settings_set_num_threads` in the C API.
- Forward `backend=interfaces.CPU(thread_count=N)` in Python EmbeddingEngine.
- Pass `backend = .cpu(threadCount: N)` in Swift EmbeddingEngine.

LiteRT-LM-PiperOrigin-RevId: 979300636
@copybara-service
copybara-service Bot force-pushed the litert_lm_pr_979300636 branch from 0ea6e2a to 069bcdb Compare September 11, 2026 20:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant