Total 2 skills · from GitHub & curated sets, updated daily
Orchestra-Research/AI-Research-SKILLs/02-tokenization/huggingface-tokenizers
Fast tokenizers optimized for research and production. Rust-based implementation tokenizes 1GB in <20 seconds. Supports BPE, WordPiece, and Unigram algorithms. Train custom vocabularies, track alignments, handle padding/truncation. Integrates seamlessly with transformers. Use when you need high-performance tokenization or custom tokenizer training.
a5c-ai/babysitter/library/specializations/desktop-development/skills/tauri-project-setup
Initialize Tauri project with Rust backend and frontend framework integration