awesome-infra-for-ai digest (2026-06-29)
The awesome-infra-for-ai list received 7 new repositories. data-privacy-stack/presidio (9,745 stars) — Presidio is an open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images, and structured data, leveraging NLP and customizable pipelines. NVIDIA/cuvs (794 stars) — cuVS is an NVIDIA library providing GPU-accelerated algorithms for vector similarity search and clustering, designed to simplify high-performance vector operations. workweave/router (553 stars) — A model router for agentic systems that routes prompts to the most suitable LLM, optimizing performance and cost by dynamically selecting from various providers like Anthropic and OpenAI. lightonai/next-plaid (503 stars) — NextPlaid is a local-first multi-vector database and indexing engine that powers ColGREP, a semantic code search tool for terminals and coding agents. agencyenterprise/PromptInject (501 stars) — PromptInject is a framework for quantitatively analyzing the robustness of LLMs against adversarial prompt attacks through modular prompt assembly and evaluation. vortico/flama (288 stars) — Flama is a production framework for serving predictive and generative AI models as APIs, supporting OpenAI/Anthropic/Ollama-compatible endpoints, a built-in chat UI, and native Model Context Protoc... tma1-ai/tma1 (103 stars) — TMA1 provides local-first observability for LLM agents, capturing every LLM call, routing insights back to the agent via hooks and MCP tools, and offering a dashboard for detailed analysis.