NiFi automates cybersecurity, observability, event streams, and generative AI data pipelines and distribution for thousands of companies worldwide across every industry.

Apache Polaris is an open-source, fully featured catalog for Apache Iceberg™. It standardizes how Iceberg tables are managed and accessed across engines and platforms.

Apache Spark is a unified analytics engine for large-scale data processing. It offers APIs in multiple languages and provides distributed processing with data parallelism and fault tolerance.

arctic-embed is a suite of high-quality text embedding models. It is optimized for building retrieval systems with strong performance and efficiency.

ArcticInference is an open-source plugin for vLLM. It delivers fast, cost-effective inference for large language models and embeddings.

ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs).

dbt is a command-line tool that enables analytics engineers to transform data in their warehouses by writing select statements. Dbt turns those select statements into tables and views and transforms data without extracting or loading it.

DeepSpeed is a deep learning optimization library built on PyTorch. It enables efficient training and serving of very large AI models through advanced memory and parallelism techniques.

Django is a high-level Python web framework that promotes rapid development and clean design. Snowflake maintains the backend integration for Django.

Feast is an open-source feature store for machine learning. It streamlines feature sharing, reuse, and serving for both training pipelines and real-time inference.

FoundationDB is a distributed database designed to handle large volumes of structured data across clusters of commodity servers. It organizes data as an ordered key-value store and employs ACID transactions for all operations.

Goose is an open-source, local-first AI agent framework that integrates with your tools via the Model Context Protocol (MCP) to automate and extend developer workflows.

Jupyter Notebook is an interactive, open-source environment for data and scientific computing. It combines code, text, and visualizations in shareable, executable documents.

Lezer-snowsql is a SnowSQL grammar for the lezer parser system. Lezer provides a parser generator that outputs JavaScript modules.

Modin is a drop-in replacement for pandas. While pandas is single-threaded, Modin lets you instantly speed up your workflows by scaling pandas so it uses all of your cores. Modin works especially well on larger datasets, where pandas becomes slow or runs out of memory.

The OSI Initiative is a collaborative open-source project for standardizing semantic model exchange. It aims to streamline how analytics, AI, and BI tools share and use semantic models.

PostGIS is the geospatial extension for PostgreSQL. It adds support for geographic objects, spatial queries, and geospatial analytics.

Postgres (PostgreSQL®) is a popular open-source relational database. It is known for its reliability, extensibility, and strong SQL compliance.

PyTorch is a leading open source machine learning library for building and training deep learning models. Snowflake joined the PyTorch Foundation as a general member to help accelerate the adoption of PyTorch.

SansShell is primarily a gRPC server with a variety of options for localhost debugging and management. Its goal is to replace the need to use an interactive shell for emergency debugging and recovery with a much safer interface.

schemachange is a Python-based tool to manage Snowflake objects. It follows an imperative-style approach to database change management (DCM).

Sequelize is an easy-to-use and promise-based Node.js ORM tool for Postgres, MySQL, MariaDB, SQLite, DB2, Microsoft SQL Server, Snowflake, and IBM. It features solid transaction support, relations, eager and lazy loading, read replication and more.

Snowpark for Python, client side library provides dataframe style APIs for querying and processing data in Snowflake. It lets you build and deploy data pipelines, ML workflows and applications from any IDE that can run a Python kernel

Streamlit is a Python library that makes it easy to create and share beautiful, custom web apps for machine learning and data science.

Terraform is an infrastructure-as-code tool that lets you build, change, and version resources. Our partners at the Chan Zuckerberg Initiative developed a Terraform provider for Snowflake that we now maintain.

TruLens is an open-source toolkit for evaluating, testing, and monitoring LLM applications, with built-in support for feedback, observability, and guardrails.

vLLM is a high-performance inference engine for large language models that optimizes memory use with PagedAttention to deliver faster, more efficient serving at scale.