Snowflake Openflow
Blurb on Openflow and how it’s based on Apache NiFi.
By building with open source, developers can innovate faster with powerful services. Our engineers regularly contribute to open source projects to accelerate the innovation that our customers and the industry benefit from.
Open source only works when the technical community joins forces to commit together. We’re proud of the work that Snowflakes do every day to contribute to and lead open source projects.
In addition to open sourcing our own projects and libraries, Snowflake supports key open source projects through technical and financial contributions.
Open source is important to Snowflake because we use it ourselves. Many of our products and features are built directly on top of popular open source projects.
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Ut enim ad minim veniam, quis nostrud exercitation ullamco."
Benoit Dageville
Co-founder and President of Product
Open source only works when the technical community joins forces to commit together. We’re proud of the work that Snowflakes do every day to contribute to and lead open source projects.
0 Results
In addition to open sourcing our own projects and libraries, Snowflake supports key open source projects through technical and financial contributions.
Contributers
Projects Contributed To
Projects Open Sourced
Streamlit is a Python library that makes it easy to create and share beautiful, custom web apps for machine learning and data science.
Snowpark for Python, client side library provides dataframe style APIs for querying and processing data in Snowflake. It lets you build and deploy data pipelines, ML workflows and applications from any IDE that can run a Python kernel
Terraform is an infrastructure-as-code tool that lets you build, change, and version resources. Our partners at the Chan Zuckerberg Initiative developed a Terraform provider for Snowflake that we now maintain.
SansShell is primarily a gRPC server with a variety of options for localhost debugging and management. Its goal is to replace the need to use an interactive shell for emergency debugging and recovery with a much safer interface.
schemachange is a Python-based tool to manage Snowflake objects. It follows an imperative-style approach to database change management (DCM).
Lezer-snowsql is a SnowSQL grammar for the lezer parser system. Lezer provides a parser generator that outputs JavaScript modules.
Django is a high-level Python web framework that encourages rapid development and clean, pragmatic design. We maintain the Snowflake backend for Django
Modin is a drop-in replacement for pandas. While pandas is single-threaded, Modin lets you instantly speed up your workflows by scaling pandas so it uses all of your cores. Modin works especially well on larger datasets, where pandas becomes slow or runs out of memory.
NiFi automates cybersecurity, observability, event streams, and generative AI data pipelines and distribution for thousands of companies worldwide across every industry.
ArcticInference is an open-source vLLM plugin that delivers the fastest and most cost-effective inference for LLMs and Embeddings.
ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs).
Anaconda is a distribution of the Python and R programming languages for scientific computing such as data science, machine learning applications, large-scale data processing, and predictive analytics that aims to simplify package management and deployment.
Apache Beam is a unified model for defining both batch and streaming data-parallel processing pipelines, as well as a set of language-specific SDKs for constructing pipelines and ruRunners for executing them on distributed processing backends.
Apache Iceberg is a table format for storing large, slow-moving tabular data. It is designed to improve on the standard table layout built into Hive, Trino, and Spark.
Apache Flume is a distributed service for efficiently collecting, aggregating, and moving large amounts of log data. It has a simple and flexible architecture based on streaming data flows.
dbt is a command-line tool that enables analytics engineers to transform data in their warehouses by writing select statements. Dbt turns those select statements into tables and views and transforms data without extracting or loading it.
Feast is a feature store that speeds up operationalizing analytic data for model training and online inference. It simplifies sharing and reuse of features, and makes it easier to serve features to online systems.
FoundationDB is a distributed database designed to handle large volumes of structured data across clusters of commodity servers. It organizes data as an ordered key-value store and employs ACID transactions for all operations.
Sequelize is an easy-to-use and promise-based Node.js ORM tool for Postgres, MySQL, MariaDB, SQLite, DB2, Microsoft SQL Server, Snowflake, and IBM. It features solid transaction support, relations, eager and lazy loading, read replication and more.
PyTorch is a leading open source machine learning library for building and training deep learning models. Snowflake joined the PyTorch Foundation as a general member to help accelerate the adoption of PyTorch.
The Linux Foundation provides a neutral, trusted hub for developers and organizations to code, manage, and scale open technology projects and ecosystems. Snowflake joined the Linux Foundation as a Silver member.
NumFOCUS provides a stable, independent, and professional home for the open source projects powering contemporary scientific inquiry and business processes. Snowflake joined NumFOCUS as a Community Sponsor.
Open source is important to Snowflake because we use it ourselves. Many of our products and features are built directly on top of popular open source projects.
get started
Snowflake Labs hosts projects that were developed by our community, customers, and people at Snowflake. Snowflake’s does not officially maintain these projects. We invite everyone to contribute code, report bugs, and help improve the documentation.
Do you have an open source project we should support? Do you want to contribute to projects we maintain? Get in touch.
blurb about how to find and join OSS events near you - would link off to a meetup.com page. blurb about how to find and join OSS events near you - would link off to a meetup.com page
Subscribe to our monthly newsletter
Stay up to date on Snowflake’s latest products, expert insights and resources—right in your inbox!