01Open source
Repos
Open-source repos worth knowing, by the problem they take on.
Data & Databases
kvrocks
Apache Kvrocks is a C++ distributed key-value NoSQL database compatible with Redis protocol, and developers would check it now for scalable.
Mini Lsm
Mini-LSM is an educational Rust repository for building a storage engine to learn database internals.
slatedb
SlateDB is a Rust-based embedded storage engine that uses object storage for scalable, durable data management.
Objectbox Java
ObjectBox Java is a lightweight on-device database for Android and JVM apps with vector search capabilities.
Tusk
Tusk is a fast, native Rust database client for macOS supporting 20 databases with AI features, appealing to developers seeking keyboard-driven.
USearch
A C++ single-file vector similarity search and clustering engine with a fast HNSW implementation and bindings for many languages.
typedb
A Rust database unifying relational, document, and graph models with the declarative, strongly typed TypeQL query language, for developers working.
dqlite
A C embeddable library extending SQLite with Raft-based replication, high availability, and automatic failover.
orioledb
OrioleDB – building a modern cloud-native storage engine (
ydb
A C++ open-source distributed SQL database with ACID transactions and strong consistency, of interest to developers building highly available services.
WatermelonDB React Database
WatermelonDB is a reactive, offline-first database for React and React Native apps that stays fast with tens of thousands of records. It uses lazy loading and observables to optimize client-side persistence across mobile and web platforms.
Adminer PHP Database
Adminer is a full-featured database management tool distributed as a single PHP file ready to deploy. It supports MySQL, PostgreSQL, SQLite, MS SQL, and other databases with a lightweight footprint.
Apache IoTDB
Apache IoTDB is a time-series database purpose-built for IoT workloads with a high-performance storage engine. It is an Apache top-level project specializing in efficient ingestion and management of massive device-generated data.
Quivr Content Engine
Quivr is an open-source engine that ingests continuous content streams, makes them searchable within seconds, and supports topic monitoring with alerts. It features durable ingestion, hybrid search, and a plugin system for formats, models, and business rules.
Goose Database Migrations
Goose is a database migration tool for Go that manages schema changes via SQL scripts or Go functions, working as both CLI and library. It supports multiple databases including Postgres, MySQL, and Spanner.
Ibis Python Dataframe
Ibis is a portable Python dataframe library that lets users compose lazy expressions (using DuckDB by default) and run them unchanged across 20+ database backends. It enables local iteration and remote deployment by changing a single line of code.
Flyway Database Migrations
Flyway is a database migration tool by Redgate supporting versioned schema changes across 50+ database systems. It is an industry-standard Java-based solution with broad enterprise adoption.
Chroma AI Search
Chroma is an AI-focused search infrastructure offering vector, hybrid, and full-text search through a four-function API and a hosted serverless cloud service. It is notable for its Rust-based purpose-built vector database design and strong momentum in AI infrastructure.
SeaORM Rust ORM
SeaORM is a relational ORM for Rust that models complex relationships and provides filters, pagination, and nested queries for building APIs. It is notable for filling a gap in the Rust ecosystem with async support and production-ready usage at 250k+ weekly downloads.
MikroORM TypeScript ORM
MikroORM is a TypeScript ORM for Node.js based on Data Mapper, Unit of Work, and Identity Map patterns, supporting major SQL and MongoDB databases. It is notable for its well-architected pattern implementation, suitable for complex applications.
Databasus Backup Tool
Databasus is a PostgreSQL backup tool providing physical, logical, and WAL streaming backups with point-in-time recovery and restore verification. It is notable as a practical DevOps tool designed for disaster recovery and near-zero data loss.
ToyDB Distributed SQL
toyDB is an educational distributed SQL database written in Rust, featuring Raft consensus, ACID transactions, and a pluggable storage engine. It is notable for making complex database internals simple and understandable for learning.
Apache CouchDB
Apache CouchDB is a database with an intuitive HTTP/JSON API and a seamless multi-primary synchronization model, designed for reliability. It is notable for its unique sync architecture and continued active maintenance.
SpiceDB Authorization Database
SpiceDB is an open-source database for storing and querying fine-grained authorization data, inspired by Google's Zanzibar system. It is notable for setting a standard for scalable authorization, addressing broken access control, a top web security threat.
PouchDB Database
Apache PouchDB is an open-source JavaScript database inspired by CouchDB that runs in the browser and enables offline-first applications. It is notable for its sync capabilities, which help web developers build apps that work offline as well as online.
MariaDB Server
MariaDB Server is a community-developed fork of MySQL, led by the original MySQL team. It is notable for its broad deployment, MySQL compatibility, and recent addition of native vector search and analytical features.
Dexie.js Wrapper
Dexie.js is a minimalistic wrapper library for the browser's IndexedDB database. It is notable for its excellent TypeScript support, workarounds for browser bugs, and optional Dexie Cloud sync service.
Beekeeper Studio
Beekeeper Studio is a cross-platform SQL editor and database manager for MySQL, Postgres, SQLite, SQL Server, and more. It is notable for its modern, easy-to-use interface and free, no-signup community edition.
pgcli Postgres CLI
pgcli is a Postgres command-line client with autocompletion and syntax highlighting. It is notable as a best-in-class, daily-use tool for database developers.
Go MySQL Driver
go-sql-driver/mysql is a MySQL driver for Go's database/sql package. It is notable as the de facto standard, battle-tested MySQL driver for Go applications.
mycli MySQL CLI
mycli is a MySQL terminal client with auto-completion, syntax highlighting, and dataframe integration. It is notable as a practical, well-maintained tool that supports MySQL, MariaDB, Percona, TiDB, and Apache Doris.
Universal SQL CLI
usql is a universal command-line client for PostgreSQL, MySQL, Oracle, SQLite, SQL Server, and many other SQL and NoSQL databases, modeled on psql. Notable for its multi-database support and ability to copy data between different systems.
immudb Database
immudb is an open-source immutable database with built-in cryptographic proof and verification, supporting key-value, document, and SQL models. Its novel approach provides tamper-proof data storage without requiring trust in the database.
DB Browser SQLite
DB Browser for SQLite is a high-quality, open-source visual tool for creating, designing, and editing SQLite database files. It is a solid, cross-platform GUI widely used by developers working with SQLite.
DDIA Chinese Translation
This repository hosts a Chinese translation of the book 'Designing Data-Intensive Applications'. It is a valuable educational resource for Chinese-speaking developers studying distributed systems and database architecture.
SQLmap Tool
Automates detection and exploitation of SQL injection flaws to take over database servers, including data fetching, file system access, and OS command execution. Industry-standard penetration testing tool, actively maintained.
Apache ZooKeeper
Apache ZooKeeper is a centralized service for maintaining configuration, naming, and distributed synchronization. It is a critical, battle-tested foundation for many distributed data systems.
CloudNativePG Operator
CloudNativePG is a Kubernetes operator that manages the full operational lifecycle of PostgreSQL databases within Kubernetes clusters, from deployment to maintenance. It is popular for addressing high-availability and operational challenges of PostgreSQL on Kubernetes.
Gun Protocol
GUN is an open source protocol and ecosystem for syncing decentralized graph data, enabling encrypted, realtime peer-to-peer applications. It is notable as a novel p2p data store with CRDT-based synchronization, used in production by many apps.
Apache Cassandra
Apache Cassandra is an open source transactional distributed database with linear scalability and proven fault-tolerance on commodity hardware or cloud infrastructure. It is notable as a proven distributed wide-column database with exceptional scalability and fault tolerance.