Databases

Interesting

  • ​Materialize - Streaming SQL Database powered by Timely Dataflow. (Web)
  • ​PlanetScale - Database for Developers. (HN) (Release Article)
  • ​LMDB Store - Simple, efficient, ultra-fast, scalable data store wrapper for LMDB.
  • ​Mentat - Persistent, relational store inspired by Datomic and DataScript.
  • ​RocksDB - Persistent Key-Value Store for Flash and RAM Storage. (Rocksplicator - RocksDB Replication)
  • ​TerarkDB - RocksDB compatible KV storage engine with better performance. (HN)
  • ​LevelDB - Fast key-value storage library written at Google that provides an ordered mapping from string keys to string values.
  • ​GoLevelDB - LevelDB key/value database in Go.
  • ​NodeLevelDB - Fast & simple storage. A Node.js-style LevelDB wrapper for Node.js, Electron and browsers. (Awesome)
  • ​TiDB - Distributed HTAP database compatible with the MySQL protocol.
  • ​TiKV - Distributed transactional key-value database, originally created to complement TiDB. (pd - Placement driver for TiKV) (TiKV Rust Client)
  • ​Noria - Dynamically changing, partially-stateful data-flow for web application backends. (Paper) (Notes)
  • ​RethinkDB - Pushes JSON to your apps in realtime.
  • ​RedixDB - Persistent real-time key-value store, with the same redis protocol with powerful features.
  • ​AresDB - GPU-powered real-time analytics storage and query engine.
  • ​Sophia - Modern transactional key-value/row storage library.
  • ​Bolt - Embedded key/value database for Go.
  • ​InfluxDB - Scalable datastore for metrics, events, and real-time analytics. (Web)
  • ​EdgeDB - Open-source object-relational database built on top of PostgreSQL. (EdgeDB 1.0 Beta) (Web) (GitHub) (Talk)
  • ​Cassandra - Highly-scalable partitioned row store. Rows are organized into tables with a required primary key.
  • ​Scylla - Drop-in Apache Cassandra alternative big data database that powers your applications with ultra-low latency and extremely high throughput, while reducing TCO to a fraction of most NoSQL databases. Code (Scylla University)
  • ​JanusGraph - Open-source, distributed graph database. (Web) (HN)
  • ​DuckDB - Embeddable SQL OLAP Database Management System. (HN) (Playing With DuckDB) (5 minute intro) (Web)
  • ​DuckDB-Wasm - Efficient Analytical SQL in the Browser. (HN)
  • ​Genji - Document-oriented, embedded SQL database, works with Bolt, Badger and memory. (Web)
  • ​Atlas - In-memory dimensional time series database.
  • ​Pebble - RocksDB/LevelDB inspired key-value database in Go. (Intro article) (HN) (Pebble vs RocksDB: Implementation Differences)
  • ​LogDevice - Distributed storage for sequential data.
  • ​SQLite - C-language library that implements a small, fast, self-contained, high-reliability, full-featured, SQL database engine.
  • ​better-sqlite3 - Fastest and simplest library for SQLite3 in NodeJS.
  • ​gStore - Graph database engine for managing large graph-structured data.
  • ​MongoDB - General purpose, document-based, distributed database built for modern application developers.
  • ​Ardb - High Performance Persistent NoSql, Full Redis-Protocol Compatibility.
  • ​datahikeai - Durable datalog implementation adaptable for distribution.
  • ​Yugabyte DB - High-performance distributed SQL database for global, internet-scale apps.
  • ​JuliaDB - Parallel analytical database in pure Julia. (Docs) (HN)
  • ​Delta Lake - Storage layer that brings scalable, ACID transactions to Apache Spark and other big-data engines.
  • ​M3 - Distributed TSDB, Aggregator and Query Engine, Prometheus Sidecar, Graphite Compatible, Metrics Platform. Prometheus compatible. (Web)
  • ​WatermelonDB - Reactive & asynchronous database for powerful React and React Native apps.
  • ​Neo4j - High performance graph store with all the features expected of a mature and robust database, like a friendly query language and ACID transactions.
  • ​Dgraph - Horizontally scalable and distributed graph database, providing ACID transactions, consistent replication and linearizable reads.
  • ​MeiliDB - Full-text search database based on the fast LMDB key-value store.
  • ​CrateDB - Distributed SQL database that makes it simple to store and analyze massive amounts of machine data in real-time.
  • ​Riak - Distributed, decentralized data storage system.
  • ​CockroachDB - Open source, cloud-native SQL database.
  • ​ActorDB - Distributed SQL database.
  • ​ksqlDB - Event streaming database purpose-built for stream processing applications. (HN) (Code)
  • ​OmniSciDB - Open source SQL-based, relational, columnar database engine that leverages the full performance and parallelism of modern hardware.
  • ​Sonnerie - Simple timeseries database.
  • ​Dolt - Git for Data. SQL database that you can fork, clone, branch, merge. (HN)
  • ​Crux - Open source document database with bitemporal graph queries. (Website) (Article) (HN)
  • ​LokiJS - Document oriented database written in JavaScript.
  • ​terrier - Carnegie Mellon's new database system project that is replacing Peloton.
  • ​Nebula Graph - Open-source graph database capable of hosting super large scale graphs with dozens of billions of vertices (nodes) and trillions of edges, with milliseconds of latency. (HN) (Active Fork)
  • ​SeaTable - Online lightweight database with a spreadsheet interface. (Code)
  • ​Ceph - Distributed object, block, and file storage platform.
  • ​Vitess - Database clustering system for horizontal scaling of MySQL through generalized sharding. (Web)
  • ​MinIO - High Performance, Kubernetes Native Object Storage. (Web) (GitHub) (MinIO: A Bare Metal Drop-In for AWS S3) (MinIO Console) (MinIO Operator)
  • ​ShareDB - Realtime database backend based on Operational Transformation (OT).
  • ​Irmin - Distributed database built on the same principles as Git. (Code) (HN)
  • ​Noms - Decentralized database philosophically descendant from the Git version control system.
  • ​SwayDB - Fast embeddable persistent and in-memory key-value storage engine that provides storage as simple data structures - Map, Set & Queue.
  • ​TrailDB - Efficient tool for storing and querying series of events.
  • ​QuestDB - Relational database with ultimate time-series performance. (HN)
  • ​Prometheus - Systems and service monitoring system.
  • ​Akumuli - Time-series database.
  • ​SSDB - Redis compatible NoSQL database stored on disk.
  • ​minikeyvalue - Distributed key value store in under 1000 lines. (HN)
  • ​Bedrock - Simple, modular, WAN-replicated, Blockchain-based data foundation for global-scale applications. (Web)
  • ​TerminusDB - Full featured in-memory graph database management system with a rich query language. (Code) (HN)
  • ​WhiteDB - Lightweight database library operating fully in main memory. Disk is used only for dumping/restoring database and logging.
  • ​FaunaDB - Database built for serverless, featuring native GraphQL.
  • ​ImmuDB - Lightweight, high-speed immutable database for systems and applications. Written in Go. (HN)
  • ​NutsDB - Simple, fast, embeddable, persistent key/value store written in pure Go.
  • ​remoteStorage - Open protocol for per-user storage on the Web.
  • ​TimescaleDB - Open-source database built for analyzing time-series data with the power and convenience of SQL. (timescaledb-tune) (HN) (2.0 release)
  • ​ClickHouse - Open-source column-oriented database management system that allows generating analytical data reports in real time. (How ClickHouse Saved our Data) (HN) (Faster ClickHouse Imports) (HN: ClickHouse, Inc.) (Article) (HN)
  • ​ArongoDB - Natively store data for graph, document and search needs. Utilize feature-rich access with one query language. (Go Driver) (Arangolite - Go Driver) (Python Driver)
  • ​LiteStore - Lightweight, self-contained, RESTful, multi-format NoSQL document store server written in Nim and powered by a SQLite backend for storage.
  • ​RecallGraph - Versioning data store for time-variant graph data. (HN)
  • ​Apache Pinot - Realtime distributed OLAP datastore. (Code)
  • ​Apache Ignite - Horizontally scalable, fault-tolerant distributed in-memory computing platform for building real-time applications that can process terabytes of data with in-memory speed.
  • ​TileDB - Storage Engine for Data Science.
  • ​Pravega - Open source distributed storage service implementing Streams. It offers Stream as the main primitive for the foundation of reliable storage systems.
  • ​libmdbx - Extremely fast, compact, powerful, embedded, transactional key-value store database.
  • ​libfpta - Ultra fast, compact, Embedded Database for tabular and semistructured data.
  • ​Realm - Mobile database that runs directly inside phones, tablets or wearables.
  • ​HSE - Embeddable key-value store designed for SSDs based on NAND flash or persistent memory.
  • ​GhostDB - Distributed, in-memory, general purpose key-value data store that delivers microsecond performance at any scale. (HN)
  • ​Datalevin - Port of Datascript in-memory Datalog database to Lightning Memory-Mapped Database (LMDB).
  • ​DagDB - Syncable database built on IPLD.
  • ​MonetDB - Column-store pioneer. (Web)
  • ​RxDB - NoSQL-database for JavaScript Applications like Websites, hybrid Apps, Electron-Apps, Progressive Web Apps and NodeJs. (HN)
  • ​Graviton Database - Simple, fast, versioned, authenticated, embeddable key-value store database in pure Go. (HN)
  • ​SeaweedFS - Distributed object store and file system to store and serve billions of files fast.
  • ​IndexedDB - IndexedDB, but with promises.
  • ​JsStore - Complete IndexedDB wrapper with SQL like syntax. (Web)
  • ​Quadrable - Authenticated multi-version database: sparse binary merkle tree with compact partial-tree proofs.
  • ​Manticore Search - Database designed specifically for search, including full-text search.
  • ​Amazon QLDB - Fully managed ledger database that provides a transparent, immutable, and cryptographically verifiable transaction log. (Awesome)
  • ​Oxigraph - Graph database implementing the SPARQL standard.
  • ​JavaScript Database (JSDB) - Transparent, in-memory, streaming write-on-update JavaScript database for Small Web applications that persists to a JavaScript transaction log. (Intro) (Lobsters)
  • ​Cete - Distributed key value store server written in Go built on top of BadgerDB.
  • ​NoisePage - Self-Driving Database Management System. (Code) (HN)
  • ​Sir.DB - Git-diff-able JSON database on yer filesystem. (HN)
  • ​Bigbucket - Serverless NoSQL database with a focus on scalability, availability and simplicity. It has a Bigtable-style data model with storage backed by a Cloud Storage Bucket.
  • ​AnnaBellaDB - Proof-of-concept (PoC) network latency and access-pattern aware key-value store.
  • ​OpenCog AtomSpace - In-RAM knowledge representation (KR) database, an associated query engine and graph-re-writing system, and a rule-driven inferencing engine that can apply and manipulate sequences of rules to perform reasoning. (Web)
  • ​Sybil - Append only analytics datastore with no up front table schema requirements. Just log JSON records to a table and run queries.
  • ​Comdb2 - Clustered RDBMS built on Optimistic Concurrency Control techniques.
  • ​Arctic - High performance datastore for time series and tick data.
  • ​Warp 10 - Open Source Geo Time Series Platform designed to handle data coming from sensors, monitoring systems and the Internet of Things. (Web)
  • ​Eva - Distributed database-system implementing an entity-attribute-value data-model that is time-aware, accumulative, and atomically consistent.
  • ​Firestore - Develop rich applications using a fully managed, scalable, and serverless document database. (Intro) (Running Google Firestore locally)
  • ​Graphik - Identity-aware, permissioned, persistant document/graph database & pubsub server written in Go.
  • ​AIStore - Lightweight object storage system with the capability to linearly scale-out with each added storage node and a special focus on petascale deep learning. (Web)
  • ​DatenLord - Computing Defined Storage, an application-orientated, cloud-native distributed storage system.
  • ​AgateDB - Embeddable, persistent and fast key-value (KV) database written in pure Rust.
  • ​TensorBase - Modern big data warehouse with performance in its core mind. (Web)
  • ​Redwood - Highly-configurable, distributed, realtime database that manages a state tree shared among many peers.
  • ​Drivine - Best and fastest graph database client (Neo4j & AgensGraph) for Node.js & TypeScript. (Code) (Starter Template)
  • ​InfiniCache - In-memory cache that is built atop ephemeral serverless functions. (HN)
  • ​Blazegraph - Ultra high-performance graph database supporting Blueprints and RDF/SPARQL APIs.
  • ​Escanor - High performance key value database with useful json document indexing and manipulations.
  • ​Condensation - General-purpose distributed data system with conflict-free synchronization, and inherent end-to-end security. (GitHub)
  • ​ZenoDB - Go-based embeddable time series database optimized for performing aggregated analytical SQL queries on dimensional data.
  • ​IndraDB - Graph database written in rust.
  • ​SteveCare - Peer-to-peer database system that enables people to build complex databases between peers, without any intermediary platform.
  • ​CORTX - Open Source Mass-Capacity Optimized Object Store.
  • ​PouchDB - JavaScript Database that Syncs. (Code)
  • ​CryptDB - Database system that can process SQL queries over encrypted data. (Code)
  • ​LBADD - Experimental distributed SQL database, written in Go.
  • ​Baserow - Self-hosted Airtable alternative. (HN) (Code)
  • ​KuiBaDB - Another Postgres rewritten with Rust and multi-threading.
  • ​LeanStore - High-performance OLTP storage engine optimized for many-core CPUs and NVMe SSDs. (Web)
  • ​KVS - Abstract Chain Database. (Code)
  • ​Yorkie - Document store for building collaborative editing applications. (Code)
  • ​InfluxDB IOx - Future core of InfluxDB, an open source time series database.
  • ​EliasDB - Graph-based database.
  • ​Resql - SQL database server that uses SQLite as its SQL engine and it provides replication and automatic failover capabilities.
  • ​Tarantool - In-memory computing platform. (Go client) (Lua Code)
  • ​EventQL - Database for large-scale event analytics. (Code)
  • ​OceanBase - Distributed, banking suitable, open-source related database featuring high scalability and high compatibility. (HN)
  • ​Kvrocks - Distributed key value NoSQL database based on RocksDB and compatible with Redis protocol.
  • ​UnQLite - Embedded NoSQL, Transactional Database Engine. (Web)
  • ​LinDB - Scalable, high performance, high availability distributed time series database. (Web)
  • ​TimeBase - High performance time series database. (Web)
  • ​Greenplum Database - Advanced, fully featured, open source data warehouse, based on PostgreSQL. (Web)
  • ​JinDB - Small relational database engine written in Rust with the standard library and no external dependencies.
  • ​Memgraph - In-Memory Cypher Graph Database.
  • ​LemonGraph - Log-based transactional graph (nodes/edges/properties) database engine that is backed by a single file.
  • ​Go SQL DB - Relational database that supports SQL queries for research purposes in Go.
  • ​Skizze - Probabilistic data structure service and storage.
  • ​Skytable - Extremely fast, secure and reliable real-time NoSQL database with automated snapshots and TLS. (Web)
  • ​IceFireDB - Distributed disk storage database based on Raft and Redis protocol. (HN)
  • ​RefineDB - Strongly-typed document database that runs on any transactional key-value store.
  • ​Engula - Cloud-native storage engine for next-generation data infrastructures. (Code)
  • ​BerylDB - A data structure data manager that can be used to store data as key-value entries. (Docs)
  • ​Hyrise - Research in-memory database. (Web)
  • ​Apache Doris - Fast MPP database for all modern analytics on big data. (Code)
  • ​Vertica - Big Data Analytics On-Premises, in the Cloud, or on Hadoop. (Getting Started with Vertica)
  • ​Embeddinghub - Vector database built for Machine Learning embeddings. (HN)
  • ​GQLite - Embedded graph database implemented with Rust.
  • ​Xata - Database service for serverless apps. (HN)
  • ​SpiceDB - Zanzibar-inspired database that stores, computes, and validates application permissions. (Article) (HN) (CLI)
  • ​Authzed - Managed permissions database for everyone. (GitHub) (Authzed API)
  • ​Datomic - Transactional database with a flexible data model, elastic scaling, and rich queries. (GitHub) (Replicating with Datomic)
  • ​EdgelessDB - Open-source MySQL-compatible database for confidential computing. Runs entirely inside a secure enclave and comes with advanced features for collaboration, recovery, and access control. (Intro)
  • ​Infinitree - Scalable and encrypted embedded database with 3-tier caching.
  • ​Zerostash - Deduplicated, encrypted data store that provides native versioning capabilities, and was designed to secure all metadata related to the files.
  • ​BonsaiDb - Rust-written, ACID-compliant, document-database inspired by CouchDB. (Web)
  • ​Amazon Timestream - Fast, scalable, serverless time series database. (Tools and Samples)
  • ​Hive - Lightweight and blazing fast key-value database written in pure Dart. (Docs)
  • ​Couchbase Lite for iOS and MacOS - Lightweight, embedded, syncable NoSQL database engine for iOS and MacOS apps.
  • ​Kepler - Decentralized storage based on permissioned data overlays called orbits.
  • ​Ambry - Distributed object store that supports storage of trillion of small immutable objects (50K -100K) as well as billions of large objects.
  • ​ChaosDB - Unauthorized Privileged Access to Microsoft Azure Cosmos DB. (Explained) (HN)
  • ​MirDB - Persistent Key-Value Store with Memcached protocol.

Tools

  • ​Postico - Modern PostgreSQL Client for the Mac.
  • ​TablePlus (HN)
  • ​SQLiteStudio - Free, open source, multi-platform SQLite database manager.
  • ​litecli - Command-line client for SQLite databases that has auto-completion and syntax highlighting.
  • ​Beekeeper Studio - Query and manage your relational databases. (Code)
  • ​Diwata - User-friendly database interface.
  • ​Sequel Ace - MySQL/MariaDB database management for macOS. (Web)
  • ​ExtendsClass - Online MySQL playground for testing.
  • ​Dropbase - Turn offline files into live databases instantly. (HN)
  • ​Synth - Create synthetic data environments in seconds. (HN)
  • ​Baserow - Open source online database tool and Airtable alternative.
  • ​SHMIG - Database migration tool written in BASH.
  • ​goose - Database migration tool. Manage your database schema by creating incremental SQL changes or Go functions.
  • ​migrate - Database migrations written in Go. Use as CLI or import as library.
  • ​Flyway - Database Migrations Made Easy. (Tweet) (Code)
  • ​Liquibase - Open Source Version Control for Your Database.
  • ​gh-ost - GitHub's Online Schema Migrations for MySQL.
  • ​Dbmate - Lightweight, framework-agnostic database migration tool.
  • ​ShardingSphere - Distributed Database Middleware Ecosphere.
  • ​ln2sql - NLP tool to query a database in natural language.
  • ​Hue - Open source SQL Assistant for Data Warehouses. (Code)
  • ​ley - Driver-agnostic database migrations.
  • ​DBeaver - Free Universal Database Tool. (Code)
  • ​Skeema - Schema management CLI for MySQL.
  • ​noisepage-test - DBMS Performance & Correctness Testing Framework.
  • ​erd - Translates a plain text description of a relational database schema to a graphical entity-relationship diagram.
  • ​CloudBeaver - Database Management from Browser. (Code)
  • ​DbGate - Database manager for MySQL, PostgreSQL, SQL Server and MongoDB. (Code)
  • ​Snaplet - Work with your database as easily as your code.
  • ​Condenser - Database subsetting tool.
  • ​NocoDB - Turns your SQL database into a Nocode platform. Free & Open Source. (Code) (HN)
  • ​Owoof - Program for querying and modifying information in a datalog-like format backed by SQLite.
  • ​Gobang – Cross-platform TUI database management tool written in Rust. (HN)
  • ​Jailer - Truly relational database client. (HN)
  • ​dbcritic - Finds problems in a database schema.
  • ​IceCream - Sync Realm Database with CloudKit.
  • ​Kinto - Minimalist JSON storage service with synchronisation and sharing abilities. (Docs)
  • ​SchemaCrawler - Free database schema discovery and comprehension tool. (Web)
  • ​dbmigrate - PostgreSQL/SQLite/MySQL migration tool in rust.
  • ​Qsh - Improved database querying from your terminal. (HN)
  • ​trona - Write DB migrations with SQL and run them with a CLI.
  • ​Azimutt - Entity Relationship diagram (ERD) visualization tool, with various filters and inputs to help understand your SQL schema. (Code)
  • ​Models - Tool for automated migrations for PostgreSQL, SQLite and MySQL.
  • ​Atlas - Set of tools designed to help companies better work with their data. It includes several components that can be used individually but are designed to work very well together. (Code)
  • ​replikativ - Open, scalable and distributive infrastructure for a data-driven community of applications. (Web) (Unified storage IO)
  • ​Bytebase - Web-based, zero-config, dependency-free database schema change and version control management tool for developers and DBAs. (Web)
  • ​Sequelize-Auto - Automatically generate models for SequelizeJS via the command line.
  • ​DrawSQL - Database schema diagrams.
  • ​SQLize - Generate MySQL/PostgreSQL Migration from Go struct and existing SQL.
  • ​OmniDB - Web tool for database management. (Code)
  • ​Maxwell's Daemon - Application that reads MySQL binlogs and writes row updates as JSON to Kafka, Kinesis, or other streaming platforms. (Code)
  • ​MaxScale - Intelligent database proxy. (Docs)
  • ​Couchbase - Modern Database for Enterprise Applications.
  • ​Couchbase Mobile - SQLite Alternative. (C++ Client)

Notes

Links