Databases

Interesting

  • ​Materialize - Streaming SQL Database powered by Timely Dataflow. (Web)

  • ​PlanetScale - Database for Developers. (HN) (Release Article)

  • ​Mentat - Persistent, relational store inspired by Datomic and DataScript.

  • ​RocksDB - Persistent Key-Value Store for Flash and RAM Storage. (Rocksplicator - RocksDB Replication)

  • ​TerarkDB - RocksDB compatible KV storage engine with better performance. (HN)

  • ​LevelDB - Fast key-value storage library written at Google that provides an ordered mapping from string keys to string values.

  • ​GoLevelDB - LevelDB key/value database in Go.

  • ​NodeLevelDB - Fast & simple storage. A Node.js-style LevelDB wrapper for Node.js, Electron and browsers. (Awesome)

  • ​TiDB - Distributed HTAP database compatible with the MySQL protocol.

  • ​TiKV - Distributed transactional key-value database, originally created to complement TiDB. (pd - Placement driver for TiKV) (TiKV Rust Client)

  • ​Noria - Dynamically changing, partially-stateful data-flow for web application backends. (Paper) (Notes)

  • ​RethinkDB - Pushes JSON to your apps in realtime.

  • ​RedixDB - Persistent real-time key-value store, with the same redis protocol with powerful features.

  • ​AresDB - GPU-powered real-time analytics storage and query engine.

  • ​Sophia - Modern transactional key-value/row storage library.

  • ​Bolt - Embedded key/value database for Go.

  • ​InfluxDB - Scalable datastore for metrics, events, and real-time analytics. (Web)

  • ​EdgeDB - Open-source object-relational database built on top of PostgreSQL. (EdgeDB 1.0 Beta)

  • ​Cassandra - Highly-scalable partitioned row store. Rows are organized into tables with a required primary key.

  • ​Scylla - Drop-in Apache Cassandra alternative big data database that powers your applications with ultra-low latency and extremely high throughput, while reducing TCO to a fraction of most NoSQL databases. Code.

  • ​JanusGraph - Open-source, distributed graph database.

  • ​DuckDB - Embeddable SQL OLAP Database Management System. (HN) (Playing With DuckDB) (5 minute intro)

  • ​Genji - Document-oriented, embedded SQL database, works with Bolt, Badger and memory. (Web)

  • ​Atlas - In-memory dimensional time series database.

  • ​Pebble - RocksDB/LevelDB inspired key-value database in Go. (Intro article) (HN) (Pebble vs RocksDB: Implementation Differences)

  • ​LogDevice - Distributed storage for sequential data.

  • ​SQLite - C-language library that implements a small, fast, self-contained, high-reliability, full-featured, SQL database engine.

  • ​better-sqlite3 - Fastest and simplest library for SQLite3 in NodeJS.

  • ​gStore - Graph database engine for managing large graph-structured data.

  • ​MongoDB - General purpose, document-based, distributed database built for modern application developers.

  • ​Ardb - High Performance Persistent NoSql, Full Redis-Protocol Compatibility.

  • ​datahikeai - Durable datalog implementation adaptable for distribution.

  • ​Yugabyte DB - High-performance distributed SQL database for global, internet-scale apps.

  • ​JuliaDB - Parallel analytical database in pure Julia. (Docs) (HN)

  • ​Delta Lake - Storage layer that brings scalable, ACID transactions to Apache Spark and other big-data engines.

  • ​M3 - Distributed TSDB, Aggregator and Query Engine, Prometheus Sidecar, Graphite Compatible, Metrics Platform. Prometheus compatible. (Web)

  • ​WatermelonDB - Reactive & asynchronous database for powerful React and React Native apps.

  • ​Neo4j - High performance graph store with all the features expected of a mature and robust database, like a friendly query language and ACID transactions.

  • ​Dgraph - Horizontally scalable and distributed graph database, providing ACID transactions, consistent replication and linearizable reads.

  • ​MeiliDB - Full-text search database based on the fast LMDB key-value store.

  • ​CrateDB - Distributed SQL database that makes it simple to store and analyze massive amounts of machine data in real-time.

  • ​Riak - Distributed, decentralized data storage system.

  • ​CockroachDB - Open source, cloud-native SQL database.

  • ​ActorDB - Distributed SQL database.

  • ​ksqlDB - Event streaming database purpose-built for stream processing applications. (HN) (Code)

  • ​OmniSciDB - Open source SQL-based, relational, columnar database engine that leverages the full performance and parallelism of modern hardware.

  • ​Sonnerie - Simple timeseries database.

  • ​Dolt - Git for Data. SQL database that you can fork, clone, branch, merge. (HN)

  • ​Crux - Open source document database with bitemporal graph queries. (Website) (Article) (HN)

  • ​LokiJS - Document oriented database written in JavaScript.

  • ​terrier - Carnegie Mellon's new database system project that is replacing Peloton.

  • ​Nebula Graph - Open-source graph database capable of hosting super large scale graphs with dozens of billions of vertices (nodes) and trillions of edges, with milliseconds of latency. (HN) (Active Fork)

  • ​SeaTable - Online lightweight database with a spreadsheet interface. (Code)

  • ​Ceph - Distributed object, block, and file storage platform.

  • ​Vitess - Database clustering system for horizontal scaling of MySQL through generalized sharding. (Web)

  • ​MinIO - High Performance, Kubernetes Native Object Storage. (Web) (GitHub)

  • ​ShareDB - Realtime database backend based on Operational Transformation (OT).

  • ​Irmin - Distributed database built on the same principles as Git. (Code) (HN)

  • ​Noms - Decentralized database philosophically descendant from the Git version control system.

  • ​SwayDB - Fast embeddable persistent and in-memory key-value storage engine that provides storage as simple data structures - Map, Set & Queue.

  • ​TrailDB - Efficient tool for storing and querying series of events.

  • ​QuestDB - Relational database with ultimate time-series performance. (HN)

  • ​Prometheus - Systems and service monitoring system.

  • ​Akumuli - Time-series database.

  • ​SSDB - Redis compatible NoSQL database stored on disk.

  • ​minikeyvalue - Distributed key value store in under 1000 lines. (HN)

  • ​Bedrock - Rock solid distributed database specializing in active/active automatic failover and WAN replication.

  • ​TerminusDB - Full featured in-memory graph database management system with a rich query language. (Code) (HN)

  • ​WhiteDB - Lightweight database library operating fully in main memory. Disk is used only for dumping/restoring database and logging.

  • ​FaunaDB - Database built for serverless, featuring native GraphQL.

  • ​ImmuDB - Lightweight, high-speed immutable database for systems and applications. Written in Go. (HN)

  • ​NutsDB - Simple, fast, embeddable, persistent key/value store written in pure Go.

  • ​remoteStorage - Open protocol for per-user storage on the Web.

  • ​TimescaleDB - Open-source database built for analyzing time-series data with the power and convenience of SQL. (timescaledb-tune) (HN) (2.0 release)

  • ​ClickHouse - Open-source column-oriented database management system that allows generating analytical data reports in real time. (How ClickHouse Saved our Data) (HN)

  • ​ArongoDB - Natively store data for graph, document and search needs. Utilize feature-rich access with one query language. (Go Driver) (Arangolite - Go Driver)

  • ​LiteStore - Lightweight, self-contained, RESTful, multi-format NoSQL document store server written in Nim and powered by a SQLite backend for storage.

  • ​RecallGraph - Versioning data store for time-variant graph data. (HN)

  • ​Apache Pinot - Realtime distributed OLAP datastore. (Code)

  • ​Apache Ignite - Horizontally scalable, fault-tolerant distributed in-memory computing platform for building real-time applications that can process terabytes of data with in-memory speed.

  • ​TileDB - Storage Engine for Data Science.

  • ​Pravega - Open source distributed storage service implementing Streams. It offers Stream as the main primitive for the foundation of reliable storage systems.

  • ​libmdbx - Extremely fast, compact, powerful, embedded, transactional key-value store database.

  • ​Realm - Mobile database that runs directly inside phones, tablets or wearables.

  • ​HSE - Embeddable key-value store designed for SSDs based on NAND flash or persistent memory.

  • ​GhostDB - Distributed, in-memory, general purpose key-value data store that delivers microsecond performance at any scale. (HN)

  • ​Datalevin - Port of Datascript in-memory Datalog database to Lightning Memory-Mapped Database (LMDB).

  • ​DagDB - Syncable database built on IPLD.

  • ​MonetDB - Column-store pioneer. (Web)

  • ​RxDB - NoSQL-database for JavaScript Applications like Websites, hybrid Apps, Electron-Apps, Progressive Web Apps and NodeJs. (HN)

  • ​Graviton Database - Simple, fast, versioned, authenticated, embeddable key-value store database in pure Go. (HN)

  • ​SeaweedFS - Distributed object store and file system to store and serve billions of files fast.

  • ​IndexedDB - IndexedDB, but with promises.

  • ​JsStore - Complete IndexedDB wrapper with SQL like syntax. (Web)

  • ​Quadrable - Authenticated multi-version database: sparse binary merkle tree with compact partial-tree proofs.

  • ​Manticore Search - Database designed specifically for search, including full-text search.

  • ​Amazon QLDB - Fully managed ledger database that provides a transparent, immutable, and cryptographically verifiable transaction log. (Awesome)

  • ​Oxigraph - Graph database implementing the SPARQL standard.

  • ​JavaScript Database (JSDB) - Transparent, in-memory, streaming write-on-update JavaScript database for Small Web applications that persists to a JavaScript transaction log. (Intro) (Lobsters)

  • ​Cete - Distributed key value store server written in Go built on top of BadgerDB.

  • ​NoisePage - Self-Driving Database Management System. (Code) (HN)

  • ​Sir.DB - Git-diff-able JSON database on yer filesystem. (HN)

  • ​Bigbucket - Serverless NoSQL database with a focus on scalability, availability and simplicity. It has a Bigtable-style data model with storage backed by a Cloud Storage Bucket.

  • ​AnnaBellaDB - Proof-of-concept (PoC) network latency and access-pattern aware key-value store.

  • ​OpenCog AtomSpace - In-RAM knowledge representation (KR) database, an associated query engine and graph-re-writing system, and a rule-driven inferencing engine that can apply and manipulate sequences of rules to perform reasoning. (Web)

  • ​Sybil - Append only analytics datastore with no up front table schema requirements. Just log JSON records to a table and run queries.

  • ​Comdb2 - Clustered RDBMS built on Optimistic Concurrency Control techniques.

  • ​Arctic - High performance datastore for time series and tick data.

  • ​Warp 10 - Open Source Geo Time Series Platform designed to handle data coming from sensors, monitoring systems and the Internet of Things. (Web)

  • ​Eva - Distributed database-system implementing an entity-attribute-value data-model that is time-aware, accumulative, and atomically consistent.

  • ​Firestore - Develop rich applications using a fully managed, scalable, and serverless document database. (Intro) (Running Google Firestore locally)

  • ​Graphik - Identity-aware, permissioned, persistant document/graph database & pubsub server written in Go.

  • ​AIStore - Lightweight object storage system with the capability to linearly scale-out with each added storage node and a special focus on petascale deep learning. (Web)

  • ​DatenLord - Computing Defined Storage, an application-orientated, cloud-native distributed storage system.

  • ​AgateDB - Embeddable, persistent and fast key-value (KV) database written in pure Rust.

  • ​TensorBase - Modern big data warehouse with performance in its core mind. (Web)

  • ​Redwood - Highly-configurable, distributed, realtime database that manages a state tree shared among many peers.

  • ​Drivine - Best and fastest graph database client (Neo4j & AgensGraph) for Node.js & TypeScript. (Code) (Starter Template)

  • ​InfiniCache - In-memory cache that is built atop ephemeral serverless functions. (HN)

  • ​Blazegraph - Ultra high-performance graph database supporting Blueprints and RDF/SPARQL APIs.

  • ​Escanor - High performance key value database with useful json document indexing and manipulations.

  • ​Condensation - General-purpose distributed data system with conflict-free synchronization, and inherent end-to-end security. (GitHub)

  • ​ZenoDB - Go-based embeddable time series database optimized for performing aggregated analytical SQL queries on dimensional data.

  • ​IndraDB - Graph database written in rust.

  • ​SteveCare - Peer-to-peer database system that enables people to build complex databases between peers, without any intermediary platform.

  • ​CORTX - Open Source Mass-Capacity Optimized Object Store.

  • ​PouchDB - JavaScript Database that Syncs. (Code)

  • ​CryptDB - Database system that can process SQL queries over encrypted data. (Code)

  • ​LBADD - Experimental distributed SQL database, written in Go.

  • ​Baserow - Self-hosted Airtable alternative. (HN) (Code)

  • ​KuiBaDB - Another Postgres rewritten with Rust and multi-threading.

  • ​LeanStore - High-performance OLTP storage engine optimized for many-core CPUs and NVMe SSDs. (Web)

  • ​KVS - Abstract Chain Database. (Code)

  • ​Yorkie - Document store for building collaborative editing applications. (Code)

  • ​InfluxDB IOx - Future core of InfluxDB, an open source time series database.

  • ​EliasDB - Graph-based database.

  • ​Resql - SQL database server that uses SQLite as its SQL engine and it provides replication and automatic failover capabilities.

  • ​Tarantool - In-memory computing platform. (Go client)

  • ​EventQL - Database for large-scale event analytics. (Code)

  • ​OceanBase - Distributed, banking suitable, open-source related database featuring high scalability and high compatibility. (HN)

  • ​Kvrocks - Distributed key value NoSQL database based on RocksDB and compatible with Redis protocol.

  • ​UnQLite - Embedded NoSQL, Transactional Database Engine. (Web)

Tools

  • ​Postico - Modern PostgreSQL Client for the Mac.

  • ​TablePlus (HN)

  • ​SQLiteStudio - Free, open source, multi-platform SQLite database manager.

  • ​litecli - Command-line client for SQLite databases that has auto-completion and syntax highlighting.

  • ​Beekeeper Studio - Query and manage your relational databases. (Code)

  • ​Diwata - User-friendly database interface.

  • ​Sequel Ace - MySQL/MariaDB database management for macOS. (Web)

  • ​ExtendsClass - Online MySQL playground for testing.

  • ​Dropbase - Turn offline files into live databases instantly. (HN)

  • ​Synth - Create synthetic data environments in seconds. (HN)

  • ​Baserow - Open source online database tool and Airtable alternative.

  • ​SHMIG - Database migration tool written in BASH.

  • ​goose - Database migration tool. Manage your database schema by creating incremental SQL changes or Go functions.

  • ​migrate - Database migrations written in Go. Use as CLI or import as library.

  • ​Flyway - Database Migrations Made Easy. (Tweet)

  • ​Liquibase - Open Source Version Control for Your Database.

  • ​gh-ost - GitHub's Online Schema Migrations for MySQL.

  • ​Dbmate - Lightweight, framework-agnostic database migration tool.

  • ​ShardingSphere - Distributed Database Middleware Ecosphere.

  • ​ln2sql - NLP tool to query a database in natural language.

  • ​Hue - Open source SQL Assistant for Data Warehouses. (Code)

  • ​ley - Driver-agnostic database migrations.

  • ​DBeaver - Free Universal Database Tool. (Code)

  • ​Skeema - Schema management CLI for MySQL.

  • ​noisepage-test - DBMS Performance & Correctness Testing Framework.

  • ​erd - Translates a plain text description of a relational database schema to a graphical entity-relationship diagram.

  • ​CloudBeaver - Database Management from Browser. (Code)

  • ​DbGate - Database manager for MySQL, PostgreSQL, SQL Server and MongoDB. (Code)

  • ​Snaplet - Work with your database as easily as your code.

  • ​Condenser - Database subsetting tool.

  • ​NocoDB - Turns your SQL database into a Nocode platform. Free & Open Source. (Code) (HN)

  • ​Owoof - Program for querying and modifying information in a datalog-like format backed by SQLite.

Notes

Links