Interesting

• ​Mentat - Persistent, relational store inspired by Datomic and DataScript.

• ​RocksDB - Persistent Key-Value Store for Flash and RAM Storage.

• ​LevelDB - Fast key-value storage library written at Google that provides an ordered mapping from string keys to string values.

• ​GoLevelDB - LevelDB key/value database in Go.

• ​NodeLevelDB - Fast & simple storage. A Node.js-style LevelDB wrapper for Node.js, Electron and browsers. (Awesome)

• ​TiDB - Distributed HTAP database compatible with the MySQL protocol.

• ​tikv - Distributed transactional key-value database, originally created to complement TiDB.

  • ​pd - Placement driver for TiKV.

• ​Noria - Dynamically changing, partially-stateful data-flow for web application backends.

• ​RethinkDB - Pushes JSON to your apps in realtime.

• ​RedixDB - Persistent real-time key-value store, with the same redis protocol with powerful features.

• ​AresDB - GPU-powered real-time analytics storage and query engine.

• ​Sophia - Modern transactional key-value/row storage library.

• ​Bolt - Embedded key/value database for Go.

• ​InfluxDB - Scalable datastore for metrics, events, and real-time analytics. (Web)

• ​EdgeDB - Open-source object-relational database built on top of PostgreSQL.

• ​Cassandra - Highly-scalable partitioned row store. Rows are organized into tables with a required primary key.

• ​Scylla - Drop-in Apache Cassandra alternative big data database that powers your applications with ultra-low latency and extremely high throughput, while reducing TCO to a fraction of most NoSQL databases. Code.

• ​JanusGraph - Open-source, distributed graph database.

• ​DuckDB - Embeddable SQL OLAP Database Management System.

• ​sled - Modern embedded database.

• ​Genji - Multi engine embedded database.

• ​Atlas - In-memory dimensional time series database.

• ​Pebble - RocksDB/LevelDB inspired key-value database in Go.

• ​LogDevice - Distributed storage for sequential data.

• ​SQLite - C-language library that implements a small, fast, self-contained, high-reliability, full-featured, SQL database engine.

• ​better-sqlite3 - Fastest and simplest library for SQLite3 in NodeJS.

• ​rqlite - Lightweight, distributed relational database built on SQLite.

• ​gStore - Graph database engine for managing large graph-structured data.

• ​MongoDB - General purpose, document-based, distributed database built for modern application developers.

• ​Ardb - High Performance Persistent NoSql, Full Redis-Protocol Compatibility.

• ​datahikeai - Durable datalog implementation adaptable for distribution.

• ​Yugabyte DB - High-performance distributed SQL database for global, internet-scale apps.

• ​JuliaDB - Parallel analytical database in pure Julia.

• ​Delta Lake - Storage layer that brings scalable, ACID transactions to Apache Spark and other big-data engines.

• ​M3 - Distributed TSDB, Aggregator and Query Engine, Prometheus Sidecar, Graphite Compatible, Metrics Platform.

• ​WatermelonDB - Reactive & asynchronous database for powerful React and React Native apps.

• ​Neo4j - High performance graph store with all the features expected of a mature and robust database, like a friendly query language and ACID transactions.

• ​Dgraph - Horizontally scalable and distributed graph database, providing ACID transactions, consistent replication and linearizable reads.

• ​MeiliDB - Full-text search database based on the fast LMDB key-value store.

• ​CrateDB - Distributed SQL database that makes it simple to store and analyze massive amounts of machine data in real-time.

• ​Riak - Distributed, decentralized data storage system.

• ​CockroachDB - Open source, cloud-native SQL database.

• ​ActorDB - Distributed SQL database.

• ​ksqlDB - Event streaming database purpose-built for stream processing applications. (HN) (Code)

• ​OmniSciDB - Open source SQL-based, relational, columnar database engine that leverages the full performance and parallelism of modern hardware.

• ​Sonnerie - Simple timeseries database.

• ​SQLite compiled to JavaScript​

• ​Dolt - Relational database, i.e. it has tables, and you can execute SQL queries against those tables. It also has version control primitives that operate at the level of table cell.

• ​Crux - Open source document database with bitemporal graph queries. (Website) (Article) (HN)

• ​LokiJS - Document oriented database written in JavaScript.

• ​terrier - Carnegie Mellon's new database system project that is replacing Peloton.

• ​Nebula Graph - Open-source graph database capable of hosting super large scale graphs with dozens of billions of vertices (nodes) and trillions of edges, with milliseconds of latency. (HN)

• ​SeaTable - Online lightweight database with a spreadsheet interface. (Code)

• ​Ceph - Distributed object, block, and file storage platform.

• ​Vitess - Database clustering system for horizontal scaling of MySQL through generalized sharding.

• ​MinIO - High performance object storage server compatible with Amazon S3 APIs.

• ​Memory-Efficient Search Trees for Database Management Systems (2020) (HN)

• ​ShareDB - Realtime database backend based on Operational Transformation (OT).

• ​Irmin - Distributed database built on the same principles as Git. (Code) (HN)

• ​Noms - Decentralized database philosophically descendant from the Git version control system.

• ​SwayDB - Fast embeddable persistent and in-memory key-value storage engine that provides storage as simple data structures - Map, Set & Queue.

• ​TrailDB - Efficient tool for storing and querying series of events.

• ​QuestDB - Relational database with ultimate time-series performance. (HN)

• ​Prometheus - Systems and service monitoring system.

• ​Akumuli - Time-series database.

• ​SSDB - Redis compatible NoSQL database stored on disk.

• ​minikeyvalue - Distributed key value store in under 1000 lines.

• ​Bedrock - Rock solid distributed database specializing in active/active automatic failover and WAN replication.

• ​TerminusDB - Full featured in-memory graph database management system with a rich query language. (Code) (HN)

• ​WhiteDB - Lightweight database library operating fully in main memory. Disk is used only for dumping/restoring database and logging.

• ​FaunaDB - Database built for serverless, featuring native GraphQL. (Awesome)

• ​immudb - Lightweight, high-speed immutable database for systems and applications. Written in Go.

• ​NutsDB - Simple, fast, embeddable, persistent key/value store written in pure Go.

• ​remoteStorage - Open protocol for per-user storage on the Web.

• ​TimescaleDB - Open-source database built for analyzing time-series data with the power and convenience of SQL. (timescaledb-tune)

• ​ClickHouse - Free analytics DBMS for big data.

• ​ArongoDB - Natively store data for graph, document and search needs. Utilize feature-rich access with one query language. (Go Driver)

• ​LiteStore - Lightweight, self-contained, RESTful, multi-format NoSQL document store server written in Nim and powered by a SQLite backend for storage.

• ​RecallGraph - Versioning data store for time-variant graph data. (HN)

• ​Apache Pinot - Realtime distributed OLAP datastore. (Code)

• ​Apache Ignite - Horizontally scalable, fault-tolerant distributed in-memory computing platform for building real-time applications that can process terabytes of data with in-memory speed.

• ​TileDB - Storage Engine for Data Science.

• ​Pravega - Open source distributed storage service implementing Streams. It offers Stream as the main primitive for the foundation of reliable storage systems.

• ​libmdbx - Extremely fast, compact, powerful, embedded, transactional key-value store database.

• ​Realm - Mobile database that runs directly inside phones, tablets or wearables.

• ​HSE - Embeddable key-value store designed for SSDs based on NAND flash or persistent memory.

• ​GhostDB - Distributed, in-memory, general purpose key-value data store that delivers microsecond performance at any scale. (HN)

• ​Datalevin - Port of Datascript in-memory Datalog database to Lightning Memory-Mapped Database (LMDB).

• ​DagDB - Syncable database built on IPLD.

Tools

• ​Postico - Modern PostgreSQL Client for the Mac.

• ​TablePlus (HN)

• ​SQLiteStudio - Free, open source, multi-platform SQLite database manager.

• ​litecli - Command-line client for SQLite databases that has auto-completion and syntax highlighting.

• ​Beekeeper Studio - Query and manage your relational databases.

• ​Diwata - User-friendly database interface.

• ​Sequel Ace - MySQL/MariaDB database management for macOS. (Web)

• ​ExtendsClass - Online MySQL playground for testing.

Links

• ​Stanford DB course​

• ​Algebraic Query Language - Schemas as categories, DB instances as functors, provable data migration as functor composition.

• ​David Nolen: Out of the Tarpit, Revisited (2017)​

• ​syncing-thesis - Syncing strategies for mobile apps.

• ​Storage Performance Development Kit - Provides a set of tools and libraries for writing high performance, scalable, user-mode storage applications.

• ​Let's Build a Simple Database - Writing a sqlite clone from scratch in C.

• ​Readings in Databases - List of papers essential to understanding databases and building new data systems.

• ​Dbmate - Lightweight, framework-agnostic database migration tool.

• ​Turning the database inside-out with Apache Samza (2015)​

• ​Designing Data Intensive Applications Book - Deep dives into different types of data storage solutions, their history, and how they actually work.

• ​Scalable SQL and NoSQL Data Stores - Good paper that helps differentiate similar but different datastores. Really helpful when you're trying to pick a modern data solution.

• ​"Transactions: myths, surprises and opportunities" by Martin Kleppmann (2015)​

• ​Using Apache Arrow, Calcite and Parquet to build a Relational Cache (2017)​

• ​Apache Arrow - Development platform for in-memory analytics. It contains a set of technologies that enable big data systems to process and move data fast. (Web) (HN)

• ​Blazer - Explore your data with SQL. Easily create charts and dashboards, and share them with your team.

• ​Moving on from RocksDB to something FASTER - Matthew Brookes (2019)​

• ​List of software that turns your database into a REST/GraphQL API​

• ​What Are Databases? (2019)​

• ​Advanced Database Systems (2019) (Other courses) (Web) (Code)

• ​Facebook Scuba, MongoDB, CockroachDB (CMU Databases Systems lecture) (2019)​

• ​DB - Version control for databases: save, restore, and archive snapshots of your database from the command line. (HN)

• ​Why databases use ordered indexes but programming uses hash tables (2019)​

• ​Samuel Madden professor research page​

• ​Curated list of resources for graph databases and graph computing tools​

• ​Graph Databases book​

• ​Big News In Databases — Fall 2019​

• ​Ask HN: What are some examples of good database schema designs? (2020)​

• ​Data flows and security architecture in CockroachDB (2020)​

• ​Awesome Database Learning - List of learning materials to understand databases internals.

• ​Sharing an SQLite database across containers is surprisingly brilliant (2020)​

• ​Your Database as an API (2020) (Lobsters)

• ​Elle - Black-box transactional safety checker based on cycle detection.

• ​Millions of Tiny Databases (2020) (Article)

• ​The Next 50 Years of Databases (2015) (HN)

• ​Interview with Noria’s creator: a promising dataflow research database implemented in Rust (2019)​

• ​The High Cost of Splitting Related Data (2020)​

• ​Awesome Database Tools​

• ​Storage: Complete Overview for Developers (2020)​

• ​Event-Reduce - Algorithm to optimize database queries that run multiple times. (HN)

• ​Apache Druid vs. Time-Series Databases (2019) (HN)

• ​Lopez: Breaking boundaries between programming languages and databases (2019)​

• ​Declarative Frameworks and Optimization Techniques for Developing Scalable Advanced Analytics over Databases and Data Streams (2019)​

• ​Things I Wished More Developers Knew About Databases (2020) (HN)

• ​toyDB - Distributed SQL database in Rust, written as a learning project.

• ​Gallery of 200 database schema diagrams of open-source packages (HN)

• ​MySQL sharding at Quora (HN)

• ​Database Internals book - Deep Dive Into How Distributed Data Systems Work.

• ​Fast and maintainable patterns for fetching from a database (2020)​

• ​DbCleaner - Clean database for testing, inspired by database_cleaner for Ruby.

• ​polluter - Easiest solution to seed database with Go.

• ​In Search of a Local-First Database (2020)​

• ​Local-first database: remoteStorage.js (2020)​

• ​Jon Gjengset's PhD thesis​

• ​Succinct Data Structures and Delta Encoding for Modern Databases (2020)​

• ​About Pool Sizing​

• ​migrate - Database migrations written in Go. Use as CLI or import as library.

• ​I want to own the database that my apps use (2020) (Lobsters)

• ​Hermitage: Testing transaction isolation levels​

• ​Amazon's Dynamo (2007)​

• ​The Curious Case of Small Files (2020) (Lobsters)

• ​MiniCouchDB in Rust (2020) (HN) (Lobsters)

• ​Accessing SQLite, PostgreSQL and MySQL through ODBC​

• ​17 Things Developers Need to Know About Databases - Peter Zaitsev (2020)​

• ​Readings in Database Systems (HN)

• ​Stanford Future Data Systems Research Group​

• ​Stanford Data Management and Data Systems (2017)​

• ​Concept-oriented model: Modeling and processing data using functions (2019) (Summary)

• ​DBCore - Generate applications powered by your database. (Lobsters) (Code) (Article)

• ​Recent database technology that should be on your radar (2020) (HN)

• ​DB Weekly - Weekly round-up of database technology news and articles covering new developments, SQL, NoSQL, document databases, graph databases, and more.

• ​Making Databases Work: The Pragmatic Wisdom of Michael Stonebraker (2018) (HN)

• ​SOSD: A Benchmark for Learned Indexes (Code)

• ​RMI - Recursive model index, a learned index structure.

• ​SchemaHero - Kubernetes operator for declarative database schema management. (Web)

• ​TablaM - Practical general language but tailored for data-manipulation and database (in the broad sense of the word) coding. (Comment)

• ​What are databases? (2020)​

• ​The myth of “joins don't scale” (2020) (HN)

• ​Your database is a distributed system (2015)​

• ​Sieuferd - General-purpose user interface for relational databases.

• ​Unofficial Guide to Datomic Internals (2014) (HN)

• ​Lobsters: Does anyone use advanced database access control anymore?​

• ​Introduction to database schemas​

• ​BaseDash - Build internal tools for your database. (HN)