Everything I know
Everything I know
🏡
🐦
🐙
📷
Introduction
Meta
Sharing
Ideas
Focusing
Minimalism
Research
Knowledge
Environment
Music
Life
Writing
macOS
Hardware
Math
Computer Science
Programming
Programming languages
Data Science
Open Source
Languages
Text editors
Operating systems
Package managers
DevOps
Mindfulness
Compilers
Physics
Biology
Automation
Education
Economy
Governance
Consciousness
Drugs
Chemistry
Unix
Web
Cloud computing
Front End
Security
Social networks
Networking
Health
Fitness
Medicine
History
Travel
Geography
Business
Relationships
3D Printing
Anki
Philosophy
Video
Machine learning
Computer graphics
Tools
Design
Keyboards
Future
Cryptocurrencies
Privacy
Games
Streaming
Talks
Analytics
Databases
PostgreSQL
SQLite
Redis
DynamoDB
FaunaDB
FoundationDB
Prometheus
MongoDB
SQL
Prisma
Memcached
Kdb+
Neo4j
Dgraph
Cassandra
MariaDB
Blockchain
Art
API
Distributed systems
Backups
Space
Psychology
Sleep
IRC
Work
Management
LaTeX
Robots
NLP
Virtual Reality
Augmented Reality
Neuroscience
CLI
Humans
Philanthropy
Animals
Podcasts
Documentaries
Movies
TV series
Courses
Articles
Poems
Research papers
Books
Other
Notes
Looking back
Powered by GitBook

Databases

Interesting

  • ​Materialize - Streaming SQL Database powered by Timely Dataflow. (Web)

  • ​PlanetScale - Database for Developers. (HN) (Release Article)

  • ​Mentat - Persistent, relational store inspired by Datomic and DataScript.

  • ​RocksDB - Persistent Key-Value Store for Flash and RAM Storage. (Rocksplicator - RocksDB Replication)

  • ​TerarkDB - RocksDB compatible KV storage engine with better performance. (HN)

  • ​LevelDB - Fast key-value storage library written at Google that provides an ordered mapping from string keys to string values.

  • ​GoLevelDB - LevelDB key/value database in Go.

  • ​NodeLevelDB - Fast & simple storage. A Node.js-style LevelDB wrapper for Node.js, Electron and browsers. (Awesome)

  • ​TiDB - Distributed HTAP database compatible with the MySQL protocol.

  • ​TiKV - Distributed transactional key-value database, originally created to complement TiDB. (pd - Placement driver for TiKV) (TiKV Rust Client)

  • ​Noria - Dynamically changing, partially-stateful data-flow for web application backends. (Paper) (Notes)

  • ​RethinkDB - Pushes JSON to your apps in realtime.

  • ​RedixDB - Persistent real-time key-value store, with the same redis protocol with powerful features.

  • ​AresDB - GPU-powered real-time analytics storage and query engine.

  • ​Sophia - Modern transactional key-value/row storage library.

  • ​Bolt - Embedded key/value database for Go.

  • ​InfluxDB - Scalable datastore for metrics, events, and real-time analytics. (Web)

  • ​EdgeDB - Open-source object-relational database built on top of PostgreSQL. (EdgeDB 1.0 Beta)

  • ​Cassandra - Highly-scalable partitioned row store. Rows are organized into tables with a required primary key.

  • ​Scylla - Drop-in Apache Cassandra alternative big data database that powers your applications with ultra-low latency and extremely high throughput, while reducing TCO to a fraction of most NoSQL databases. Code.

  • ​JanusGraph - Open-source, distributed graph database.

  • ​DuckDB - Embeddable SQL OLAP Database Management System. (HN) (Playing With DuckDB) (5 minute intro)

  • ​sled - Modern embedded database. (sledtool - CLI tool to work with Sled key-value databases)

  • ​Genji - Document-oriented, embedded SQL database, works with Bolt, Badger and memory. (Web)

  • ​Atlas - In-memory dimensional time series database.

  • ​Pebble - RocksDB/LevelDB inspired key-value database in Go. (Intro article) (HN) (Pebble vs RocksDB: Implementation Differences)

  • ​LogDevice - Distributed storage for sequential data.

  • ​SQLite - C-language library that implements a small, fast, self-contained, high-reliability, full-featured, SQL database engine.

  • ​better-sqlite3 - Fastest and simplest library for SQLite3 in NodeJS.

  • ​gStore - Graph database engine for managing large graph-structured data.

  • ​MongoDB - General purpose, document-based, distributed database built for modern application developers.

  • ​Ardb - High Performance Persistent NoSql, Full Redis-Protocol Compatibility.

  • ​datahikeai - Durable datalog implementation adaptable for distribution.

  • ​Yugabyte DB - High-performance distributed SQL database for global, internet-scale apps.

  • ​JuliaDB - Parallel analytical database in pure Julia. (Docs) (HN)

  • ​Delta Lake - Storage layer that brings scalable, ACID transactions to Apache Spark and other big-data engines.

  • ​M3 - Distributed TSDB, Aggregator and Query Engine, Prometheus Sidecar, Graphite Compatible, Metrics Platform. Prometheus compatible. (Web)

  • ​WatermelonDB - Reactive & asynchronous database for powerful React and React Native apps.

  • ​Neo4j - High performance graph store with all the features expected of a mature and robust database, like a friendly query language and ACID transactions.

  • ​Dgraph - Horizontally scalable and distributed graph database, providing ACID transactions, consistent replication and linearizable reads.

  • ​MeiliDB - Full-text search database based on the fast LMDB key-value store.

  • ​CrateDB - Distributed SQL database that makes it simple to store and analyze massive amounts of machine data in real-time.

  • ​Riak - Distributed, decentralized data storage system.

  • ​CockroachDB - Open source, cloud-native SQL database.

  • ​ActorDB - Distributed SQL database.

  • ​ksqlDB - Event streaming database purpose-built for stream processing applications. (HN) (Code)

  • ​OmniSciDB - Open source SQL-based, relational, columnar database engine that leverages the full performance and parallelism of modern hardware.

  • ​Sonnerie - Simple timeseries database.

  • ​Dolt - Git for Data. SQL database that you can fork, clone, branch, merge. (HN)

  • ​Crux - Open source document database with bitemporal graph queries. (Website) (Article) (HN)

  • ​LokiJS - Document oriented database written in JavaScript.

  • ​terrier - Carnegie Mellon's new database system project that is replacing Peloton.

  • ​Nebula Graph - Open-source graph database capable of hosting super large scale graphs with dozens of billions of vertices (nodes) and trillions of edges, with milliseconds of latency. (HN) (Active Fork)

  • ​SeaTable - Online lightweight database with a spreadsheet interface. (Code)

  • ​Ceph - Distributed object, block, and file storage platform.

  • ​Vitess - Database clustering system for horizontal scaling of MySQL through generalized sharding. (Web)

  • ​MinIO - High Performance, Kubernetes Native Object Storage. (Web) (GitHub)

  • ​Memory-Efficient Search Trees for Database Management Systems (2020) (HN)

  • ​ShareDB - Realtime database backend based on Operational Transformation (OT).

  • ​Irmin - Distributed database built on the same principles as Git. (Code) (HN)

  • ​Noms - Decentralized database philosophically descendant from the Git version control system.

  • ​SwayDB - Fast embeddable persistent and in-memory key-value storage engine that provides storage as simple data structures - Map, Set & Queue.

  • ​TrailDB - Efficient tool for storing and querying series of events.

  • ​QuestDB - Relational database with ultimate time-series performance. (HN)

  • ​Prometheus - Systems and service monitoring system.

  • ​Akumuli - Time-series database.

  • ​SSDB - Redis compatible NoSQL database stored on disk.

  • ​minikeyvalue - Distributed key value store in under 1000 lines. (HN)

  • ​Bedrock - Rock solid distributed database specializing in active/active automatic failover and WAN replication.

  • ​TerminusDB - Full featured in-memory graph database management system with a rich query language. (Code) (HN)

  • ​WhiteDB - Lightweight database library operating fully in main memory. Disk is used only for dumping/restoring database and logging.

  • ​FaunaDB - Database built for serverless, featuring native GraphQL.

  • ​ImmuDB - Lightweight, high-speed immutable database for systems and applications. Written in Go. (HN)

  • ​NutsDB - Simple, fast, embeddable, persistent key/value store written in pure Go.

  • ​remoteStorage - Open protocol for per-user storage on the Web.

  • ​TimescaleDB - Open-source database built for analyzing time-series data with the power and convenience of SQL. (timescaledb-tune) (HN) (2.0 release)

  • ​ClickHouse - Open-source column-oriented database management system that allows generating analytical data reports in real time. (How ClickHouse Saved our Data) (HN)

  • ​ArongoDB - Natively store data for graph, document and search needs. Utilize feature-rich access with one query language. (Go Driver) (Arangolite - Go Driver)

  • ​LiteStore - Lightweight, self-contained, RESTful, multi-format NoSQL document store server written in Nim and powered by a SQLite backend for storage.

  • ​RecallGraph - Versioning data store for time-variant graph data. (HN)

  • ​Apache Pinot - Realtime distributed OLAP datastore. (Code)

  • ​Apache Ignite - Horizontally scalable, fault-tolerant distributed in-memory computing platform for building real-time applications that can process terabytes of data with in-memory speed.

  • ​TileDB - Storage Engine for Data Science.

  • ​Pravega - Open source distributed storage service implementing Streams. It offers Stream as the main primitive for the foundation of reliable storage systems.

  • ​libmdbx - Extremely fast, compact, powerful, embedded, transactional key-value store database.

  • ​Realm - Mobile database that runs directly inside phones, tablets or wearables.

  • ​HSE - Embeddable key-value store designed for SSDs based on NAND flash or persistent memory.

  • ​GhostDB - Distributed, in-memory, general purpose key-value data store that delivers microsecond performance at any scale. (HN)

  • ​Datalevin - Port of Datascript in-memory Datalog database to Lightning Memory-Mapped Database (LMDB).

  • ​DagDB - Syncable database built on IPLD.

  • ​MonetDB - Column-store pioneer. (Web)

  • ​RxDB - NoSQL-database for JavaScript Applications like Websites, hybrid Apps, Electron-Apps, Progressive Web Apps and NodeJs. (HN)

  • ​Graviton Database - Simple, fast, versioned, authenticated, embeddable key-value store database in pure Go. (HN)

  • ​SeaweedFS - Distributed object store and file system to store and serve billions of files fast.

  • ​IndexedDB - IndexedDB, but with promises.

  • ​JsStore - Complete IndexedDB wrapper with SQL like syntax. (Web)

  • ​Quadrable - Authenticated multi-version database: sparse binary merkle tree with compact partial-tree proofs.

  • ​Manticore Search - Database designed specifically for search, including full-text search.

  • ​Amazon QLDB - Fully managed ledger database that provides a transparent, immutable, and cryptographically verifiable transaction log. (Awesome)

  • ​Oxigraph - Graph database implementing the SPARQL standard.

  • ​JavaScript Database (JSDB) - Transparent, in-memory, streaming write-on-update JavaScript database for Small Web applications that persists to a JavaScript transaction log. (Intro) (Lobsters)

  • ​Cete - Distributed key value store server written in Go built on top of BadgerDB.

  • ​NoisePage - Self-Driving Database Management System. (Code) (HN)

  • ​Sir.DB - Git-diff-able JSON database on yer filesystem. (HN)

  • ​Bigbucket - Serverless NoSQL database with a focus on scalability, availability and simplicity. It has a Bigtable-style data model with storage backed by a Cloud Storage Bucket.

  • ​AnnaBellaDB - Proof-of-concept (PoC) network latency and access-pattern aware key-value store.

  • ​OpenCog AtomSpace - In-RAM knowledge representation (KR) database, an associated query engine and graph-re-writing system, and a rule-driven inferencing engine that can apply and manipulate sequences of rules to perform reasoning. (Web)

  • ​Sybil - Append only analytics datastore with no up front table schema requirements. Just log JSON records to a table and run queries.

  • ​Comdb2 - Clustered RDBMS built on Optimistic Concurrency Control techniques.

  • ​Arctic - High performance datastore for time series and tick data.

  • ​Warp 10 - Open Source Geo Time Series Platform designed to handle data coming from sensors, monitoring systems and the Internet of Things. (Web)

  • ​Eva - Distributed database-system implementing an entity-attribute-value data-model that is time-aware, accumulative, and atomically consistent.

  • ​Firestore - Develop rich applications using a fully managed, scalable, and serverless document database. (Intro) (Running Google Firestore locally)

  • ​Graphik - Identity-aware, permissioned, persistant document/graph database & pubsub server written in Go.

  • ​AIStore - Lightweight object storage system with the capability to linearly scale-out with each added storage node and a special focus on petascale deep learning. (Web)

  • ​DatenLord - Computing Defined Storage, an application-orientated, cloud-native distributed storage system.

  • ​AgateDB - Embeddable, persistent and fast key-value (KV) database written in pure Rust.

  • ​TensorBase - Modern big data warehouse with performance in its core mind. (Web)

  • ​Redwood - Highly-configurable, distributed, realtime database that manages a state tree shared among many peers.

  • ​Drivine - Best and fastest graph database client (Neo4j & AgensGraph) for Node.js & TypeScript. (Code) (Starter Template)

  • ​InfiniCache - In-memory cache that is built atop ephemeral serverless functions. (HN)

  • ​Blazegraph - Ultra high-performance graph database supporting Blueprints and RDF/SPARQL APIs.

  • ​Escanor - High performance key value database with useful json document indexing and manipulations.

  • ​Condensation - General-purpose distributed data system with conflict-free synchronization, and inherent end-to-end security. (GitHub)

  • ​ZenoDB - Go-based embeddable time series database optimized for performing aggregated analytical SQL queries on dimensional data.

  • ​IndraDB - Graph database written in rust.

  • ​SteveCare - Peer-to-peer database system that enables people to build complex databases between peers, without any intermediary platform.

  • ​CORTX - Open Source Mass-Capacity Optimized Object Store.

  • ​PouchDB - JavaScript Database that Syncs. (Code)

  • ​CryptDB - Database system that can process SQL queries over encrypted data. (Code)

  • ​LBADD - Experimental distributed SQL database, written in Go.

  • ​Baserow - Self-hosted Airtable alternative. (HN) (Code)

  • ​KuiBaDB - Another Postgres rewritten with Rust and multi-threading.

  • ​LeanStore - High-performance OLTP storage engine optimized for many-core CPUs and NVMe SSDs. (Web)

  • ​KVS - Abstract Chain Database. (Code)

  • ​Yorkie - Document store for building collaborative editing applications. (Code)

  • ​InfluxDB IOx - Future core of InfluxDB, an open source time series database.

  • ​EliasDB - Graph-based database.

  • ​Resql - SQL database server that uses SQLite as its SQL engine and it provides replication and automatic failover capabilities.

  • ​Tarantool - In-memory computing platform. (Go client)

  • ​EventQL - Database for large-scale event analytics. (Code)

  • ​OceanBase - Distributed, banking suitable, open-source related database featuring high scalability and high compatibility. (HN)

  • ​Kvrocks - Distributed key value NoSQL database based on RocksDB and compatible with Redis protocol.

  • ​UnQLite - Embedded NoSQL, Transactional Database Engine. (Web)

Tools

  • ​Postico - Modern PostgreSQL Client for the Mac.

  • ​TablePlus (HN)

  • ​SQLiteStudio - Free, open source, multi-platform SQLite database manager.

  • ​litecli - Command-line client for SQLite databases that has auto-completion and syntax highlighting.

  • ​Beekeeper Studio - Query and manage your relational databases. (Code)

  • ​Diwata - User-friendly database interface.

  • ​Sequel Ace - MySQL/MariaDB database management for macOS. (Web)

  • ​ExtendsClass - Online MySQL playground for testing.

  • ​Dropbase - Turn offline files into live databases instantly. (HN)

  • ​Synth - Create synthetic data environments in seconds. (HN)

  • ​Baserow - Open source online database tool and Airtable alternative.

  • ​SHMIG - Database migration tool written in BASH.

  • ​goose - Database migration tool. Manage your database schema by creating incremental SQL changes or Go functions.

  • ​migrate - Database migrations written in Go. Use as CLI or import as library.

  • ​Flyway - Database Migrations Made Easy. (Tweet)

  • ​Liquibase - Open Source Version Control for Your Database.

  • ​gh-ost - GitHub's Online Schema Migrations for MySQL.

  • ​Dbmate - Lightweight, framework-agnostic database migration tool.

  • ​ShardingSphere - Distributed Database Middleware Ecosphere.

  • ​ln2sql - NLP tool to query a database in natural language.

  • ​Hue - Open source SQL Assistant for Data Warehouses. (Code)

  • ​ley - Driver-agnostic database migrations.

  • ​DBeaver - Free Universal Database Tool. (Code)

  • ​Skeema - Schema management CLI for MySQL.

  • ​noisepage-test - DBMS Performance & Correctness Testing Framework.

  • ​erd - Translates a plain text description of a relational database schema to a graphical entity-relationship diagram.

  • ​CloudBeaver - Database Management from Browser. (Code)

  • ​DbGate - Database manager for MySQL, PostgreSQL, SQL Server and MongoDB. (Code)

  • ​Snaplet - Work with your database as easily as your code.

  • ​Condenser - Database subsetting tool.

  • ​NocoDB - Turns your SQL database into a Nocode platform. Free & Open Source. (Code) (HN)

  • ​Owoof - Program for querying and modifying information in a datalog-like format backed by SQLite.

Notes

Links

Previous
Analytics
Next
PostgreSQL
Last updated 1 day ago
Edit on GitHub
Contents
Interesting
Tools
Notes
Links