Skip to content

Latest commit

 

History

History
1494 lines (1271 loc) · 73.9 KB

database.md

File metadata and controls

1494 lines (1271 loc) · 73.9 KB

Bookmarks tagged [database]

https://dzone.com/articles/2019-open-source-database-report-top-databases-pub

Take a look at the state of databases, including a special glance at how open source databases are performing against commercial counterparts.


https://stackoverflow.com/questions/1108/how-does-database-indexing-work

Why is it needed?

When data is stored on disk-based storage devices, it is stored as blocks of data. These blocks are accessed in their entirety, making them the atomic disk access operation. Disk bl...


https://stackoverflow.com/questions/8922056/what-is-the-best-way-to-upload-and-store-pictures-on-the...

All big websites don't save pictures to the database they store them in the disk. They save a reference to the picture's position in a table. And then link from there.

Why? Performance.

Pulling heav...


https://github.com/paulftw/hiberlite

C++ Object-relational mapping for sqlite3. [BSD]


https://github.com/redis/hiredis

A minimalistic C client library for the Redis database. [BSD]


https://github.com/google/leveldb

A fast key-value storage library written at Google that provides an ordered mapping from string keys to string values. [BSD]


http://symas.com/mdb/

Very fast embedded key/value store with full ACID semantics. [OpenLDAP]


https://github.com/bendiken/lmdbxx

C++11 wrapper for the LMDB embedded database library. [PublicDomain]


https://github.com/mongodb/mongo-c-driver

MongoDB client library for C. [Apache2]


https://github.com/mongodb/mongo-cxx-driver

C++ driver for MongoDB. [Apache2]


https://github.com/mongodb/libbson

A BSON utility library. [Apache2]


http://www.tangentsoft.net/mysql++/

A C++ wrapper for MySQL's C API. [LGPL]


https://github.com/nanodbc/nanodbc

A small C++ wrapper for the native C ODBC API. [MIT]


https://www.codesynthesis.com/products/odb/

An open-source, cross-platform, and cross-database object-relational mapping (ORM) system for C++. [GPLv2]


https://github.com/luca3m/redis3m

Wrapper of hiredis with clean C++ interface, supporting sentinel and ready to use patterns. [Apache2]


https://github.com/facebook/rocksdb

Embedded key-value store for fast storage from facebook. [BSD]


https://github.com/LiveAsynchronousVisualizedArchitecture/simdb

High performance, shared memory, lock free, cross platform, single file, minimal dependencies, C++11 key-value store [Apache2]


https://github.com/SOCI/soci

A database abstraction layer for C++. [BSL-1.0]


http://www.sqlite.org/

A completely embedded, full-featured relational database in a few 100k that you can include right into your project. [PublicDomain]


https://github.com/SRombauts/SQLiteCpp

SQLiteC++ (SQLiteCpp) is a smart and easy to use C++ SQLite3 wrapper. [MIT]


https://github.com/SqliteModernCpp/sqlite_modern_cpp

Header only C++14 wrapper around sqlite library. [MIT]


https://github.com/fnc12/sqlite_orm

SQLite ORM light header only library for modern C++. [BSD-3-Clause]


https://github.com/rbock/sqlpp11

A type safe embedded domain specific language for SQL queries and results in C++. [BSD-2-Clause]


https://upscaledb.com

An embedded "typed" key/value store with a built-in query interface. [GPLv3]


https://hasura.io/

Instant Realtime GraphQL on Postgres


https://www.prisma.io/

Prisma replaces traditional ORMs and can be used to build GraphQL servers, REST APIs, microservices & more.


https://github.com/RisingStack/graffiti

⚠️ DEVELOPMENT DISCONTINUED - Node.js GraphQL ORM. Contribute to RisingStack/graffiti development by creating an account on GitHub.


https://github.com/vaffel/sql-to-graphql

Generate a GraphQL API based on your SQL database structure - rexxars/sql-to-graphql


https://github.com/PumpkinDB/PumpkinDB

an event sourcing database engine


https://github.com/seppo0010/rsedis

A Redis reimplementation in Rust


https://github.com/paritytech/paritydb

Fast and reliable database, optimised for read operation


https://github.com/tikv/tikv

A distributed KV database in Rust


https://github.com/sfackler/r2d2

generic connection pool


https://github.com/innoave/rincon

An ArangoDB (NoSQL and Graph store) driver for Rust


https://github.com/Metaswitch/cassandra-rs

bindings to the DataStax C/C++ client


https://github.com/YellowInnovation/sofa

an interface to CouchDB HTTP REST API for stable rust


https://github.com/vhbit/sherwood

ForestDB bindings


https://github.com/panoptix-za/influxdb-rs

asynchronous interface


https://github.com/driftluo/InfluxDBClient-rs

Synchronization interface


https://github.com/skade/leveldb

LevelDB bindings


https://github.com/mitsuhiko/redis-rs

Redis library in Rust


https://github.com/rust-rocksdb/rust-rocksdb

RocksDB bindings


https://github.com/zitsen/unqlite.rs

UnQLite bindings


https://github.com/seladb/pickledb-rs

a lightweight and simple key-value store, heavily inspired by Python's PickleDB.


https://github.com/steffengy/tiberius


https://github.com/AgilData/mysql-proxy-rs

A MySQL Proxy


https://github.com/jgallagher/rusqlite

Sqlite3 bindings


https://github.com/diesel-rs/diesel

an ORM and Query builder for Rust Build Status


https://github.com/ivanceras/rustorm

an ORM for Rust Build Status


https://apacheignite.readme.io/docs/kubernetes-deployment

Memory-centric distributed database, caching, processing platform


http://blog.kubernetes.io/2016/07/thousand-instances-of-cassandra-using-kubernetes-pet-set.html

Editor’s note: this post is part of a series of in-depth articles on what’s new in Kubernetes 1.3 Running The Greek Pet Monster Races For the Kubernetes 1.3 launch, we wanted to put the new Pet Set th...


http://www.cockroachlabs.com/blog/running-cockroachdb-on-kubernetes/

Running CockroachDB on Kubernetes pairs its built-in replication and survivability with Kubernetes’ process management, creating a highly available system.


http://ppires.wordpress.com/2014/12/24/clustering-hazelcast-on-kubernetes/

I've had experience with clustering Hazelcast in Google Cloud Engine before, but right now, in the advent of containers, Kubernetes is becoming a standard for app/container orchestration and therefore...


http://minio.io

Enterprise grade, Amazon S3 compatible, object storage software designed for high performance workloads like AI, machine learning + cloud native apps.


http://www.mongodb.com/blog/post/running-mongodb-as-a-microservice-with-docker-and-kubernetes

Running MongoDB as a Microservice with Docker and Kubernetes


https://github.com/sorenmat/k8s-rds

Provision RDS databases via CRD from Kubernetes


http://vitess.io/

Horizontal scaling of MySql by Youtube


https://github.com/dgraph-io/badger

Fast key-value store in Go.


https://github.com/iwanbk/bcache

Eventually consistent distributed in-memory cache Go library.


https://github.com/allegro/bigcache

Efficient key/value cache for gigabytes of data.


https://github.com/boltdb/bolt

Low-level key/value database for Go.


https://github.com/tidwall/buntdb

Fast, embeddable, in-memory key/value database for Go with custom indexing and spatial support.


https://github.com/akyoto/cache

In-memory key:value store with expiration time, 0 dependencies, <100 LoC, 100% coverage.


https://github.com/muesli/cache2go

In-memory key:value cache which supports automatic invalidation based on timeouts.


https://github.com/oaStuff/clusteredBigCache

BigCache with clustering support and individual item expiration.


https://github.com/cockroachdb/cockroach

Scalable, Geo-Replicated, Transactional Datastore.


https://github.com/codingsince1985/couchcache

RESTful caching micro-service backed by Couchbase server.


https://github.com/CovenantSQL/CovenantSQL

CovenantSQL is a SQL database on blockchain.


https://github.com/dgraph-io/dgraph

Scalable, Distributed, Low Latency, High Throughput Graph Database.


https://github.com/peterbourgon/diskv

Home-grown disk-backed key-value store.


https://github.com/krotik/eliasdb

Dependency-free, transactional graph database with REST API, phrase search and SQL-like query language.


https://github.com/VictoriaMetrics/fastcache

fast thread-safe inmemory cache for big number of entries. Minimizes GC overhead.


https://github.com/bluele/gcache

Cache library with support for expirable Cache, LFU, LRU and ARC.


https://github.com/pmylund/go-cache

In-memory key:value store/cache (similar to Memcached) library for Go, suitable for single-machine applications.


https://github.com/syndtr/goleveldb

Implementation of the LevelDB key/value database in Go.


https://github.com/kapitan-k/gorocksdb

Gorocksdb is a wrapper for RocksDB written in Go.


https://github.com/golang/groupcache

Groupcache is a caching and cache-filling library, intended as a replacement for memcached in many cases.


https://github.com/influxdb/influxdb

Scalable datastore for metrics, events, and real-time analytics.


https://github.com/siddontang/ledisdb

Ledisdb is a high performance NoSQL like Redis based on LevelDB.


https://github.com/jmhodges/levigo

Levigo is a Go wrapper for LevelDB.


https://github.com/couchbase/moss

Moss is a simple LSM key-value storage engine written in 100% Go.


https://github.com/xujiajun/nutsdb

Nutsdb is a simple, fast, embeddable, persistent key/value store written in pure Go. It supports fully serializable transactions and many data structures such as list, set, sorted set.


https://github.com/fern4lvarez/piladb

Lightweight RESTful database engine based on stack data structures.


https://github.com/prometheus/prometheus

Monitoring system and time series database.


https://github.com/recoilme/pudge

Fast and simple key/value store written using Go's standard library.


https://github.com/rqlite/rqlite

The lightweight, distributed, relational database built on SQLite.


https://github.com/nanobox-io/golang-scribble

Tiny flat file JSON store.


https://github.com/recoilme/slowpoke

Key-value store with persistence.


https://github.com/rafaeljesus/tempdb

Key-value store for temporary items.


https://github.com/pingcap/tidb

TiDB is a distributed SQL database. Inspired by the design of Google F1.


https://github.com/HouzuoGuo/tiedot

Your NoSQL database powered by Golang.


https://github.com/chrislusf/vasto

A distributed high-performance key-value store. On Disk. Eventual consistent. HA. Able to grow or shrink without service interruption.


https://github.com/VictoriaMetrics/VictoriaMetrics

fast, resource-effective and scalable open source time series database. May be used as long-term remote storage for Prometheus. Supports PromQL.


https://github.com/khezen/avro

Discover SQL schemas and convert them to AVRO schemas. Query SQL records into AVRO bytes.


https://github.com/GuiaBolso/darwin

Database schema evolution library for Go.


https://github.com/RichardKnop/go-fixtures

Django style fixtures for Golang's excellent built-in database/sql library.


https://github.com/robinjoseph08/go-pg-migrations

A Go package to help write migrations with go-pg/pg.


https://github.com/emvi/gondolier

Database migration library using struct decorators.


https://github.com/steinbacher/goose

Database migration tool. You can manage your database's evolution by creating incremental SQL or Go scripts.


https://github.com/go-gormigrate/gormigrate

Database schema migration helper for Gorm ORM.


https://github.com/golang-migrate/migrate

Database migrations. CLI and Golang library.


https://github.com/lopezator/migrator

Dead simple Go database migration library.


https://github.com/pravasan/pravasan

Simple Migration tool - currently for MySQL but planning to soon support Postgres, SQLite, MongoDB, etc.


https://github.com/gobuffalo/pop/tree/master/soda

Database migration, creation, ORM, etc... for MySQL, PostgreSQL, and SQLite.


https://github.com/rubenv/sql-migrate

Database migration tool. Allows embedding migrations into the application using go-bindata.


https://github.com/Vertamedia/chproxy

HTTP proxy for ClickHouse database.


https://github.com/nikepan/clickhouse-bulk

Collects small insterts and sends big requests to ClickHouse servers.


https://github.com/codingconcepts/datagen

A fast data generator that's multi-table aware and supports multi-row DML.


https://github.com/sj14/dbbench

Database benchmarking tool with support for several databases and scripts.


https://github.com/siddontang/go-mysql

Go toolset to handle MySQL protocol and replication.


https://github.com/siddontang/go-mysql-elasticsearch

Sync your MySQL data into Elasticsearch automatically.


https://github.com/flike/kingshard

kingshard is a high performance proxy for MySQL powered by Golang.


https://github.com/2tvenom/myreplication

MySql binary log replication listener. Supports statement and row based replication.


https://github.com/knocknote/octillery

Go package for sharding databases ( Supports every ORM or raw SQL ).


https://github.com/github/orchestrator

MySQL replication topology manager & visualizer.


https://github.com/sosedoff/pgweb

Web-based PostgreSQL database browser.


https://github.com/hexdigest/prep

Use prepared SQL statements without changing your code.


https://github.com/nuveo/prest

Serve a RESTful API from any PostgreSQL database.


https://github.com/andizzle/rwdb

rwdb provides read replica capability for multiple database servers setup.


https://github.com/youtube/vitess

vitess provides servers and tools which facilitate scaling of MySQL databases for large scale web services.


https://github.com/gchaincl/dotsql

Go library that helps you keep sql files in one place and use them with ease.


https://github.com/didi/gendry

Non-invasive SQL builder and powerful data binder.


https://github.com/xujiajun/godbal

Database Abstraction Layer (dbal) for go. Support SQL builder and get result easily.


https://github.com/doug-martin/goqu

Idiomatic SQL builder and query library.


https://github.com/galeone/igor

Abstraction layer for PostgreSQL that supports advanced functionality and uses gorm-like syntax.


https://github.com/pupizoid/ormlite

Lightweight package containing some ORM-like features and helpers for sqlite databases.


https://github.com/go-ozzo/ozzo-dbx

Powerful data retrieval methods as well as DB-agnostic query building capabilities.


https://github.com/variadico/scaneo

Generate Go code to convert database rows into arbitrary structs.


https://github.com/elgris/sqrl

SQL query builder, fork of Squirrel with improved performance.


https://gitlab.com/qosenergy/squalus

Thin layer over the Go SQL package that makes it easier to perform queries.


https://github.com/Masterminds/squirrel

Go library that helps you build SQL queries.


https://github.com/knq/xo

Generate idiomatic Go code for databases based on existing schema definitions or custom queries supporting PostgreSQL, MySQL, SQLite, Oracle, and Microsoft SQL Server.


https://github.com/patx/pickledb

A simple and lightweight key-value store for Python.


https://github.com/msiemens/tinydb

A tiny, document-oriented database.


https://github.com/zopefoundation/ZODB

A native object database for Python. A key-value and object graph database.


https://github.com/brianc/node-postgres

PostgreSQL client. Pure JavaScript and native libpq bindings.


https://github.com/luin/ioredis

Redis client.


https://github.com/Level/levelup

LevelDB.


https://github.com/mysqljs/mysql

MySQL client.


https://github.com/apache/couchdb-nano

CouchDB client.


https://github.com/aerospike/aerospike-client-nodejs

Aerospike client.


https://github.com/couchbase/couchnode

Couchbase client.


https://github.com/mongodb/node-mongodb-native

MongoDB driver.


https://github.com/sequelize/sequelize

Multi-dialect ORM. Supports PostgreSQL, SQLite, MySQL.


https://github.com/bookshelf/bookshelf

ORM for PostgreSQL, MySQL and SQLite3 in the style of Backbone.js.


https://github.com/robconery/massive-js

PostgreSQL data access tool.


https://github.com/Automattic/mongoose

Elegant MongoDB object modeling.


https://github.com/balderdashy/waterline

Datastore-agnostic tool that dramatically simplifies interaction with one or more databases.


https://github.com/PhilWaldmann/openrecord

ORM for PostgreSQL, MySQL, SQLite3 and RESTful datastores. Similar to ActiveRecord.


https://github.com/vitaly-t/pg-promise

PostgreSQL framework for native SQL using promises.


https://github.com/Vincit/objection.js

Lightweight ORM built on the SQL query builder Knex.


https://github.com/typeorm/typeorm

ORM for PostgreSQL, MariaDB, MySQL, SQLite, and more.


https://github.com/tgriesser/knex

Query builder for PostgreSQL, MySQL and SQLite3, designed to be flexible, portable, and fun to use.


https://github.com/louischatriot/nedb

Embedded persistent database written in JavaScript.


https://github.com/typicode/lowdb

Small JavaScript database powered by Lodash.


https://github.com/lukechilds/keyv

Simple key-value storage with support for multiple backends.


https://github.com/tommybananas/finale

RESTful endpoint generator for your Sequelize models.


https://github.com/mlaanderson/database-js

Wrapper for multiple databases with a JDBC-like connection.


https://github.com/pkosiec/mongo-seeding

Populate MongoDB databases with JavaScript and JSON files.


https://github.com/brysgo/graphql-bookshelf

Some help defining GraphQL schema around BookshelfJS models.


https://github.com/mickhansen/graphql-sequelize

Sequelize helpers for GraphQL.


https://github.com/fenos/graphql-thinky

Build an optimized GraphQL schema from Thinky RethinkDB models.


https://github.com/rse/graphql-tools-sequelize

OO-style schema definition functions and schema resolver functions for GraphQL-Tools using Sequelize ORM


https://github.com/larsbs/graysql-orm-loader

A GraysQL extension to load a GraphQL schema from an ORM.


https://gql-dal.github.io/greldal/

A simple micro-framework for bidirectional mapping between relational datastores and GraphQL APIs.


https://dgraph.io/

Scalable, distributed, low latency, high throughput Graph database with GraphQL as the query language


https://phoenix.apache.org

High-performance relational database layer over HBase for low-latency applications.


https://github.com/arangodb/arangodb-java-driver

ArangoDB Java driver.


https://github.com/OpenHFT/Chronicle-Map

Efficient, in-memory (opt. persisted to disk), off-heap key-value store.


http://druid.io

High-performance, column-oriented, distributed data store.


https://github.com/eXist-db/exist

A NoSQL document database and application platform.


https://github.com/vladmihalcea/flexy-pool

Brings metrics and failover strategies to the most common connection pooling solutions.


https://flywaydb.org

Simple database migration tool.


https://h2database.com

Small SQL database notable for its in-memory functionality.


https://github.com/brettwooldridge/HikariCP

High-performance JDBC connection pool.


https://github.com/jasync-sql/jasync-sql

Async DB driver for MySQL and PostgreSQL.


http://jdbi.org

Convenient abstraction of JDBC.


https://github.com/searchbox-io/Jest

Client for the Elasticsearch REST API.


https://github.com/justinsb/jetcd

Client library for etcd.


https://github.com/my2iu/Jinq

Typesafe database queries via symbolic execution of Java 8 Lambdas (on top of JPA or jOOQ).


https://www.jooq.org

Generates typesafe code based on SQL schema.


http://www.liquibase.org

Database-independent library for tracking, managing and applying database schema changes.


http://www.mapdb.org

Embedded database engine that provides concurrent collections backed on disk or in off-heap memory.


https://github.com/vorburger/MariaDB4j

Launcher for MariaDB that requires no installation or external dependencies.


https://orientdb.com/orientdb

Embeddable distributed database written on top of Hazelcast.


https://github.com/prestodb/presto

Distributed SQL query engine for big data.


http://www.querydsl.com

Typesafe unified queries.


https://github.com/realm/realm-java

Mobile database to run directly inside phones, tablets or wearables.


https://github.com/mrniko/redisson

Allows for distributed and scalable data structures on top of a Redis server.


https://github.com/requery/requery

A modern, lightweight but powerful object mapping and SQL generator. Easily map to or create databases, or perform queries and updates from any Java-using platform.


https://github.com/speedment/speedment

Database access library that utilizes Java 8's Stream API for querying.


https://sql2o.org

Thin JDBC wrapper that simplifies database access and provides simple mapping of ResultSets to POJOs.


https://www.vibur.org

JDBC connection pool library with advanced performance monitoring capabilities.


https://jetbrains.github.io/xodus

Highly concurrent transactional schema-less and ACID-compliant embedded database.


https://github.com/numetriclabz/awesome-db#readme

A curated list of amazingly awesome database libraries, resources and shiny things by https://www.numetriclabz.com/ - numetriclabz/awesome-db


https://github.com/dahlia/awesome-sqlalchemy#readme

A curated list of awesome tools for SQLAlchemy. Contribute to dahlia/awesome-sqlalchemy development by creating an account on GitHub.


https://github.com/mark-rushakoff/awesome-influxdb#readme

A curated list of awesome projects, libraries, tools, etc. related to InfluxDB - mark-rushakoff/awesome-influxdb


https://github.com/neueda/awesome-neo4j#readme

A curated list of Neo4j resources. Contribute to neueda/awesome-neo4j development by creating an account on GitHub.


https://github.com/ramnes/awesome-mongodb#readme

🍃 A curated list of awesome MongoDB resources, libraries, tools and applications - ramnes/awesome-mongodb


https://github.com/d3viant0ne/awesome-rethinkdb#readme

A curated list of awesome RethinkDB resources, libraries, tools and applications - d3viant0ne/awesome-rethinkdb


https://github.com/mohataher/awesome-tinkerpop#readme

A curated list of useful libraries for Apache TinkerPop3 and Tinkerpop2 - mohataher/awesome-tinkerpop


https://github.com/dhamaniasad/awesome-postgres#readme

A curated list of awesome PostgreSQL software, libraries, tools and resources, inspired by awesome-mysql - dhamaniasad/awesome-postgres


https://github.com/quangv/awesome-couchdb#readme

CouchDB - curated meta resources & best practices list - quangv/awesome-couchdb


https://github.com/rayokota/awesome-hbase#readme

A curated list of awesome HBase projects and resources. - rayokota/awesome-hbase


https://github.com/erictleung/awesome-nosql-guides#readme

💻 Curated list of awesome resources and links about using NoSQL databases - erictleung/awesome-nosql-guides


https://en.wikipedia.org/wiki/Two-phase_commit_protocol

In transaction processing, databases, and computer networking, the two-phase commit protocol (2PC) is a type of atomic commitment protocol (ACP). It is a distributed algorithm that coordinates all the...


https://en.wikipedia.org/wiki/Transaction_log

In the field of databases in computer science, a transaction log (also transaction journal, database log, binary log or audit trail) is a history of actions executed by a database management system us...


https://redis.io/

Redis is an open source (BSD licensed), in-memory data structure store, used as a database, cache and message broker. It supports data structures such as strings, hashes, lists, sets, sorted sets with...


http://www.ipa.go.jp/files/000018652.pdf

独立行政法人 情報処理推進機構(IPA) (PDF)


http://www.oreilly.com/data/free/what-is-database-design-anyway.csp


http://web.cecs.pdx.edu/~maier/TheoryBook/TRD.html


http://people.cs.aau.dk/~csj/Thesis/

Christian S. Jensen


http://www.redbook.io


http://webdam.inria.fr/Alice/


http://www.dcs.warwick.ac.uk/~hugh/TTM/DTATRM.pdf

(PDF)


http://public.dhe.ibm.com/software/dw/db2/express-c/wiki/Database_fundamentals.pdf

(PDF)


http://www.dcs.warwick.ac.uk/~hugh/TTM/Database-Explorations-revision-2.pdf

(PDF)


http://shop.oreilly.com/product/0636920022640.do


https://github.com/justinyhuang/the-little-mongodb-book-cn