databunker - Secure SDK/vault for personal records/PII built to comply with GDPR

•    Go

---

Project demo is available at: https://demo.databunker.org/. Please add a ⭐star if you like our project. We live in a world where the privacy of our information is nonexistent. The EU has been working to remediate this fallacy with GDPR, and the US (California) follows with a first sparrow called CCPA.

security privacy encryption database vault application-server compliance passportjs tokenization gdpr data-protection legaltech anonymization pii data-anonymization secure-storage privacy-by-design user-consent piidata ccpa

immudb - world’s fastest immutable database

•    Go

---

immudb is a database with built-in cryptographic proof and verification. It can track changes in sensitive data and the integrity of the history will be protected by the clients, without the need to trust the server. It can operate as a key-value store or as relational database (SQL).

immutable-database immutable database key-value verification immutability pci-dss cryptographic compliance merkle-tree gdpr sensitive-data regulations tamper-evident verifiable-data-structures auditable tamperproof

TDengine - Big data platform designed and optimized for the Internet of Things

•    C

---

TDengine is an open-source big data platform designed and optimized for Internet of Things (IoT), Connected Vehicles, and Industrial IoT. Besides the 10x faster time-series database, it provides caching, stream computing, message queuing and other functionalities to reduce the complexity and costs of development and operations.

iot database monitoring time-series bigdata full-stack connected-vehicles industrial-iot time-series-database analytics real-time-analytics column-store columnar-database

Coolstorage - ORM library for .NET

•    CSharp

---

The main strength of Vici CoolStorage is the ease of use. Most ORM tools still require a lot of unneeded code to accomplish basic data persistence tasks, but Vici CoolStorage is designed to relieve the programmer from these tedious and error-prone tasks, making it very intuitive to use.

orm persistence database-development datamapper ormdotnet

mimesis - Mimesis is a fast and easy to use library for Python, which helps generate synthetic data for a variety of purposes in a variety of languages

•    Python

---

Mimesis is a fast and easy to use library for Python programming language, which helps generate synthetic data for a variety of purposes in a variety of languages. This data can be particularly useful during software development and testing. For example, it could be used to populate a testing database, create beautiful JSON and XML files, anonymize data taken from a production service, etc. You can find the complete documentation on the Read the Docs.

fake dummy data generate testing mimesis schema mock fixtures factory language locale synthetic mocking anonymize json xml bootstrap

Jailer - Database Subsetting and Browsing Tool

•    Java

---

Database Subsetting and Browsing Tool. Exports consistent, referentially intact row-sets from relational databases (JDBC). Removes data w/o violating integrity. Generates DbUnit datasets, hierarchically structured XML and topologically sorted SQL-DML.

database-tools database-administration administration database-front-end database-management database-gui

Ora2Pg - Tool used to migrate an Oracle database to a PostgreSQL compatible schema

•    Perl

---

Ora2Pg is a free tool used to migrate an Oracle database to a PostgreSQL compatible schema. It connects your Oracle database, scan it automatically and extracts its structure or data, it then generates SQL scripts that you can load into PostgreSQL.

database-tools database-migration oracle-to-postgresql postgresql-tools

Database Objects - ORM in VB6

•    VB6

---

The DatabaseObjects library is an open source tool for mapping relation database systems (MySQL, SQL Server, Microsoft Access) to an object-oriented structure. The library can simplify the development and maintenance of small and large systems by providing a mechanism to consolidate business logic, maintain data integrity, increasing productivity and minimise errors.

orm persistence database-development datamapper ormdotnet

gdpr-documents - 🇪🇺 Your Right to be Informed and Erased

•    Javascript

---

GDPR is important because it improves the protection of European data subjects' rights and clarifies what companies that process personal data must do to safeguard these rights. After one of the Equifax data breaches & one year after feared GDPR came into force, a team of lawyers decided to explore the state of data protection of European banks & credit scoring entities. At first, we researched available GDPR requests but found next to nothing. The vast majority of information advises companies on how to fend off personal data inquiries. This saddened us, as financial institutions gather massive amounts of detailed information about us. We expected that more people would want to execute their right to know. To shift this imbalance a little, we created our request templates. Currently is available "Data Access" request & Data Erase in 8 European languages.

gdpr

Dev Lake - Data lake for Dev

•    Go

---

Dev Lake brings all your DevOps data into one practical, personalized, extensible view. Ingest, analyze, and visualize data from an ever-growing list of developer tools, with our free and open source product. Dev Lake is most exciting for leaders and managers looking to make better sense of their development data, though it's useful for any developer looking to bring a more data-driven approach to their own practices. With Dev Lake you can ask your process any question, just connect and query.

devops big-data data-warehouse big-code data-source data-connectors jira github gitlab jenkins performance-metrics analytics

seqan - SeqAn's official repository.

•    C++

---

SeqAn is an open source C++ library of efficient algorithms and data structures for the analysis of sequences with the focus on biological data. Our library applies a unique generic design that guarantees high performance, generality, extensibility, and integration with other libraries. SeqAn is easy to use and simplifies the development of new software tools with a minimal loss of performance. The SeqAn library itself, the tests and demos are licensed under the very permissing 3-clause BSD License. The licenses for the applications themselves can be found in the LICENSE files.

high-performance cpp14 indexing simd alignment bwt fasta blast fastq-format bioinfomatics suffixarray sequence-alignments seqan htslib sam-bam

pg-migrator - PostgreSQL Migration Tool

•    Javascript

---

The complete and easy to use command-line migration tool for PostgreSQL. Install this globally and you'll have access to the pg-migrator command anywhere on your system.

pg postgres postgresql migrate migration migrator pg-migrate pg-migration pg-migrator patch patcher pg-patch pg-patcher db database database-migration database-migrator node-postgres node-postgresql

Open3D - Open3D: A Modern Library for 3D Data Processing

•    C++

---

Open3D is an open-source library that supports rapid development of software that deals with 3D data. The Open3D frontend exposes a set of carefully selected data structures and algorithms in both C++ and Python. The backend is highly optimized and is set up for parallelization. We welcome contributions from the open-source community. Please cite our work if you use Open3D.

cpp11 3d-vision robotics point-cloud triangle-mesh

Open3D - Open3D: A Modern Library for 3D Data Processing

•    C++

---

Open3D is an open-source library that supports rapid development of software that deals with 3D data. The Open3D frontend exposes a set of carefully selected data structures and algorithms in both C++ and Python. The backend is highly optimized and is set up for parallelization. We welcome contributions from the open-source community. For more, please visit the Open3D documentation.

visualization machine-learning arm gui opengl cpp tensorflow gpu rendering computer-graphics cuda pytorch registration reconstruction 3d odometry pointcloud mesh-processing 3d-perception

Immutable-js - Immutable persistent data collections for Javascript which increase efficiency and simplicity

•    Javascript

---

Immutable data cannot be changed once created, leading to much simpler application development, no defensive copying, and enabling advanced memoization and change detection techniques with simple logic. Persistent data presents a mutative API which does not update the data in-place, but instead always yields new updated data.

immutable persistent lazy data data-structure functional collection stateless sequence iteration

RUBRIX - Python framework to explore, label, and monitor data for NLP

•    Python

---

Rubrix is a production-ready Python framework for exploring, annotating, and managing data in NLP projects. Most annotation tools treat data collection as a one-off activity at the beginning of each project. In real-world projects, data collection is a key activity of the iterative process of ML model development. Once a model goes into production, you want to monitor and analyze its predictions, and collect more data to improve your model over time. Rubrix is designed to close this gap, enabling you to iterate as much as you need.

nlp elasticsearch data-science machine-learning natural-language-processing pytorch artificial-intelligence weak-supervision knowledge-graph developer-tools active-learning annotation-tool weakly-supervised-learning human-in-the-loop mlops text-labeling

TrailDB - Efficient tool for storing and querying series of events

•    C

---

TrailDB is a library, implemented in C, which allows you to query series of events at blazing speed. TrailDB is also optimized for speed of development: Use its simple API with your favorite language, in your favorite environment. TrailDB's secret sauce is data compression. It leverages predictability of time-based data to compress your data to a fraction of its original size. In contrast to traditional compression, you can query the encoded data directly, decompressing only the parts you need.

database data-analytics event-data big-data time-series time-series-database

sdsl-lite - Succinct Data Structure Library 2.0

•    C++

---

The Succinct Data Structure Library (SDSL) is a powerful and flexible C++11 library implementing succinct data structures. In total, the library contains the highlights of 40 research publications. Succinct data structures can represent an object (such as a bitvector or a tree) in space close to the information-theoretic lower bound of the object while supporting operations of the original object efficiently. The theoretical time complexity of an operation performed on the classical data structure and the equivalent succinct data structure are (most of the time) identical. Succinct data structures have very attractive theoretical properties. However, in practice implementing succinct data structures is non-trivial as they are often composed of complex operations on bitvectors. The SDSL Library provides high quality, open source implementations of many succinct data structures proposed in literature.

interactive-coding-challenges - Interactive Python coding interview challenges (algorithms and data structures)

•    Python

---

Overhauled to now include 120 challenges and solutions and added Anki flashcards.Also included are unit tested reference implementations of various data structures and algorithms.

algorithm data-structure development programming coding interview interview-questions interview-practice competitive-programming

Code for Rapid C# Windows Development eBook + LINQPad and Data Tools

•    CSharp

---

The worked example in Joseph Chancellor's book 'Rapid C# Windows Development' which uses LLBLGen Pro with the Adventure Works database. It also contains an Enumerable Debugger Visualizer, Databound TreeView control, LINQPad DataEditor, Data Browser and LLBL Data Context driver.

llblgen adventureworks codegen debugger-visualizer orm