Sources & Attribution

The following sources, articles, libraries, etc. were used or referenced in the creation of MADI. Not all elements are included in the current product.

• Graphs

  • Spinning Around In Cycles With Directed Acyclic Graphs
  • Aura in GCP

• Vector Storage

  • Big Query Emulator
  • Postgres Vector Options
  • Euclidean vs Cosine Similarity
  • OpenAI Embeddings
  • Redis Example
  • Redis Support in Memorystore
  • Weaviate and Docker

• Running Python

  • Jupyter Notebooks in VsCode
  • Speeding up Python with Tuplex

• Running in JS

  • Hello Danfo: Pandas for Javascript, from Tensorflow
  • Open Neural Network Exchange
  • Running transformers in JS

• Vector Math & Functions

  • FAISS for similarity and dense vector search
  • Typesense
  • Question Answering Guide
  • Bigquery vector ANN
  • Find anything Fast on Matching Engine
  • Scalable realtime vector search

• API automation

  • Chai OpenAPI response validator
  • OpenAPI tools
  • Portman
  • Postman's own openAPI converter
  • OpenAPI generator
  • Discriminators

• Mural Automation

  • Automatically sign in with Google using Puppeteer

• AutoGPT Options

  • Relatedly: Scaffolding Literature Reviews with Existing Related Work Sections

• Interface Options

  • https://github.com/Yidadaa/ChatGPT-Next-Web
  • https://github.com/wieslawsoltes/ChatGPT
  • https://github.com/ztjhz/BetterChatGPT
  • https://github.com/AidanGuarniere/myChat
  • https://github.com/enricoros/big-agi
  • https://github.com/nemoteric/GPT-4-Chat-UI (very simple)

• Images

  • Robot icons created by Freepik - Flaticon

• Unlisted

  • PostgreSQL Graph Search Practices - 10 Billion-Scale Graph with Millisecond Response - Alibaba Cloud Community
  • [Project] pgANN Fast Approximate Nearest Neighbor (ANN) searches with a PostgreSQL database. : MachineLearning
  • netrasys/pgANN: Fast Approximate Nearest Neighbor (ANN) searches with a PostgreSQL database.
  • expert/postgresql-large-cube - Docker Image | Docker Hub
  • change cube dimesions from 100 via postgres cli - Google Search
  • expert/postgresql-large-cube - Docker Image | Docker Hub
  • "CUBE_MAX_DIM" cloud sql - Google Search
  • 11 Dimensionality reduction techniques you should know in 2021 | by Rukshan Pramoditha | Towards Data Science
  • machine learning - How to export PCA to use in another program - Data Science Stack Exchange
  • OpenAI’s Embeddings with Vector Database | Better Programming
  • nlp - Which dimensionality reduction technique works well for BERT sentence embeddings? - Stack Overflow
  • Dimension reduction by whitening BERT/ Roberta. | by deepankar | Medium
  • Topic Modelling using LDA and LSA in Sklearn | Kaggle
  • Embeddings - OpenAI API
  • openai-cookbook/examples/vector_databases/redis at main · openai/openai-cookbook
  • Working with Jupyter Notebooks in Visual Studio Code
  • goccy/bigquery-emulator: BigQuery emulator server implemented in Go
  • python - Convert JSON IPython notebook (.ipynb) to .py file - Stack Overflow
  • www.codegpt.co
  • Fine-tuning - OpenAI API
  • How to Speed up Python Data Pipelines up to 91X?
  • pythonexamples.org
  • javascript - Node console.log on large array shows "... 86 more items" - Stack Overflow
  • python - HTTPError: HTTP Error 429: Too Many Requests with WIKI pages - Stack Overflow
  • Fine-tuning - OpenAI API
  • openai-cookbook/examples/fine-tuned_qa at main · openai/openai-cookbook
  • openai/chatgpt-retrieval-plugin: The ChatGPT Retrieval Plugin lets you easily search and find personal or work documents by asking questions in everyday language.
  • bigquery euclidean distance - Google Search
  • dotenv - npm
  • openai-openapi/openapi.yaml at master · openai/openai-openapi
  • ceifa/tiktoken-node: OpenAI's tiktoken but with node bindings
  • openai-cookbook/Question_answering_using_embeddings.ipynb at main · openai/openai-cookbook
  • OpenAI GPT2
  • JavaScript | onnxruntime
  • @xenova/transformers - npm
  • Xenova/transformers.js at main
  • redis.io
  • Matching Engine ANN service overview  |  Vertex AI  |  Google Cloud
  • Find anything blazingly fast with Google's vector search technology | Google Cloud Blog
  • Your Google Cloud database options, explained | Google Cloud Blog
  • Database versions and version policies  |  Cloud SQL for PostgreSQL  |  Google Cloud
  • stoplightio/prism: Turn any OpenAPI2/3 and Postman Collection file into an API server with mocking, transformations and validations.
  • Pricing | Pinecone
  • Real Time Deep Learning Vector Similarity Search | Google Cloud - Community
  • tensorflow serving cloudrun - Google Search
  • Embeddings - OpenAI API
  • openai-cookbook/Semantic_text_search_using_embeddings.ipynb at main · openai/openai-cookbook
  • New and improved embedding model
  • Recommendation Systems with Deep Learning | by Sascha Heyer | Google Cloud - Community | Medium
  • How To Deploy ML Models With Google Cloud Run - Python Engineer
  • Embeddings - OpenAI API
  • openai-cookbook/Using_vector_databases_for_embeddings_search.ipynb at main · openai/openai-cookbook
  • ann index that can be atomically updated - Google Search
  • The ANN-tree: an index for efficient approximate nearest neighbor search - Database Systems for Advanced Applications, 2001. Proceedings. Seventh International Conference on
  • nmslib/hnswlib: Header-only C++/python library for fast approximate nearest neighbors
  • Google Cloud console
  • Redis Enterprise Cloud Pricing | Redis
  • Enterprise Support Policies | Redis
  • DALL·E 2 vs Midjourney vs Stable Diffusion | by Anjana Samindra Perera | MLearning.ai | Medium
  • faiss - HNSW index on BigQuery - Stack Overflow
  • Introduction to search in BigQuery  |  Google Cloud
  • Hierarchical Navigable Small Worlds (HNSW) | Pinecone
  • txtai/43_Embeddings_in_the_Cloud.ipynb at master · neuml/txtai
  • Optimizing full text search in Postgres and BigQuery | Part 2 of Optimized Analytics Applications • Supertype
  • Manage search indexes  |  BigQuery  |  Google Cloud
  • Search functions  |  BigQuery  |  Google Cloud
  • nmslib/hnswlib: Header-only C++/python library for fast approximate nearest neighbors
  • rdrr.io
  • HNSWPostgresIndexer | latest | Jina AI Cloud
  • BigQuery cookbook - Analytics Help
  • pickle — Python object serialization — Python 3.11.3 documentation
  • python use pickle as column in bigquery - Google Search
  • Crawlee as Puppeteer abstraction
  • Installing node-canvas
  • pkg-config not found on m1
  • ARticle Extraction Lib
  • Archive.today extractor
  • Bypass paywalls by domain
  • Got-Scraping use
  • Proxy option ScrapeStack
  • Proxy option ProxiesAPI
  • Proxy option Crawlbase
  • Scraping Detection Research