<div align="center"> <p> <a href="https://www.hongbomiao.com"><img width="100" src="https://github.com/hongbo-miao/hongbomiao.com/assets/3375461/650b632a-383f-4e84-8227-bf1fac268d45" alt="Butterfly" /></a> </p> <h2>Personal R&D Lab</h2> <p>Making magic happen</p> <br /> <p> <a href="https://github.com/hongbo-miao/hongbomiao.com/actions"><img alt="GitHub Actions" src="https://img.shields.io/github/actions/workflow/status/hongbo-miao/hongbomiao.com/build.yml?branch=main" /></a> <a href="https://depfu.com/github/hongbo-miao/hongbomiao.com?project_id=29781"><img alt="Depfu" src="https://badges.depfu.com/badges/e337a1462a48dbcb803c98b5b2157aa7/overview.svg" /></a> <a href="https://stats.uptimerobot.com/RoOoGTvyWN"><img alt="Uptime Robot status" src="https://img.shields.io/uptimerobot/status/m783305207-c7842815153e530df85633fe" /></a> <a href="https://www.http3check.net/?host=hongbomiao.com"><img alt="HTTP/3" src="https://img.shields.io/badge/http%2F3-supported-brightgreen" /></a> <a href="https://hstspreload.org/?domain=www.hongbomiao.com"><img alt="Chromium HSTS preload" src="https://img.shields.io/hsts/preload/www.hongbomiao.com" /></a> <a href="https://github.com/commitizen/cz-cli"><img alt="Commitizen friendly" src="https://img.shields.io/badge/commitizen-friendly-brightgreen.svg" /></a> </p> <p> <a href="https://goreportcard.com/report/github.com/hongbo-miao/hongbomiao.com/api-go"><img alt="Go Report Card" src="https://goreportcard.com/badge/github.com/hongbo-miao/hongbomiao.com/api-go" /></a> <a href="https://observatory.mozilla.org/analyze/www.hongbomiao.com"><img alt="Mozilla Observatory grade" src="https://img.shields.io/mozilla-observatory/grade/www.hongbomiao.com" /></a> <a href="https://app.codacy.com/gh/hongbo-miao/hongbomiao.com/dashboard"><img alt="Codacy grade" src="https://img.shields.io/codacy/grade/dc922acc14014b4abc978afd0810e56b" /></a> <a href="https://codeclimate.com/github/hongbo-miao/hongbomiao.com"><img alt="Code Climate maintainability" src="https://img.shields.io/codeclimate/maintainability/hongbo-miao/hongbomiao.com" /></a> <a href="https://codeclimate.com/github/hongbo-miao/hongbomiao.com/trends/technical_debt"><img alt="Code Climate technical debt" src="https://img.shields.io/codeclimate/tech-debt/hongbo-miao/hongbomiao.com" /></a> </p> <p> <a href="https://hitsofcode.com/github/hongbo-miao/hongbomiao.com/view?branch=main"><img alt="Code hits" src="https://hitsofcode.com/github/hongbo-miao/hongbomiao.com?branch=main&label=code%20hits" /></a> <a href="https://github.com/hongbo-miao/hongbomiao.com"><img alt="Code lines" src="https://img.shields.io/endpoint?url=https://gist.githubusercontent.com/hongbo-miao/ecff3e2b8226a5c1406b0c2e2622e968/raw/code_line_count.json" /></a> <a href="https://github.com/hongbo-miao/hongbomiao.com"><img alt="Code size" src="https://img.shields.io/github/languages/code-size/hongbo-miao/hongbomiao.com" /></a> <a href="https://github.com/hongbo-miao/hongbomiao.com/graphs/contributors"><img alt="Commit activity" src="https://img.shields.io/github/commit-activity/y/hongbo-miao/hongbomiao.com"></a> </p> <p> <a href="https://codecov.io/gh/hongbo-miao/hongbomiao.com"><img alt="Codecov" src="https://img.shields.io/codecov/c/github/hongbo-miao/hongbomiao.com" /></a> <a href="https://github.com/prettier/prettier"><img alt="Code style" src="https://img.shields.io/badge/code_style-prettier-ff69b4.svg" /></a> <a href="https://github.com/psf/black"><img alt="Code style" src="https://img.shields.io/badge/code%20style-black-000000.svg" /></a> <a href="https://github.com/hongbo-miao/hongbomiao.com/blob/main/LICENSE"><img alt="License" src="https://img.shields.io/github/license/hongbo-miao/hongbomiao.com" /></a> </p> <p> <a href="https://twitter.com/hongbo_miao"><img alt="X follow" src="https://img.shields.io/twitter/follow/hongbo_miao?label=Follow&style=social" /></a> <a href="https://github.com/hongbo-miao"><img alt="GitHub follow" src="https://img.shields.io/github/followers/hongbo-miao?label=Follow&style=social" /></a> </p> <p> <a href="https://www.chromatic.com/builds?appId=5d626a63a601530020759b10"><img alt="Storybook" src="https://cdn.jsdelivr.net/gh/storybookjs/brand@master/badge/badge-storybook.svg" /></a> </p> </div>

🪴 Project Activity

Repobeats analytics

👩‍🚀 Introduction

A personal research and development (R&D) lab that facilitates the sharing of knowledge.

🚀 Architecture

The diagram illustrates the repository's architecture, which is considered overly complex. It is essential to thoroughly understand the tradeoffs associated with before onboarding any technology into your project.

(The diagram here may take a moment to load. Please wait patiently.)

Architecture

📦 Setup

make kubernetes-set-up

make kubernetes-clean

🧱 Tech Stack

Web

React - Web framework
Redux - State container
React Query - Hooks for fetching, caching and updating asynchronous data
redux-observable - Side effects
RxJS - Asynchronous programming with observable streams
graphql-tag - GraphQL query parsing
Bulma - CSS framework
PurgeCSS - Unused CSS removing
Jest - Unit testing, snapshot testing
React Testing Library - React component testing
Storybook - Visual testing
- Chromatic - Storybook reviewing
rxjs/testing - Marble testing
Cypress - End-to-end testing
Lighthouse CI - Performance, accessibility, search engine optimization (SEO), progressive web app (PWA) analysis
Sentry - Error tracking
Report URI - Security reporting
Google Tag Manager - Tag management
Google Analytics - Web analytics
FullStory - Experience analytics, session replay, heatmaps
Namecheap - Domain
Cloudflare - DNS, DDoS protection, CDN
HTTP/3 Check - HTTP/3 checking
hstspreload.org - HSTS checking
Mozilla Observatory - Security monitoring
UptimeRobot - Uptime monitoring

Mobile - iOS

SwiftUI - UI framework
XCTest - Unit testing, performance testing
Slather - Code coverage reports generating

Mobile - Android

AndroidX - Android Jetpack
JUnit - Unit testing, instrumented testing

Mobile - React Native

Expo - Universal native apps making platform
React Native - Mobile application framework
UI Kitten - UI library
React Native Testing Library - React Native component testing

Desktop - Qt

Qt Quick - Cross-platform application development framework
QML - Qt modeling language

API Server - Go

Gin - Web framework
gRPC - Remote procedure call (RPC) framework
graphql-go - GraphQL
jwt-go - JSON Web Token (JWT)
gin-contrib/cors - Cross-Origin Resource Sharing (CORS)
opa - Open Policy Agent
dgo - Dgraph client
minio-go - MinIO client
go-redis - Redis client
pgx - PostgreSQL driver
Resty - HTTP client
Squirrel - SQL query builder
apm-agent-go - Application performance monitoring (APM) agent
OpenTelemetry Go - OpenTelemetry
Prometheus Go - Prometheus
Testify - Unit testing
GoDotEnv - Environment variables loading
jsonparser - JSON parser
zerolog - Logging

API Server - Python

Flask - Web framework
Flask-CORS - Cross-Origin Resource Sharing (CORS)
Gunicorn - Python web server gateway interface (WSGI) HTTP server
asyncpg - PostgreSQL client
Tenacity - General-purpose retrying library
pytest - Unit testing
pydantic - Data validation
HTTPX - HTTP client
pypdf - PDF library
Poetry - Python package management
- Poe the Poet - Poetry task runner

API Server - Node.js

Express - Web framework
GraphQL.js, express-graphql - GraphQL
- graphql-ws, graphql-subscriptions - GraphQL subscriptions
- graphql-upload - GraphQL upload
- graphql-shield - GraphQL permissions
- graphql-depth-limit - GraphQL depth limit
- graphql-query-complexity - GraphQL query complexity analysis
DataLoader - Batching and caching
Knex.js - SQL query builder
node-postgres - PostgreSQL client
ioredis - Redis client
rate-limiter-flexible - Rate limiting
expressjs/cors - Cross-Origin Resource Sharing (CORS)
csurf - CSRF protection
jsonwebtoken, express-jwt - JSON Web Token (JWT)
bcrypt - Password hashing
axios - HTTP client
Helmet - HTTP header Content-Security-Policy, Referrer-Policy, Strict-Transport-Security, X-Content-Type-Options, X-DNS-Prefetch-Control, X-Download-Options, X-Frame-Options, X-Permitted-Cross-Domain-Policies, X-XSS-Protection
Report To - HTTP header Report-To
Network Error Logging - HTTP header NEL
express-request-id - HTTP header X-Request-ID
response-time - HTTP header X-Response-Time
connect-timeout - Request timeout
Terminus - Health check and graceful shutdown
pino - Logging
dotenv-flow - Environment variables loading
Stryker - Mutation testing
SuperTest - HTTP testing
autocannon - HTTP benchmarking
Clinic.js - Performance profiling
Node.js - JavaScript runtime
npm - JavaScript package management

Cloud Native

Sealed Secrets - Kubernetes secret encrypting
ExternalDNS - Kubernetes services and Ingresses exposing
cert-manager - Kubernetes X.509 certificate management
Hasura - GraphQL Engine
- hasura-metric-adapter - Hasura GraphQL Engine metric adapter
Linkerd - Service mesh
Caddy - Web server, reverse proxy, load balancer
Traefik - Web server, reverse proxy, load balancer
nginx - Web server, reverse proxy, load balancer
Metrics Server - Kubernetes metrics
Elastic APM - Application performance monitoring
OpenTelemetry - Observability framework
Jaeger - Distributed tracing system
Netdata - Distributed monitoring platform
Telegraf - Plugin-driven server agent
Thanos - Highly available Prometheus setup with long-term storage capabilities
Pixie - Observability tool for Kubernetes applications
Docker - Container
Skaffold - Continuous development for Kubernetes applications
Multipass - VM management
Locust - Load testing
Cloudflare Tunnel - Tunneling
Vertical Pod Autoscaler - Kubernetes vertical pod autoscaler
K3s - Lightweight Kubernetes
containerd - Container runtime
Kubernetes - Container-orchestration system

Data

Database, Data Warehouse, Data Lakehouse

Trino - Distributed SQL query engine
PostgreSQL - Object-relational database
- Postgres Operator - PostgreSQL high-availability (HA) template
- Postgres Operator - PostgreSQL cluster provisioning
- pgAdmin - PostgreSQL management tool
MySQL - Relational database
- MariaDB - Fork of MySQL
Hydra - Column-oriented SQL database
ClickHouse - Column-oriented SQL database
YugabyteDB - Distributed SQL database
TimescaleDB - Time-series SQL database
InfluxDB - Time-series database
- InfluxDB Enterprise - Distributed time-series database
Prometheus - Time-series database
Loki - Log aggregation system
Apache Cassandra - Distributed wide-column NoSQL database
Qdrant - Distributed vector database
Chroma - Distributed vector database
Dgraph - Distributed graph database
Elasticsearch - Distributed document-oriented search engine
- Kibana - Elasticsearch visualization
Redis - Distributed in-memory key–value database
- KeyDB - Multithreaded fork of Redis
MinIO - Object storage
Apache ZooKeeper - Distributed coordination system
Apache Hadoop - Software utility collection
- Apache Hadoop HDFS (Distributed File System) - Distributed file system
- Apache Hadoop YARN (Yet Another Resource Negotiator) - Resource management and job scheduling framework
- Apache Hadoop MapReduce - Data processing framework
Apache Hive - Distributed data warehousing and SQL-like query language system built on top of Apache Hadoop
Delta Lake - Data lakehouse
Snowflake - Data warehouse
golang-migrate/migrate - Database migrations

Data Ingestion

Airbyte - Data integration
Vector - Log collector
Fluent Bit - Log collector

Data Orchestration

Prefect - Orchestration platform
Apache Airflow - Orchestration platform
Temporal - Orchestration platform

Data Processing

Apache Spark - Data processing framework
- Spark ML - Spark machine learning
- pyspark - Spark API library
- Delight - Spark UI and history server
Apache Sedona - Spatial data processing framework
Apache Flink - Data processing framework
- flink-streaming-java - Flink
- flink-connector-twitter - Flink Twitter connector
- flink-connector-jdbc - Flink JDBC Connector
- flink-connector-redis - Flink Redis connector
Apache Kafka - Distributed event streaming platform
- Client
  - librdkafka - Kafka C/C++ client
    - libserdes - AVRO serialization and deserialization
  - confluent-kafka - Kafka Python client
- Schema registry
  - Confluent Schema Registry - Schema Registry