Data Ingestion Setup

• Connector Configuration: Define sources in ingestion-config.yml:

  sources:
    - name: binance-spot
      type: rest
      endpoint: https://api.binance.com
      pairs: ["BTC-USD", "ETH-USD"]
    - name: eth-mainnet
      type: rpc
      endpoint: https://mainnet.infura.io/v3/<key>

• Pipeline Deployment:

  orient-cli data ingest --config ingestion-config.yml

• Monitoring: Check ingestion status and lag metrics:

  orient-cli data status --source binance-spot