For the scraper team

How to send cars to Ross Auto

This page shows how to upload your scraped cars to our server. Start with the four steps. The rest of the page is detail you can look up when you need it.

Server is live Keys come to you in a separate, private message
Address
POST https://push.rossauto.ca/v1/push
Format
One car per line (NDJSON), or a JSON list
Size
Up to 100 MB per upload
Keys
One key per website, 18 in total
Server status
GET https://push.rossauto.ca/health
This guide
https://push.rossauto.ca/docs

Four steps to start

  1. Get your keysWe send you 18 keys, one for each website, in a private message. Keep them secret: not in your code, not in your logs.
  2. Send a small testPick 10 to 50 cars from one website that you already sent us in the files before. Upload them with the command below.
  3. Wait for our OKWe check that we recognise those cars. That proves your listing numbers match ours.
  4. Send everythingAfter our OK, send all cars from all websites, as often as you scrape. The keys do not expire.

How to send one upload

Every upload is one HTTPS request with three headers and your cars in the body.

Authorization: Bearer YOUR-KEYThe key of the website these cars come from.
Content-Type: application/x-ndjsonOne car per line. For a JSON list, use application/json.
Idempotency-Key: copart-ca-2026-09-28-0400-part-1A name you give this upload. See rule 7 below.
Body: your carsExactly as your scraper saves them. Do not change the fields.
Copy and run
curl -sS https://push.rossauto.ca/v1/push \
  -H "Authorization: Bearer $INGEST_KEY_COPART_CA" \
  -H "Content-Type: application/x-ndjson" \
  -H "Idempotency-Key: copart-ca-test-1" \
  --data-binary @test-cars.ndjson

Use --data-binary, not -d. With -d, curl removes the line breaks and the upload fails.

Seven rules

  1. Maximum 100 MB per upload.Split a bigger file into parts. Each part is its own upload, and the parts can arrive in any order.
  2. One upload at a time for each website.Wait for our reply before you send the next part.
  3. Every car needs its listing number and its listing link.The listing number is how we recognise a car we already have. Buyers see it on our site as the "Source number".
  4. Never change the format of the listing number.If it changes, every car looks new to us and is added a second time. If you must change it, tell us first.
  5. Send the cars exactly as your scraper produces them.Do not rename, clean or remove fields. We convert the data on our side.
  6. Sending the same car again is good.It tells us the car is still for sale. A car that is missing from every upload for 90 days is removed from our site.
  7. Give every upload its own name (Idempotency-Key).If an upload fails or times out, send it again with the same name, and we will not save it twice. A new upload always gets a new name. Never reuse a name from an earlier day: we would think it is the old upload and skip it. A good name is the website, the date and time of the scrape run, and the part number.

What our reply means

ReplyMeaningWhat you do
202 or 200We received it.Nothing. Keep the batchId from the reply.
400The file is broken. The reply says which line.Fix the file, then send it again.
401The key is wrong or missing.Check you used the key of this website.
413The upload is bigger than 100 MB.Split it into parts.
503We are busy with other uploads.Wait 30 seconds. Send it again with the same name.
500A problem on our side.Wait a few minutes. Send it again with the same name.

A 202 means we received the upload. It does not mean every car in it was good: we check the cars after that. If we find a problem, we tell you, with the batchId and some example cars.

Sending a big file

A website with more than 100 MB of cars is sent in parts. This Python example splits a file, names each part, and sends it again when our reply says to.

Show the Python example
Python
import os, time
from datetime import datetime, timezone

import requests

URL = "https://push.rossauto.ca/v1/push"
WEBSITE = "copart-ca"
KEY = os.environ["INGEST_KEY_COPART_CA"]
RUN = datetime.now(timezone.utc).strftime("%Y-%m-%d-%H%M")   # when this scrape run started
PART_SIZE = 90 * 1024 * 1024                                # under the 100 MB limit


def send(body, part):
    name = f"{WEBSITE}-{RUN}-part-{part}"                    # same name on every retry
    for attempt in range(1, 9):
        try:
            reply = requests.post(URL, data=body, timeout=600, headers={
                "Authorization": f"Bearer {KEY}",
                "Content-Type": "application/x-ndjson",
                "Idempotency-Key": name,
            })
        except requests.RequestException:
            time.sleep(30 * attempt)                         # no reply: try again
            continue
        if reply.status_code in (200, 202):
            return reply.json()["batchId"]
        if reply.status_code == 503 or reply.status_code >= 500:
            time.sleep(30 * attempt)                         # busy, or our problem: try again
            continue
        raise RuntimeError(f"{reply.status_code}: {reply.text}")  # 400, 401, 413: fix first
    raise RuntimeError(f"part {part}: no success after 8 tries")


def send_file(path):
    part, lines, size = 1, [], 0
    with open(path, "rb") as file:
        for line in file:
            if lines and size + len(line) > PART_SIZE:
                print(part, send(b"".join(lines), part))
                part, lines, size = part + 1, [], 0
            lines.append(line)
            size += len(line)
    if lines:
        print(part, send(b"".join(lines), part))

Which key is for which website

The key values come in a private message, not on this page. This table only shows which key belongs to which website.

WebsiteKey name

Please answer these four questions

  1. How often will you send each website?Every hour, a few times a day, once a day, or not fixed. A rough answer is fine.
  2. Does one upload contain all cars of a website, or only new and changed cars?This decides how we treat a car you stop sending.
  3. Can you tell us when a car is sold or removed?Yes with the reason, yes without the reason, or no. All three are fine; we just need to know which.
  4. For Bring a Trailer and First Choice, can you send make and model as separate fields?Not urgent. Today we read them from the title.