# Compare Two Avro Files

> Compare two Avro files by a key field and list the added, removed and changed records. Reads the embedded schema, runs in your browser. Free.

Page: https://datautility.in/compare-avro-files
This is the Markdown copy of the page. The tool itself runs in the browser: your files are processed on your own device and are not uploaded.

**Quick answer:** Compare two datasets and see what was added, removed or changed.

## How to use the Compare Two Avro Files

Data Comparison shows exactly what changed between two versions of a file. Pick a key column, or use the first column or the first two columns, and it lists rows that were added, removed or changed, down to the cell. Use it to check an export against last month, to review a data migration, or to find which values a script changed. CSV, Excel, JSON, Parquet and Avro are supported, and the two files can be different formats.

1. Load dataset A and B
2. Pick or type the key column
3. Review and download the differences

## What it does

- See rows added, removed or changed
- Down to the cell
- Pick any key column
- Download the differences

## Tips

- A key column (like id) matches the same record in both files. Click Use first column as key, pick columns, or type their names.
- If you choose no key, the first two columns of the files are used as the key.
- Numbers match by value, so 36 and 36.0 are treated as equal. Dates match across formats too: a text date, an Excel date and a Parquet timestamp at midnight are the same value.
- Comparing different formats? Columns whose names differ only by case or punctuation (address.city in a CSV and address_city in an Avro file, which cannot hold dots) are matched, and the page tells you which.
- Use “Ignore case” or “Ignore spaces” to skip trivial differences.

## Comparing Avro by record

Avro files carry their schema, so the tool reads the field names and types from the file and shows each record as a row. Pick a key field, such as an event id, and it lists the records that were added, removed or changed between two files, for example two days of an event log or a topic exported before and after a change.

Nested records, arrays and maps are flattened into columns, and date and timestamp types are read as dates.

## Field names

Avro does not allow a dot in a field name, so a nested field such as address.city is stored as address_city. When you compare an Avro file with a CSV or JSON file, columns that differ only by case or punctuation are matched automatically, and the page lists the matches so nothing is hidden.

- [Open an Avro file](https://datautility.in/avro-viewer-online)
- [Avro to CSV](https://datautility.in/avro-to-csv)

## Example

Input:

```
events-1.avro + events-2.avro, key = event_id
```

Output:

```
Added 3 · Removed 2 · Changed 5
```

## Frequently asked questions

### How do I compare two Avro files?
Load both .avro files, choose a key field and read the added, removed and changed records. The schema is read from the file, and nested records are flattened into columns.

### Which Avro files can it read?
Files with no compression or with deflate. Nested records, arrays, maps, enums, unions and date and timestamp types are read.

### Why does an Avro column name use an underscore where my CSV has a dot?
Avro field names cannot contain dots, so address.city is stored as address_city. When you compare Avro with another format, columns that differ only by case or punctuation are matched and the page tells you which.

### Which file formats can I compare?
CSV, TSV, Excel (.xlsx), JSON, Parquet and Avro, in any combination. For example, compare a Parquet file with the CSV it was made from. Nested JSON and Avro fields are flattened into columns such as address.city.

### Will 10 in a CSV match 10 in a Parquet file?
Yes. Values are compared by meaning, not by how they are written: 10 equals 10.0, true equals "true", and a date equals the same date in any format. A value only counts as changed if it really differs.

### Can Data Comparison do change data capture (CDC)?
It does the snapshot version of CDC for files. Compare the earlier and the latest export by key: added rows are inserts, changed rows are updates and removed rows are deletes. It does not read database logs or run in real time.

### How does Data Comparison find differences?
It matches rows by a key column, or by the first two columns, and shows which rows were added, removed or changed, down to the cell. It works with CSV and Excel files.

### Is my data uploaded?
No. Everything runs in your browser and nothing is stored.

## Related pages

- [Data Comparison (CSV and Excel Diff)](https://datautility.in/data-comparison): Compare two CSV, Excel, JSON, Parquet or Avro files by a key column. See inserts, updates and deletes (CDC), cell by cell. Free, in your browser.
- [Compare Two CSV Files](https://datautility.in/compare-two-csv-files): Compare two CSV or Excel files by a key column and see added, removed and changed rows. Free, runs in your browser.
- [Compare Two Excel Files](https://datautility.in/compare-excel-files): Compare two Excel (.xlsx) files by a key column and see every added, removed and changed row and cell. Free, and your files stay in your browser.
- [Compare Two Parquet Files](https://datautility.in/compare-parquet-files): Compare two Parquet files by a key column and see every added, removed and changed row and cell. Free, runs in your browser, nothing is uploaded.
- [Compare Two JSON Files](https://datautility.in/compare-json-files): Compare two JSON files by a key field and see which records were added, removed or changed, down to the nested field. Free, in your browser.
- [Compare CSV with Parquet](https://datautility.in/compare-csv-with-parquet): Check that a Parquet file matches the CSV it was made from: find rows and values that differ after a conversion or migration. Free, in your browser.
- [CSV Diff Tool](https://datautility.in/csv-diff): Find the differences between two CSV files online: which rows were added, removed or changed, cell by cell. Free, in your browser.
- [CDC for CSV and Excel Files (Change Data Capture)](https://datautility.in/change-data-capture-csv): Change data capture for files: compare two CSV or Excel snapshots and list inserts, updates and deletes by key. Free, private, runs in your browser.

## Topic guides

- [Avro Guides and Free Avro Tools](https://datautility.in/guides/avro)
- [Data Cleaning Guides and Free Tools](https://datautility.in/guides/data-cleaning)

## Guides

- [Compare Two CSV or Excel Files: Find Added, Removed and Changed Rows](https://datautility.in/blog/compare-two-csv-files-find-differences)
- [Compare Two Financial Files: A Simple Reconciliation](https://datautility.in/blog/compare-financial-reports-reconciliation-files)
- [How to Compare Two JSON API Responses](https://datautility.in/blog/compare-json-api-responses)
- [Compare Inventory and Stock Files Between Two Dates](https://datautility.in/blog/compare-inventory-and-stock-files)

Open the tool: https://datautility.in/compare-avro-files
