Documents to Delta tables in Databricks

How it works

1. 1

   Connect Databricks once

   Create a role with insert rights on one schema and paste its credentials into Holofin. Holofin creates the table on the first load; nothing else in Databricks is visible to it.

2. 2

   Send documents the way you already do

   Upload in the app, forward by email, or post to the API. Holofin classifies each file, splits bundles into documents and reads the fields of each type.

3. 3

   Query the rows

   Each field lands as one row with its confidence, the page it came from and a needs_review flag. Join it to your own tables in Databricks like any other source.

How the Databricks connector writes

The only grant Holofin needs:

-- Service principal: holofin-loader (OAuth machine-to-machine)
GRANT USE CATALOG ON CATALOG holofin TO `holofin-loader`;
GRANT USE SCHEMA, CREATE TABLE ON SCHEMA holofin.extracted TO `holofin-loader`;
GRANT MODIFY, SELECT ON SCHEMA holofin.extracted TO `holofin-loader`;

The table Holofin writes

One row per field, so a new document type never changes the table. The same columns exist in every warehouse; types follow Databricks's own names.

Query it in Databricks

Count the statements whose balances do not add up, week by week, with FILTER and GROUP BY ALL:

-- Statements whose balances do not add up, by week loaded
SELECT
  date_trunc('WEEK', loaded_at) AS week,
  count(DISTINCT document_id) AS statements,
  count(DISTINCT document_id) FILTER (
    WHERE field = 'closing_balance' AND needs_review
  ) AS balance_mismatches
FROM holofin.extracted.document_fields
WHERE document_type = 'bank_statement'
GROUP BY ALL
ORDER BY week DESC

Security

• Documents are processed in Europe, on OVHcloud servers in France certified ISO 27001.
• Holofin only ever writes to the schema you grant. It cannot read your other tables.
• Retention of the source files in Holofin is set per organization, from zero data retention to indefinite. Rows in your warehouse follow your own policies.
• GDPR: Holofin acts as your processor. No document leaves the European Union.