Skip to main content
Manage SQL and Kafka data sources, test connections, and crawl schemas/sample data.

Launch the UI

import panel as pn
pn.extension("tabulator")

import resinkit as rsk
ui = rsk.show_sources_ui()
ui.show()
Or via an instance:
from resinkit import Resinkit
sdk = Resinkit()
ui = sdk.ui_sources()
ui.show()

Features

  • Table of sources with name, type, database, and extra params
  • Add sources via a menu: SQLite, RDS (MySQL/Postgres/Oracle/MSSQL), Kafka
  • Test Connection before saving
  • Bulk delete selected sources
  • Crawl databases to persist DDL, DSDS, and sample CSVs locally

Adding sources

1

Open the add-source dialog

Use the + Add Source button and select a source type.
2

Fill in required fields

Choose a SQLite file from the server list. Optionally add newline-separated key=value parameters.
Provide host, port (auto-set by type), database, user, and password.
Provide connection properties (for example bootstrap.servers=<host>:<port>) and any additional properties.
Validate credentials and network access before submitting.
3

Test and submit

Use the top-right controls to Cancel, Test Connection, or Submit.

Refresh and delete

  • Use Refresh to reload the table
  • Select rows via checkbox and click Delete Selected to remove in bulk

Crawl database tables

After creating a SQL source, you can crawl it programmatically:
from resinkit.core.resinkit_api_client import ResinkitAPIClient
client = ResinkitAPIClient()
result = await client.crawl_database_tables({
  "config": {
    "source": "<source_name>",
    "tables": [{"name_regex": ".*"}]
  }
})
Crawl output is saved under get_settings().resinkit.sources_dir/<source_name>/:
  • .retrieval_metadata.json
  • per-table ddl.sql, optional sample.csv, and dsds.txt

Troubleshooting

  • Connection test errors will show inline; verify network and credentials
  • Kafka requires a valid bootstrap.servers
  • If the table is empty, check server connectivity and auth
Use small regex scopes for large catalogs when crawling to avoid long operations.