Custom Data
To evaluate synthetic data generated by external tools, use the custom_data method.
The custom_data method enables Evaluator to correctly recognize and evaluate external files as synthetic results.
Usage Examples
Click the below button to run this example in Colab:
Note: If using Colab, please see the runtime setup guide.
Synthesizer:
external_data:
method: custom_data
filepath: benchmark://adult-income_syn
schema: benchmark://adult-income_schemaThis example demonstrates custom_data usage with other modules:
- Synthesizer: Uses
custom_datato import external synthetic data - Other modules: Loader, Splitter, and Evaluator are used together for complete evaluation workflow
ℹ️
When using
custom_data, the filepath parameter supports all Loader formats, including benchmark:// protocol and regular file paths.