Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Xsystem Analyzer and Label Analyzer did not work when enabled #69

Open
snowgy opened this issue Dec 5, 2023 · 2 comments
Open

Xsystem Analyzer and Label Analyzer did not work when enabled #69

snowgy opened this issue Dec 5, 2023 · 2 comments
Assignees

Comments

@snowgy
Copy link
Collaborator

snowgy commented Dec 5, 2023

I was trying to use xsystem analyzer and label analyzer to label spatial-temporal attributes. I modified profile_schema.yml to enable both analyzers. However, when I ran ddprofiler, the output profiles did not contain new fields such as columnLabel or xstructure. I attached the csv file I used to test. In this dataset, dna_sample_timestamp should be labeled as datetime and location should be labeled as geo-coordinate.

2ivx-z93u.csv

@snowgy snowgy changed the title Xsystem Analyzer and Label Analyzer do not work when enabled Xsystem Analyzer and Label Analyzer did not work when enabled Dec 5, 2023
@luthfibalaka
Copy link
Contributor

luthfibalaka commented Feb 23, 2024

Is there a way to extend Xsystem to recognize more format for each type?

For instance, columns in the format format {'type': 'Point', 'coordinates': [a, b]} are not recognized as locations, whereas (a, b) is. Or, do we need to create regex patterns for that?

@snowgy
Copy link
Collaborator Author

snowgy commented Feb 23, 2024

yes. you can extend Xsystem to support this.

In ddprofiler/app/src/test/java/ddprofiler/analysis/modules/LabelAnalyzerTest.java#L4, there is a path to the regex reference file. Adding more regex expressions to that file should work

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants