Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

mt test #835

Closed
wants to merge 100 commits into from
Closed

mt test #835

wants to merge 100 commits into from

Conversation

touma-I
Copy link
Collaborator

@touma-I touma-I commented Nov 26, 2024

Why are these changes needed?

Testing Ci/CD after update from dev.

Related issue number (if any).

blublinsky and others added 30 commits October 10, 2024 19:05
@blublinsky
added folder_transform
47f4526
@blublinsky
added folder_transform
5fd20a1
@blublinsky
added folder_transform
38b4725
@blublinsky
added folder_transform
a3abf21
@cmadam
Merge branch 'folder_transform' into fuzzy-dedup
d93a06c
@cmadam
Fuzzy dedup pure python implementation
af8475d 
Signed-off-by: Constantin M Adam <[email protected]>
@cmadam
Fuzzy dedup spark implementation
7f9b503 
Signed-off-by: Constantin M Adam <[email protected]>
@blublinsky
added folder_transform
3349521
@blublinsky
added folder_transform
0553edf
@blublinsky
added folder_transform
a53412e
@blublinsky
added folder_transform
9c3ace7
@blublinsky
added noop testing
7091a2e
@Kibnelson
Fuzzy dedup ray implementation
680c78a 
Signed-off-by: nelson <[email protected]>
@Kibnelson
Fixed bug in ray to distribute docs to remove file to all workers
0c31dc0 
Signed-off-by: nelson <[email protected]>
@cmadam
Merge with updated folder_transform branch
47d8fdf 
Signed-off-by: Constantin M Adam <[email protected]>
@blublinsky
added folder_transform
6ee6695
@blublinsky
added folder_transform
e7260ba
@blublinsky
added folder_transform
5856f3f
@blublinsky
added folder_transform
6519686
@blublinsky
added noop testing
c728224
@blublinsky
added noop Ray testing
6e2863a
@blublinsky
added noop Spark testing
3c9be57
@blublinsky
more data access simplifications
371a712
@cmadam
Renamed/refactored fuzzy dedup python orchestrator
680f313 
Signed-off-by: Constantin M Adam <[email protected]>
@cmadam
Rewrote cluster_analysis_transform as a folder_transform
c29d3bf 
Signed-off-by: Constantin M Adam <[email protected]>
@cmadam
Wrote get_duplicate_list_transform as a folder_transform
aada59e 
Signed-off-by: Constantin M Adam <[email protected]>
@cmadam
Added text preprocessing
2019d56 
Signed-off-by: Constantin M Adam <[email protected]>
@cmadam
Added python test data
9362803 
Signed-off-by: Constantin M Adam <[email protected]>
@cmadam
Added project admin tools
ddbd602 
Signed-off-by: Constantin M Adam <[email protected]>
@cmadam
Bug fix
4dac838 
Signed-off-by: Constantin M Adam <[email protected]>
cmadam and others added 21 commits November 14, 2024 12:38
@cmadam
Add FIXME for kubeflow/pipelines#10914
fffb630 
Signed-off-by: Constantin M Adam <[email protected]>
@cmadam
Add FIXME for kubeflow/pipelines#10914
5547d7f 
Signed-off-by: Constantin M Adam <[email protected]>
@cmadam
Remove pyproject.toml dependencies
09e56e0 
Signed-off-by: Constantin M Adam <[email protected]>
@cmadam
Fix bug in number of actors calculation
d3eac50 
Signed-off-by: Constantin M Adam <[email protected]>
@cmadam
Cleanup main entry point and local implementation of python transforms
fa5959b 
Signed-off-by: Constantin M Adam <[email protected]>
@cmadam
Cleanup main entry point and local implementation of ray transforms
c4f889b 
Signed-off-by: Constantin M Adam <[email protected]>
@cmadam
Cleanup main entry point and local implementation of spark transforms
f3c5be0 
Signed-off-by: Constantin M Adam <[email protected]>
@cmadam
Cleanup main entry point and local implementation of spark transforms
4941d5b 
Signed-off-by: Constantin M Adam <[email protected]>
@cmadam
Added documentation for python, ray, spark and kfp
9c82fe0 
Signed-off-by: Constantin M Adam <[email protected]>
@shahrokhDaijavad
Update README.md
ed4e9c1 
utils folder is one level up from the python folder
@cmadam
Code cleanup and bug fixes
fb5601a 
Signed-off-by: Constantin M Adam <[email protected]>
@cmadam
Merge branch 'fuzzy-dedup' of github.com:IBM/data-prep-kit into fuzzy…
8de14b5 
…-dedup
@cmadam
Reduce the amount of logging
0636d5f 
Signed-off-by: Constantin M Adam <[email protected]>
@cmadam
Cleanup KFP pipeline code
d58518b 
Signed-off-by: Constantin M Adam <[email protected]>
@touma-I
Merge branch 'dev' into fuzzy-dedup
ea2a269
@touma-I
added fdedup to build package for all transforms
280d105 
Signed-off-by: Maroun Touma <[email protected]>
@cmadam
First draft of fdedup notebook
1a762e0 
Signed-off-by: Constantin M Adam <[email protected]>
@cmadam
Added sample ray fuzzy dedup jupyter notebook
ffebdc1 
Signed-off-by: Constantin M Adam <[email protected]>
@cmadam
Add jupyter notebooks for python, ray and spark fuzzy dedup
75fc4d1 
Signed-off-by: Constantin M Adam <[email protected]>
@cmadam
Add jupyter notebooks for python, ray and spark fuzzy dedup
edd5841 
Signed-off-by: Constantin M Adam <[email protected]>
@touma-I
create test branch for updating fdedup with latest release for 0.2.3.…
a62f92b 
…dev0

Signed-off-by: Maroun Touma <[email protected]>
@touma-I touma-I closed this Nov 26, 2024
@touma-I touma-I reopened this Nov 26, 2024
@touma-I touma-I closed this Nov 26, 2024
@touma-I touma-I reopened this Nov 26, 2024
@touma-I touma-I changed the title Fuzzy dedup mt mt test Nov 26, 2024
@touma-I touma-I marked this pull request as ready for review November 26, 2024 12:31
@touma-I touma-I marked this pull request as draft November 26, 2024 12:31
@touma-I touma-I closed this Nov 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
6 participants
@touma-I @blublinsky @cmadam @Kibnelson @daw3rd @shahrokhDaijavad