Synchronize main into dev staging destination - #1111
Merged
Conversation
Remove wildcard expansion check from log messages.
…inished add_log_info_when_wrangle_finished
…ation PR #951 in the wrong location
…h-all-floats Coalesce broken with all floats
- compute.py: keep both _UNSET sentinel (PR) and numpy/_compute/_format imports (main) - test_wrangles.py: use main's prefix-slice translation assertions - test_compute.py: keep PR's new case_when boolean/multi-column tests alongside main's TestScoreSearchResults class
- Remove forced dtype=object to preserve numeric dtypes (Copilot + thomasstvr) - Add numpy.select fallback for pandas < 2.2 which lacks Series.case_when (Copilot) - Fix docstring: NaN -> pd.NA to match actual behavior (Copilot) - Fix YAML test: default: None -> default: null (None is a string in PyYAML, null is Python None) (Copilot)
…numpyselect-rather-than-pandascase_when why-is-case_when-using-numpyselect-rather-than-pandascase_when
* The Akeneo connector should also be able to read.
* Move optional packages to separate requirements file
* Accept path objects in read / write / run recipe
* Remove illegal characters when writing to Excel
* add new Action pipeline to create the release candidate package * apply the latest fixes for the pipeline to deploy release candidate packages * adjust the translate test to make them more robust * adjust the asset-lookup equal
Remove redundant run of the unit tests
The delete endpoint is /model/content (consistent with all other model operations), not /model/delete. Tests now mock the HTTP delete call since the backend endpoint is gated on API-Core PR #111. Co-Authored-By: Mariia Borodii <mborodii@binariks.com>
* Add DuckDB and Microsoft Access connectors Add DuckDB read/write/run connector with recipe schemas Add Microsoft Access read/write/run connector via ODBC Export new connectors from wrangles.connectors Document optional duckdb and pyodbc dependencies Add connector tests for DuckDB and Access * fix translate tests * fix duckdb tests --------- Co-authored-by: Eric Hills <53243273+ebhills@users.noreply.github.com>
* Add split.dictionary to_lists mode * fix tests * renamed parameters
* Add n parameter to lookup for multi-match retrieval * n!=1 always returns a dict per match, allow * expansion for output * fix translate tests * Patch setup.py to use requirements-full.txt * implemented wildcard output expansion
* Create Column should NOT error if column exists * Added new value_if_exists and coalesce_value parameters to handle logic if column preexists
* 496 selectkeys (#1033) * Add split.dictionary to_lists mode * Fix where skipping wrangles when all rows are filtered out * 1005 bug where passes empty dataframe (#1034) * enable package build on main branch * 956 create column should not error if column exists (#1036) * Create Column should NOT error if column exists * install full package list * 990 enhancement add n to lookup params (#1037) * Add n parameter to lookup for multi-match retrieval * 985 enhancement allow list of onemultiple defaults (#1039) * convert.from_json and convert.from_yaml accept default as a list when input is also a list * 985-enhancement-allow-list-of-onemultiple-defaults * column-shift bug in wrangles/recipe.py * Revert "Merge branch 'dev' into 1005-bug-where-passes-empty-dataframe" This reverts commit a6b9b57, reversing changes made to af67032. * publesh dev rc * skip pre-creating output columns
eliminate error when occasional strings get mixed in with mostly numbers
* allow rename to skip missing inputs when output exists * Apply suggestions from code review Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com> --------- Co-authored-by: Eric Hills <53243273+ebhills@users.noreply.github.com> Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
…880) - 817-output-empty-string-when-extract-use_labels-does-not-get-a-match-mae - add new param that can toggle off these empty labels - add param to format use_labels output as dict or columns
* Implement consistent extract output formatting * support sict and list parameters * add log messages * Simplify extract output_format: drop output_column_name, infer Columns from output list * Treat explicit single-item output lists as Columns format in extract wrangles * Normalize extract output_format enums to lowercase; rename String to Concatenate and delimiter to char * Default extract.brackets output_format to list, matching other extract wrangles brackets was the only extract.* wrangle that defaulted to a concatenated string instead of a JSON list when output_format was unspecified. Columns and Concatenate remain available as explicit output_format choices. * fix failing tests
Removed Python version 3.12 from the workflow matrix.
#987) * convert.from_json and convert.from_yaml accept default as a list when input is also a list * 985-enhancement-allow-list-of-onemultiple-defaults * Address review feedback on convert.from_json/from_yaml default lists * Fixed test dummy data in test_convert.py so input column values match their default types * fix publish dev rc * add real tests * update timeout for test to avoid intermittent failures
* Standardize on eol=lf adopt linux convention so that local windows development does create back & forth line end diffs. * Add EditorConfig support Add a repository-wide `.editorconfig` to standardize encoding, line endings, final newlines, and whitespace handling, with Windows overrides for batch files and preserved trailing whitespace in Markdown. The devcontainer now also installs the EditorConfig VS Code extension so those rules apply automatically in the development environment. * Refresh devcontainer setup for Python 3.13 Update the shared devcontainer to use the Python 3.13 base image, install the full editable development environment, and improve VS Code defaults for YAML and Python tooling. Add Windows-specific Docker Desktop startup guidance with a helper script, and sync the Copilot instructions with the current local setup and test dependencies. * Update copilot-instructions.md
goal is to have a dev schema that reflects new / changes
#1022) * update extract.codes recipe schema to match the Wrangles-Extract-Codes microservice * Update extract.codes schema and tolerant tests
…gle-wrangle add train.delete to delete a model by model_id
…here Fix recipe schema so nested recipe: wrangles accept where
Merge pull request #1101 from wrangleworks/1100-bug-extractcustom-outputs-a-string-unless-output_format-is-specifically-set-to-list
Preserve the dev package version and deterministic release regressions while adopting current main workflow and extract implementations. Resolve the six overlapping files against main, then retain focused coverage for multi-input list merging, input/output length validation, and mocked translation boundaries.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
maininto thedevstaging destination through a dedicated sync branchdevpackage version (1.19.4) and deterministic release regression coveragemainworkflow and extract implementationsWhy
devhad diverged from production: 65 commits existed only onmain, while 8 commits existed only ondev. This PR restoresmainas an ancestor ofdevwhile retaining the intentional staging delta.Conflict resolution
The workflow and extract implementation conflicts use current
mainas the production baseline. The retained staging delta is limited to:setup.pytests/recipes/wrangles/test_extract.pytests/test_wrangles.pyThese preserve the staging package version, deterministic translation mocks, multi-input match-list coverage, and input/output-length validation.
Validation
mainin only the three intentional files aboveMerge direction
This PR is
sync/main-into-dev-2026-08-02→dev. It must be merged with Create a merge commit so themainancestry is retained. Do not squash or rebase this synchronization PR.