Andreas/mtg_python_deckbuilder
1
0
Fork 0
mirror of https://github.com/mwisnowski/mtg_python_deckbuilder.git synced 2025-12-16 23:50:12 +01:00
Code Issues Projects Releases Packages Wiki Activity Actions
286 commits 15 branches 38 tags 37 MiB
Commit graph

286 commits

This branch
This branch
All branches
Author SHA1 Message Date
matt
bff64de370 fix: systematically handle numpy arrays from Parquet files across codebase 
- Add ensure_theme_tags_list() utility to builder_utils for simpler numpy array handling
- Update phase3_creatures.py: 6 locations now use bu.ensure_theme_tags_list()
- Update phase4_spells.py: 9 locations now use bu.ensure_theme_tags_list()
- Update tagger.py: 2 locations use hasattr/list() for numpy compatibility
- Update extract_themes.py: 2 locations use hasattr/list() for numpy compatibility
- Fix build-similarity-cache.yml verification script to handle numpy arrays
- Enhance workflow debug output to show complete row data

Parquet files return numpy.ndarray objects for array columns, not Python lists.
The M4 migration added numpy support to canonical parse_theme_tags() in builder_utils,
but many parts of the codebase still used isinstance(list) checks that fail with arrays.
This commit systematically replaces all 19 instances with proper numpy array handling.

Fixes GitHub Actions workflow 'RuntimeError: No theme tags found' and verification failures.
 2025-10-18 22:47:09 -07:00
matt
db0b0ccfdb fix: handle numpy arrays in parse_theme_tags 
Parquet files return numpy arrays, not Python lists. Added conversion
from ndarray to list before processing theme tags.
 2025-10-18 22:39:53 -07:00
matt
7a94e195b7 fix: remove incorrect import inside loop - functions are in same file 2025-10-18 22:36:45 -07:00
matt
29b5da4778 fix: correct DataFrame column filtering and enhance debug output 
- Fix KeyError in generate_theme_catalog.py: use isCommander column correctly
- DataFrame.get() doesn't work like dict.get() - use column name directly
- Enhanced debug step to print full row data for better diagnostics
 2025-10-18 22:32:54 -07:00
matt
a689400c47 fix: add Path wrapper in workflow debug step 2025-10-18 22:27:13 -07:00
matt
30dfca0b67 fix: remove CSV fallback from theme catalog generation, add Parquet debug step 
- Remove CSV fallback logic (Parquet-only in M4 migration)
- Add better error messages when Parquet file missing or empty
- Add workflow debug step to inspect Parquet file after tagging
- Simplify build_theme_catalog function signature
 2025-10-18 22:22:35 -07:00
matt
9e6c3e66e9 fix: update generate_theme_catalog to use processed/ directory 2025-10-18 22:11:46 -07:00
matt
0e19824372 fix: use generate_theme_catalog script instead of non-existent function 2025-10-18 22:07:48 -07:00
matt
5ebd3c829e fix: create tagging completion flag in processed directory 2025-10-18 22:02:12 -07:00
matt
3694a5382d fix: ensure theme catalog is generated before similarity cache build 2025-10-18 21:57:45 -07:00
matt
8e8b788091 fix: add detailed tag validation to CI workflow 2025-10-18 21:56:23 -07:00
matt
e92f2ccfb4 fix: handle themeTags as list in similarity cache builder 2025-10-18 21:50:12 -07:00
matt
dec6e659b8 Merge branch 'overhaul/csv-to-parquet-migration' of https://github.com/mwisnowski/mtg_python_deckbuilder into overhaul/csv-to-parquet-migration 2025-10-18 21:43:20 -07:00
matt
b92918581e fix: use correct processed/ path for similarity cache building 2025-10-18 21:43:04 -07:00
mwisnowski
74eb47e670
Change tagging step to run in parallel 2025-10-18 21:37:07 -07:00
matt
8435312c8f feat: migrate to unified Parquet format with instant GitHub setup and 4x faster tagging 2025-10-18 21:32:12 -07:00
mwisnowski
e9e949aae3
Merge pull request #46 from mwisnowski/maintenance/ui-user-friendliness
Some checks failed
CI / build (push) Has been cancelled
Details 
chore: prepare release v2.9.1
 2025-10-17 18:51:33 -07:00
matt
be6e73347a chore: prepare release v2.9.1 2025-10-17 18:49:38 -07:00
mwisnowski
b5d11b30ef
Merge pull request #45 from mwisnowski/maintenance/ui-user-friendliness 
feat(ui): add similar cards refresh button and reduce sidebar animati…
 2025-10-17 18:41:40 -07:00
matt
0f4d165201 feat(ui): add similar cards refresh button and reduce sidebar animation distractions 2025-10-17 18:40:15 -07:00
matt
dfddf35b4e chore: alos include the updated dockerhub-docker-compose.yml 2025-10-17 18:04:55 -07:00
matt
23307c0d46 chore: sync docker-compose.yml and .env.example with dockerhub-docker-compose.yml 2025-10-17 18:04:32 -07:00
matt
fd240e2533 feat: bake similarity cache into Docker images 
- Copy card_files/ to /.defaults/card_files/ during build
- Entrypoint checks for baked-in cache before downloading
- Fallback to GitHub download if not present in image
- Reduces startup time and bandwidth usage
 2025-10-17 17:29:17 -07:00
matt
0cf7598400 fix: remove cache build dependency from dockerhub publish 
Docker builds don't need to wait for cache building.
Cache is downloaded if available, skipped if not.
 2025-10-17 17:20:17 -07:00
matt
4cf3969ae6 chore: prepare release 2.9.0 2025-10-17 17:17:20 -07:00
mwisnowski
49eabce19d
Merge pull request #44 from mwisnowski/fix/github-action-module-path 
Fix/GitHub action module path
 2025-10-17 17:13:11 -07:00
matt
86752b351b feat: optimize cache workflow with orphan branch and age check 
- Create/use orphan branch 'similarity-cache-data' for cache distribution
- Add age check to dockerhub-publish: only rebuild if cache >7 days old
- Use git add -f to force-add cache files (keeps .gitignore clean)
- Weekly scheduled builds will keep cache fresh automatically

This avoids rebuilding cache on every Docker publish while ensuring
cache is always reasonably fresh (<7 days old).
 2025-10-17 17:11:04 -07:00
matt
b26057f68d fix: allow similarity cache files in card_files directory 
Added .gitignore exceptions for:
- card_files/similarity_cache.parquet
- card_files/similarity_cache_metadata.json

These files need to be committed to the similarity-cache-data branch
for distribution with Docker builds.
 2025-10-17 16:54:51 -07:00
matt
fc911b818e fix: correct module path for all_cards.parquet generation in CI 
Changed from non-existent code.web.services.card_loader to correct
code.file_setup.card_aggregator.CardAggregator module.

Fixes ModuleNotFoundError in build-similarity-cache workflow.
 2025-10-17 16:41:44 -07:00
mwisnowski
951f5ef45a
Merge pull request #43 from mwisnowski/feature/card-browser 
Feature/card browser
 2025-10-17 16:22:47 -07:00
matt
c2960c808e Add card browser with similar cards and performance optimizations 2025-10-17 16:17:36 -07:00
matt
a8dc1835eb feat(card-browser): advanced filters, keyboard shortcuts, and responsive design 2025-10-16 19:02:33 -07:00
matt
e0fe8a36e6 chore: prepare release 2.8.1
Some checks are pending
CI / build (push) Waiting to run
Details
2025-10-16 11:44:18 -07:00
mwisnowski
ab1aac1ee7
Merge pull request #42 from mwisnowski/feature/colorless-commander-improvements 
Add colorless commander filtering and display fixes
 2025-10-16 11:29:49 -07:00
matt
bec984ce3e Add colorless commander filtering and display fixes 2025-10-16 11:20:27 -07:00
matt
2eab6ab653 chore: prepare release v2.8.0
Some checks are pending
CI / build (push) Waiting to run
Details
2025-10-15 18:43:33 -07:00
mwisnowski
6f4b995c5f
Merge pull request #41 from mwisnowski/feature/theme-browser-tuneup 
feat: improve theme browser performance and add keyboard navigation
 2025-10-15 18:40:24 -07:00
matt
77302f895f feat: improve theme browser performance and add keyboard navigation 2025-10-15 18:10:17 -07:00
mwisnowski
40e676e39b
Merge pull request #40 from mwisnowski/feature/theme-catalog-optimization 
feat: theme catalog optimization with tag search and faster enrichment
 2025-10-15 17:24:08 -07:00
matt
9e6c68f559 feat: theme catalog optimization with tag search and faster enrichment 2025-10-15 17:17:46 -07:00
mwisnowski
952b151162
Merge pull request #39 from mwisnowski/feature/all-cards-consolidation 
feat: consolidate card data into optimized format for faster queries and prep for future feature additions
 2025-10-15 11:09:03 -07:00
matt
f70ffca23e feat: consolidate card data into optimized format for faster queries and reduced file sizes 2025-10-15 11:04:49 -07:00
matt
5753bb19f8 chore: prepare release v2.7.1
Some checks failed
CI / build (push) Has been cancelled
Details
2025-10-14 17:53:15 -07:00
mwisnowski
15c11ec3d5
Merge pull request #38 from mwisnowski/fix/wizard-enhancements 
fix: Quick Build UI now uses full-width layout on desktop
 2025-10-14 17:48:46 -07:00
matt
3647d04eec fix: Quick Build UI now uses full-width layout on desktop 2025-10-14 17:47:27 -07:00
matt
32638b9ec3 fix: use versioned release notes in GitHub release workflow 2025-10-14 17:04:22 -07:00
matt
3228b92581 chore: prepare release 2.7.0 2025-10-14 17:01:44 -07:00
mwisnowski
94261a025e
Merge pull request #37 from mwisnowski/features/wizard-enchancements 
Wizard Enhancements: Quick Build, Skip Controls & Slider UI
 2025-10-14 16:56:42 -07:00
matt
35bff901d2 feat: add ideal counts slider UI with smart validation 2025-10-14 16:45:49 -07:00
matt
9ab3835e2a feat: stage reordering, skip controls, quick build, and commander session cleanup 2025-10-14 16:09:58 -07:00