Aidan b058ca23c0 feat: add extraction+saving of title, description, image, and keywords to db, add robots check before scraping

2025-04-23 21:45:37 -04:00

..

src

feat: add extraction+saving of title, description, image, and keywords to db, add robots check before scraping

2025-04-23 21:45:37 -04:00

.gitignore

[scraper] func: add database, docker support, ingest functions, and basic menu

2025-04-23 20:19:47 -04:00

docker-compose.yml

[scraper] func: add database, docker support, ingest functions, and basic menu

2025-04-23 20:19:47 -04:00

drizzle.config.ts

[scraper] func: add database, docker support, ingest functions, and basic menu

2025-04-23 20:19:47 -04:00

package.json

feat: add extraction+saving of title, description, image, and keywords to db, add robots check before scraping

2025-04-23 21:45:37 -04:00

tsconfig.json

[scraper] func: add database, docker support, ingest functions, and basic menu

2025-04-23 20:19:47 -04:00