 mrh
|
a78d48b434
完成 Google search 关键词回车搜索
|
1 year ago |
|
mrh
|
21bfc2c2a4
使用单例模式便于外部调用，不过会话逻辑是错误的，它会到时间莫明重启，我只需要在程序运行期间浏览器也保持运行即可。如果外部API调用发现浏览器被关闭再次重启就好，而且状态似乎也不需要额外定义，playwright 应该有相关的方法检测浏览器或页面是否存活吧
|
1 year ago |
|
mrh
|
9712124875
基于上下文管理器完成谷歌搜索，用的测试指纹浏览器
|
1 year ago |
|
mrh
|
9138dec48e
测试指纹浏览器和示例 camoufox
|
1 year ago |
|
mrh
|
3de3e57e9c
转移目录结构
|
1 year ago |
|
mrh
|
4875fb3dc9
pandoc 并未能转换。原因待查明
|
1 year ago |
|
mrh
|
b356480683
single search key convert all format:md,html,docx, use pandoc, docling
|
1 year ago |
|
mrh
|
cf43f2a601
浏览器新增随机 ua
|
1 year ago |
|
mrh
|
5b323bb205
完成批量搜索，倒是仍然遇到反爬检测
|
1 year ago |
|
mrh
|
0a0b65e876
完成 dp 最后一页的检查
|
1 year ago |
|
mrh
|
d09e9d56ca
修改 excel 导入管理
|
1 year ago |
|
mrh (aider)
|
77bd06e99f
refactor: Convert excel_import functions to class-based approach
|
1 year ago |
|
mrh (aider)
|
333e4f2d83
feat: add progress tracking and management for Excel keywords
|
1 year ago |
|
mrh
|
d3642e09b5
改变数据模型架构
|
1 year ago |
|
mrh (aider)
|
64f0fb921d
fix: use sqlalchemy.text() for raw SQL execution in drop_table
|
1 year ago |
|
mrh
|
1c46f2b7ce
refactor: Make `drop_table` function accept a model parameter
|
1 year ago |
|
mrh (aider)
|
e8250fe763
refactor: modify drop_table to only delete SearchResult table
|
1 year ago |
|
mrh (aider)
|
5a07937f67
feat: add is_last_page field to track search pagination end
|
1 year ago |
|
mrh
|
becc835c83
refactor: Add debug print and database initialization in SearchManager
|
1 year ago |
|
mrh
|
dfca410425
新增日志库
|
1 year ago |
|
mrh (aider)
|
3143d25dab
feat: add cache parameter to search methods for database lookup
|
1 year ago |
|
mrh (aider)
|
51bee11ffb
refactor: extract database save logic into separate method in SearchManager
|
1 year ago |
|
mrh
|
f5db96a546
refactor: remove unused methods and adjust return value in search_manager
|
1 year ago |
|
mrh (aider)
|
4ce06ce2c8
refactor: move database logic to DatabaseManager and add duplicate checking
|
1 year ago |
|
mrh
|
03506cf2d5
默认的 crawl4ai 有反爬检测，新增一个 Drission 管理看看如何规避
|
1 year ago |
|
mrh (aider)
|
a33426c675
fix: Pass datetime.now as callable to default_factory in SearchResult
|
1 year ago |
|
mrh
|
8ab84386e7
refactor: Rename `Keyword` to `SearchResult` and add `DatabaseManager` class
|
1 year ago |
|
mrh
|
ad8aa1e1f0
循环读取关键词并搜索。新问题：页面存在却提示无结果
|
1 year ago |
|
mrh
|
c9d00c553e
将 excel 导入数据库
|
1 year ago |
|
mrh
|
78e12d7b83
加入 dristion page 后关键词搜索
|
1 year ago |
