github-mirror/discourse
2
0
Fork 0
mirror of https://github.com/discourse/discourse.git synced 2025-05-21 18:12:32 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity

Improve Google Groups scraper

Browse Source 
* Better error detection during login phase
* Experimental support for 2FA and SMS codes
* Detect missing permissions to scrape email addresses
This commit is contained in:
Gerhard Schlager
2019-03-24 23:08:03 +01:00
parent 40ac895ef7
commit 2349ba3bc4
2 changed files with 82 additions and 6 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
script/import_scripts/mbox/support/indexer.rb
View File

@ -38,7 +38,7 @@ module ImportScripts::Mbox
private
METADATA_FILENAME = 'metadata.yml'.freeze
IGNORED_FILE_EXTENSIONS = ['.dbindex', '.dbnames', '.digest', '.subjects', 'status.yml']
IGNORED_FILE_EXTENSIONS = ['.dbindex', '.dbnames', '.digest', '.subjects', '.yml']
def index_category(directory)
metadata_file = File.join(directory, METADATA_FILENAME)