Commit Graph

59 Commits

Author SHA1 Message Date
a71b219c9a Improvements to phpBB3 import script (#10999)
* FEATURE: Import attachments

* FEATURE: Add support for importing multiple forums in one

* FEATURE: Add support for category and tag mapping

* FEATURE: Import groups

* FIX: Add spaces around images

* FEATURE: Custom mapping of user rank to trust levels

* FIX: Do not fail import if it cannot import polls

* FIX: Optimize existing records lookup

Co-authored-by: Gerhard Schlager <mail@gerhard-schlager.at>
Co-authored-by: Jarek Radosz <jradosz@gmail.com>
2021-01-14 21:44:43 +02:00
f7ea2fdea5 FIX: Import posts of missing users from phpbb3 (#9085)
Posts without a user probably shouldn't happen unless there was some direct database tampering, but data like that has been seen in the wild.

The importer will assign those posts to the "system" user.
2020-03-06 22:54:40 +01:00
0f3c3bc309 Make import scripts work with frozen strings 2019-05-30 22:22:24 +02:00
7429700389 FIX: ensure we can download maxmind without redis or db config
This also corrects FileHelper.download so it supports "follow_redirect"
correctly (it used to always follow 1 redirect) and adds a `validate_url`
param that will bypass all uri validation if set to false (default is true)
2019-05-28 10:28:57 +10:00
30990006a9 DEV: enable frozen string literal on all files
This reduces chances of errors where consumers of strings mutate inputs
and reduces memory usage of the app.

Test suite passes now, but there may be some stuff left, so we will run
a few sites on a branch prior to merging
2019-05-13 09:31:32 +08:00
74ca49d7cd FIX: Importing of polls from phpBB3 was broken
Follow-up to 24369a81
2019-05-06 12:37:19 +02:00
9334d2f4f7 FEATURE: add more granular user option levels for email notifications (#7143)
Migrates email user options to a new data structure, where `email_always`, `email_direct` and `email_private_messages` are replace by

* `email_messages_level`, with options: `always`, `only_when_away` and `never` (defaults to `always`)
* `email_level`, with options: `always`, `only_when_away` and `never` (defaults to `only_when_away`)
2019-03-15 10:55:11 -04:00
24369a8166 Improve phpBB3 importer
* Log errors when mapping of posts, messages, etc. fails
* Allow permalink normalizations for old subfolder installation
* Disable importing of polls for now. It's broken.
2019-02-17 23:20:20 +01:00
9248ad1905 DEV: Enable Style/SingleLineMethods and Style/Semicolon in Rubocop (#6717) 2018-12-04 11:48:13 +08:00
1ba8e8948d FIX: add support for string avatar_type values in PHPBB3 importer 2018-06-07 18:14:11 -04:00
dad1e4b17d don't import data only available in a plugin in phpBB 3 importer 2018-03-17 00:36:12 +01:00
bb6ac51607 Update PHPBB3 importer
- Extract name from profile_fields_data table
- Use 'posts.poster_ip' to track topic views
2018-03-16 18:32:27 +01:00
07bc52dc69 import topic views in phpbb3 2018-03-07 19:27:03 +01:00
192a0886e2 FIX: BBCode to Markdown conversion in phpBB3 importer was broken
This fixes the conversion for quotes, code blocks and lists (except for nested lists). It also discourages the usage of the ruby-bbcode-to-md gem.
2018-01-30 12:50:42 +01:00
c26db2116c FIX: phpBB3 importer imported some users as anonymous users 2018-01-30 12:50:42 +01:00
667b025d12 make rubocop happy 2017-11-07 14:20:46 -05:00
4f0bdec370 some improvements for importers (#5295)
* decode html entities within code blocks

* Only import users that actually participated in the bbpress part of Wordpress; import password hashes

* create permalinks for topics

* Better handling of [code] blocks
2017-11-07 17:50:43 +01:00
e9fb2c5756 phpBB3 importer: Fix validation of site settings 2017-08-29 01:48:30 +02:00
5012d46cbd Add rubocop to our build. (#5004) 2017-07-28 10:20:09 +09:00
32ef30cff9 phpBB3 importer: Permalink for first post of each topic was missing 2017-07-25 23:29:56 +02:00
5be52fa821 phpBB3 importer: Use permalink normalization for category links 2017-07-25 21:14:46 +02:00
cdbe027c1c Refactor FileHelper to use keyword arguments. 2017-05-24 13:54:26 -04:00
71414f7ba2 We don't need to log downloading avatars that are too large 2017-05-09 14:46:42 -04:00
8d9b5ed70a phpBB3 importer: Disable file size validators during import 2017-04-26 01:05:36 +02:00
1fb5dac1bc phpBB3 importer: Fix the link regex
Thanks to Leo Davidson for the improved regex.
https://meta.discourse.org/t/importing-from-phpbb3/30810/153
2017-02-05 17:13:31 +01:00
14a0dff469 phpBB3 importer: Fix import of anonymous users 2017-02-05 15:26:50 +01:00
b79eef32e7 phpBB3 importer: Make it harder to set wrong table prefix 2017-02-05 14:13:25 +01:00
5569afc48b phpBB3 importer: Don't ignore users that belong to non-existent group 2017-02-05 14:13:25 +01:00
m.b
2fde6944e3 Add missing fat arrow in bbcode_to_md method rescue block
Related to https://meta.discourse.org/t/undefined-local-variable-or-method-e-during-phpbb3-migration/48861
2016-08-19 13:18:27 +02:00
37a78752e9 phpBB3 importer: fixes for internal links and guest users (#4350)
* phpBB3 importer: ignore query parameters in internal links

* phpBB3 importer: Don't fail if guest usernames differ only by case

* phpBB3 importer: Import username as name for guest users
2016-07-27 22:57:33 +02:00
fccc0c93c5 Store the original username during import (#4349) 2016-07-27 22:30:15 +02:00
c145e747b6 A few small changes to the phpBB3 importer (#4321)
* Reconnect to phpBB3 database on connection loss

* Map geek smiley to :nerd: emoji in phpBB3 importer

* Import PMs to yourself from phpBB3

* Allow empty table prefix in phpBB3 importer
2016-07-11 23:59:15 +02:00
0227658515 Make phpBB3 importer compatible with latest poll plugin changes (#4253) 2016-06-06 22:59:33 +02:00
2e1cc061d8 Make sure PMs imported from phpBB3 are only visible to the correct users
In addition this tries to automatically fix PMs that were migrated
from phpBB2 to phpBB3.
2016-05-26 20:27:08 +02:00
1eaaa97849 Fix import from phpBB 3.1 2016-05-07 23:35:48 +02:00
38d0697b2f Merge pull request #4191 from gschlager/phpbb3-importer-polls
Fix import of polls from phpBB3
2016-04-25 10:32:43 +02:00
e19ee93ee3 Stop using OFFSET in DB queries of phpBB3 importer
http://use-the-index-luke.com/no-offset
2016-04-24 14:25:35 +02:00
a796289b3a Fix import of polls from phpBB3 2016-04-23 23:03:50 +02:00
91b5ea4113 Make permalink import from phpBB3 configurable
There are a few changes to the original permalink import:
- adds permalinks for posts
- does not create incorrect permalinks for private messages
- adds permalink normalizations for topics and posts
2016-04-09 22:36:45 +02:00
4afa032b4c Make port number configurable. 2016-03-29 20:47:48 +02:00
5741717322 Merge pull request #4054 from ryantm/phpbb-import-script
phpbb-import-script: move bbcode_to_md to before other text processing
2016-03-07 18:17:12 +01:00
396713718b FEATURE: Adds ~200 more emoji
This includes all new emoji from Unicode 7 and Unicode 8 with the
exception of skin tones which will require a new interface.
2016-03-04 15:10:14 -05:00
e1f7d05677 phpbb-import-script: move bbcode_to_md to before other text processing
This seems to fix the issue I reported at
https://meta.discourse.org/t/import-script-phpbb/40424
2016-03-02 15:14:58 -08:00
0172684719 Some fixes for phpbb importer. 2016-03-01 10:21:54 +08:00
9e46690086 Add Permalink to phpbb3 import script. 2016-02-29 11:48:43 +08:00
15165440e5 Map :-) to :slightly_smiling: during phpBB3 import 2016-02-04 20:39:53 +01:00
9d96c6d435 Prepare settings file for Docker based phpBB3 importer 2016-02-04 20:39:53 +01:00
1164129edc Better error handling for polls imported from phpBB3 2016-01-13 22:57:57 +01:00
bed9135f40 Failed file upload shouldn't crash phpBB3 importer 2016-01-13 22:56:45 +01:00
f2663ecb09 FIX: Correctly import users and passwords from phpBB 3.1
- Ruby doesn't support the $2y$ prefix used for bcrypt Blowfish hashes.
- The importer ignored users that didn't have optional profile fields.
2015-12-26 23:05:19 +01:00