Errors porting Drupal6 to Flarum

[Unresponsive]

I'm trying to export my Drupal 6 forum to Flarum.

First error was:
PDOException SQLSTATE[42S02]: Base table or view not found: 1146 Table 'oldforum.nodeforum' doesn't exist
Looked at the database and found out that for some reason table 'nodeforum' is called 'forum' there, so I changed that in the Drupal6 source file. Now discussions are being exported successfully with this one change.

Instead of table 'node_comments' I have just 'comments'. Changed that in the Drupal6 source file and removed all the different joins as well. Now comment are being exported successfully.

PM import was giving more errors so commented that out for now.

However now I'm getting 'Operation not permitted' error when NitroPorter is inserting discussions from intermediate table to flarum table. Any idreas why?

Source: Drupal 6 (oldforum)
Target: Flarum (newforum-flarum)
Flag: Use Discussion Body: Enabled
export: User — 8413 rows, 00.99s (6.5mb)
export: UserMeta — 8413 rows, 00.78s (6.3mb)
export: Role — 11 rows, 00.01s (5.8mb)
export: UserRole — 3054 rows, 00.09s (6.2mb)
export: Category — 16 rows, 00.01s (5.8mb)
export: Discussion — 7953 rows, 01.81s (8.5mb)
inserting 'Comment': 100,000 done...
export: Comment — 185387 rows, 15.57s (7.1mb)
import: users — 8413 rows, 01.01s (6.9mb)
import: groups — 11 rows, 00.01s (6.1mb)
import: group_user — 3054 rows, 00.10s (6.5mb)
import: tags — 16 rows, 00.01s (6.1mb)
Mentions map memory usage at 10.7mbIlluminate\Database\QueryException SQLSTATE[HY000]: General error: 1180 Got error 1 "Operation not permitted" during COMMIT (SQL: insert into `FLA_discussions` (`created_at`, `first_post_id`, `id`, `is_locked`, `is_sticky`, `last_post_id`, `last_posted_at`, `last_posted_user_id`, `post_number_index`, `slug`, `title`, `user_id`) values 

[linc]

You've made enough changes you may have found a novel error I won't be able to debug.

What is the name of the Drupal 6 plugin you're using for the forum?

[Unresponsive]

I used AdvancedForum 6 and a bunch of other plugins (comment_edited etc). At first I tried using AdvancedForum7 as a source for NitroPorter but that gave plenty of errors and I thought starting with Drupal6 source will be better.

[Unresponsive]

I see that discussions are getting successfully inserted into PORT_Discussion table. I tried running manually the following sql:

INSERT INTO `FLA_discussions` (`created_at`, `first_post_id`, `id`, `is_locked`, `is_sticky`, `last_post_id`, `last_posted_at`, `last_posted_user_id`, `post_number_index`, `slug`, `title`, `user_id`)
   SELECT DateInserted, FirstCommentID, DiscussionID, Closed, Announce, LastCommentID, DateLastComment, LastCommentUserID, NULL, NULL, Name, InsertUserID
     FROM `PORT_Discussion` 
     ORDER BY DateInserted
     LIMIT 1

and it executed without error, inserted one row in FLA_discussions. I hope I understood correctly the correspondece of PORT_Discussion and FLA_discussions columns. Was not sure what post_number_index is so used NULL for it. Also there is no slug in PORT_Discussion so used NULL for it as well.

So it's quite confusing why data is being inserted into PORT_Discussion without problem but errors out when going from PORT_Discussion to FLA_discussions.

[Unresponsive]

OK, next tried inserting all rows without LIMIT 1:

INSERT INTO `FLA_discussions` (`created_at`, `first_post_id`, `id`, `is_locked`, `is_sticky`, `last_post_id`, `last_posted_at`, `last_posted_user_id`, `post_number_index`, `slug`, `title`, `user_id`)
   SELECT DateInserted, FirstCommentID, DiscussionID, Closed, Announce, LastCommentID, DateLastComment, LastCommentUserID, NULL, NULL, Name, InsertUserID
     FROM `PORT_Discussion` 
     ORDER BY DateInserted

Got duplicate key error, maybe that is the reason for NitroPorter error. Will investigate further.

[Unresponsive]

Yes, that was the reason, node and node_revisions tables in Drupal 6 contained several rows with identical nid but different vid (i. e., some discussions had several revisions saved in these tables, which I guess is fine for Drupal 6). So using left join to extract discussions from Drupal tables resulted in duplicate rows in PORT_Discussion with the same DiscussionID. PORT_Discussion does not require DiscussionID to be unique, but FLA_discussions does, therefore the error above when moving discussions from PORT_Discussion to FLA_discussions. So I just added group by n.nid at the end of discussion extraction sql in the Drupal 6 source file and that resolved the problem.

However there are next errors, will report on these later.

[linc]

Makes sense, I've amended the query for 3.7: cfd0bd5

[Unresponsive]

@linc, I'm not an expert in PHP or SQL, and don't fully understand how NitroPorter functions. This is the code from your (unmodified by me) Drupal 6 source file:

/**
   * @param ExportModel $ex
   */
  protected function comments(ExportModel $ex): void
  {
      $comment_Map = array(
          'cid' => 'CommentID',
          'uid' => 'InsertUserID',
          'body' => array('Column' => 'Body'),
          'hostname' => 'InsertIPAddress',
          'created' => array('Column' => 'DateInserted', 'Filter' => 'timestampToDate')
      );
      $ex->export(
          'Comment',
          "select
                  n.created,
                  n.uid,
                  r.body,
                  c.nid as DiscussionID,
                  n.title,
                  'Html' as Format,
                  nullif(n.changed, n.created) as DateUpdated
               from node n
               left join node_comments c
                  on c.cid = n.nid
               left join node_revisions r
                  on r.nid = n.nid
               where n.type = 'forum_reply'",
          $comment_Map
      );
  }

It seems that it doesn't extract Comment ID (cid) form the Drupal database, does it?… Or does that happen somewhere else in the code?

[linc]

That does appear to be an error, yes. It should get selected in the SQL.

[linc]

Fix is here for 3.7: 4b411eb