Migration error bootstrapping a new profile #474

Closed
opened 2023-08-24 22:23:05 +12:00 by dtonon · 2 comments
dtonon commented 2023-08-24 22:23:05 +12:00 (Migrated from github.com)

On 2fe2550.
When I try to create a new profile the migration crashes.

# export GOSSIP_PROFILE="relays"

# ./target/release/gossip-unstable
2023-08-24T10:18:49.598406Z  INFO src/filter.rs:30: No spam filter: No such file or directory (os error 2)
2023-08-24T10:18:49.600133Z  INFO src/storage/import/mod.rs:10: Importing SQLITE data into LMDB...
2023-08-24T10:18:49.600686Z  INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 1
2023-08-24T10:18:49.606099Z  INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 2
2023-08-24T10:18:49.607291Z  INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 3
2023-08-24T10:18:49.611273Z  INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 4
2023-08-24T10:18:49.612983Z  INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 5
2023-08-24T10:18:49.613839Z  INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 6
2023-08-24T10:18:49.614431Z  INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 7
2023-08-24T10:18:49.614691Z  INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 8
2023-08-24T10:18:49.615620Z  INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 9
2023-08-24T10:18:49.616220Z  INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 10
2023-08-24T10:18:49.617471Z  INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 11
2023-08-24T10:18:49.618272Z  INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 12
2023-08-24T10:18:49.620785Z  INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 13
2023-08-24T10:18:49.621082Z  INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 14
2023-08-24T10:18:49.622464Z  INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 15
2023-08-24T10:18:49.622735Z  INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 16
2023-08-24T10:18:49.623323Z  INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 17
2023-08-24T10:18:49.623645Z  INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 18
2023-08-24T10:18:49.624031Z  INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 19
2023-08-24T10:18:49.625653Z  INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 20
2023-08-24T10:18:49.626179Z  INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 21
2023-08-24T10:18:49.628925Z  INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 22
2023-08-24T10:18:49.629683Z  INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 23
2023-08-24T10:18:49.630993Z  INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 24
2023-08-24T10:18:49.633474Z  INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 25
2023-08-24T10:18:49.633908Z  INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 26
2023-08-24T10:18:49.634381Z  INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 27
2023-08-24T10:18:49.635897Z  INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 28
2023-08-24T10:18:49.636414Z  INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 29
2023-08-24T10:18:49.637142Z  INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 30
2023-08-24T10:18:49.637701Z  INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 31
2023-08-24T10:18:49.640098Z  INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 32
2023-08-24T10:18:49.640630Z  INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 33
2023-08-24T10:18:49.641185Z  INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 34
2023-08-24T10:18:49.646664Z  INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 35
2023-08-24T10:18:49.647522Z  INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 36
2023-08-24T10:18:49.648002Z  INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 37
2023-08-24T10:18:49.651495Z  INFO src/storage/import/legacy/mod.rs:106: Database is at version 37
2023-08-24T10:18:49.651517Z  INFO src/storage/import/legacy/mod.rs:122: Normalizing Database URLs (this will take some time)
2023-08-24T10:18:49.651746Z  INFO src/storage/import/mod.rs:17: LDMB: setup
2023-08-24T10:18:49.651776Z  INFO src/storage/import/mod.rs:24: LMDB: imported local settings.
2023-08-24T10:18:49.651794Z  INFO src/storage/import/mod.rs:31: LMDB: imported settings.
2023-08-24T10:18:49.651806Z  INFO src/storage/import/mod.rs:41: LMDB: imported event-seen-on-relay data.
2023-08-24T10:18:49.651817Z  INFO src/storage/import/mod.rs:52: LMDB: imported event-viewed data.
2023-08-24T10:18:49.651829Z  INFO src/storage/import/mod.rs:63: LMDB: imported event hashtag index.
2023-08-24T10:18:49.651843Z  INFO src/storage/import/mod.rs:70: LMDB: imported relays.
2023-08-24T10:18:49.651853Z  INFO src/storage/import/mod.rs:75: LMDB: imported events and tag index
2023-08-24T10:18:49.651867Z  INFO src/storage/import/mod.rs:82: LMDB: imported people
2023-08-24T10:18:49.651879Z  INFO src/storage/import/mod.rs:89: LMDB: import person_relays
2023-08-24T10:18:49.651986Z  INFO src/storage/import/mod.rs:100: Importing SQLITE data into LMDB: Done.
2023-08-24T10:18:49.652028Z  INFO src/storage/migrations/mod.rs:37: LMDB Migration 0 -> 1: Computing and storing event relationships for 0 events...
2023-08-24T10:18:49.652032Z  INFO src/storage/migrations/mod.rs:91: syncing...
2023-08-24T10:18:49.652034Z  INFO src/storage/migrations/mod.rs:61: done.
2023-08-24T10:18:49.652037Z  INFO src/storage/migrations/mod.rs:43: LMDB Migration 1 -> 2: Updating Settings...
2023-08-24T10:18:49.652043Z  INFO src/storage/migrations/mod.rs:61: done.
2023-08-24T10:18:49.652045Z  INFO src/storage/migrations/mod.rs:47: LMDB Migration 2 -> 3: Removing invalid relays...
2023-08-24T10:18:49.652047Z  INFO src/storage/migrations/mod.rs:120: Deleted 0 bad relays
2023-08-24T10:18:49.652049Z  INFO src/storage/migrations/mod.rs:61: done.
2023-08-24T10:18:49.652051Z  INFO src/storage/migrations/mod.rs:51: LMDB Migration 3 -> 4: Using kv for settings...
Error: Error { kind: Speedy(Error { kind: InputBufferIsTooSmall { actual_size: 65, expected_size: 247 } }), file: None, line: None }

On 2fe2550. When I try to create a new profile the migration crashes. ``` # export GOSSIP_PROFILE="relays" # ./target/release/gossip-unstable 2023-08-24T10:18:49.598406Z INFO src/filter.rs:30: No spam filter: No such file or directory (os error 2) 2023-08-24T10:18:49.600133Z INFO src/storage/import/mod.rs:10: Importing SQLITE data into LMDB... 2023-08-24T10:18:49.600686Z INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 1 2023-08-24T10:18:49.606099Z INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 2 2023-08-24T10:18:49.607291Z INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 3 2023-08-24T10:18:49.611273Z INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 4 2023-08-24T10:18:49.612983Z INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 5 2023-08-24T10:18:49.613839Z INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 6 2023-08-24T10:18:49.614431Z INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 7 2023-08-24T10:18:49.614691Z INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 8 2023-08-24T10:18:49.615620Z INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 9 2023-08-24T10:18:49.616220Z INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 10 2023-08-24T10:18:49.617471Z INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 11 2023-08-24T10:18:49.618272Z INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 12 2023-08-24T10:18:49.620785Z INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 13 2023-08-24T10:18:49.621082Z INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 14 2023-08-24T10:18:49.622464Z INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 15 2023-08-24T10:18:49.622735Z INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 16 2023-08-24T10:18:49.623323Z INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 17 2023-08-24T10:18:49.623645Z INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 18 2023-08-24T10:18:49.624031Z INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 19 2023-08-24T10:18:49.625653Z INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 20 2023-08-24T10:18:49.626179Z INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 21 2023-08-24T10:18:49.628925Z INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 22 2023-08-24T10:18:49.629683Z INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 23 2023-08-24T10:18:49.630993Z INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 24 2023-08-24T10:18:49.633474Z INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 25 2023-08-24T10:18:49.633908Z INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 26 2023-08-24T10:18:49.634381Z INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 27 2023-08-24T10:18:49.635897Z INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 28 2023-08-24T10:18:49.636414Z INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 29 2023-08-24T10:18:49.637142Z INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 30 2023-08-24T10:18:49.637701Z INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 31 2023-08-24T10:18:49.640098Z INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 32 2023-08-24T10:18:49.640630Z INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 33 2023-08-24T10:18:49.641185Z INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 34 2023-08-24T10:18:49.646664Z INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 35 2023-08-24T10:18:49.647522Z INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 36 2023-08-24T10:18:49.648002Z INFO src/storage/import/legacy/mod.rs:90: Upgrading database to version 37 2023-08-24T10:18:49.651495Z INFO src/storage/import/legacy/mod.rs:106: Database is at version 37 2023-08-24T10:18:49.651517Z INFO src/storage/import/legacy/mod.rs:122: Normalizing Database URLs (this will take some time) 2023-08-24T10:18:49.651746Z INFO src/storage/import/mod.rs:17: LDMB: setup 2023-08-24T10:18:49.651776Z INFO src/storage/import/mod.rs:24: LMDB: imported local settings. 2023-08-24T10:18:49.651794Z INFO src/storage/import/mod.rs:31: LMDB: imported settings. 2023-08-24T10:18:49.651806Z INFO src/storage/import/mod.rs:41: LMDB: imported event-seen-on-relay data. 2023-08-24T10:18:49.651817Z INFO src/storage/import/mod.rs:52: LMDB: imported event-viewed data. 2023-08-24T10:18:49.651829Z INFO src/storage/import/mod.rs:63: LMDB: imported event hashtag index. 2023-08-24T10:18:49.651843Z INFO src/storage/import/mod.rs:70: LMDB: imported relays. 2023-08-24T10:18:49.651853Z INFO src/storage/import/mod.rs:75: LMDB: imported events and tag index 2023-08-24T10:18:49.651867Z INFO src/storage/import/mod.rs:82: LMDB: imported people 2023-08-24T10:18:49.651879Z INFO src/storage/import/mod.rs:89: LMDB: import person_relays 2023-08-24T10:18:49.651986Z INFO src/storage/import/mod.rs:100: Importing SQLITE data into LMDB: Done. 2023-08-24T10:18:49.652028Z INFO src/storage/migrations/mod.rs:37: LMDB Migration 0 -> 1: Computing and storing event relationships for 0 events... 2023-08-24T10:18:49.652032Z INFO src/storage/migrations/mod.rs:91: syncing... 2023-08-24T10:18:49.652034Z INFO src/storage/migrations/mod.rs:61: done. 2023-08-24T10:18:49.652037Z INFO src/storage/migrations/mod.rs:43: LMDB Migration 1 -> 2: Updating Settings... 2023-08-24T10:18:49.652043Z INFO src/storage/migrations/mod.rs:61: done. 2023-08-24T10:18:49.652045Z INFO src/storage/migrations/mod.rs:47: LMDB Migration 2 -> 3: Removing invalid relays... 2023-08-24T10:18:49.652047Z INFO src/storage/migrations/mod.rs:120: Deleted 0 bad relays 2023-08-24T10:18:49.652049Z INFO src/storage/migrations/mod.rs:61: done. 2023-08-24T10:18:49.652051Z INFO src/storage/migrations/mod.rs:51: LMDB Migration 3 -> 4: Using kv for settings... Error: Error { kind: Speedy(Error { kind: InputBufferIsTooSmall { actual_size: 65, expected_size: 247 } }), file: None, line: None } ```
dtonon commented 2023-08-24 22:27:38 +12:00 (Migrated from github.com)

The same problem happens with a fresh Gossip setup.

The same problem happens with a fresh Gossip setup.
mikedilger commented 2023-08-25 09:29:42 +12:00 (Migrated from github.com)

Yep. Pushed a fix.

Yep. Pushed a fix.
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
nostr/gossip#474
No description provided.