Modify ↓

Opened 5 months ago

Last modified 4 months ago

#23452 needinfo defect

DataIntegrityProblemException after usage of utilsplugin2.selection.NodeWayUtils

Reported by: Peter Agenga Owned by: Peter Agenga
Priority: normal Milestone:
Component: Core Version: latest
Keywords: template_report Cc:

Description

What steps will reproduce the problem?

What is the expected result?

What happens instead?

Please provide any additional information below. Attach a screenshot if possible.

Revision:18940
Build-Date:2024-01-17 12:43:02

Identification: JOSM/1.5 (18940 en) Windows 11 64-Bit
OS Build number: Windows 10 Pro 2009 (22621)
Memory Usage: 1062 MB / 2026 MB (478 MB allocated, but free)
Java version: 17.0.10+7-LTS, Azul Systems, Inc., OpenJDK 64-Bit Server VM
Look and Feel: com.sun.java.swing.plaf.windows.WindowsLookAndFeel
Screen: \Display0 1366×768 (scaling 1.00×1.00)
Maximum Screen Size: 1366×768
Best cursor sizes: 16×16→32×32, 32×32→32×32
System property file.encoding: Cp1252
System property sun.jnu.encoding: Cp1252
Locale info: en_US
Numbers with default locale: 1234567890 -> 1234567890
VM arguments: [-Djpackage.app-version=1.5.18940, --add-modules=java.scripting,java.sql,javafx.controls,javafx.media,javafx.swing,javafx.web, --add-exports=java.base/sun.security.action=ALL-UNNAMED, --add-exports=java.desktop/com.sun.imageio.plugins.jpeg=ALL-UNNAMED, --add-exports=java.desktop/com.sun.imageio.spi=ALL-UNNAMED, --add-opens=java.base/java.lang=ALL-UNNAMED, --add-opens=java.base/java.nio=ALL-UNNAMED, --add-opens=java.base/jdk.internal.loader=ALL-UNNAMED, --add-opens=java.base/jdk.internal.ref=ALL-UNNAMED, --add-opens=java.desktop/javax.imageio.spi=ALL-UNNAMED, --add-opens=java.desktop/javax.swing.text.html=ALL-UNNAMED, --add-opens=java.prefs/java.util.prefs=ALL-UNNAMED, -Djpackage.app-path=%UserProfile%\AppData\Local\JOSM\JOSM.exe]

Dataset consistency test:
[NO DATASET] {Node id=-4610421146133789624 version=0 MVDT lat=-1.074143000000005,lon=35.8837724} is referenced by {Way id=1244914313 version=1 MVT nodes=[{Node id=11573007117 version=1 MV lat=-1.074124227836191,lon=35.88375965950718}, {Node id=-4610421146133789624 version=0 MVDT lat=-1.074143000000005,lon=35.8837724}, {Node id=11573007116 version=1 V lat=-1.0744487,lon=35.8839199}, {Node id=11573007109 version=1 V lat=-1.0750554,lon=35.884243}, {Node id=11573007118 version=1 V lat=-1.0751916,lon=35.8843128}, {Node id=11573007132 version=1 V lat=-1.0757762,lon=35.8846334}, {Node id=11573007115 version=1 V lat=-1.0761168,lon=35.8847889}, {Node id=11573007114 version=1 V lat=-1.0766665,lon=35.8850867}]} but not found in dataset
[DELETED REFERENCED] {Way id=1244914313 version=1 MVT nodes=[{Node id=11573007117 version=1 MV lat=-1.074124227836191,lon=35.88375965950718}, {Node id=-4610421146133789624 version=0 MVDT lat=-1.074143000000005,lon=35.8837724}, {Node id=11573007116 version=1 V lat=-1.0744487,lon=35.8839199}, {Node id=11573007109 version=1 V lat=-1.0750554,lon=35.884243}, {Node id=11573007118 version=1 V lat=-1.0751916,lon=35.8843128}, {Node id=11573007132 version=1 V lat=-1.0757762,lon=35.8846334}, {Node id=11573007115 version=1 V lat=-1.0761168,lon=35.8847889}, {Node id=11573007114 version=1 V lat=-1.0766665,lon=35.8850867}]} refers to deleted primitive {Node id=-4610421146133789624 version=0 MVDT lat=-1.074143000000005,lon=35.8837724}


Plugins:
+ BuildingGeneralization (36)
+ Mapillary (2.2.0)
+ apache-commons (36176)
+ buildings_tools (36200)
+ mapathoner (1.5.5)
+ mapwithai (827)
+ pmtiles (36156)
+ todo (137)
+ utilsplugin2 (36200)

Map paint styles:
+ https://github.com/osmlab/appledata/archive/josm_paint_inline_validation.zip
+ https://github.com/MissingMaps/josm_styles/archive/master.zip
+ https://josm.openstreetmap.de/josmfile?page=Rules/IncompleteObjectWarnings&zip=1
+ https://josm.openstreetmap.de/josmfile?page=Styles/MapillaryDetections&zip=1
+ https://josm.openstreetmap.de/josmfile?page=Styles/MapWithAI&zip=1

Last errors/warnings:
- 15056.762 E: Bad Request - <html>The OSM server 'https://api.openstreetmap.org/api/0.6/' reported a bad request.<br><br>Error message(untranslated): Placeholder node not found for reference -4610421146133789624 in way 1244914313</html>
- 15112.499 E: Error header: Placeholder node not found for reference -4610421146133789624 in way 1244914313
- 15112.642 E: org.openstreetmap.josm.io.OsmApiException: ResponseCode=400, Error Header=<Placeholder node not found for reference -4610421146133789624 in way 1244914313>
- 15112.645 E: Bad Request - <html>The OSM server 'https://api.openstreetmap.org/api/0.6/' reported a bad request.<br><br>Error message(untranslated): Placeholder node not found for reference -4610421146133789624 in way 1244914313</html>
- 15134.930 E: Error header: Placeholder node not found for reference -4610421146133789624 in way 1244914313
- 15135.070 E: org.openstreetmap.josm.io.OsmApiException: ResponseCode=400, Error Header=<Placeholder node not found for reference -4610421146133789624 in way 1244914313>
- 15135.073 E: Bad Request - <html>The OSM server 'https://api.openstreetmap.org/api/0.6/' reported a bad request.<br><br>Error message(untranslated): Placeholder node not found for reference -4610421146133789624 in way 1244914313</html>
- 15165.485 E: Handled by bug report queue: org.openstreetmap.josm.data.osm.DataIntegrityProblemException: Primitive must be part of the dataset: {Node id=-4610421146133789624 version=0 MVDT lat=-1.074143000000005,lon=35.8837724}
- 15174.183 E: Handled by bug report queue: org.openstreetmap.josm.data.osm.DataIntegrityProblemException: Primitive must be part of the dataset: {Node id=-4610421146133789624 version=0 MVDT lat=-1.074143000000005,lon=35.8837724}
- 15183.737 E: Handled by bug report queue: org.openstreetmap.josm.data.osm.DataIntegrityProblemException: Primitive must be part of the dataset: {Node id=-4610421146133789624 version=0 MVDT lat=-1.074143000000005,lon=35.8837724}



=== REPORTED CRASH DATA ===
BugReportExceptionHandler#handleException:
No data collected.

Warning issued by: BugReportExceptionHandler#handleException

=== STACK TRACE ===
Thread: AWT-EventQueue-0 (23) of main
org.openstreetmap.josm.data.osm.DataIntegrityProblemException: Primitive must be part of the dataset: {Node id=-4610421146133789624 version=0 MVDT lat=-1.074143000000005,lon=35.8837724}
	at org.openstreetmap.josm.data.osm.OsmPrimitive.checkDataset(OsmPrimitive.java:198)
	at org.openstreetmap.josm.data.osm.OsmPrimitive.referrers(OsmPrimitive.java:702)
	at org.openstreetmap.josm.data.osm.OsmPrimitive.referrers(OsmPrimitive.java:723)
	at org.openstreetmap.josm.data.osm.Node.getParentWays(Node.java:366)
	at org.openstreetmap.josm.plugins.utilsplugin2.selection.NodeWayUtils.lambda$addWaysConnectedToWay$0(NodeWayUtils.java:99)
	at java.base/java.lang.Iterable.forEach(Unknown Source)
	at org.openstreetmap.josm.plugins.utilsplugin2.selection.NodeWayUtils.addWaysConnectedToWay(NodeWayUtils.java:99)
	at org.openstreetmap.josm.plugins.utilsplugin2.selection.NodeWayUtils.addWaysConnectedToWaysRecursively(NodeWayUtils.java:236)
	at org.openstreetmap.josm.plugins.utilsplugin2.selection.ConnectedWaysAction.actionPerformed(ConnectedWaysAction.java:47)
	at java.desktop/javax.swing.SwingUtilities.notifyAction(Unknown Source)
	at java.desktop/javax.swing.JComponent.processKeyBinding(Unknown Source)
	at java.desktop/javax.swing.KeyboardManager.fireBinding(Unknown Source)
	at java.desktop/javax.swing.KeyboardManager.fireKeyboardAction(Unknown Source)
	at java.desktop/javax.swing.JComponent.processKeyBindingsForAllComponents(Unknown Source)
	at java.desktop/javax.swing.JComponent.processKeyBindings(Unknown Source)
	at java.desktop/javax.swing.JComponent.processKeyEvent(Unknown Source)
	at java.desktop/java.awt.Component.processEvent(Unknown Source)
	at java.desktop/java.awt.Container.processEvent(Unknown Source)
	at java.desktop/java.awt.Component.dispatchEventImpl(Unknown Source)
	at java.desktop/java.awt.Container.dispatchEventImpl(Unknown Source)
	at java.desktop/java.awt.Component.dispatchEvent(Unknown Source)
	at java.desktop/java.awt.KeyboardFocusManager.redispatchEvent(Unknown Source)
	at java.desktop/java.awt.DefaultKeyboardFocusManager.dispatchKeyEvent(Unknown Source)
	at java.desktop/java.awt.DefaultKeyboardFocusManager.preDispatchKeyEvent(Unknown Source)
	at java.desktop/java.awt.DefaultKeyboardFocusManager.typeAheadAssertions(Unknown Source)
	at java.desktop/java.awt.DefaultKeyboardFocusManager.dispatchEvent(Unknown Source)
	at java.desktop/java.awt.Component.dispatchEventImpl(Unknown Source)
	at java.desktop/java.awt.Container.dispatchEventImpl(Unknown Source)
	at java.desktop/java.awt.Window.dispatchEventImpl(Unknown Source)
	at java.desktop/java.awt.Component.dispatchEvent(Unknown Source)
	at java.desktop/java.awt.EventQueue.dispatchEventImpl(Unknown Source)
	at java.desktop/java.awt.EventQueue$4.run(Unknown Source)
	at java.desktop/java.awt.EventQueue$4.run(Unknown Source)
	at java.base/java.security.AccessController.doPrivileged(Unknown Source)
	at java.base/java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
	at java.base/java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
	at java.desktop/java.awt.EventQueue$5.run(Unknown Source)
	at java.desktop/java.awt.EventQueue$5.run(Unknown Source)
	at java.base/java.security.AccessController.doPrivileged(Unknown Source)
	at java.base/java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
	at java.desktop/java.awt.EventQueue.dispatchEvent(Unknown Source)
	at java.desktop/java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
	at java.desktop/java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
	at java.desktop/java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
	at java.desktop/java.awt.EventDispatchThread.pumpEvents(Unknown Source)
	at java.desktop/java.awt.EventDispatchThread.pumpEvents(Unknown Source)
	at java.desktop/java.awt.EventDispatchThread.run(Unknown Source)

Attachments (0)

Change History (4)

comment:1 by GerdP, 5 months ago

Component: Core validator → Plugin utilsplugin2
Priority: critical → normal
Summary: {{{ Revision:18940 Build-Date:2024-01-17 12:43:02 Identification: JOSM/1.5 (18940 en) Windows 11 64-Bit OS Build number: Windows 10 Pro 2009 (22621) Memory Usage: 1062 MB / 2026 MB (447 MB allocated, but free) Java version: 17.0.10+7-LTS, Azul Systems, Inc., OpenJDK 64-Bit Server VM Look and Feel: com.sun.java.swing.plaf.windows.WindowsLookAndFeel Screen: \Display0 1366×768 (scaling 1.00×1.00) Maximum Screen Size: 1366×768 Best cursor sizes: 16×16→32×32, 32×32→32×32 System property file.encoding: Cp1252 System property sun.jnu.encoding: Cp1252 Locale info: en_US Numbers with default locale: 1234567890 -> 1234567890 VM arguments: [-Djpackage.app-version=1.5.18940, --add-modules=java.scripting,java.sql,javafx.controls,javafx.media,javafx.swing,javafx.web, --add-exports=java.base/sun.security.action=ALL-UNNAMED, --add-exports=java.desktop/com.sun.imageio.plugins.jpeg=ALL-UNNAMED, --add-exports=java.desktop/com.sun.imageio.spi=ALL-UNNAMED, --add-opens=java.base/java.lang=ALL-UNNAMED, --add-opens=java.base/java.nio=ALL-UNNAMED, --add-opens=java.base/jdk.internal.loader=ALL-UNNAMED, --add-opens=java.base/jdk.internal.ref=ALL-UNNAMED, --add-opens=java.desktop/javax.imageio.spi=ALL-UNNAMED, --add-opens=java.desktop/javax.swing.text.html=ALL-UNNAMED, --add-opens=java.prefs/java.util.prefs=ALL-UNNAMED, -Djpackage.app-path=%UserProfile%\AppData\Local\JOSM\JOSM.exe] Dataset consistency test: [NO DATASET] {Node id=-4610421146133789624 version=0 MVDT lat=-1.074143000000005,lon=35.8837724} is referenced by {Way id=1244914313 version=1 MVT nodes=[{Node id=11573007117 version=1 MV lat=-1.074124227836191,lon=35.88375965950718}, {Node id=-4610421146133789624 version=0 MVDT lat=-1.074143000000005,lon=35.8837724}, {Node id=11573007116 version=1 V lat=-1.0744487,lon=35.8839199}, {Node id=11573007109 version=1 V lat=-1.0750554,lon=35.884243}, {Node id=11573007118 version=1 V lat=-1.0751916,lon=35.8843128}, {Node id=11573007132 version=1 V lat=-1.0757762,lon=35.8846334}, {Node id=11573007115 version=1 V lat=-1.0761168,lon=35.8847889}, {Node id=11573007114 version=1 V lat=-1.0766665,lon=35.8850867}]} but not found in dataset [DELETED REFERENCED] {Way id=1244914313 version=1 MVT nodes=[{Node id=11573007117 version=1 MV lat=-1.074124227836191,lon=35.88375965950718}, {Node id=-4610421146133789624 version=0 MVDT lat=-1.074143000000005,lon=35.8837724}, {Node id=11573007116 version=1 V lat=-1.0744487,lon=35.8839199}, {Node id=11573007109 version=1 V lat=-1.0750554,lon=35.884243}, {Node id=11573007118 version=1 V lat=-1.0751916,lon=35.8843128}, {Node id=11573007132 version=1 V lat=-1.0757762,lon=35.8846334}, {Node id=11573007115 version=1 V lat=-1.0761168,lon=35.8847889}, {Node id=11573007114 version=1 V lat=-1.0766665,lon=35.8850867}]} refers to deleted primitive {Node id=-4610421146133789624 version=0 MVDT lat=-1.074143000000005,lon=35.8837724} Plugins: + BuildingGeneralization (36) + Mapillary (2.2.0) + apache-commons (36176) + buildings_tools (36200) + mapathoner (1.5.5) + mapwithai (827) + pmtiles (36156) + todo (137) + utilsplugin2 (36200) Map paint styles: + https://github.com/osmlab/appledata/archive/josm_paint_inline_validation.zip + https://github.com/MissingMaps/josm_styles/archive/master.zip + https://josm.openstreetmap.de/josmfile?page=Rules/IncompleteObjectWarnings&zip=1 + https://josm.openstreetmap.de/josmfile?page=Styles/MapillaryDetections&zip=1 + https://josm.openstreetmap.de/josmfile?page=Styles/MapWithAI&zip=1 Last errors/warnings: - 15056.762 E: Bad Request - <html>The OSM server 'https://api.openstreetmap.org/api/0.6/' reported a bad request.<br><br>Error message(untranslated): Placeholder node not found for reference -4610421146133789624 in way 1244914313</html> - 15112.499 E: Error header: Placeholder node not found for reference -4610421146133789624 in way 1244914313 - 15112.642 E: org.openstreetmap.josm.io.OsmApiException: ResponseCode=400, Error Header=<Placeholder node not found for reference -4610421146133789624 in way 1244914313> - 15112.645 E: Bad Request - <html>The OSM server 'https://api.openstreetmap.org/api/0.6/' reported a bad request.<br><br>Error message(untranslated): Placeholder node not found for reference -4610421146133789624 in way 1244914313</html> - 15134.930 E: Error header: Placeholder node not found for reference -4610421146133789624 in way 1244914313 - 15135.070 E: org.openstreetmap.josm.io.OsmApiException: ResponseCode=400, Error Header=<Placeholder node not found for reference -4610421146133789624 in way 1244914313> - 15135.073 E: Bad Request - <html>The OSM server 'https://api.openstreetmap.org/api/0.6/' reported a bad request.<br><br>Error message(untranslated): Placeholder node not found for reference -4610421146133789624 in way 1244914313</html> - 15165.485 E: Handled by bug report queue: org.openstreetmap.josm.data.osm.DataIntegrityProblemException: Primitive must be part of the dataset: {Node id=-4610421146133789624 version=0 MVDT lat=-1.074143000000005,lon=35.8837724} - 15174.183 E: Handled by bug report queue: org.openstreetmap.josm.data.osm.DataIntegrityProblemException: Primitive must be part of the dataset: {Node id=-4610421146133789624 version=0 MVDT lat=-1.074143000000005,lon=35.8837724} - 15183.737 E: Handled by bug report queue: org.openstreetmap.josm.data.osm.DataIntegrityProblemException: Primitive must be part of the dataset: {Node id=-4610421146133789624 version=0 MVDT lat=-1.074143000000005,lon=35.8837724} === REPORTED CRASH DATA === BugReportExceptionHandler#handleException: No data collected. Warning issued by: BugReportExceptionHandler#handleException === STACK TRACE === Thread: AWT-EventQueue-0 (23) of main org.openstreetmap.josm.data.osm.DataIntegrityProblemException: Primitive must be part of the dataset: {Node id=-4610421146133789624 version=0 MVDT lat=-1.074143000000005,lon=35.8837724} at org.openstreetmap.josm.data.osm.OsmPrimitive.checkDataset(OsmPrimitive.java:198) at org.openstreetmap.josm.data.osm.OsmPrimitive.referrers(OsmPrimitive.java:702) at org.openstreetmap.josm.data.osm.OsmPrimitive.referrers(OsmPrimitive.java:723) at org.openstreetmap.josm.data.osm.Node.getParentWays(Node.java:366) at org.openstreetmap.josm.plugins.utilsplugin2.selection.NodeWayUtils.lambda$addWaysConnectedToWay$0(NodeWayUtils.java:99) at java.base/java.lang.Iterable.forEach(Unknown Source) at org.openstreetmap.josm.plugins.utilsplugin2.selection.NodeWayUtils.addWaysConnectedToWay(NodeWayUtils.java:99) at org.openstreetmap.josm.plugins.utilsplugin2.selection.NodeWayUtils.addWaysConnectedToWaysRecursively(NodeWayUtils.java:236) at org.openstreetmap.josm.plugins.utilsplugin2.selection.ConnectedWaysAction.actionPerformed(ConnectedWaysAction.java:47) at java.desktop/javax.swing.SwingUtilities.notifyAction(Unknown Source) at java.desktop/javax.swing.JComponent.processKeyBinding(Unknown Source) at java.desktop/javax.swing.KeyboardManager.fireBinding(Unknown Source) at java.desktop/javax.swing.KeyboardManager.fireKeyboardAction(Unknown Source) at java.desktop/javax.swing.JComponent.processKeyBindingsForAllComponents(Unknown Source) at java.desktop/javax.swing.JComponent.processKeyBindings(Unknown Source) at java.desktop/javax.swing.JComponent.processKeyEvent(Unknown Source) at java.desktop/java.awt.Component.processEvent(Unknown Source) at java.desktop/java.awt.Container.processEvent(Unknown Source) at java.desktop/java.awt.Component.dispatchEventImpl(Unknown Source) at java.desktop/java.awt.Container.dispatchEventImpl(Unknown Source) at java.desktop/java.awt.Component.dispatchEvent(Unknown Source) at java.desktop/java.awt.KeyboardFocusManager.redispatchEvent(Unknown Source) at java.desktop/java.awt.DefaultKeyboardFocusManager.dispatchKeyEvent(Unknown Source) at java.desktop/java.awt.DefaultKeyboardFocusManager.preDispatchKeyEvent(Unknown Source) at java.desktop/java.awt.DefaultKeyboardFocusManager.typeAheadAssertions(Unknown Source) at java.desktop/java.awt.DefaultKeyboardFocusManager.dispatchEvent(Unknown Source) at java.desktop/java.awt.Component.dispatchEventImpl(Unknown Source) at java.desktop/java.awt.Container.dispatchEventImpl(Unknown Source) at java.desktop/java.awt.Window.dispatchEventImpl(Unknown Source) at java.desktop/java.awt.Component.dispatchEvent(Unknown Source) at java.desktop/java.awt.EventQueue.dispatchEventImpl(Unknown Source) at java.desktop/java.awt.EventQueue$4.run(Unknown Source) at java.desktop/java.awt.EventQueue$4.run(Unknown Source) at java.base/java.security.AccessController.doPrivileged(Unknown Source) at java.base/java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source) at java.base/java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source) at java.desktop/java.awt.EventQueue$5.run(Unknown Source) at java.desktop/java.awt.EventQueue$5.run(Unknown Source) at java.base/java.security.AccessController.doPrivileged(Unknown Source) at java.base/java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source) at java.desktop/java.awt.EventQueue.dispatchEvent(Unknown Source) at java.desktop/java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source) at java.desktop/java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source) at java.desktop/java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source) at java.desktop/java.awt.EventDispatchThread.pumpEvents(Unknown Source) at java.desktop/java.awt.EventDispatchThread.pumpEvents(Unknown Source) at java.desktop/java.awt.EventDispatchThread.run(Unknown Source) }}} → DataIntegrityProblemException after usage of utilsplugin2.selection.NodeWayUtils
Type: task → defect

comment:2 by GerdP, 5 months ago

I was not yet able to reproduce this. You somehow managed to have incorrect data in JOSM, but the function that failed didn't create that error, it is just not handling it correctly. If you still have the data, please save it and (if not very large) attach it here or post a link to it.

comment:3 by skyper, 4 months ago

Component: Plugin utilsplugin2 → Core

It would be really useful to find the cause for the data inconsistency. Was the data already inconsistent when loading? What action (plugin?) produces inconsistent data.
Unfortunately without a complete description of how to reproduce it is almost impossible to find the needle in the hay stack.

comment:4 by skyper, 4 months ago

Owner: changed from team to Peter Agenga
Status: new → needinfo

Modify Ticket

Change Properties
Set your email in Preferences
Action
as needinfo The owner will remain Peter Agenga.
as The resolution will be set. Next status will be 'closed'.
to The owner will be changed from Peter Agenga to the specified user. Next status will be 'new'.
as duplicate The resolution will be set to duplicate. Next status will be 'closed'. The specified ticket will be cross-referenced with this ticket.
The owner will be changed from Peter Agenga to anonymous. Next status will be 'assigned'.

Add Comment
E-mail address and name can be saved in the Preferences .
Attachments ↑ Description ↑
 
Note: See TracTickets for help on using tickets.