Commit Graph
299 Commits
Author SHA1 Message Date
Axel Uhl 134a13b92b bug5824: trying to fix test which now has to wait for the update task to complete 2023-02-24 18:07:40 +01:00
Axel Uhl fec5e28408 bug5824: enhanced logging 2023-02-24 16:24:46 +01:00
Axel Uhl f3b434ff2c bug5824: introduced update queue and task for IncrementalMstHmmWindEstimationForTrackedRace 2023-02-24 15:30:05 +01:00
Axel Uhl b56a2da2bc Merge branch 'master' into bug2346 2022-10-29 00:20:26 +02:00
Axel Uhl 3964d53ba7 fixed comment 2022-07-27 12:59:58 +02:00
Finn Huelsbusch d888c1fad9 added configuration for eclipse 2022-06 and updated the onboarding 2022-07-07 16:51:33 +02:00
Axel Uhl 59cbdf1e15 bug5741: cache Class.forName results while reading all operations of one RabbitMQ message;
This avoids thousands of expensive Class.forName calls. Now, the next
most expensive thing is reading the class descripors from the stream.
2022-06-16 14:56:26 +02:00
Tim Hessenmüller 2ce706a5bc Merge remote-tracking branch 'origin/master' into bug2346 2022-06-15 13:21:09 +02:00
Axel Uhl 383be72d6b bug5716: catch exception during wind estimation model loading attempt and leave model cache empty;
this will lead to the model being loaded from the import URL provided in
case an exception occurs
2022-04-21 15:11:40 +02:00
Axel Uhl ba371818db bug5694: removed now obsolete classes patched only for serializability 2022-03-18 14:02:20 +01:00
Tim Hessenmüller 295c7e5a47 Merge remote-tracking branch 'origin/master' into bug2346 2021-11-19 15:52:00 +01:00
Axel Uhl 370d23b983 mongo42driver: uncompilable interims commit with *-legacy bundle removed from our bundle dependencies;
this produces lots of compilation errors, mostly because of MongoClientURI replaced by ConnectionString
2021-08-26 23:29:35 +02:00
Axel Uhl 0bd21957a8 MongoDB Driver update: added org.mongodb.bson to all bundles that require it; now it's down to actual deprecations and functions removed/replaced 2021-08-25 21:53:23 +02:00
Axel Uhl 61f1a68ac9 protect against GridFS synchronization issues when a replica starts up and load wind regression models 2021-07-26 10:57:23 +09:00
Axel Uhl cf799d6986 disable WADL generation for all Jersey RESTlets; it is extremely time-consuming 2021-07-25 20:36:50 +09:00
Axel Uhl 4f61f4c925 made loading persistent wind estimation models more resilient against DB race conditions during initialization;
after seeing the following exception:

com.mongodb.MongoGridFSException: No file found with the filename: SERIALIZATION.modelForDistanceBasedTwdDeltaStdRegressor.IncrementalSingleDimensionPolynomialRegressor.DistanceBasedTwdTransitionRegressorFrom1368.0ToMaximum.clf and revision: -1
        at com.mongodb.client.gridfs.GridFSBucketImpl.getFileByName(GridFSBucketImpl.java:558)
        at com.mongodb.client.gridfs.GridFSBucketImpl.openDownloadStream(GridFSBucketImpl.java:265)
        at com.mongodb.client.gridfs.GridFSBucketImpl.openDownloadStream(GridFSBucketImpl.java:260)
        at com.sap.sailing.windestimation.model.store.MongoDbModelStoreImpl.loadAllPersistedModels(MongoDbModelStoreImpl.java:147)
        at com.sap.sailing.windestimation.model.ModelLoader.loadBestModelsForAllContexts(ModelLoader.java:132)
        at com.sap.sailing.windestimation.model.AbstractModelCache.preloadAllModels(AbstractModelCache.java:66)
        at com.sap.sailing.windestimation.model.AbstractModelCache.clearCache(AbstractModelCache.java:121)
        at com.sap.sailing.windestimation.model.regressor.twdtransition.GaussianBasedTwdTransitionDistributionCache.clearCache(GaussianBasedTwdTransitionDistributionCache.java:92)
        at com.sap.sailing.windestimation.integration.WindEstimationFactoryServiceImpl.reloadWindEstimationModels(WindEstimationFactoryServiceImpl.java:164)
        at com.sap.sailing.windestimation.integration.WindEstimationFactoryServiceImpl.clearReplicaState(WindEstimationFactoryServiceImpl.java:150)
        at com.sap.sse.replication.impl.ReplicationServiceImpl.startToReplicateFrom(ReplicationServiceImpl.java:825)
        at com.sap.sse.replication.impl.Activator$1.run(Activator.java:207)

it seems that during replica initialization a DB dropping / clearing may race against the
loading of the models. The gridFs.find() method has listed a file which then doesn't exist when trying to
open it. This would break the entire replication initialization process, and the replica will not
become available. By catching and logging the exception and simply leaving the model empty,
the initial load can then take over, and all models should be fine.
2021-07-16 12:19:04 +02:00
Axel Uhl 2c622e5b45 patched <!DOCTYPE projectDescription> into all project files to avoid info/warning in problems view about no grammar constraint 2021-06-19 12:45:03 +02:00
Axel Uhl 0850670965 bug5576: reverted to a single read-out for TrackedRaceImpl.getWindWithConfidence but average track-based estimation across 30s 2021-06-15 18:05:42 +02:00
Axel Uhl e76eaa9807 use ReadConcern, not WriteConcern when exporting wind estimation models 2021-05-27 10:59:39 +02:00
Axel Uhl ac765dca84 bug4811: place a new "port" field in version.json in the "start" script and use it for replica registration; added new port fields to replication status, for both, replicatedfrom and replicatedby 2021-04-20 16:33:50 +02:00
Axel Uhl cb53096508 Merge branch 'master' into bug4811 2021-04-19 11:27:10 +02:00
Axel Uhl 00f726e710 made all variables / parameters on whose value a lock is obtained/released final and adding missing finally clauses 2021-04-16 16:01:34 +02:00
Axel Uhl 4feff1d222 Merge branch 'master' into bug4811 2021-04-16 12:03:43 +02:00
Axel Uhl ef9097dd5e bug5513 aftermath: fixing class of invalidRequest filter in all shiro.ini files 2021-04-16 12:01:50 +02:00
Axel Uhl 37fb3dc0a5 bug5513: added configuration of Shiro invalidRequest filter for backward compatibility to all shiro.ini files;
re-enabling backslash, semicolon and non-ASCII characters (important, e.g., for Umlaut characters)
in URL paths again
2021-04-16 11:37:44 +02:00
Axel Uhl 26dbb62819 Merge branch 'master' into bug4811 2021-04-13 18:25:48 +02:00
Axel Uhl ae75a94737 bug5513: added the now necessary authc = com.sap.sse.security.CustomFilter to all shiro.ini files, as already documented in Wiki 2021-04-13 09:39:49 +02:00
Axel Uhl 6b23e3a8d8 bug4811: preparing for enforcing replica by setting auto-scaling group minSize 2021-04-08 15:03:20 +02:00
Axel Uhl 4db4b95b62 bug4811: set org.eclipse.jdt.core.compiler.codegen.methodParameters to generate in all preference files; Tycho respects them! 2021-02-16 14:58:38 +01:00
Axel Uhl acf654f412 Merge branch 'master' into bug4811; re-generated launch configs on branch bug4811 2021-02-10 11:34:27 +01:00
Axel Uhl c7cdfc8200 bug4811: moved AbstractReplicableWithObjectInputStream to com.sap.sse.replication.interfaces and used throughout 2021-02-09 14:07:07 +01:00
Tim Hessenmüller 68a92abafb Merge remote-tracking branch 'origin/master' into bug2346 2021-02-05 13:51:03 +01:00
Georg Herdt 07525d4ae1 Merge branch 'master' into bug5480
# Conflicts:
#	java/com.sap.sailing.feature.p2build/raceanalysis.product
#	java/com.sap.sailing.server/SailingServer (No Proxy).launch
#	java/com.sap.sse.security.ui/WEB-INF/web.xml
2021-01-29 09:34:47 +01:00
Axel Uhl 0ca193fa8f bug5482: consolidated AccessControlAndEncodingResponseFilter copies into com.sap.sse bundle 2021-01-21 15:05:24 +01:00
Georg Herdt e6ae9da861 upgrade to recent servlet/web.xml standard of jetty 9.4.
bug 5153
2021-01-17 22:16:10 +01:00
Georg Herdt fbadad0ef7 switch from java.servlet bundle to osgi-servlet bundle to be able to resolve DTDs and XSD for validation (e.g. web.xml)
bug 5153
2021-01-17 22:10:27 +01:00
Tim Hessenmüller 42310bb7f6 Merge remote-tracking branch 'origin/master' into bug2346 2020-12-20 18:47:22 +01:00
Tim Hessenmüller dcfdedadd4 Moved NotEnoughDataHasBeenAddedException into GWT module com.sap.sailing.domain.common.polars 2020-12-20 17:45:40 +01:00
Axel Uhl d8d358db65 made windestimation model export use StreamingOutput; changed env.sh such that polar and windestimation import is not enabled by default;
this is now part of the live-master-server environment
2020-12-11 11:22:10 +01:00
Axel Uhl 28b2b981f0 bug5457: added ReadConcern/WriteConcern for GridFS bucket handling for windestimation models 2020-12-10 18:46:54 +01:00
Axel Uhl be871fefed bug4811: adjusted manifests for new minimum release of httpcomponents bundles 2020-11-02 18:34:37 +01:00
Axel Uhl f1293d3ba2 bug4811: removed warnings by adjusting to httpclient >=4.3, using client builder pattern 2020-11-02 18:28:17 +01:00
Axel Uhl ce85ac9a39 bug4811: removed upper version bounds for org.apache.httpcomponents stuff; added org.apache.commons.logging to target platform 2020-11-02 17:40:51 +01:00
Axel Uhl 6bd4c9239e consistently use Replicable's operation type parameter for apply(...) method parameter 2020-03-24 13:08:20 +01:00
Axel Uhl a18d9de352 report actual replication operation class for wrappers; use single volatile boolean flag for initial load state instead of ThreadLocal 2020-03-06 01:32:48 +01:00
Steffen Schaefer b9f53284b9 Bug 5085: Moved some security related classes to prevent dependency
cycles and adjusted shiro.ini files
2019-12-09 09:21:35 +01:00
Axel Uhl 6a78973b46 removed redundant ObjectInputStream subclass in wind estimation replication code 2019-12-03 15:14:06 +01:00
Axel Uhl f62f672e87 added TODO regarding write lock on estimation wind track 2019-07-27 21:15:10 +02:00
Axel Uhl dc4faaef3e changed synchronization/locking during maneuver-based wind estimation;
using classic synchronization during MST construction, and only later
lock the wind track while updating it. This decouples the MST creation
and Dijkstra calculation from the period the wind track needs to be
locked for
2019-07-24 00:35:14 +02:00
Axel Uhl c530e6d212 improved lock name for IncrementalMstHmmWindEstimationForTrackedRace, including race/regatta name 2019-07-23 23:16:00 +02:00