t/getQuery
minionworker-1 | [2024-05-15 21:26:45,860: WARNING/ForkPoolWorker-1] ########## Finished namespace:5c9d71061565ca92b097ff494c969b_UncertaintySampling, job_uid=28fcb8a2bb9ae4716a46e4b6a58e63d6, time_enqueued=0.001793, execution_time=0.06032109260559082 ##########
minionworker-1 | [2024-05-15 21:26:45,874: WARNING/ForkPoolWorker-1] #### Finished getQuery, time_enqueued=0.001527, execution_time=0.053614139556884766 ####
nextbackenddocker-1 | [2024-05-15 21:26:46 +0000] [7] [DEBUG] POST /api/experiment/processAnswer
minionworker-1 | [2024-05-15 21:26:46,688: WARNING/ForkPoolWorker-1] #### Finished processAnswer, time_enqueued=0.004867, execution_time=0.03965330123901367 ####
minionworker-1 | [2024-05-15 21:26:46,688: WARNING/ForkPoolWorker-1] >>>>>>>> Starting namespace:5c9d71061565ca92b097ff494c969b_RandomSampling, job_uid=2bb003efb24bb9353c5d7b9372af0715, time_enqueued=0.00165 <<<<<<<<<
nextbackenddocker-1 | [2024-05-15 21:26:46 +0000] [7] [DEBUG] POST /api/experiment/getQuery
minionworker-1 | [2024-05-15 21:26:46,790: WARNING/ForkPoolWorker-1] #### Finished getQuery, time_enqueued=0.002666, execution_time=0.05387735366821289 ####
minionworker-1 | [2024-05-15 21:26:46,809: WARNING/ForkPoolWorker-1] ########## Finished namespace:5c9d71061565ca92b097ff494c969b_RandomSampling, job_uid=2bb003efb24bb9353c5d7b9372af0715, time_enqueued=0.00165, execution_time=0.08316993713378906 ##########
nextbackenddocker-1 | [2024-05-15 21:26:47 +0000] [7] [DEBUG] POST /api/experiment/processAnswer
minionworker-1 | [2024-05-15 21:26:47,452: WARNING/ForkPoolWorker-1] #### Finished processAnswer, time_enqueued=0.00487, execution_time=0.006047248840332031 ####
nextbackenddocker-1 | [2024-05-15 21:26:47 +0000] [7] [DEBUG] POST /api/experiment/getQuery
minionworker-1 | [2024-05-15 21:26:47,528: WARNING/MainProcess] Soft time limit (5s) exceeded for next.broker.celery_app.tasks.apply_sync_by_namespace[54b761dd-7806-4974-b0b2-1befc4cefbce]
minionworker-1 | [2024-05-15 21:26:47,529: WARNING/ForkPoolWorker-2] tasks Exception: SoftTimeLimitExceeded() Traceback (most recent call last):
minionworker-1 | File "/next_backend/next/broker/celery_app/tasks.py", line 201, in apply_sync_by_namespace
minionworker-1 | response, dt = next.utils.timeit(getattr(next_alg, task_name))(butler, args)
minionworker-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
minionworker-1 | File "/next_backend/next/utils.py", line 219, in timed
minionworker-1 | result = f(*args, **kw)
minionworker-1 | ^^^^^^^^^^^^^^
minionworker-1 | File "/next_backend/apps/PoolBasedTripletMDS/algs/CrowdKernel/myAlg.py", line 124, in incremental_embedding_update
minionworker-1 | tau = utilsCrowdKernel.getCrowdKernelTauDistribution(X,S,mu)
minionworker-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
minionworker-1 | File "/next_backend/apps/PoolBasedTripletMDS/algs/CrowdKernel/utilsCrowdKernel.py", line 208, in getCrowdKernelTauDistribution
minionworker-1 | tau[a,i] = tau[a,i] + log( getCrowdKernelTripletProbability(X[q[0]], X[q[1]], X[i], mu=mu))
minionworker-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
minionworker-1 | File "/next_backend/apps/PoolBasedTripletMDS/algs/CrowdKernel/utilsCrowdKernel.py", line 168, in getCrowdKernelTripletProbability
minionworker-1 | ba = norm(b-a)
minionworker-1 | ^^^^^^^^^
minionworker-1 | File "/usr/local/lib/python3.11/site-packages/numpy/linalg/linalg.py", line 2379, in _norm_dispatcher
minionworker-1 | def _norm_dispatcher(x, ord=None, axis=None, keepdims=None):
minionworker-1 |
minionworker-1 | File "/usr/local/lib/python3.11/site-packages/billiard/pool.py", line 228, in soft_timeout_sighandler
minionworker-1 | raise SoftTimeLimitExceeded()
minionworker-1 | billiard.exceptions.SoftTimeLimitExceeded: SoftTimeLimitExceeded()
minionworker-1 | [2024-05-15 21:26:47,529: WARNING/ForkPoolWorker-2] File "/next_backend/next/broker/celery_app/tasks.py", line 201, in apply_sync_by_namespace
minionworker-1 | response, dt = next.utils.timeit(getattr(next_alg, task_name))(butler, args)
minionworker-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
minionworker-1 | [2024-05-15 21:26:47,529: WARNING/ForkPoolWorker-2] File "/next_backend/next/utils.py", line 219, in timed
minionworker-1 | result = f(*args, **kw)
minionworker-1 | ^^^^^^^^^^^^^^
minionworker-1 | [2024-05-15 21:26:47,529: WARNING/ForkPoolWorker-2] File "/next_backend/apps/PoolBasedTripletMDS/algs/CrowdKernel/myAlg.py", line 124, in incremental_embedding_update
minionworker-1 | tau = utilsCrowdKernel.getCrowdKernelTauDistribution(X,S,mu)
minionworker-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
minionworker-1 | [2024-05-15 21:26:47,529: WARNING/ForkPoolWorker-2] File "/next_backend/apps/PoolBasedTripletMDS/algs/CrowdKernel/utilsCrowdKernel.py", line 208, in getCrowdKernelTauDistribution
minionworker-1 | tau[a,i] = tau[a,i] + log( getCrowdKernelTripletProbability(X[q[0]], X[q[1]], X[i], mu=mu))
minionworker-1 | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
minionworker-1 | [2024-05-15 21:26:47,529: WARNING/ForkPoolWorker-2] File "/next_backend/apps/PoolBasedTripletMDS/algs/CrowdKernel/utilsCrowdKernel.py", line 168, in getCrowdKernelTripletProbability
minionworker-1 | ba = norm(b-a)
minionworker-1 | ^^^^^^^^^
minionworker-1 | [2024-05-15 21:26:47,529: WARNING/ForkPoolWorker-2] File "/usr/local/lib/python3.11/site-packages/numpy/linalg/linalg.py", line 2379, in _norm_dispatcher
minionworker-1 | def _norm_dispatcher(x, ord=None, axis=None, keepdims=None):
minionworker-1 |
minionworker-1 | [2024-05-15 21:26:47,529: WARNING/ForkPoolWorker-2] File "/usr/local/lib/python3.11/site-packages/billiard/pool.py", line 228, in soft_timeout_sighandler
minionworker-1 | raise SoftTimeLimitExceeded()
minionworker-1 | [2024-05-15 21:26:47,530: WARNING/ForkPoolWorker-2] >>>>>>>> Starting namespace:5c9d71061565ca92b097ff494c969b_Test, job_uid=8703e697993eb09dddde937b621b02ff, time_enqueued=109.411547 <<<<<<<<<
minionworker-1 | [2024-05-15 21:26:47,551: WARNING/ForkPoolW
