[7/8/2025, 11:52:13 AM][INFO][Client] The interface for location Test - MFA(ID: 21) has been created successfully, interface name: utun8.
[7/8/2025, 11:52:13 AM][INFO][Client] A background task has been spawned to watch the defguard service log file for location Test - MFA (interface utun8), location's specific collected logs will be displayed in the location's detailed view.
[7/8/2025, 11:58:38 AM][WARN][Client] slow statement: execution time exceeded alert threshold summary="DELETE FROM location_stats WHERE …" db.statement="\n\nDELETE FROM location_stats WHERE collected_at < $1\n" rows_affected=0 rows_returned=0 elapsed=5.201211167s elapsed_secs=5.201211167 slow_threshold=1s
[7/8/2025, 11:58:38 AM][ERROR][Client] Failed to purge location stats: Database error: error returned from database: (code: 5) database is locked
[7/8/2025, 11:58:39 AM][WARN][Client] slow statement: execution time exceeded alert threshold summary="WITH cte AS (SELECT …" db.statement="\n\nWITH cte AS (SELECT id, location_id, COALESCE(upload - LAG(upload) OVER (PARTITION BY location_id ORDER BY collected_at), 0) upload, COALESCE(download - LAG(download) OVER (PARTITION BY location_id ORDER BY collected_at), 0) download, last_handshake, strftime($1, collected_at) collected_at, listen_port, persistent_keepalive_interval FROM location_stats ORDER BY collected_at LIMIT -1 OFFSET 1) SELECT id, location_id, SUM(MAX(upload, 0)) \"upload!: i64\", SUM(MAX(download, 0)) \"download!: i64\", last_handshake, collected_at \"collected_at!: NaiveDateTime\", listen_port \"listen_port!: u32\", persistent_keepalive_interval \"persistent_keepalive_interval?: u16\" FROM cte WHERE location_id = $2 AND collected_at >= $3 GROUP BY collected_at ORDER BY collected_at LIMIT $4\n" rows_affected=0 rows_returned=0 elapsed=5.190890709s elapsed_secs=5.190890709 slow_threshold=1s
[7/8/2025, 11:58:39 AM][ERROR][Client] Invoking "location_stats" failed due to unknown error: "Database error: error returned from database: (code: 5) database is locked"
[7/8/2025, 11:58:39 AM][WARN][Client] slow statement: execution time exceeded alert threshold summary="WITH cte AS (SELECT …" db.statement="\n\nWITH cte AS (SELECT id, location_id, COALESCE(upload - LAG(upload) OVER (PARTITION BY location_id ORDER BY collected_at), 0) upload, COALESCE(download - LAG(download) OVER (PARTITION BY location_id ORDER BY collected_at), 0) download, last_handshake, strftime($1, collected_at) collected_at, listen_port, persistent_keepalive_interval FROM location_stats ORDER BY collected_at LIMIT -1 OFFSET 1) SELECT id, location_id, SUM(MAX(upload, 0)) \"upload!: i64\", SUM(MAX(download, 0)) \"download!: i64\", last_handshake, collected_at \"collected_at!: NaiveDateTime\", listen_port \"listen_port!: u32\", persistent_keepalive_interval \"persistent_keepalive_interval?: u16\" FROM cte WHERE location_id = $2 AND collected_at >= $3 GROUP BY collected_at ORDER BY collected_at LIMIT $4\n" rows_affected=0 rows_returned=0 elapsed=5.194387708s elapsed_secs=5.194387708 slow_threshold=1s
[7/8/2025, 11:58:39 AM][ERROR][Client] Invoking "location_stats" failed due to unknown error: "Database error: error returned from database: (code: 5) database is locked"
[7/8/2025, 11:58:39 AM][WARN][Client] slow statement: execution time exceeded alert threshold summary="WITH cte AS (SELECT …" db.statement="\n\nWITH cte AS (SELECT id, location_id, COALESCE(upload - LAG(upload) OVER (PARTITION BY location_id ORDER BY collected_at), 0) upload, COALESCE(download - LAG(download) OVER (PARTITION BY location_id ORDER BY collected_at), 0) download, last_handshake, strftime($1, collected_at) collected_at, listen_port, persistent_keepalive_interval FROM location_stats ORDER BY collected_at LIMIT -1 OFFSET 1) SELECT id, location_id, SUM(MAX(upload, 0)) \"upload!: i64\", SUM(MAX(download, 0)) \"download!: i64\", last_handshake, collected_at \"collected_at!: NaiveDateTime\", listen_port \"listen_port!: u32\", persistent_keepalive_interval \"persistent_keepalive_interval?: u16\" FROM cte WHERE location_id = $2 AND collected_at >= $3 GROUP BY collected_at ORDER BY collected_at LIMIT $4\n" rows_affected=0 rows_returned=0 elapsed=5.214130375s elapsed_secs=5.214130375 slow_threshold=1s
[7/8/2025, 11:58:39 AM][ERROR][Client] Invoking "location_stats" failed due to unknown error: "Database error: error returned from database: (code: 5) database is locked"
[7/8/2025, 11:58:39 AM][WARN][Client] slow statement: execution time exceeded alert threshold summary="WITH cte AS (SELECT …" db.statement="\n\nWITH cte AS (SELECT id, location_id, COALESCE(upload - LAG(upload) OVER (PARTITION BY location_id ORDER BY collected_at), 0) upload, COALESCE(download - LAG(download) OVER (PARTITION BY location_id ORDER BY collected_at), 0) download, last_handshake, strftime($1, collected_at) collected_at, listen_port, persistent_keepalive_interval FROM location_stats ORDER BY collected_at LIMIT -1 OFFSET 1) SELECT id, location_id, SUM(MAX(upload, 0)) \"upload!: i64\", SUM(MAX(download, 0)) \"download!: i64\", last_handshake, collected_at \"collected_at!: NaiveDateTime\", listen_port \"listen_port!: u32\", persistent_keepalive_interval \"persistent_keepalive_interval?: u16\" FROM cte WHERE location_id = $2 AND collected_at >= $3 GROUP BY collected_at ORDER BY collected_at LIMIT $4\n" rows_affected=0 rows_returned=0 elapsed=5.193135584s elapsed_secs=5.193135584 slow_threshold=1s
[7/8/2025, 11:58:39 AM][WARN][Client] slow statement: execution time exceeded alert threshold summary="WITH cte AS (SELECT …" db.statement="\n\nWITH cte AS (SELECT id, location_id, COALESCE(upload - LAG(upload) OVER (PARTITION BY location_id ORDER BY collected_at), 0) upload, COALESCE(download - LAG(download) OVER (PARTITION BY location_id ORDER BY collected_at), 0) download, last_handshake, strftime($1, collected_at) collected_at, listen_port, persistent_keepalive_interval FROM location_stats ORDER BY collected_at LIMIT -1 OFFSET 1) SELECT id, location_id, SUM(MAX(upload, 0)) \"upload!: i64\", SUM(MAX(download, 0)) \"download!: i64\", last_handshake, collected_at \"collected_at!: NaiveDateTime\", listen_port \"listen_port!: u32\", persistent_keepalive_interval \"persistent_keepalive_interval?: u16\" FROM cte WHERE location_id = $2 AND collected_at >= $3 GROUP BY collected_at ORDER BY collected_at LIMIT $4\n" rows_affected=0 rows_returned=0 elapsed=5.194517833s elapsed_secs=5.194517833 slow_threshold=1s
[7/8/2025, 11:58:39 AM][ERROR][Client] Invoking "location_stats" failed due to unknown error: "Database error: error returned from database: (code: 5) database is locked"
[7/8/2025, 11:58:39 AM][ERROR][Client] Invoking "location_stats" failed due to unknown error: "Database error: error returned from database: (code: 5) database is locked"
[7/8/2025, 11:58:39 AM][WARN][Client] slow statement: execution time exceeded alert threshold summary="WITH cte AS (SELECT …" db.statement="\n\nWITH cte AS (SELECT id, location_id, COALESCE(upload - LAG(upload) OVER (PARTITION BY location_id ORDER BY collected_at), 0) upload, COALESCE(download - LAG(download) OVER (PARTITION BY location_id ORDER BY collected_at), 0) download, last_handshake, strftime($1, collected_at) collected_at, listen_port, persistent_keepalive_interval FROM location_stats ORDER BY collected_at LIMIT -1 OFFSET 1) SELECT id, location_id, SUM(MAX(upload, 0)) \"upload!: i64\", SUM(MAX(download, 0)) \"download!: i64\", last_handshake, collected_at \"collected_at!: NaiveDateTime\", listen_port \"listen_port!: u32\", persistent_keepalive_interval \"persistent_keepalive_interval?: u16\" FROM cte WHERE location_id = $2 AND collected_at >= $3 GROUP BY collected_at ORDER BY collected_at LIMIT $4\n" rows_affected=0 rows_returned=0 elapsed=5.199624209s elapsed_secs=5.1996242089999996 slow_threshold=1s
[7/8/2025, 11:58:39 AM][WARN][Client] slow statement: execution time exceeded alert threshold summary="WITH cte AS (SELECT …" db.statement="\n\nWITH cte AS (SELECT id, location_id, COALESCE(upload - LAG(upload) OVER (PARTITION BY location_id ORDER BY collected_at), 0) upload, COALESCE(download - LAG(download) OVER (PARTITION BY location_id ORDER BY collected_at), 0) download, last_handshake, strftime($1, collected_at) collected_at, listen_port, persistent_keepalive_interval FROM location_stats ORDER BY collected_at LIMIT -1 OFFSET 1) SELECT id, location_id, SUM(MAX(upload, 0)) \"upload!: i64\", SUM(MAX(download, 0)) \"download!: i64\", last_handshake, collected_at \"collected_at!: NaiveDateTime\", listen_port \"listen_port!: u32\", persistent_keepalive_interval \"persistent_keepalive_interval?: u16\" FROM cte WHERE location_id = $2 AND collected_at >= $3 GROUP BY collected_at ORDER BY collected_at LIMIT $4\n" rows_affected=0 rows_returned=0 elapsed=5.199197667s elapsed_secs=5.199197667 slow_threshold=1s
[7/8/2025, 11:58:39 AM][ERROR][Client] Invoking "location_stats" failed due to unknown error: "Database error: error returned from database: (code: 5) database is locked"
[7/8/2025, 11:58:39 AM][WARN][Client] slow statement: execution time exceeded alert threshold summary="WITH cte AS (SELECT …" db.statement="\n\nWITH cte AS (SELECT id, location_id, COALESCE(upload - LAG(upload) OVER (PARTITION BY location_id ORDER BY collected_at), 0) upload, COALESCE(download - LAG(download) OVER (PARTITION BY location_id ORDER BY collected_at), 0) download, last_handshake, strftime($1, collected_at) collected_at, listen_port, persistent_keepalive_interval FROM location_stats ORDER BY collected_at LIMIT -1 OFFSET 1) SELECT id, location_id, SUM(MAX(upload, 0)) \"upload!: i64\", SUM(MAX(download, 0)) \"download!: i64\", last_handshake, collected_at \"collected_at!: NaiveDateTime\", listen_port \"listen_port!: u32\", persistent_keepalive_interval \"persistent_keepalive_interval?: u16\" FROM cte WHERE location_id = $2 AND collected_at >= $3 GROUP BY collected_at ORDER BY collected_at LIMIT $4\n" rows_affected=0 rows_returned=0 elapsed=5.200887875s elapsed_secs=5.200887875 slow_threshold=1s
[7/8/2025, 11:58:39 AM][ERROR][Client] Invoking "location_stats" failed due to unknown error: "Database error: error returned from database: (code: 5) database is locked"
[7/8/2025, 11:58:39 AM][ERROR][Client] Invoking "location_stats" failed due to unknown error: "Database error: error returned from database: (code: 5) database is locked"
[7/8/2025, 11:58:42 AM][ERROR][Client] Failed to retrieve instance teonite(ID: 2) config from core: Internal error: HTTP request failed for instance teonite(2), url: https://enrollment.teonite.net/, error sending request for url (https://enrollment.teonite.net/api/v1/poll)
[7/8/2025, 11:58:44 AM][WARN][Client] slow statement: execution time exceeded alert threshold summary="DELETE FROM tunnel_stats WHERE …" db.statement="\n\nDELETE FROM tunnel_stats WHERE collected_at < $1\n" rows_affected=0 rows_returned=0 elapsed=5.2177765s elapsed_secs=5.2177765 slow_threshold=1s
[7/8/2025, 11:58:44 AM][ERROR][Client] Failed to purge tunnel stats: Database error: error returned from database: (code: 5) database is locked
[7/8/2025, 11:58:45 AM][WARN][Client] slow statement: execution time exceeded alert threshold summary="WITH cte AS (SELECT …" db.statement="\n\nWITH cte AS (SELECT id, location_id, COALESCE(upload - LAG(upload) OVER (PARTITION BY location_id ORDER BY collected_at), 0) upload, COALESCE(download - LAG(download) OVER (PARTITION BY location_id ORDER BY collected_at), 0) download, last_handshake, strftime($1, collected_at) collected_at, listen_port, persistent_keepalive_interval FROM location_stats ORDER BY collected_at LIMIT -1 OFFSET 1) SELECT id, location_id, SUM(MAX(upload, 0)) \"upload!: i64\", SUM(MAX(download, 0)) \"download!: i64\", last_handshake, collected_at \"collected_at!: NaiveDateTime\", listen_port \"listen_port!: u32\", persistent_keepalive_interval \"persistent_keepalive_interval?: u16\" FROM cte WHERE location_id = $2 AND collected_at >= $3 GROUP BY collected_at ORDER BY collected_at LIMIT $4\n" rows_affected=0 rows_returned=0 elapsed=5.204426542s elapsed_secs=5.204426542 slow_threshold=1s
[7/8/2025, 11:58:45 AM][ERROR][Client] Invoking "location_stats" failed due to unknown error: "Database error: error returned from database: (code: 5) database is locked"
[7/8/2025, 11:58:45 AM][WARN][Client] slow statement: execution time exceeded alert threshold summary="WITH cte AS (SELECT …" db.statement="\n\nWITH cte AS (SELECT id, location_id, COALESCE(upload - LAG(upload) OVER (PARTITION BY location_id ORDER BY collected_at), 0) upload, COALESCE(download - LAG(download) OVER (PARTITION BY location_id ORDER BY collected_at), 0) download, last_handshake, strftime($1, collected_at) collected_at, listen_port, persistent_keepalive_interval FROM location_stats ORDER BY collected_at LIMIT -1 OFFSET 1) SELECT id, location_id, SUM(MAX(upload, 0)) \"upload!: i64\", SUM(MAX(download, 0)) \"download!: i64\", last_handshake, collected_at \"collected_at!: NaiveDateTime\", listen_port \"listen_port!: u32\", persistent_keepalive_interval \"persistent_keepalive_interval?: u16\" FROM cte WHERE location_id = $2 AND collected_at >= $3 GROUP BY collected_at ORDER BY collected_at LIMIT $4\n" rows_affected=0 rows_returned=0 elapsed=5.204784792s elapsed_secs=5.204784792 slow_threshold=1s
[7/8/2025, 11:58:45 AM][ERROR][Client] Invoking "location_stats" failed due to unknown error: "Database error: error returned from database: (code: 5) database is locked"
[7/8/2025, 11:58:45 AM][WARN][Client] slow statement: execution time exceeded alert threshold summary="WITH cte AS (SELECT …" db.statement="\n\nWITH cte AS (SELECT id, location_id, COALESCE(upload - LAG(upload) OVER (PARTITION BY location_id ORDER BY collected_at), 0) upload, COALESCE(download - LAG(download) OVER (PARTITION BY location_id ORDER BY collected_at), 0) download, last_handshake, strftime($1, collected_at) collected_at, listen_port, persistent_keepalive_interval FROM location_stats ORDER BY collected_at LIMIT -1 OFFSET 1) SELECT id, location_id, SUM(MAX(upload, 0)) \"upload!: i64\", SUM(MAX(download, 0)) \"download!: i64\", last_handshake, collected_at \"collected_at!: NaiveDateTime\", listen_port \"listen_port!: u32\", persistent_keepalive_interval \"persistent_keepalive_interval?: u16\" FROM cte WHERE location_id = $2 AND collected_at >= $3 GROUP BY collected_at ORDER BY collected_at LIMIT $4\n" rows_affected=0 rows_returned=0 elapsed=5.201554583s elapsed_secs=5.201554583 slow_threshold=1s
[7/8/2025, 11:58:45 AM][ERROR][Client] Invoking "location_stats" failed due to unknown error: "Database error: error returned from database: (code: 5) database is locked"
[7/8/2025, 11:58:45 AM][WARN][Client] slow statement: execution time exceeded alert threshold summary="WITH cte AS (SELECT …" db.statement="\n\nWITH cte AS (SELECT id, location_id, COALESCE(upload - LAG(upload) OVER (PARTITION BY location_id ORDER BY collected_at), 0) upload, COALESCE(download - LAG(download) OVER (PARTITION BY location_id ORDER BY collected_at), 0) download, last_handshake, strftime($1, collected_at) collected_at, listen_port, persistent_keepalive_interval FROM location_stats ORDER BY collected_at LIMIT -1 OFFSET 1) SELECT id, location_id, SUM(MAX(upload, 0)) \"upload!: i64\", SUM(MAX(download, 0)) \"download!: i64\", last_handshake, collected_at \"collected_at!: NaiveDateTime\", listen_port \"listen_port!: u32\", persistent_keepalive_interval \"persistent_keepalive_interval?: u16\" FROM cte WHERE location_id = $2 AND collected_at >= $3 GROUP BY collected_at ORDER BY collected_at LIMIT $4\n" rows_affected=0 rows_returned=0 elapsed=5.191352084s elapsed_secs=5.191352084 slow_threshold=1s
[7/8/2025, 11:58:45 AM][ERROR][Client] Invoking "location_stats" failed due to unknown error: "Database error: error returned from database: (code: 5) database is locked"
[7/8/2025, 11:58:45 AM][WARN][Client] slow statement: execution time exceeded alert threshold summary="WITH cte AS (SELECT …" db.statement="\n\nWITH cte AS (SELECT id, location_id, COALESCE(upload - LAG(upload) OVER (PARTITION BY location_id ORDER BY collected_at), 0) upload, COALESCE(download - LAG(download) OVER (PARTITION BY location_id ORDER BY collected_at), 0) download, last_handshake, strftime($1, collected_at) collected_at, listen_port, persistent_keepalive_interval FROM location_stats ORDER BY collected_at LIMIT -1 OFFSET 1) SELECT id, location_id, SUM(MAX(upload, 0)) \"upload!: i64\", SUM(MAX(download, 0)) \"download!: i64\", last_handshake, collected_at \"collected_at!: NaiveDateTime\", listen_port \"listen_port!: u32\", persistent_keepalive_interval \"persistent_keepalive_interval?: u16\" FROM cte WHERE location_id = $2 AND collected_at >= $3 GROUP BY collected_at ORDER BY collected_at LIMIT $4\n" rows_affected=0 rows_returned=0 elapsed=5.197250542s elapsed_secs=5.197250542 slow_threshold=1s
[7/8/2025, 11:58:45 AM][ERROR][Client] Invoking "location_stats" failed due to unknown error: "Database error: error returned from database: (code: 5) database is locked"
[7/8/2025, 11:58:45 AM][WARN][Client] slow statement: execution time exceeded alert threshold summary="WITH cte AS (SELECT …" db.statement="\n\nWITH cte AS (SELECT id, location_id, COALESCE(upload - LAG(upload) OVER (PARTITION BY location_id ORDER BY collected_at), 0) upload, COALESCE(download - LAG(download) OVER (PARTITION BY location_id ORDER BY collected_at), 0) download, last_handshake, strftime($1, collected_at) collected_at, listen_port, persistent_keepalive_interval FROM location_stats ORDER BY collected_at LIMIT -1 OFFSET 1) SELECT id, location_id, SUM(MAX(upload, 0)) \"upload!: i64\", SUM(MAX(download, 0)) \"download!: i64\", last_handshake, collected_at \"collected_at!: NaiveDateTime\", listen_port \"listen_port!: u32\", persistent_keepalive_interval \"persistent_keepalive_interval?: u16\" FROM cte WHERE location_id = $2 AND collected_at >= $3 GROUP BY collected_at ORDER BY collected_at LIMIT $4\n" rows_affected=0 rows_returned=0 elapsed=5.199987792s elapsed_secs=5.199987792 slow_threshold=1s
[7/8/2025, 11:58:45 AM][ERROR][Client] Invoking "location_stats" failed due to unknown error: "Database error: error returned from database: (code: 5) database is locked"
[7/8/2025, 11:58:45 AM][WARN][Client] slow statement: execution time exceeded alert threshold summary="WITH cte AS (SELECT …" db.statement="\n\nWITH cte AS (SELECT id, location_id, COALESCE(upload - LAG(upload) OVER (PARTITION BY location_id ORDER BY collected_at), 0) upload, COALESCE(download - LAG(download) OVER (PARTITION BY location_id ORDER BY collected_at), 0) download, last_handshake, strftime($1, collected_at) collected_at, listen_port, persistent_keepalive_interval FROM location_stats ORDER BY collected_at LIMIT -1 OFFSET 1) SELECT id, location_id, SUM(MAX(upload, 0)) \"upload!: i64\", SUM(MAX(download, 0)) \"download!: i64\", last_handshake, collected_at \"collected_at!: NaiveDateTime\", listen_port \"listen_port!: u32\", persistent_keepalive_interval \"persistent_keepalive_interval?: u16\" FROM cte WHERE location_id = $2 AND collected_at >= $3 GROUP BY collected_at ORDER BY collected_at LIMIT $4\n" rows_affected=0 rows_returned=0 elapsed=5.210313333s elapsed_secs=5.210313333 slow_threshold=1s
[7/8/2025, 11:58:45 AM][ERROR][Client] Invoking "location_stats" failed due to unknown error: "Database error: error returned from database: (code: 5) database is locked"
[7/8/2025, 11:58:45 AM][WARN][Client] slow statement: execution time exceeded alert threshold summary="WITH cte AS (SELECT …" db.statement="\n\nWITH cte AS (SELECT id, location_id, COALESCE(upload - LAG(upload) OVER (PARTITION BY location_id ORDER BY collected_at), 0) upload, COALESCE(download - LAG(download) OVER (PARTITION BY location_id ORDER BY collected_at), 0) download, last_handshake, strftime($1, collected_at) collected_at, listen_port, persistent_keepalive_interval FROM location_stats ORDER BY collected_at LIMIT -1 OFFSET 1) SELECT id, location_id, SUM(MAX(upload, 0)) \"upload!: i64\", SUM(MAX(download, 0)) \"download!: i64\", last_handshake, collected_at \"collected_at!: NaiveDateTime\", listen_port \"listen_port!: u32\", persistent_keepalive_interval \"persistent_keepalive_interval?: u16\" FROM cte WHERE location_id = $2 AND collected_at >= $3 GROUP BY collected_at ORDER BY collected_at LIMIT $4\n" rows_affected=0 rows_returned=0 elapsed=5.225537166s elapsed_secs=5.225537166 slow_threshold=1s
[7/8/2025, 11:58:45 AM][ERROR][Client] Invoking "location_stats" failed due to unknown error: "Database error: error returned from database: (code: 5) database is locked"
[7/8/2025, 11:58:47 AM][ERROR][Client] Failed to retrieve instance Demo(ID: 4) config from core: Internal error: HTTP request failed for instance Demo(4), url: https://enroll.defguard.net/, error sending request for url (https://enroll.defguard.net/api/v1/poll)
[7/8/2025, 11:58:49 AM][WARN][Client] slow statement: execution time exceeded alert threshold summary="INSERT INTO location_stats (location_id, …" db.statement="\n\nINSERT INTO location_stats (location_id, upload, download, last_handshake, collected_at, listen_port, persistent_keepalive_interval) VALUES ($1, $2, $3, $4, $5, $6, $7) RETURNING id \"id!\"\n" rows_affected=0 rows_returned=1 elapsed=5.213201209s elapsed_secs=5.213201209 slow_threshold=1s
[7/8/2025, 11:58:52 AM][WARN][Client] slow statement: execution time exceeded alert threshold summary="WITH cte AS (SELECT …" db.statement="\n\nWITH cte AS (SELECT id, location_id, COALESCE(upload - LAG(upload) OVER (PARTITION BY location_id ORDER BY collected_at), 0) upload, COALESCE(download - LAG(download) OVER (PARTITION BY location_id ORDER BY collected_at), 0) download, last_handshake, strftime($1, collected_at) collected_at, listen_port, persistent_keepalive_interval FROM location_stats ORDER BY collected_at LIMIT -1 OFFSET 1) SELECT id, location_id, SUM(MAX(upload, 0)) \"upload!: i64\", SUM(MAX(download, 0)) \"download!: i64\", last_handshake, collected_at \"collected_at!: NaiveDateTime\", listen_port \"listen_port!: u32\", persistent_keepalive_interval \"persistent_keepalive_interval?: u16\" FROM cte WHERE location_id = $2 AND collected_at >= $3 GROUP BY collected_at ORDER BY collected_at LIMIT $4\n" rows_affected=0 rows_returned=0 elapsed=5.20310575s elapsed_secs=5.20310575 slow_threshold=1s
[7/8/2025, 11:58:52 AM][ERROR][Client] Invoking "location_stats" failed due to unknown error: "Database error: error returned from database: (code: 5) database is locked"
[7/8/2025, 11:58:52 AM][WARN][Client] slow statement: execution time exceeded alert threshold summary="WITH cte AS (SELECT …" db.statement="\n\nWITH cte AS (SELECT id, location_id, COALESCE(upload - LAG(upload) OVER (PARTITION BY location_id ORDER BY collected_at), 0) upload, COALESCE(download - LAG(download) OVER (PARTITION BY location_id ORDER BY collected_at), 0) download, last_handshake, strftime($1, collected_at) collected_at, listen_port, persistent_keepalive_interval FROM location_stats ORDER BY collected_at LIMIT -1 OFFSET 1) SELECT id, location_id, SUM(MAX(upload, 0)) \"upload!: i64\", SUM(MAX(download, 0)) \"download!: i64\", last_handshake, collected_at \"collected_at!: NaiveDateTime\", listen_port \"listen_port!: u32\", persistent_keepalive_interval \"persistent_keepalive_interval?: u16\" FROM cte WHERE location_id = $2 AND collected_at >= $3 GROUP BY collected_at ORDER BY collected_at LIMIT $4\n" rows_affected=0 rows_returned=0 elapsed=5.199995667s elapsed_secs=5.199995667 slow_threshold=1s
[7/8/2025, 11:58:52 AM][ERROR][Client] Invoking "location_stats" failed due to unknown error: "Database error: error returned from database: (code: 5) database is locked"
[7/8/2025, 11:58:52 AM][WARN][Client] slow statement: execution time exceeded alert threshold summary="WITH cte AS (SELECT …" db.statement="\n\nWITH cte AS (SELECT id, location_id, COALESCE(upload - LAG(upload) OVER (PARTITION BY location_id ORDER BY collected_at), 0) upload, COALESCE(download - LAG(download) OVER (PARTITION BY location_id ORDER BY collected_at), 0) download, last_handshake, strftime($1, collected_at) collected_at, listen_port, persistent_keepalive_interval FROM location_stats ORDER BY collected_at LIMIT -1 OFFSET 1) SELECT id, location_id, SUM(MAX(upload, 0)) \"upload!: i64\", SUM(MAX(download, 0)) \"download!: i64\", last_handshake, collected_at \"collected_at!: NaiveDateTime\", listen_port \"listen_port!: u32\", persistent_keepalive_interval \"persistent_keepalive_interval?: u16\" FROM cte WHERE location_id = $2 AND collected_at >= $3 GROUP BY collected_at ORDER BY collected_at LIMIT $4\n" rows_affected=0 rows_returned=0 elapsed=5.210187125s elapsed_secs=5.210187125 slow_threshold=1s
[7/8/2025, 11:58:52 AM][ERROR][Client] Invoking "location_stats" failed due to unknown error: "Database error: error returned from database: (code: 5) database is locked"
[7/8/2025, 11:58:52 AM][WARN][Client] slow statement: execution time exceeded alert threshold summary="WITH cte AS (SELECT …" db.statement="\n\nWITH cte AS (SELECT id, location_id, COALESCE(upload - LAG(upload) OVER (PARTITION BY location_id ORDER BY collected_at), 0) upload, COALESCE(download - LAG(download) OVER (PARTITION BY location_id ORDER BY collected_at), 0) download, last_handshake, strftime($1, collected_at) collected_at, listen_port, persistent_keepalive_interval FROM location_stats ORDER BY collected_at LIMIT -1 OFFSET 1) SELECT id, location_id, SUM(MAX(upload, 0)) \"upload!: i64\", SUM(MAX(download, 0)) \"download!: i64\", last_handshake, collected_at \"collected_at!: NaiveDateTime\", listen_port \"listen_port!: u32\", persistent_keepalive_interval \"persistent_keepalive_interval?: u16\" FROM cte WHERE location_id = $2 AND collected_at >= $3 GROUP BY collected_at ORDER BY collected_at LIMIT $4\n" rows_affected=0 rows_returned=0 elapsed=5.201431s elapsed_secs=5.201431 slow_threshold=1s
[7/8/2025, 11:58:52 AM][ERROR][Client] Invoking "location_stats" failed due to unknown error: "Database error: error returned from database: (code: 5) database is locked"
[7/8/2025, 11:58:52 AM][WARN][Client] slow statement: execution time exceeded alert threshold summary="WITH cte AS (SELECT …" db.statement="\n\nWITH cte AS (SELECT id, location_id, COALESCE(upload - LAG(upload) OVER (PARTITION BY location_id ORDER BY collected_at), 0) upload, COALESCE(download - LAG(download) OVER (PARTITION BY location_id ORDER BY collected_at), 0) download, last_handshake, strftime($1, collected_at) collected_at, listen_port, persistent_keepalive_interval FROM location_stats ORDER BY collected_at LIMIT -1 OFFSET 1) SELECT id, location_id, SUM(MAX(upload, 0)) \"upload!: i64\", SUM(MAX(download, 0)) \"download!: i64\", last_handshake, collected_at \"collected_at!: NaiveDateTime\", listen_port \"listen_port!: u32\", persistent_keepalive_interval \"persistent_keepalive_interval?: u16\" FROM cte WHERE location_id = $2 AND collected_at >= $3 GROUP BY collected_at ORDER BY collected_at LIMIT $4\n" rows_affected=0 rows_returned=0 elapsed=5.207841709s elapsed_secs=5.207841709 slow_threshold=1s
[7/8/2025, 11:58:52 AM][ERROR][Client] Invoking "location_stats" failed due to unknown error: "Database error: error returned from database: (code: 5) database is locked"
[7/8/2025, 11:58:52 AM][WARN][Client] slow statement: execution time exceeded alert threshold summary="WITH cte AS (SELECT …" db.statement="\n\nWITH cte AS (SELECT id, location_id, COALESCE(upload - LAG(upload) OVER (PARTITION BY location_id ORDER BY collected_at), 0) upload, COALESCE(download - LAG(download) OVER (PARTITION BY location_id ORDER BY collected_at), 0) download, last_handshake, strftime($1, collected_at) collected_at, listen_port, persistent_keepalive_interval FROM location_stats ORDER BY collected_at LIMIT -1 OFFSET 1) SELECT id, location_id, SUM(MAX(upload, 0)) \"upload!: i64\", SUM(MAX(download, 0)) \"download!: i64\", last_handshake, collected_at \"collected_at!: NaiveDateTime\", listen_port \"listen_port!: u32\", persistent_keepalive_interval \"persistent_keepalive_interval?: u16\" FROM cte WHERE location_id = $2 AND collected_at >= $3 GROUP BY collected_at ORDER BY collected_at LIMIT $4\n" rows_affected=0 rows_returned=0 elapsed=5.204606375s elapsed_secs=5.204606375 slow_threshold=1s
[7/8/2025, 11:58:52 AM][ERROR][Client] Invoking "location_stats" failed due to unknown error: "Database error: error returned from database: (code: 5) database is locked"
[7/8/2025, 11:58:52 AM][WARN][Client] slow statement: execution time exceeded alert threshold summary="WITH cte AS (SELECT …" db.statement="\n\nWITH cte AS (SELECT id, location_id, COALESCE(upload - LAG(upload) OVER (PARTITION BY location_id ORDER BY collected_at), 0) upload, COALESCE(download - LAG(download) OVER (PARTITION BY location_id ORDER BY collected_at), 0) download, last_handshake, strftime($1, collected_at) collected_at, listen_port, persistent_keepalive_interval FROM location_stats ORDER BY collected_at LIMIT -1 OFFSET 1) SELECT id, location_id, SUM(MAX(upload, 0)) \"upload!: i64\", SUM(MAX(download, 0)) \"download!: i64\", last_handshake, collected_at \"collected_at!: NaiveDateTime\", listen_port \"listen_port!: u32\", persistent_keepalive_interval \"persistent_keepalive_interval?: u16\" FROM cte WHERE location_id = $2 AND collected_at >= $3 GROUP BY collected_at ORDER BY collected_at LIMIT $4\n" rows_affected=0 rows_returned=0 elapsed=5.221582667s elapsed_secs=5.221582667 slow_threshold=1s
[7/8/2025, 11:58:52 AM][ERROR][Client] Invoking "location_stats" failed due to unknown error: "Database error: error returned from database: (code: 5) database is locked"
[7/8/2025, 11:58:52 AM][WARN][Client] slow statement: execution time exceeded alert threshold summary="WITH cte AS (SELECT …" db.statement="\n\nWITH cte AS (SELECT id, location_id, COALESCE(upload - LAG(upload) OVER (PARTITION BY location_id ORDER BY collected_at), 0) upload, COALESCE(download - LAG(download) OVER (PARTITION BY location_id ORDER BY collected_at), 0) download, last_handshake, strftime($1, collected_at) collected_at, listen_port, persistent_keepalive_interval FROM location_stats ORDER BY collected_at LIMIT -1 OFFSET 1) SELECT id, location_id, SUM(MAX(upload, 0)) \"upload!: i64\", SUM(MAX(download, 0)) \"download!: i64\", last_handshake, collected_at \"collected_at!: NaiveDateTime\", listen_port \"listen_port!: u32\", persistent_keepalive_interval \"persistent_keepalive_interval?: u16\" FROM cte WHERE location_id = $2 AND collected_at >= $3 GROUP BY collected_at ORDER BY collected_at LIMIT $4\n" rows_affected=0 rows_returned=0 elapsed=5.216622666s elapsed_secs=5.216622666 slow_threshold=1s
[7/8/2025, 11:58:52 AM][ERROR][Client] Invoking "location_stats" failed due to unknown error: "Database error: error returned from database: (code: 5) database is locked"
[7/8/2025, 11:58:52 AM][ERROR][Client] Failed to retrieve instance Demo DEV(ID: 5) config from core: Internal error: HTTP request failed for instance Demo DEV(5), url: https://enrollment-dev.teonite.net/, error sending request for url (https://enrollment-dev.teonite.net/api/v1/poll)
[7/8/2025, 11:58:52 AM][WARN][Client] slow statement: execution time exceeded alert threshold summary="DELETE FROM location_stats WHERE …" db.statement="\n\nDELETE FROM location_stats WHERE collected_at < $1\n" rows_affected=0 rows_returned=0 elapsed=3.6820105s elapsed_secs=3.6820105 slow_threshold=1s
[7/8/2025, 11:59:27 AM][ERROR][Client] Failed to retrieve instance Acquinox(ID: 1) config from core: Internal error: HTTP request failed for instance Acquinox(1), url: https://enroll.acquinox.capital/, error sending request for url (https://enroll.acquinox.capital/api/v1/poll)
[7/8/2025, 11:59:28 AM][WARN][Client] slow statement: execution time exceeded alert threshold summary="DELETE FROM location_stats WHERE …" db.statement="\n\nDELETE FROM location_stats WHERE collected_at < $1\n" rows_affected=0 rows_returned=0 elapsed=5.1881505s elapsed_secs=5.1881505 slow_threshold=1s
[7/8/2025, 11:59:28 AM][ERROR][Client] Failed to purge location stats: Database error: error returned from database: (code: 5) database is locked
[7/8/2025, 11:59:29 AM][WARN][Client] slow statement: execution time exceeded alert threshold summary="SELECT id \"id: _\", …" db.statement="\n\nSELECT id \"id: _\", instance_id, name, address, pubkey, endpoint, allowed_ips, dns, network_id, route_all_traffic, mfa_enabled, keepalive_interval FROM location WHERE id = $1\n" rows_affected=0 rows_returned=0 elapsed=5.208898125s elapsed_secs=5.208898125 slow_threshold=1s
[7/8/2025, 11:59:30 AM][WARN][Client] slow statement: execution time exceeded alert threshold summary="WITH prev_download AS ( …" db.statement="\n\nWITH prev_download AS (\n SELECT download\n FROM location_stats\n WHERE location_id = $1\n ORDER BY collected_at DESC\n LIMIT 1 OFFSET 1\n )\n SELECT ls.id \"id!: i64\",\n ls.location_id,\n ls.upload \"upload!: i64\",\n ls.download \"download!: i64\",\n ls.last_handshake,\n ls.collected_at \"collected_at!: NaiveDateTime\",\n ls.listen_port \"listen_port!: u32\",\n ls.persistent_keepalive_interval \"persistent_keepalive_interval?: u16\"\n FROM location_stats ls\n LEFT JOIN prev_download pd\n WHERE ls.location_id = $1\n AND (pd.download IS NULL OR ls.download != pd.download)\n ORDER BY ls.collected_at DESC\n LIMIT 1\n" rows_affected=0 rows_returned=0 elapsed=5.219356209s elapsed_secs=5.219356209 slow_threshold=1s
[7/8/2025, 11:59:30 AM][WARN][Client] Verification for location utun8(21) skipped due to database error: Database error: error returned from database: (code: 5) database is locked
[7/8/2025, 11:59:32 AM][ERROR][Client] Failed to retrieve instance teonite(ID: 2) config from core: Internal error: HTTP request failed for instance teonite(2), url: https://enrollment.teonite.net/, error sending request for url (https://enrollment.teonite.net/api/v1/poll)
[7/8/2025, 11:59:33 AM][ERROR][Service] Couldn't send network usage stats update for utun8: channel closed
[7/8/2025, 11:59:33 AM][ERROR][Client] Invoking "disconnect" timed out after 10 seconds
[7/8/2025, 11:59:33 AM][ERROR][Client] Error handling interface: Invoking "disconnect" timed out after 10 seconds
[7/8/2025, 11:59:34 AM][WARN][Client] slow statement: execution time exceeded alert threshold summary="DELETE FROM tunnel_stats WHERE …" db.statement="\n\nDELETE FROM tunnel_stats WHERE collected_at < $1\n" rows_affected=0 rows_returned=0 elapsed=5.194414333s elapsed_secs=5.194414333 slow_threshold=1s
[7/8/2025, 11:59:34 AM][WARN][Client] slow statement: execution time exceeded alert threshold summary="SELECT id \"id: _\", …" db.statement="\n\nSELECT id \"id: _\", instance_id, name, address, pubkey, endpoint, allowed_ips, dns, network_id, route_all_traffic, mfa_enabled, keepalive_interval FROM location WHERE id = $1\n" rows_affected=0 rows_returned=1 elapsed=3.870412917s elapsed_secs=3.870412917 slow_threshold=1s
[7/8/2025, 11:59:34 AM][ERROR][Client] Failed to retrieve instance Demo(ID: 4) config from core: Internal error: Device config not present in response
[7/8/2025, 11:59:34 AM][INFO][Service] Interface utun8 removed successfully
[7/8/2025, 11:59:35 AM][INFO][Client] Automatically retrieved the newest instance configuration from core for 1 instances, sleeping for 30s
[7/8/2025, 11:59:35 AM][WARN][Client] slow statement: execution time exceeded alert threshold summary="INSERT INTO connection (location_id, …" db.statement="\n\nINSERT INTO connection (location_id, start, end) VALUES ($1, $2, $3) RETURNING id \"id!\"\n" rows_affected=0 rows_returned=1 elapsed=1.171470708s elapsed_secs=1.171470708 slow_threshold=1s
[7/8/2025, 11:59:35 AM][INFO][Client] Network interface utun8 for location Test - MFA(ID: 21) has been removed
[7/8/2025, 11:59:35 AM][INFO][Client] Disconnected from location UNKNOWN(ID: 21)
[7/8/2025, 11:59:36 AM][INFO][Client] The background task responsible for watching the defguard service log file for interface utun8 is being stopped.
