Changeset 3367268

Timestamp:

09/24/2025 02:47:37 PM (5 months ago)

Author:

mxchat

Message:

upgrade to 2.4.4 includes various bug fixes, such as similarity_threshold default setting and streaming fix.

Location:

mxchat-basic

Files:

• tags/2.4.4 (added)
• tags/2.4.4/admin (added)
• tags/2.4.4/admin/class-ajax-handler.php (added)
• tags/2.4.4/admin/class-knowledge-manager.php (added)
• tags/2.4.4/admin/class-pinecone-manager.php (added)
• tags/2.4.4/css (added)
• tags/2.4.4/css/admin-add-ons.css (added)
• tags/2.4.4/css/admin-style.css (added)
• tags/2.4.4/css/chat-style.css (added)
• tags/2.4.4/css/chat-transcripts.css (added)
• tags/2.4.4/css/content-selector.css (added)
• tags/2.4.4/css/intent-style.css (added)
• tags/2.4.4/css/knowledge-style.css (added)
• tags/2.4.4/css/test-panel.css (added)
• tags/2.4.4/images (added)
• tags/2.4.4/images/Icon-01.svg (added)
• tags/2.4.4/images/Icon-02.svg (added)
• tags/2.4.4/images/Icon-03.svg (added)
• tags/2.4.4/images/Icon-04.svg (added)
• tags/2.4.4/images/pro-only-dark.png (added)
• tags/2.4.4/includes (added)
• tags/2.4.4/includes/class-mxchat-addons.php (added)
• tags/2.4.4/includes/class-mxchat-admin.php (added)
• tags/2.4.4/includes/class-mxchat-integrator.php (added)
• tags/2.4.4/includes/class-mxchat-meta-box.php (added)
• tags/2.4.4/includes/class-mxchat-public.php (added)
• tags/2.4.4/includes/class-mxchat-user.php (added)
• tags/2.4.4/includes/class-mxchat-utils.php (added)
• tags/2.4.4/includes/class-mxchat-word-handler.php (added)
• tags/2.4.4/includes/pdf-parser (added)
• tags/2.4.4/includes/pdf-parser/alt_autoload.php (added)
• tags/2.4.4/includes/pdf-parser/src (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Config.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Document.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Element (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Element.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Element/ElementArray.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Element/ElementBoolean.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Element/ElementDate.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Element/ElementHexa.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Element/ElementMissing.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Element/ElementName.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Element/ElementNull.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Element/ElementNumeric.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Element/ElementString.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Element/ElementStruct.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Element/ElementXRef.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Encoding (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Encoding.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Encoding/AbstractEncoding.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Encoding/EncodingLocator.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Encoding/ISOLatin1Encoding.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Encoding/ISOLatin9Encoding.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Encoding/MacRomanEncoding.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Encoding/PDFDocEncoding.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Encoding/PostScriptGlyphs.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Encoding/StandardEncoding.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Encoding/WinAnsiEncoding.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Exception (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Exception/EmptyPdfException.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Exception/EncodingNotFoundException.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Exception/MissingPdfHeaderException.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Exception/NotImplementedException.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Font (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Font.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Font/FontCIDFontType0.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Font/FontCIDFontType2.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Font/FontTrueType.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Font/FontType0.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Font/FontType1.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Font/FontType3.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Header.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/PDFObject.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Page.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Pages.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/Parser.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/RawData (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/RawData/FilterHelper.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/RawData/RawDataParser.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/XObject (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/XObject/Form.php (added)
• tags/2.4.4/includes/pdf-parser/src/Smalot/PdfParser/XObject/Image.php (added)
• tags/2.4.4/js (added)
• tags/2.4.4/js/activation-script.js (added)
• tags/2.4.4/js/chat-script.js (added)
• tags/2.4.4/js/content-selector.js (added)
• tags/2.4.4/js/knowledge-processing.js (added)
• tags/2.4.4/js/meta-box.js (added)
• tags/2.4.4/js/mxchat-admin.js (added)
• tags/2.4.4/js/mxchat-test-streaming.js (added)
• tags/2.4.4/js/mxchat_transcripts.js (added)
• tags/2.4.4/js/test-panel.js (added)
• tags/2.4.4/languages (added)
• tags/2.4.4/languages/mxchat.pot (added)
• tags/2.4.4/mxchat-basic.php (added)
• tags/2.4.4/readme.txt (added)
• trunk/admin/class-ajax-handler.php (modified) (4 diffs)
• trunk/admin/class-knowledge-manager.php (modified) (78 diffs)
• trunk/admin/class-pinecone-manager.php (modified) (36 diffs)
• trunk/includes/class-mxchat-addons.php (modified) (1 diff)
• trunk/includes/class-mxchat-admin.php (modified) (4 diffs)
• trunk/includes/class-mxchat-integrator.php (modified) (30 diffs)
• trunk/js/chat-script.js (modified) (3 diffs)
• trunk/mxchat-basic.php (modified) (3 diffs)
• trunk/readme.txt (modified) (5 diffs)

mxchat-basic/trunk/admin/class-ajax-handler.php

@@ -31 +31 @@
     add_action('wp_ajax_migrate_pinecone_settings', array($this, 'ajax_migrate_pinecone_settings'));
     
-    // License AJAX - FIXED TO MATCH JAVASCRIPT
+    // License AJAX 
     add_action('wp_ajax_mxchat_handle_activate_license', array($this, 'mxchat_handle_activate_license'));
     add_action('wp_ajax_mxchat_check_license_status', array($this, 'mxchat_check_license_status'));
@@ -249 +249 @@
     update_option('mxchat_current_knowledge_bot', $bot_id);
     
-    // Clear caches when switching bots
-    $pinecone_manager = MxChat_Pinecone_Manager::get_instance();
-    $pinecone_manager->mxchat_clear_all_bot_caches();
+    // No cache clearing needed since we removed caching
     
     wp_send_json_success(array(
@@ -499 +497 @@
 
 /**
- * Validates and activates chat license via AJAX - FIXED VERSION
+ * Validates and activates chat license via AJAX
  */
 public function mxchat_handle_activate_license() {
@@ -607 +605 @@
      */
     public function mxchat_check_license_status() {
-        // Verify nonce - FIXED: Use the correct nonce string
+        // Verify nonce
         if (!check_ajax_referer('mxchat_activate_license_nonce', 'security', false)) {
             wp_send_json_error('Security check failed');

mxchat-basic/trunk/admin/class-knowledge-manager.php

@@ -91 +91 @@
         
         // Debug logging
-        error_log('MANUAL BATCH DEBUG: Process type: ' . $process_type);
-        error_log('MANUAL BATCH DEBUG: URL: ' . $url);
+        //error_log('MANUAL BATCH DEBUG: Process type: ' . $process_type);
+        //error_log('MANUAL BATCH DEBUG: URL: ' . $url);
         
         // FIXED: Extract bot_id from stored status instead of POST data
@@ -100 +100 @@
             $status_key = sanitize_key('mxchat_pdf_status_' . md5($url));
             $status = get_transient($status_key);
-            error_log('MANUAL BATCH DEBUG: Status key: ' . $status_key);
-            error_log('MANUAL BATCH DEBUG: Status data: ' . print_r($status, true));
+            //error_log('MANUAL BATCH DEBUG: Status key: ' . $status_key);
+            //error_log('MANUAL BATCH DEBUG: Status data: ' . print_r($status, true));
             
             if ($status && isset($status['bot_id'])) {
                 $bot_id = $status['bot_id'];
-                error_log('MANUAL BATCH DEBUG: Bot ID from status: ' . $bot_id);
+                //error_log('MANUAL BATCH DEBUG: Bot ID from status: ' . $bot_id);
             } else {
-                error_log('MANUAL BATCH DEBUG: No bot_id in status, using default');
+                //error_log('MANUAL BATCH DEBUG: No bot_id in status, using default');
             }
         } elseif ($process_type === 'sitemap') {
@@ -117 +117 @@
         }
         
-        error_log('MANUAL BATCH DEBUG: Final bot_id: ' . $bot_id);
+        //error_log('MANUAL BATCH DEBUG: Final bot_id: ' . $bot_id);
         
         $processed = 0;
@@ -123 +123 @@
         if ($process_type === 'pdf') {
             $processed = $this->mxchat_manual_process_pdf_batch($url);
-            error_log('MANUAL BATCH DEBUG: PDF processing returned: ' . $processed);
+            //error_log('MANUAL BATCH DEBUG: PDF processing returned: ' . $processed);
         } elseif ($process_type === 'sitemap') {
             $processed = $this->mxchat_manual_process_sitemap_batch($url);
@@ -149 +149 @@
         
     } catch (Exception $e) {
-        error_log('MANUAL BATCH DEBUG: Exception: ' . $e->getMessage());
+        //error_log('MANUAL BATCH DEBUG: Exception: ' . $e->getMessage());
         wp_send_json_error('Processing failed: ' . $e->getMessage());
     }
@@ -156 +156 @@
 private function mxchat_manual_process_pdf_batch($pdf_url) {
     try {
-        error_log('MANUAL PDF DEBUG: Starting batch processing for: ' . $pdf_url);
+        //error_log('MANUAL PDF DEBUG: Starting batch processing for: ' . $pdf_url);
         
         $status_key = sanitize_key('mxchat_pdf_status_' . md5($pdf_url));
         $status = get_transient($status_key);
         
-        error_log('MANUAL PDF DEBUG: Status key: ' . $status_key);
-        error_log('MANUAL PDF DEBUG: Status data: ' . print_r($status, true));
+        //error_log('MANUAL PDF DEBUG: Status key: ' . $status_key);
+        //error_log('MANUAL PDF DEBUG: Status data: ' . print_r($status, true));
         
         if (!$status || $status['status'] !== 'processing') {
-            error_log('MANUAL PDF DEBUG: No processing status found or status is not processing');
-            error_log('MANUAL PDF DEBUG: Status: ' . ($status ? $status['status'] : 'NULL'));
+            //error_log('MANUAL PDF DEBUG: No processing status found or status is not processing');
+            //error_log('MANUAL PDF DEBUG: Status: ' . ($status ? $status['status'] : 'NULL'));
             return 0;
         }
@@ -172 +172 @@
         // FIXED: Extract bot_id from status
         $bot_id = $status['bot_id'] ?? 'default';
-        error_log('MANUAL PDF DEBUG: Bot ID from status: ' . $bot_id);
+        //error_log('MANUAL PDF DEBUG: Bot ID from status: ' . $bot_id);
         
         // Get current progress
@@ -178 +178 @@
         $total_pages = $status['total_pages'] ?? 0;
         
-        error_log('MANUAL PDF DEBUG: Current page: ' . $current_page . ', Total pages: ' . $total_pages);
+        //error_log('MANUAL PDF DEBUG: Current page: ' . $current_page . ', Total pages: ' . $total_pages);
         
         if ($current_page >= $total_pages) {
-            error_log('MANUAL PDF DEBUG: Already completed');
+            //error_log('MANUAL PDF DEBUG: Already completed');
             return 0;
         }
         
         // Try to download the PDF again for processing
-        error_log('MANUAL PDF DEBUG: Attempting to download PDF');
+        //error_log('MANUAL PDF DEBUG: Attempting to download PDF');
         $response = wp_remote_get($pdf_url, array('timeout' => 30));
         
         if (is_wp_error($response)) {
-            error_log('MANUAL PDF DEBUG: Failed to download PDF: ' . $response->get_error_message());
+            //error_log('MANUAL PDF DEBUG: Failed to download PDF: ' . $response->get_error_message());
             return 0;
         }
@@ -196 +196 @@
         $pdf_content = wp_remote_retrieve_body($response);
         if (empty($pdf_content)) {
-            error_log('MANUAL PDF DEBUG: Empty PDF content');
+            //error_log('MANUAL PDF DEBUG: Empty PDF content');
             return 0;
         }
         
-        error_log('MANUAL PDF DEBUG: PDF content size: ' . strlen($pdf_content) . ' bytes');
+        //error_log('MANUAL PDF DEBUG: PDF content size: ' . strlen($pdf_content) . ' bytes');
         
         // Save PDF temporarily
@@ -207 +207 @@
         file_put_contents($temp_pdf_path, $pdf_content);
         
-        error_log('MANUAL PDF DEBUG: Temp PDF saved to: ' . $temp_pdf_path);
+        //error_log('MANUAL PDF DEBUG: Temp PDF saved to: ' . $temp_pdf_path);
         
         // Process 5 pages directly with bot_id
         $processed = $this->mxchat_process_pdf_pages_direct($temp_pdf_path, $pdf_url, $current_page, 5, $bot_id);
         
-        error_log('MANUAL PDF DEBUG: Direct processing returned: ' . $processed);
+        //error_log('MANUAL PDF DEBUG: Direct processing returned: ' . $processed);
         
         // Clean up temp file
         if (file_exists($temp_pdf_path)) {
             wp_delete_file($temp_pdf_path);
-            error_log('MANUAL PDF DEBUG: Cleaned up temp file');
+            //error_log('MANUAL PDF DEBUG: Cleaned up temp file');
         }
         
@@ -223 +223 @@
         
     } catch (Exception $e) {
-        error_log('MANUAL PDF DEBUG: Exception in manual batch: ' . $e->getMessage());
+        //error_log('MANUAL PDF DEBUG: Exception in manual batch: ' . $e->getMessage());
         return 0;
     }
@@ -547 +547 @@
 public function mxchat_handle_pdf_for_knowledge_base($pdf_url, $response, $bot_id = 'default') {
     if (!current_user_can('manage_options')) {
-        error_log('[PDF DEBUG] Unauthorized PDF processing attempt');
+        //error_log('[PDF DEBUG] Unauthorized PDF processing attempt');
         return false;
     }
 
-    error_log('[PDF DEBUG] Starting PDF processing for bot: ' . $bot_id);
-    error_log('[PDF DEBUG] PDF URL: ' . $pdf_url);
+    //error_log('[PDF DEBUG] Starting PDF processing for bot: ' . $bot_id);
+    //error_log('[PDF DEBUG] PDF URL: ' . $pdf_url);
 
     $pdf_url = esc_url_raw($pdf_url);
@@ -558 +558 @@
 
     if (isset($upload_dir['error']) && $upload_dir['error'] !== false) {
-        error_log('[PDF DEBUG] Upload directory error: ' . $upload_dir['error']);
+        //error_log('[PDF DEBUG] Upload directory error: ' . $upload_dir['error']);
         return false;
     }
@@ -567 +567 @@
     $response_body = wp_remote_retrieve_body($response);
     if (empty($response_body)) {
-        error_log('[PDF DEBUG] Empty PDF response body');
+        //error_log('[PDF DEBUG] Empty PDF response body');
         return false;
     }
 
     if (!wp_mkdir_p(dirname($pdf_path))) {
-        error_log('[PDF DEBUG] Failed to create directory for PDF: ' . $pdf_path);
+        //error_log('[PDF DEBUG] Failed to create directory for PDF: ' . $pdf_path);
         return false;
     }
@@ -589 +589 @@
         }
 
-        error_log('[PDF DEBUG] PDF validated successfully with ' . $total_pages . ' pages');
+        //error_log('[PDF DEBUG] PDF validated successfully with ' . $total_pages . ' pages');
 
         // UPDATED: Pass bot_id to PDF processing cron
@@ -601 +601 @@
         ));
 
-        error_log('[PDF DEBUG] Cron job scheduled with bot_id: ' . $bot_id);
+        //error_log('[PDF DEBUG] Cron job scheduled with bot_id: ' . $bot_id);
 
         // UPDATED: Store bot_id in status data
@@ -615 +615 @@
         set_transient($status_key, $status_data, DAY_IN_SECONDS);
 
-        error_log('[PDF DEBUG] Status stored with bot_id: ' . $bot_id . ' using key: ' . $status_key);
+        //error_log('[PDF DEBUG] Status stored with bot_id: ' . $bot_id . ' using key: ' . $status_key);
 
         return __('scheduled', 'mxchat');
 
     } catch (Exception $e) {
-        error_log('[PDF DEBUG] Error preparing PDF for processing: ' . $e->getMessage());
+        //error_log('[PDF DEBUG] Error preparing PDF for processing: ' . $e->getMessage());
         if (file_exists($pdf_path)) {
             wp_delete_file($pdf_path);
@@ -788 +788 @@
 public function mxchat_process_pdf_pages_cron($pdf_path, $pdf_url, $total_pages, $batch_size, $batch_pause, $bot_id = 'default') {
     // ADD THIS DEBUG SECTION AT THE VERY BEGINNING
-    error_log('[PDF CRON DEBUG] ===== PDF Cron Job Started =====');
-    error_log('[PDF CRON DEBUG] Initial bot_id parameter: ' . $bot_id);
-    error_log('[PDF CRON DEBUG] Received parameters:');
-    error_log('[PDF CRON DEBUG] - pdf_path: ' . $pdf_path);
-    error_log('[PDF CRON DEBUG] - pdf_url: ' . $pdf_url);
-    error_log('[PDF CRON DEBUG] - total_pages: ' . $total_pages);
-    error_log('[PDF CRON DEBUG] - batch_size: ' . $batch_size);
-    error_log('[PDF CRON DEBUG] - batch_pause: ' . $batch_pause);
-    error_log('[PDF CRON DEBUG] - Total args received: ' . func_num_args());
-    error_log('[PDF CRON DEBUG] - All args: ' . print_r(func_get_args(), true));
+    //error_log('[PDF CRON DEBUG] ===== PDF Cron Job Started =====');
+    //error_log('[PDF CRON DEBUG] Initial bot_id parameter: ' . $bot_id);
+    //error_log('[PDF CRON DEBUG] Received parameters:');
+    //error_log('[PDF CRON DEBUG] - pdf_path: ' . $pdf_path);
+    //error_log('[PDF CRON DEBUG] - pdf_url: ' . $pdf_url);
+    //error_log('[PDF CRON DEBUG] - total_pages: ' . $total_pages);
+    //error_log('[PDF CRON DEBUG] - batch_size: ' . $batch_size);
+    //error_log('[PDF CRON DEBUG] - batch_pause: ' . $batch_pause);
+    //error_log('[PDF CRON DEBUG] - Total args received: ' . func_num_args());
+    //error_log('[PDF CRON DEBUG] - All args: ' . print_r(func_get_args(), true));
     
     // FIXED: Get the correct bot_id from stored status instead of relying on cron parameters
@@ -805 +805 @@
     if ($status && isset($status['bot_id'])) {
         $bot_id = $status['bot_id'];
-        error_log('[PDF CRON DEBUG] Using bot_id from status: ' . $bot_id);
+        //error_log('[PDF CRON DEBUG] Using bot_id from status: ' . $bot_id);
     } else {
-        error_log('[PDF CRON DEBUG] No bot_id in status, using default: ' . $bot_id);
+        //error_log('[PDF CRON DEBUG] No bot_id in status, using default: ' . $bot_id);
     }
     
@@ -876 +876 @@
         $options = !empty($bot_options) ? $bot_options : get_option('mxchat_options');
         
-        error_log('[PDF CRON DEBUG] Using bot options for bot: ' . $bot_id);
+        //error_log('[PDF CRON DEBUG] Using bot options for bot: ' . $bot_id);
         
         if (empty($options['api_key'])) {
@@ -939 +939 @@
                     $page_processed = true;
                     $successful_pages++;
-                    error_log('[PDF CRON DEBUG] Successfully processed page ' . $page_number . ' for bot: ' . $bot_id);
+                    //error_log('[PDF CRON DEBUG] Successfully processed page ' . $page_number . ' for bot: ' . $bot_id);
                     
                 } catch (Exception $e) {
@@ -945 +945 @@
                     $last_error = $e->getMessage();
                     
-                    error_log("PDF page {$page_number} failed (attempt {$retry_count}/{$max_retries}): " . $last_error);
+                    //error_log("PDF page {$page_number} failed (attempt {$retry_count}/{$max_retries}): " . $last_error);
                     
                     if ($retry_count < $max_retries) {
@@ -967 +967 @@
                 }
                 
-                error_log("PDF page {$page_number} permanently failed after {$max_retries} attempts: " . $last_error);
+                //error_log("PDF page {$page_number} permanently failed after {$max_retries} attempts: " . $last_error);
             }
 
@@ -1007 +1007 @@
             }
             
-            error_log('[PDF CRON DEBUG] PDF processing completed for bot: ' . $bot_id);
+            //error_log('[PDF CRON DEBUG] PDF processing completed for bot: ' . $bot_id);
         }
 
     } catch (\Exception $e) {
-        error_log(sprintf('[MXCHAT-PDF] Error processing PDF for bot %s: %s', $bot_id, $e->getMessage()));
+        //error_log(sprintf('[MXCHAT-PDF] Error processing PDF for bot %s: %s', $bot_id, $e->getMessage()));
         
         $status_key = sanitize_key('mxchat_pdf_status_' . md5($pdf_url));
@@ -1142 +1142 @@
 public function mxchat_handle_sitemap_submission() {
     // START DEBUG
-    error_log('[SITEMAP DEBUG] ===== Starting URL submission process =====');
-    error_log('[SITEMAP DEBUG] POST data: ' . print_r($_POST, true));
+    //error_log('[SITEMAP DEBUG] ===== Starting URL submission process =====');
+    //error_log('[SITEMAP DEBUG] POST data: ' . print_r($_POST, true));
     
     // Get bot_id from form submission EARLY for debugging
     $bot_id = isset($_POST['bot_id']) ? sanitize_key($_POST['bot_id']) : 'default';
-    error_log('[SITEMAP DEBUG] Extracted bot_id: ' . $bot_id);
-    error_log('[SITEMAP DEBUG] Class exists MxChat_Multi_Bot_Manager: ' . (class_exists('MxChat_Multi_Bot_Manager') ? 'YES' : 'NO'));
+    //error_log('[SITEMAP DEBUG] Extracted bot_id: ' . $bot_id);
+    //error_log('[SITEMAP DEBUG] Class exists MxChat_Multi_Bot_Manager: ' . (class_exists('MxChat_Multi_Bot_Manager') ? 'YES' : 'NO'));
     // END DEBUG
 
     // Check if the form was submitted and verify permissions
     if (!isset($_POST['submit_sitemap']) || !current_user_can('manage_options')) {
-        error_log('[SITEMAP DEBUG] Error: Unauthorized access or form not submitted properly');
+        //error_log('[SITEMAP DEBUG] Error: Unauthorized access or form not submitted properly');
         wp_die(esc_html__('Unauthorized access', 'mxchat'));
     }
 
     // Verify nonce
-    error_log('[SITEMAP DEBUG] Verifying nonce');
+    //error_log('[SITEMAP DEBUG] Verifying nonce');
     check_admin_referer('mxchat_submit_sitemap_action', 'mxchat_submit_sitemap_nonce');
 
     // Validate URL
     if (!isset($_POST['sitemap_url']) || empty($_POST['sitemap_url'])) {
-        error_log('[SITEMAP DEBUG] Error: Empty or missing URL');
+        //error_log('[SITEMAP DEBUG] Error: Empty or missing URL');
         set_transient('mxchat_admin_notice_error',
             esc_html__('Please provide a valid URL.', 'mxchat'),
@@ -1175 +1175 @@
     
     // Continue processing with already extracted bot_id
-    error_log('[SITEMAP DEBUG] Processing URL: ' . $submitted_url . ' for bot: ' . $bot_id);
+    //error_log('[SITEMAP DEBUG] Processing URL: ' . $submitted_url . ' for bot: ' . $bot_id);
 
     // UPDATED: Get bot-specific options and validate API key
     $bot_options = $this->get_bot_options($bot_id);
-    error_log('[SITEMAP DEBUG] Bot options retrieved: ' . print_r($bot_options, true));
+    //error_log('[SITEMAP DEBUG] Bot options retrieved: ' . print_r($bot_options, true));
     
     $options = !empty($bot_options) ? $bot_options : get_option('mxchat_options');
     $selected_model = $options['embedding_model'] ?? 'text-embedding-ada-002';
     
-    error_log('[SITEMAP DEBUG] Selected embedding model: ' . $selected_model);
+    //error_log('[SITEMAP DEBUG] Selected embedding model: ' . $selected_model);
     
     if (strpos($selected_model, 'voyage') === 0) {
@@ -1197 +1197 @@
     }
     
-    error_log('[SITEMAP DEBUG] Provider: ' . $provider_name . ', Has API key: ' . (!empty($api_key) ? 'YES' : 'NO'));
+    //error_log('[SITEMAP DEBUG] Provider: ' . $provider_name . ', Has API key: ' . (!empty($api_key) ? 'YES' : 'NO'));
     
     if (empty($api_key)) {
@@ -1204 +1204 @@
             $provider_name
         );
-        error_log('[SITEMAP DEBUG] Error: ' . $error_message);
+        //error_log('[SITEMAP DEBUG] Error: ' . $error_message);
         set_transient('mxchat_admin_notice_error', $error_message, 30);
         wp_safe_redirect(esc_url(admin_url('admin.php?page=mxchat-prompts')));
@@ -1210 +1210 @@
     }
 
-    error_log('[SITEMAP DEBUG] Fetching URL content');
+    //error_log('[SITEMAP DEBUG] Fetching URL content');
     $response = wp_remote_get($submitted_url, array('timeout' => 30));
 
     if (is_wp_error($response) || wp_remote_retrieve_response_code($response) !== 200) {
         $error_message = is_wp_error($response) ? $response->get_error_message() : 'HTTP Status: ' . wp_remote_retrieve_response_code($response);
-        error_log('[SITEMAP DEBUG] Error fetching URL: ' . $error_message);
+        //error_log('[SITEMAP DEBUG] Error fetching URL: ' . $error_message);
         set_transient('mxchat_admin_notice_error',
             sprintf(
@@ -1228 +1228 @@
 
     $content_type = wp_remote_retrieve_header($response, 'content-type');
-    error_log('[SITEMAP DEBUG] Content type: ' . $content_type);
+    //error_log('[SITEMAP DEBUG] Content type: ' . $content_type);
     $body_content = wp_remote_retrieve_body($response);
 
     if (empty($body_content)) {
-        error_log('[SITEMAP DEBUG] Error: Empty response body');
+        //error_log('[SITEMAP DEBUG] Error: Empty response body');
         set_transient('mxchat_admin_notice_error',
             esc_html__('Empty response received from URL.', 'mxchat'),
@@ -1240 +1240 @@
         exit;
     }
-    error_log('[SITEMAP DEBUG] Retrieved body content length: ' . strlen($body_content) . ' bytes');
+    //error_log('[SITEMAP DEBUG] Retrieved body content length: ' . strlen($body_content) . ' bytes');
 
     // Handle PDF URL
     if ($this->mxchat_is_pdf_url($submitted_url, $response)) {
-        error_log('[SITEMAP DEBUG] Detected PDF URL, handling PDF for knowledge base');
-        error_log('[SITEMAP DEBUG] About to call PDF handler with bot_id: ' . $bot_id);
+        //error_log('[SITEMAP DEBUG] Detected PDF URL, handling PDF for knowledge base');
+        //error_log('[SITEMAP DEBUG] About to call PDF handler with bot_id: ' . $bot_id);
         
         // UPDATED: Pass bot_id to PDF handler
         $result = $this->mxchat_handle_pdf_for_knowledge_base($submitted_url, $response, $bot_id);
-        error_log('[SITEMAP DEBUG] PDF handling result: ' . $result);
+        //error_log('[SITEMAP DEBUG] PDF handling result: ' . $result);
 
         if ($result === 'scheduled') {
@@ -1263 +1263 @@
                 DAY_IN_SECONDS
             );
-            error_log('[SITEMAP DEBUG] PDF processing scheduled successfully for bot: ' . $bot_id);
+            //error_log('[SITEMAP DEBUG] PDF processing scheduled successfully for bot: ' . $bot_id);
             set_transient('mxchat_admin_notice_info',
                 esc_html__('PDF processing has started in the background. You can check the progress in the Knowledge Base section.', 'mxchat'),
@@ -1269 +1269 @@
             );
         } else {
-            error_log('[SITEMAP DEBUG] PDF processing failed: ' . $result);
+            //error_log('[SITEMAP DEBUG] PDF processing failed: ' . $result);
             set_transient('mxchat_admin_notice_error',
                 esc_html__('Failed to start PDF processing: ', 'mxchat') . esc_html($result),
@@ -1282 +1282 @@
     // Handle Sitemap XML
     if (strpos($content_type, 'xml') !== false || strpos($body_content, '<urlset') !== false) {
-        error_log('[SITEMAP DEBUG] Detected XML content, processing as sitemap');
+        //error_log('[SITEMAP DEBUG] Detected XML content, processing as sitemap');
         libxml_use_internal_errors(true);
         $xml = simplexml_load_string($body_content);
@@ -1289 +1289 @@
 
         if ($xml === false || !empty($xml_errors)) {
-            error_log('[SITEMAP DEBUG] Error: Invalid XML format');
+            //error_log('[SITEMAP DEBUG] Error: Invalid XML format');
             if (!empty($xml_errors)) {
                 foreach ($xml_errors as $error) {
-                    error_log('[SITEMAP DEBUG] XML Error: ' . $error->message);
+                    //error_log('[SITEMAP DEBUG] XML Error: ' . $error->message);
                 }
             }
@@ -1304 +1304 @@
         }
 
-        error_log('[SITEMAP DEBUG] Valid XML found, handling sitemap for knowledge base');
+        //error_log('[SITEMAP DEBUG] Valid XML found, handling sitemap for knowledge base');
         // UPDATED: Pass bot_id to sitemap handler
         $result = $this->mxchat_handle_sitemap_for_knowledge_base($xml, $submitted_url, $bot_id);
-        error_log('[SITEMAP DEBUG] Sitemap handling result: ' . $result);
+        //error_log('[SITEMAP DEBUG] Sitemap handling result: ' . $result);
 
         if ($result === 'scheduled') {
@@ -1337 +1337 @@
 
     // Handle Regular URL
-    error_log('[SITEMAP DEBUG] Processing as regular webpage');
+    //error_log('[SITEMAP DEBUG] Processing as regular webpage');
     $page_content = $this->mxchat_extract_main_content($body_content);
-    error_log('[SITEMAP DEBUG] Extracted content length: ' . strlen($page_content) . ' bytes');
+    //error_log('[SITEMAP DEBUG] Extracted content length: ' . strlen($page_content) . ' bytes');
 
     $sanitized_content = $this->mxchat_sanitize_content_for_api($page_content);
-    error_log('[SITEMAP DEBUG] Sanitized content length: ' . strlen($sanitized_content) . ' bytes');
+    //error_log('[SITEMAP DEBUG] Sanitized content length: ' . strlen($sanitized_content) . ' bytes');
 
     if (empty($sanitized_content)) {
-        error_log('[SITEMAP DEBUG] Error: No valid content after sanitization');
+        //error_log('[SITEMAP DEBUG] Error: No valid content after sanitization');
         
         set_transient('mxchat_admin_notice_error',
@@ -1363 +1363 @@
     }
 
-    error_log('[SITEMAP DEBUG] Generating embedding for content');
+    //error_log('[SITEMAP DEBUG] Generating embedding for content');
     $embedding_vector = $this->mxchat_generate_embedding($sanitized_content, $bot_id);
 
     if (is_string($embedding_vector)) {
-        error_log('[SITEMAP DEBUG] Error generating embedding: ' . $embedding_vector);
+        //error_log('[SITEMAP DEBUG] Error generating embedding: ' . $embedding_vector);
         $error_message = esc_html__('Failed to generate embedding: ', 'mxchat') . esc_html($embedding_vector);
         
@@ -1384 +1384 @@
 
     if (is_array($embedding_vector)) {
-        error_log('[SITEMAP DEBUG] Successfully generated embedding with ' . count($embedding_vector) . ' dimensions');
+        //error_log('[SITEMAP DEBUG] Successfully generated embedding with ' . count($embedding_vector) . ' dimensions');
 
         // UPDATED: Pass bot_id to database submission
@@ -1396 +1396 @@
 
         if (is_wp_error($db_result)) {
-            error_log('[SITEMAP DEBUG] Error: Failed to store content in database: ' . $db_result->get_error_message());
+            //error_log('[SITEMAP DEBUG] Error: Failed to store content in database: ' . $db_result->get_error_message());
             $error_message = esc_html__('Failed to store content in database: ', 'mxchat') . esc_html($db_result->get_error_message());
             
@@ -1412 +1412 @@
         }
 
-        error_log('[SITEMAP DEBUG] Successfully stored content in database');
+        //error_log('[SITEMAP DEBUG] Successfully stored content in database');
         $success_message = esc_html__('URL content successfully submitted!', 'mxchat');
         
@@ -1426 +1426 @@
         
     } else {
-        error_log('[SITEMAP DEBUG] Error: Failed to generate embedding. Unexpected result type: ' . gettype($embedding_vector));
+        //error_log('[SITEMAP DEBUG] Error: Failed to generate embedding. Unexpected result type: ' . gettype($embedding_vector));
         $error_message = esc_html__('Failed to generate embedding: Unexpected result type. Please check your API key and try again.', 'mxchat');
         
@@ -1439 +1439 @@
     }
 
-    error_log('[SITEMAP DEBUG] ===== Completed URL submission process =====');
+    //error_log('[SITEMAP DEBUG] ===== Completed URL submission process =====');
     wp_safe_redirect(esc_url(admin_url('admin.php?page=mxchat-prompts')));
     exit;
@@ -2196 +2196 @@
 
 
-
 /**
- * checking if WooCommerce products were already processed in the WordPress database.
+ * Get content list for processing
  */
 public function ajax_mxchat_get_content_list() {
@@ -2224 +2223 @@
     );
     
-    // Handle post types
+    // Handle post types - IMPROVED VERSION
     if ($post_type !== 'all') {
         $args['post_type'] = $post_type;
     } else {
-        // Default to post and page if we can't get post types
-        $args['post_type'] = array('post', 'page');
-        
-        // Try to get public post types
-        $public_types = $this->mxchat_get_public_post_types();
-        if (is_array($public_types) && !empty($public_types)) {
-            $args['post_type'] = array_keys($public_types);
-        }
+        // Get all available post types that might contain content
+        $all_post_types = array();
+        
+        // First get all public post types
+        $public_types = get_post_types(array('public' => true), 'names');
+        $all_post_types = array_merge($all_post_types, $public_types);
+        
+        // Add common forum/community post types
+        $forum_types = array('topic', 'reply', 'forum', 'wpforo_topic', 'wpforo_post');
+        foreach ($forum_types as $forum_type) {
+            if (post_type_exists($forum_type)) {
+                $all_post_types[] = $forum_type;
+            }
+        }
+        
+        // Add other commonly used post types
+        $common_types = array('product', 'job_listing', 'event', 'portfolio');
+        foreach ($common_types as $common_type) {
+            if (post_type_exists($common_type)) {
+                $all_post_types[] = $common_type;
+            }
+        }
+        
+        // Remove duplicates and ensure we have at least some post types
+        $all_post_types = array_unique($all_post_types);
+        
+        if (empty($all_post_types)) {
+            // Fallback to basic post types
+            $all_post_types = array('post', 'page');
+        }
+        
+        $args['post_type'] = $all_post_types;
+        
+        // Debug logging to see what post types are being queried
+        //error_log('MxChat Debug: Querying post types: ' . implode(', ', $all_post_types));
     }
     
@@ -2242 +2268 @@
     }
     
-    // ================================
-    // WordPress DB checking for WooCommerce products
-    // ================================
-    
+    // Get processed data from storage
     $processed_data = array();
     
-    $pinecone_manager = MxChat_Pinecone_Manager::get_instance();
     $pinecone_options = get_option('mxchat_pinecone_addon_options', array());
-    $pinecone_manager->mxchat_refresh_after_new_content($pinecone_options);
     $use_pinecone = ($pinecone_options['mxchat_use_pinecone'] ?? '0') === '1';
 
     if ($use_pinecone && !empty($pinecone_options['mxchat_pinecone_api_key'])) {
-        // ONLY check Pinecone if it's enabled
+        // Get fresh data from Pinecone - no caching
         $processed_data = $this->mxchat_get_pinecone_processed_content($pinecone_options);
     } else {
-        // IMPROVED: WordPress DB checking with better URL matching for WooCommerce
+        // WordPress DB checking with better URL matching for all post types
         global $wpdb;
         $table_name = $wpdb->prefix . 'mxchat_system_prompt_content';
@@ -2264 +2285 @@
         if (!empty($processed_items)) {
             foreach ($processed_items as $item) {
-                // FIXED: Use improved URL matching for WooCommerce products
+                // Use improved URL matching that works for all post types
                 $post_id = $this->mxchat_url_to_post_id_improved($item->source_url);
                 
@@ -2278 +2299 @@
         }
     }
-    
-    // ================================
     
     // Get processed IDs as a simple array for in_array checks
@@ -2354 +2373 @@
 }
 
+
 /**
  * This function handles various WooCommerce URL formats and permalink structures
@@ -2365 +2385 @@
     }
     
-    // If that fails, try more aggressive URL matching for WooCommerce products
+    // If that fails, try more aggressive URL matching
     // Remove trailing slashes and query parameters for better matching
     $clean_url = rtrim($url, '/');
@@ -2376 +2396 @@
     }
     
-    // For WooCommerce products, try extracting slug from URL
+    // For bbPress forum topics, try extracting slug from URL
+    if (strpos($url, '/topic/') !== false || strpos($url, '/forums/') !== false) {
+        // Handle bbPress URLs: /forums/topic/topic-name/
+        if (preg_match('/\/forums\/topic\/([^\/\?]+)/', $url, $matches)) {
+            $topic_slug = $matches[1];
+            
+            // Look up topic by slug
+            $topic = get_page_by_path($topic_slug, OBJECT, 'topic');
+            if ($topic) {
+                return $topic->ID;
+            }
+            
+            // Alternative method: query by post_name
+            global $wpdb;
+            $post_id = $wpdb->get_var($wpdb->prepare(
+                "SELECT ID FROM {$wpdb->posts} WHERE post_name = %s AND post_type = 'topic' AND post_status IN ('publish', 'closed')",
+                $topic_slug
+            ));
+            
+            if ($post_id) {
+                return intval($post_id);
+            }
+        }
+        
+        // Handle simpler topic URLs: /topic/topic-name/
+        if (preg_match('/\/topic\/([^\/\?]+)/', $url, $matches)) {
+            $topic_slug = $matches[1];
+            
+            global $wpdb;
+            $post_id = $wpdb->get_var($wpdb->prepare(
+                "SELECT ID FROM {$wpdb->posts} WHERE post_name = %s AND post_type = 'topic' AND post_status IN ('publish', 'closed')",
+                $topic_slug
+            ));
+            
+            if ($post_id) {
+                return intval($post_id);
+            }
+        }
+    }
+    
+    // For WooCommerce products
     if (strpos($url, '/product/') !== false || strpos($url, 'product=') !== false) {
         // Extract product slug from various URL formats
@@ -2410 +2470 @@
     }
     
-    // ADDITIONAL FIX: Try direct database lookup by URL variations
+    // Generic approach: try to extract slug and match against all post types
+    $parsed_url = wp_parse_url($clean_url);
+    $path = $parsed_url['path'] ?? '';
+    
+    if (!empty($path)) {
+        // Get the last part of the path as potential slug
+        $path_parts = array_filter(explode('/', trim($path, '/')));
+        $potential_slug = end($path_parts);
+        
+        if (!empty($potential_slug)) {
+            global $wpdb;
+            
+            // Try to find any post with this slug
+            $post_id = $wpdb->get_var($wpdb->prepare(
+                "SELECT ID FROM {$wpdb->posts} 
+                 WHERE post_name = %s 
+                 AND post_status IN ('publish', 'closed', 'private') 
+                 AND post_type NOT IN ('revision', 'attachment', 'nav_menu_item')
+                 ORDER BY CASE 
+                    WHEN post_type = 'post' THEN 1
+                    WHEN post_type = 'page' THEN 2
+                    WHEN post_type = 'topic' THEN 3
+                    WHEN post_type = 'product' THEN 4
+                    ELSE 5
+                 END
+                 LIMIT 1",
+                $potential_slug
+            ));
+            
+            if ($post_id) {
+                return intval($post_id);
+            }
+        }
+    }
+    
+    // ADDITIONAL: Try direct database lookup by URL variations
     global $wpdb;
     $table_name = $wpdb->prefix . 'mxchat_system_prompt_content';
     
-    // Try exact match first
-    $existing_record = $wpdb->get_row($wpdb->prepare(
-        "SELECT id, source_url FROM $table_name WHERE source_url = %s",
-        $url
-    ));
-    
-    if ($existing_record) {
-        // Found exact match, now convert the URL to post ID
-        $post_id = url_to_postid($existing_record->source_url);
-        if ($post_id > 0) {
-            return $post_id;
-        }
-    }
-    
     // Try variations of the URL (with/without trailing slash, http/https)
     $url_variations = array(
+        $url,
         rtrim($url, '/'),
         $url . '/',
@@ -2438 +2520 @@
     );
     
+    // Remove duplicates
+    $url_variations = array_unique($url_variations);
+    
     foreach ($url_variations as $variation) {
         $existing_record = $wpdb->get_row($wpdb->prepare(
@@ -2445 +2530 @@
         
         if ($existing_record) {
-            $post_id = url_to_postid($existing_record->source_url);
-            if ($post_id > 0) {
-                return $post_id;
-            }
-        }
-    }
-    
-    // Last resort: try to match against all published products by URL if WooCommerce is active
-    if (function_exists('wc_get_products')) {
-        // Get all published products (limited to avoid memory issues)
-        $products = wc_get_products(array(
-            'status' => 'publish',
-            'limit' => 1000, // Reasonable limit
-            'return' => 'ids'
-        ));
-        
-        foreach ($products as $product_id) {
-            $product_url = get_permalink($product_id);
-            
-            // Compare cleaned URLs
-            $clean_product_url = rtrim($product_url, '/');
-            $clean_product_url = strtok($clean_product_url, '?');
-            
-            if ($clean_url === $clean_product_url) {
-                return $product_id;
-            }
-            
-            // Also check if any of our URL variations match
-            foreach ($url_variations as $variation) {
-                $clean_variation = rtrim($variation, '/');
-                $clean_variation = strtok($clean_variation, '?');
-                
-                if ($clean_variation === $clean_product_url) {
-                    return $product_id;
-                }
+            // Try to get post ID from this stored URL
+            $stored_post_id = url_to_postid($existing_record->source_url);
+            if ($stored_post_id > 0) {
+                return $stored_post_id;
             }
         }
@@ -2486 +2540 @@
     return 0; // No match found
 }
-
+/**
+ * Process selected content via AJAX
+ */
 public function ajax_mxchat_process_selected_content() {
     // Basic request validation
@@ -2613 +2669 @@
     }
     
-    // Update caches if Pinecone is enabled for this bot
-    if ($use_pinecone && !empty($bot_pinecone_config['api_key'])) {
-        // Update vector ID cache for improved fetching
-        $this->mxchat_update_pinecone_vector_cache($vector_id);
-        
-        // Update local processed content cache for immediate UI feedback
-        $pinecone_cache = get_option('mxchat_pinecone_processed_cache', array());
-        $pinecone_cache[$post_id] = array(
-            'db_id' => $vector_id,
-            'processed_date' => 'Just now',
-            'url' => $source_url,
-            'source' => 'pinecone',
-            'timestamp' => current_time('timestamp')
-        );
-        update_option('mxchat_pinecone_processed_cache', $pinecone_cache);
-        
-        // Also update the general processed content cache
-        $processed_cache = get_option('mxchat_processed_content_cache', array());
-        $processed_cache[$post_id] = array(
-            'db_id' => $vector_id,
-            'timestamp' => current_time('timestamp'),
-            'url' => $source_url,
-            'source' => 'pinecone'
-        );
-        update_option('mxchat_processed_content_cache', $processed_cache);
-    }
-    
     $operation_type = $is_update ? 'update' : 'new';
     
@@ -2652 +2681 @@
         'operation_type' => $operation_type,
         'vector_id' => $vector_id,
-        'cache_updated' => $use_pinecone,
         'acf_fields_found' => $acf_field_count,
         'content_preview' => substr($content, 0, 100) . '...',
@@ -2660 +2688 @@
 }
 
-
-
-
-    /**
-     * Updates cache with new vector ID if absent
-     */
-     public function mxchat_update_pinecone_vector_cache($vector_id) {
-         $cached_ids = get_option('mxchat_pinecone_vector_ids_cache', array());
-         if (!in_array($vector_id, $cached_ids)) {
-             $cached_ids[] = $vector_id;
-             update_option('mxchat_pinecone_vector_ids_cache', $cached_ids);
-         }
-     }
 public function mxchat_get_public_post_types() {
+    // Get all public post types
     $post_types = get_post_types(array('public' => true), 'objects');
     $post_type_options = array();
@@ -2681 +2697 @@
     }
     
+    // Also include common forum/community post types that might not be marked as public
+    $additional_types = array(
+        'topic' => 'Forum Topics (bbPress)',
+        'reply' => 'Forum Replies (bbPress)', 
+        'forum' => 'Forums (bbPress)',
+        'wpforo_topic' => 'wpForo Topics',
+        'wpforo_post' => 'wpForo Posts'
+    );
+    
+    foreach ($additional_types as $type_name => $type_label) {
+        if (post_type_exists($type_name) && !isset($post_type_options[$type_name])) {
+            $post_type_options[$type_name] = $type_label;
+        }
+    }
+    
     return $post_type_options;
 }
+
+/**
+ * Retrieves processed content from Pinecone API
+ */
 public function mxchat_get_pinecone_processed_content($pinecone_options) {
-    //error_log('=== DEBUG: Starting mxchat_get_pinecone_processed_content ===');
-    
-    // First check local cache for immediate updates
-    $cached_data = get_option('mxchat_pinecone_processed_cache', array());
-    //error_log('DEBUG: Found ' . count($cached_data) . ' items in local cache');
-
     $api_key = $pinecone_options['mxchat_pinecone_api_key'] ?? '';
     $host = $pinecone_options['mxchat_pinecone_host'] ?? '';
-    
-    //error_log('DEBUG: API key present: ' . (!empty($api_key) ? 'YES' : 'NO'));
-    //error_log('DEBUG: Host: ' . $host);
 
     if (empty($api_key) || empty($host)) {
-        //error_log('DEBUG: Missing API credentials, returning cached data only');
-        return $cached_data;
+        return array();
     }
 
@@ -2704 +2729 @@
 
     try {
-        // Method 1: Try to get vectors using cached vector IDs first
-        $cached_vector_ids = get_option('mxchat_pinecone_vector_ids_cache', array());
-        //error_log('DEBUG: Found ' . count($cached_vector_ids) . ' cached vector IDs');
-
-        if (!empty($cached_vector_ids)) {
-            //error_log('DEBUG: Trying to fetch by cached vector IDs...');
-            $pinecone_data = $this->mxchat_fetch_pinecone_vectors_by_ids($pinecone_options, $cached_vector_ids);
-            //error_log('DEBUG: Fetch by IDs returned ' . count($pinecone_data) . ' items');
-        }
-
-        // Method 2: If no cached IDs or fetch failed, use scanning approach
+        // Always get fresh data from Pinecone
+        $pinecone_data = $this->mxchat_scan_pinecone_for_processed_content($pinecone_options);
+
+        // Method 2: Final fallback - try stats endpoint (if available)
         if (empty($pinecone_data)) {
-            //error_log('DEBUG: Trying scanning approach...');
-            $pinecone_data = $this->mxchat_scan_pinecone_for_processed_content($pinecone_options);
-            //error_log('DEBUG: Scanning returned ' . count($pinecone_data) . ' items');
-        }
-
-        // Method 3: Final fallback - try stats endpoint
-        if (empty($pinecone_data)) {
-            //error_log('DEBUG: Trying stats endpoint...');
             $stats_url = "https://{$host}/describe_index_stats";
 
@@ -2738 +2748 @@
                 $body = wp_remote_retrieve_body($response);
                 $stats_data = json_decode($body, true);
-                //error_log('DEBUG: Pinecone stats: ' . print_r($stats_data, true));
-            } else {
-                if (is_wp_error($response)) {
-                    //error_log('DEBUG: Stats endpoint error: ' . $response->get_error_message());
-                } else {
-                    //error_log('DEBUG: Stats endpoint failed with code: ' . wp_remote_retrieve_response_code($response));
-                }
             }
         }
 
     } catch (Exception $e) {
-        //error_log('DEBUG: Exception in get_pinecone_processed_content: ' . $e->getMessage());
-    }
-
-    // Merge cached data with Pinecone data
-    $merged_data = $pinecone_data;
-
-    foreach ($cached_data as $post_id => $cache_item) {
-        $cache_timestamp = $cache_item['timestamp'] ?? 0;
-        $time_diff = current_time('timestamp') - $cache_timestamp;
-
-        if ($time_diff < 300) { // 5 minutes = 300 seconds
-            $merged_data[$post_id] = $cache_item;
-        } else {
-            if (!isset($merged_data[$post_id])) {
-                $merged_data[$post_id] = $cache_item;
-            }
-        }
-    }
-
-    //error_log('DEBUG: Final merged data count: ' . count($merged_data));
-    //error_log('=== DEBUG: End mxchat_get_pinecone_processed_content ===');
-
-    return $merged_data;
-}
-
+        // Log error but return fresh data only
+    }
+
+    return $pinecone_data;
+}
 public function mxchat_fetch_pinecone_vectors_by_ids($pinecone_options, $vector_ids) {
     //error_log('=== DEBUG: Starting mxchat_fetch_pinecone_vectors_by_ids ===');
@@ -2867 +2850 @@
 }
 
+/**
+ * Scan Pinecone for processed content
+ */
 public function mxchat_scan_pinecone_for_processed_content($pinecone_options) {
-    //error_log('=== DEBUG: Starting mxchat_scan_pinecone_for_processed_content ===');
-    
     $api_key = $pinecone_options['mxchat_pinecone_api_key'] ?? '';
     $host = $pinecone_options['mxchat_pinecone_host'] ?? '';
 
     if (empty($api_key) || empty($host)) {
-        //error_log('DEBUG: Missing API credentials for scanning');
         return array();
     }
@@ -2885 +2868 @@
         // Try 3 different random vectors to get better coverage
         for ($i = 0; $i < 3; $i++) {
-            //error_log('DEBUG: Scanning attempt ' . ($i + 1) . '/3');
-            
             $query_url = "https://{$host}/query";
 
@@ -2918 +2899 @@
 
             if (is_wp_error($response)) {
-                //error_log('DEBUG: Query attempt ' . ($i + 1) . ' WP error: ' . $response->get_error_message());
                 continue;
             }
 
             $response_code = wp_remote_retrieve_response_code($response);
-            //error_log('DEBUG: Query attempt ' . ($i + 1) . ' response code: ' . $response_code);
             
             if ($response_code !== 200) {
-                $error_body = wp_remote_retrieve_body($response);
-                //error_log('DEBUG: Query attempt ' . ($i + 1) . ' failed with body: ' . substr($error_body, 0, 500));
                 continue;
             }
@@ -2935 +2912 @@
 
             if (isset($data['matches'])) {
-                //error_log('DEBUG: Query attempt ' . ($i + 1) . ' returned ' . count($data['matches']) . ' matches');
                 foreach ($data['matches'] as $match) {
                     $match_id = $match['id'] ?? '';
@@ -2943 +2919 @@
                     }
                 }
-            } else {
-                //error_log('DEBUG: Query attempt ' . ($i + 1) . ' - no matches key in response');
-            }
-        }
-
-        //error_log('DEBUG: Total unique matches found: ' . count($all_matches));
+            }
+        }
 
         // Convert matches to processed data format
         $processed_data = array();
-        $vector_ids_for_cache = array();
 
         foreach ($all_matches as $match) {
@@ -2979 +2950 @@
                         'timestamp' => $timestamp ?? current_time('timestamp')
                     );
-
-                    $vector_ids_for_cache[] = $match_id;
                 }
             }
         }
 
-        // Update the vector IDs cache for future use
-        if (!empty($vector_ids_for_cache)) {
-            update_option('mxchat_pinecone_vector_ids_cache', $vector_ids_for_cache);
-            //error_log('DEBUG: Updated vector IDs cache with ' . count($vector_ids_for_cache) . ' IDs');
-        }
-
-        //error_log('DEBUG: Returning ' . count($processed_data) . ' processed items from scanning');
         return $processed_data;
 
     } catch (Exception $e) {
-        //error_log('DEBUG: Exception in scan_pinecone_for_processed_content: ' . $e->getMessage());
         return array();
     }
 }
-
 /**
  * UPDATED: Generate embeddings from input text for MXChat with bot support
@@ -3216 +3176 @@
  */
 private function get_bot_options($bot_id = 'default') {
-    error_log("MXCHAT DEBUG: get_bot_options called for bot: " . $bot_id);
+    //error_log("MXCHAT DEBUG: get_bot_options called for bot: " . $bot_id);
     
     if ($bot_id === 'default' || !class_exists('MxChat_Multi_Bot_Manager')) {
-        error_log("MXCHAT DEBUG: Using default options (no multi-bot or bot is 'default')");
+        //error_log("MXCHAT DEBUG: Using default options (no multi-bot or bot is 'default')");
         return array();
     }
@@ -3226 +3186 @@
     
     if (!empty($bot_options)) {
-        error_log("MXCHAT DEBUG: Got bot-specific options from filter");
+        //error_log("MXCHAT DEBUG: Got bot-specific options from filter");
         if (isset($bot_options['similarity_threshold'])) {
-            error_log("  - similarity_threshold: " . $bot_options['similarity_threshold']);
+            //error_log("  - similarity_threshold: " . $bot_options['similarity_threshold']);
         }
     }
@@ -3241 +3201 @@
 // Also add debugging to your get_bot_pinecone_config function
 private function get_bot_pinecone_config($bot_id = 'default') {
-    error_log("MXCHAT DEBUG: get_bot_pinecone_config called for bot: " . $bot_id);
+    //error_log("MXCHAT DEBUG: get_bot_pinecone_config called for bot: " . $bot_id);
     
     // If default bot or multi-bot add-on not active, use default Pinecone config
     if ($bot_id === 'default' || !class_exists('MxChat_Multi_Bot_Manager')) {
-        error_log("MXCHAT DEBUG: Using default Pinecone config (no multi-bot or bot is 'default')");
+        //error_log("MXCHAT DEBUG: Using default Pinecone config (no multi-bot or bot is 'default')");
         $addon_options = get_option('mxchat_pinecone_addon_options', array());
         $config = array(
@@ -3253 +3213 @@
             'namespace' => $addon_options['mxchat_pinecone_namespace'] ?? ''
         );
-        error_log("MXCHAT DEBUG: Default config - use_pinecone: " . ($config['use_pinecone'] ? 'true' : 'false'));
+        //error_log("MXCHAT DEBUG: Default config - use_pinecone: " . ($config['use_pinecone'] ? 'true' : 'false'));
         return $config;
     }
     
-    error_log("MXCHAT DEBUG: Calling filter 'mxchat_get_bot_pinecone_config' for bot: " . $bot_id);
+    //error_log("MXCHAT DEBUG: Calling filter 'mxchat_get_bot_pinecone_config' for bot: " . $bot_id);
     
     // Hook for multi-bot add-on to provide bot-specific Pinecone config
@@ -3263 +3223 @@
     
     if (!empty($bot_pinecone_config)) {
-        error_log("MXCHAT DEBUG: Got bot-specific config from filter");
-        error_log("  - use_pinecone: " . (isset($bot_pinecone_config['use_pinecone']) ? ($bot_pinecone_config['use_pinecone'] ? 'true' : 'false') : 'not set'));
-        error_log("  - host: " . ($bot_pinecone_config['host'] ?? 'not set'));
-        error_log("  - namespace: " . ($bot_pinecone_config['namespace'] ?? 'not set'));
+        //error_log("MXCHAT DEBUG: Got bot-specific config from filter");
+        //error_log("  - use_pinecone: " . (isset($bot_pinecone_config['use_pinecone']) ? ($bot_pinecone_config['use_pinecone'] ? 'true' : 'false') : 'not set'));
+        //error_log("  - host: " . ($bot_pinecone_config['host'] ?? 'not set'));
+        //error_log("  - namespace: " . ($bot_pinecone_config['namespace'] ?? 'not set'));
     } else {
-        error_log("MXCHAT DEBUG: Filter returned empty config!");
+        //error_log("MXCHAT DEBUG: Filter returned empty config!");
     }
     
@@ -4265 +4225 @@
     
     if ($result['success']) {
-        // Remove from ALL caches
-        $pinecone_manager->mxchat_remove_from_pinecone_vector_cache($vector_id);
-        $pinecone_manager->mxchat_remove_from_processed_content_caches($vector_id);
-        
-        // CLEAR ALL RELEVANT CACHES
-        delete_transient('mxchat_pinecone_recent_1k_cache');
-        delete_option('mxchat_pinecone_vector_ids_cache');
-        delete_option('mxchat_pinecone_processed_cache');
-        delete_option('mxchat_processed_content_cache');
-        
-        // Also force refresh for next page load
-        $pinecone_manager->mxchat_refresh_after_new_content($pinecone_options);
-        
+        // No cache clearing needed since we removed caching
         set_transient('mxchat_admin_notice_success', 
             esc_html__('Entry deleted successfully from Pinecone.', 'mxchat'), 
@@ -4292 +4240 @@
     exit;
 }
-
+/**
+ * Handle individual Pinecone content deletion via AJAX
+ */
 public function ajax_mxchat_delete_pinecone_prompt() {
     // Verify nonce and permissions
@@ -4332 +4282 @@
     
     if ($result['success']) {
-        // Clear bot-specific caches
-        $pinecone_manager->mxchat_clear_bot_caches($bot_id);
-        
+        // No cache clearing needed since we removed caching
         wp_send_json_success(array(
             'message' => 'Entry deleted successfully from Pinecone',
@@ -4346 +4294 @@
     exit;
 }
+
 /**
  * NEW: Get hierarchical roles for dropdown
@@ -4411 +4360 @@
 
 /**
- *  Handle role restriction updates via AJAX
- */
-/**
- * UPDATED: Handle role restriction updates for both WordPress and Pinecone via AJAX
+ * Handle role restriction updates via AJAX
+ * UPDATED: Removed cache clearing call since we removed caching
  */
 public function ajax_mxchat_update_role_restriction() {
@@ -4462 +4409 @@
         );
         
-        // Clear Pinecone cache to reflect changes
-        delete_transient('mxchat_pinecone_recent_1k_cache');
+        // No cache clearing needed since we removed caching
         
     } else {

mxchat-basic/trunk/admin/class-pinecone-manager.php

@@ -29 +29 @@
  */
 public function mxchat_fetch_pinecone_records($pinecone_options, $search_query = '', $page = 1, $per_page = 20, $bot_id = 'default') {
-    error_log('=== DEBUG: mxchat_fetch_pinecone_records ===');
-    error_log('Bot ID: ' . $bot_id);
-    error_log('Pinecone Host: ' . ($pinecone_options['mxchat_pinecone_host'] ?? 'NOT SET'));
-    error_log('Pinecone Namespace: ' . ($pinecone_options['mxchat_pinecone_namespace'] ?? 'NOT SET'));
-    error_log('Use Pinecone: ' . ($pinecone_options['mxchat_use_pinecone'] ?? 'NOT SET'));
+    //error_log('=== DEBUG: mxchat_fetch_pinecone_records ===');
+    //error_log('Bot ID: ' . $bot_id);
+    //error_log('Pinecone Host: ' . ($pinecone_options['mxchat_pinecone_host'] ?? 'NOT SET'));
+    //error_log('Pinecone Namespace: ' . ($pinecone_options['mxchat_pinecone_namespace'] ?? 'NOT SET'));
+    //error_log('Use Pinecone: ' . ($pinecone_options['mxchat_use_pinecone'] ?? 'NOT SET'));
     
     $api_key = $pinecone_options['mxchat_pinecone_api_key'] ?? '';
@@ -40 +40 @@
 
     if (empty($api_key) || empty($host)) {
-        //error_log('DEBUG: Missing required Pinecone parameters');
         return array('data' => array(), 'total' => 0, 'total_in_database' => 0, 'showing_recent_only' => false);
     }
@@ -48 +47 @@
         $total_in_database = $this->mxchat_get_pinecone_total_count($pinecone_options, $bot_id);
         
-        // Check cache first for consistency (bot-specific cache)
-        $cache_key = 'mxchat_pinecone_recent_1k_cache_' . $bot_id;
-        $all_records = get_transient($cache_key);
-        
-        if ($all_records === false) {
-            // Cache miss - get fresh data (bot-specific)
-            $all_records = $this->mxchat_get_recent_1k_entries($pinecone_options, $bot_id);
-        }
+        // Always get fresh data - no caching
+        $all_records = $this->mxchat_get_recent_1k_entries($pinecone_options, $bot_id);
         
         // Filter by search query if provided
@@ -70 +63 @@
         $offset = ($page - 1) * $per_page;
         $paged_records = array_slice($all_records, $offset, $per_page);
-
-        //error_log('DEBUG: Returning ' . count($paged_records) . ' records for bot ' . $bot_id);
         
         return array(
@@ -81 +72 @@
 
     } catch (Exception $e) {
-        //error_log('DEBUG: Exception: ' . $e->getMessage());
         return array('data' => array(), 'total' => 0, 'total_in_database' => 0, 'showing_recent_only' => false);
     }
 }
-
 /**
      * Get embedding dimensions based on the selected model
@@ -143 +132 @@
 
 
+/**
+ * Get recent 1K entries from Pinecone
+ */
 private function mxchat_get_recent_1k_entries($pinecone_options, $bot_id = 'default') {
     global $wpdb;
-    error_log('=== DEBUG: mxchat_get_recent_1k_entries started ===');
-    error_log('DEBUG: Bot ID: ' . $bot_id);
+    //error_log('=== DEBUG: mxchat_get_recent_1k_entries started ===');
+    //error_log('DEBUG: Bot ID: ' . $bot_id);
     
     $api_key = $pinecone_options['mxchat_pinecone_api_key'] ?? '';
@@ -164 +156 @@
         
         foreach ($fixed_vectors as $vector_index => $query_vector) {
-            error_log('DEBUG: Using fixed query vector ' . ($vector_index + 1) . '/' . count($fixed_vectors));
+            //error_log('DEBUG: Using fixed query vector ' . ($vector_index + 1) . '/' . count($fixed_vectors));
             
             $query_data = array(
@@ -177 +169 @@
                 $query_data['namespace'] = $namespace;
             }
-            
-            // REMOVE THE BOT_ID FILTER - Each bot has its own Pinecone index
-            // No need to filter by bot_id within the index
 
             $response = wp_remote_post($query_url, array(
@@ -199 +188 @@
                         if (!empty($match_id) && !isset($seen_ids[$match_id])) {
                             $metadata = $match['metadata'] ?? array();
-                            
-                            // Remove the bot_id checking since each bot has its own index
                             
                             // Get created_at timestamp
@@ -217 +204 @@
                                 'source_url' => $metadata['source_url'] ?? '',
                                 'role_restriction' => $metadata['role_restriction'] ?? 'public',
-                                'bot_id' => $bot_id, // Just set it to current bot for display
+                                'bot_id' => $bot_id,
                                 'created_at' => $created_at,
                                 'data_source' => 'pinecone'
@@ -254 +241 @@
         }
         
-        error_log('DEBUG: Found ' . count($all_records) . ' total unique records, returning top ' . count($recent_1k));
-        
-        // Cache the results
-        $cache_key = 'mxchat_pinecone_recent_1k_cache_' . $bot_id;
-        set_transient($cache_key, $recent_1k, 60);
+        //error_log('DEBUG: Found ' . count($all_records) . ' total unique records, returning top ' . count($recent_1k));
         
         return $recent_1k;
 
     } catch (Exception $e) {
-        error_log('DEBUG: Exception in get_recent_1k_entries: ' . $e->getMessage());
+        //error_log('DEBUG: Exception in get_recent_1k_entries: ' . $e->getMessage());
         return array();
     }
 }
-
 /**
  * Generate fixed query vectors for consistent results
@@ -323 +305 @@
 
 /**
-     * Scan Pinecone for processed content (MISSING FUNCTION - ADD THIS)
-     */
-    public function mxchat_scan_pinecone_for_processed_content($pinecone_options) {
-        //error_log('=== DEBUG: Starting mxchat_scan_pinecone_for_processed_content ===');
-        
-        $api_key = $pinecone_options['mxchat_pinecone_api_key'] ?? '';
-        $host = $pinecone_options['mxchat_pinecone_host'] ?? '';
-
-        if (empty($api_key) || empty($host)) {
-            //error_log('DEBUG: Missing API credentials for scanning');
-            return array();
-        }
-
-        try {
-            // Use multiple random vectors to get better coverage
-            $all_matches = array();
-            $seen_ids = array();
-
-            // Try 3 different random vectors to get better coverage
-            for ($i = 0; $i < 3; $i++) {
-                //error_log('DEBUG: Scanning attempt ' . ($i + 1) . '/3');
-                
-                $query_url = "https://{$host}/query";
-
-                // Generate random vector with CORRECT dimensions
-                $random_vector = $this->mxchat_generate_random_vector();
-
-                $query_data = array(
-                    'includeMetadata' => true,
-                    'includeValues' => false,
-                    'topK' => 10000,
-                    'vector' => $random_vector
-                );
-
-                $response = wp_remote_post($query_url, array(
-                    'headers' => array(
-                        'Api-Key' => $api_key,
-                        'Content-Type' => 'application/json'
-                    ),
-                    'body' => json_encode($query_data),
-                    'timeout' => 30
-                ));
-
-                if (is_wp_error($response)) {
-                    //error_log('DEBUG: Query attempt ' . ($i + 1) . ' WP error: ' . $response->get_error_message());
-                    continue;
+ * Scan Pinecone for processed content
+ */
+public function mxchat_scan_pinecone_for_processed_content($pinecone_options) {
+    $api_key = $pinecone_options['mxchat_pinecone_api_key'] ?? '';
+    $host = $pinecone_options['mxchat_pinecone_host'] ?? '';
+
+    if (empty($api_key) || empty($host)) {
+        return array();
+    }
+
+    try {
+        // Use multiple random vectors to get better coverage
+        $all_matches = array();
+        $seen_ids = array();
+
+        // Try 3 different random vectors to get better coverage
+        for ($i = 0; $i < 3; $i++) {
+            $query_url = "https://{$host}/query";
+
+            // Generate random vector with CORRECT dimensions
+            $random_vector = $this->mxchat_generate_random_vector();
+
+            $query_data = array(
+                'includeMetadata' => true,
+                'includeValues' => false,
+                'topK' => 10000,
+                'vector' => $random_vector
+            );
+
+            $response = wp_remote_post($query_url, array(
+                'headers' => array(
+                    'Api-Key' => $api_key,
+                    'Content-Type' => 'application/json'
+                ),
+                'body' => json_encode($query_data),
+                'timeout' => 30
+            ));
+
+            if (is_wp_error($response)) {
+                continue;
+            }
+
+            $response_code = wp_remote_retrieve_response_code($response);
+            
+            if ($response_code !== 200) {
+                continue;
+            }
+
+            $body = wp_remote_retrieve_body($response);
+            $data = json_decode($body, true);
+
+            if (isset($data['matches'])) {
+                foreach ($data['matches'] as $match) {
+                    $match_id = $match['id'] ?? '';
+                    if (!empty($match_id) && !isset($seen_ids[$match_id])) {
+                        $all_matches[] = $match;
+                        $seen_ids[$match_id] = true;
+                    }
                 }
-
-                $response_code = wp_remote_retrieve_response_code($response);
-                //error_log('DEBUG: Query attempt ' . ($i + 1) . ' response code: ' . $response_code);
-                
-                if ($response_code !== 200) {
-                    $error_body = wp_remote_retrieve_body($response);
-                    //error_log('DEBUG: Query attempt ' . ($i + 1) . ' failed with body: ' . substr($error_body, 0, 500));
-                    continue;
-                }
-
-                $body = wp_remote_retrieve_body($response);
-                $data = json_decode($body, true);
-
-                if (isset($data['matches'])) {
-                    //error_log('DEBUG: Query attempt ' . ($i + 1) . ' returned ' . count($data['matches']) . ' matches');
-                    foreach ($data['matches'] as $match) {
-                        $match_id = $match['id'] ?? '';
-                        if (!empty($match_id) && !isset($seen_ids[$match_id])) {
-                            $all_matches[] = $match;
-                            $seen_ids[$match_id] = true;
+            }
+        }
+
+        // Convert matches to processed data format
+        $processed_data = array();
+
+        foreach ($all_matches as $match) {
+            $metadata = $match['metadata'] ?? array();
+            $source_url = $metadata['source_url'] ?? '';
+            $match_id = $match['id'] ?? '';
+
+            if (!empty($source_url) && !empty($match_id)) {
+                $post_id = url_to_postid($source_url);
+                if ($post_id) {
+                    $created_at = $metadata['created_at'] ?? '';
+                    $processed_date = 'Recently';
+
+                    if (!empty($created_at)) {
+                        $timestamp = is_numeric($created_at) ? $created_at : strtotime($created_at);
+                        if ($timestamp) {
+                            $processed_date = human_time_diff($timestamp, current_time('timestamp')) . ' ago';
                         }
                     }
-                } else {
-                    //error_log('DEBUG: Query attempt ' . ($i + 1) . ' - no matches key in response');
+
+                    $processed_data[$post_id] = array(
+                        'db_id' => $match_id,
+                        'processed_date' => $processed_date,
+                        'url' => $source_url,
+                        'source' => 'pinecone',
+                        'timestamp' => $timestamp ?? current_time('timestamp')
+                    );
                 }
             }
-
-            //error_log('DEBUG: Total unique matches found: ' . count($all_matches));
-
-            // Convert matches to processed data format
-            $processed_data = array();
-            $vector_ids_for_cache = array();
-
-            foreach ($all_matches as $match) {
-                $metadata = $match['metadata'] ?? array();
-                $source_url = $metadata['source_url'] ?? '';
-                $match_id = $match['id'] ?? '';
-
-                if (!empty($source_url) && !empty($match_id)) {
-                    $post_id = url_to_postid($source_url);
-                    if ($post_id) {
-                        $created_at = $metadata['created_at'] ?? '';
-                        $processed_date = 'Recently';
-
-                        if (!empty($created_at)) {
-                            $timestamp = is_numeric($created_at) ? $created_at : strtotime($created_at);
-                            if ($timestamp) {
-                                $processed_date = human_time_diff($timestamp, current_time('timestamp')) . ' ago';
-                            }
-                        }
-
-                        $processed_data[$post_id] = array(
-                            'db_id' => $match_id,
-                            'processed_date' => $processed_date,
-                            'url' => $source_url,
-                            'source' => 'pinecone',
-                            'timestamp' => $timestamp ?? current_time('timestamp')
-                        );
-
-                        $vector_ids_for_cache[] = $match_id;
-                    }
-                }
-            }
-
-            // Update the vector IDs cache for future use
-            if (!empty($vector_ids_for_cache)) {
-                update_option('mxchat_pinecone_vector_ids_cache', $vector_ids_for_cache);
-                //error_log('DEBUG: Updated vector IDs cache with ' . count($vector_ids_for_cache) . ' IDs');
-            }
-
-            //error_log('DEBUG: Returning ' . count($processed_data) . ' processed items from scanning');
-            return $processed_data;
-
-        } catch (Exception $e) {
-            //error_log('DEBUG: Exception in scan_pinecone_for_processed_content: ' . $e->getMessage());
-            return array();
-        }
-    }
-
+        }
+
+        return $processed_data;
+
+    } catch (Exception $e) {
+        return array();
+    }
+}
+
+/**
+ * Get total count from Pinecone stats API
+ * UPDATED: Removed cache fallback reference
+ */
 private function mxchat_get_pinecone_total_count($pinecone_options, $bot_id = 'default') {
     $api_key = $pinecone_options['mxchat_pinecone_api_key'] ?? '';
@@ -467 +428 @@
             $request_data['namespace'] = $namespace;
         }
-        
-        // REMOVE THE BOT_ID FILTER - Each bot has its own index
 
         $response = wp_remote_post($stats_url, array(
@@ -485 +444 @@
             $total_count = $stats_data['totalVectorCount'] ?? 0;
             if ($total_count > 0) {
-                error_log('DEBUG: Got total count from stats API: ' . $total_count);
+                //error_log('DEBUG: Got total count from stats API: ' . $total_count);
                 return intval($total_count);
             }
         }
 
-        // Fallback: estimate from previous scans
-        $cached_vector_ids = get_option('mxchat_pinecone_vector_ids_cache_' . $bot_id, array());
-        if (!empty($cached_vector_ids)) {
-            $estimated_count = count($cached_vector_ids);
-            return intval($estimated_count);
-        }
+        // If stats API fails, return 0 instead of using cache
+        return 0;
 
     } catch (Exception $e) {
-        error_log('DEBUG: Exception getting total count: ' . $e->getMessage());
-    }
-
-    return 0;
-}
-
-/**
- * Clear all caches for a specific bot (and general caches)
- */
-public function mxchat_clear_bot_caches($bot_id = 'default') {
-    //error_log('DEBUG: Clearing all caches for bot: ' . $bot_id);
-    
-    // Clear bot-specific caches
-    delete_transient('mxchat_pinecone_recent_1k_cache_' . $bot_id);
-    delete_transient('mxchat_pinecone_recent_1k_' . $bot_id);
-    delete_transient('mxchat_pinecone_total_count_' . $bot_id);
-    delete_option('mxchat_pinecone_vector_ids_cache_' . $bot_id);
-    delete_option('mxchat_pinecone_processed_cache_' . $bot_id);
-    delete_option('mxchat_processed_content_cache_' . $bot_id);
-    
-    // Also clear general caches for backward compatibility
-    delete_transient('mxchat_pinecone_recent_1k_cache');
-    delete_transient('mxchat_pinecone_recent_1k');
-    delete_transient('mxchat_pinecone_total_count');
-    delete_option('mxchat_pinecone_vector_ids_cache');
-    delete_option('mxchat_pinecone_processed_cache');
-    delete_option('mxchat_processed_content_cache');
-    
-    //error_log('DEBUG: All caches cleared for bot: ' . $bot_id);
-    
-    return true;
-}
-
-/**
- * Clear caches for all bots
- */
-public function mxchat_clear_all_bot_caches() {
-    // Clear default/general caches
-    $this->mxchat_clear_bot_caches('default');
-    
-    // If multi-bot addon is active, clear caches for all bots
-    if (class_exists('MxChat_Multi_Bot_Manager')) {
-        $multi_bot_manager = MxChat_Multi_Bot_Core_Manager::get_instance();
-        $available_bots = $multi_bot_manager->get_available_bots();
-        
-        foreach ($available_bots as $bot_id => $bot_name) {
-            if ($bot_id !== 'default') {
-                $this->mxchat_clear_bot_caches($bot_id);
-            }
-        }
-    }
-    
-    return true;
-}
-
-/**
- * Call this after adding new content to refresh the view for specific bot
- */
-public function mxchat_refresh_after_new_content($pinecone_options, $bot_id = 'default') {
-    //error_log('DEBUG: Refreshing after new content added for bot: ' . $bot_id);
-    
-    // Use the new comprehensive cache clearing method
-    $this->mxchat_clear_bot_caches($bot_id);
-    
-    // Force fresh fetch on next page load
-    return true;
+        //error_log('DEBUG: Exception getting total count: ' . $e->getMessage());
+        return 0;
+    }
 }
 
@@ -570 +462 @@
  */
 public function mxchat_get_bot_pinecone_options($bot_id = 'default') {
-    error_log('DEBUG: Getting Pinecone options for bot: ' . $bot_id);
+    //error_log('DEBUG: Getting Pinecone options for bot: ' . $bot_id);
     
     // If default bot or multi-bot add-on not active, use default Pinecone config
     if ($bot_id === 'default' || !class_exists('MxChat_Multi_Bot_Manager')) {
         $addon_options = get_option('mxchat_pinecone_addon_options', array());
-        error_log('DEBUG: Using default Pinecone options');
+        //error_log('DEBUG: Using default Pinecone options');
         return $addon_options;
     }
@@ -582 +474 @@
     $bot_config = apply_filters('mxchat_get_bot_pinecone_config', array(), $bot_id);
     
-    error_log('DEBUG: Bot config from filter: ' . print_r($bot_config, true));
+    //error_log('DEBUG: Bot config from filter: ' . print_r($bot_config, true));
     
     // Check if we got valid bot-specific config
@@ -596 +488 @@
         );
         
-        error_log('DEBUG: Returning bot-specific Pinecone options for bot: ' . $bot_id);
+        //error_log('DEBUG: Returning bot-specific Pinecone options for bot: ' . $bot_id);
         return $pinecone_options;
     }
     
     // Fallback to default options if bot-specific config is invalid
-    error_log('DEBUG: Bot-specific config invalid, falling back to default');
+    //error_log('DEBUG: Bot-specific config invalid, falling back to default');
     return get_option('mxchat_pinecone_addon_options', array());
 }
@@ -610 +502 @@
  */
 private function get_bot_pinecone_config($bot_id = 'default') {
-    error_log("MXCHAT DEBUG: get_bot_pinecone_config called for bot: " . $bot_id);
+    //error_log("MXCHAT DEBUG: get_bot_pinecone_config called for bot: " . $bot_id);
     
     // If default bot or multi-bot add-on not active, use default Pinecone config
     if ($bot_id === 'default' || !class_exists('MxChat_Multi_Bot_Manager')) {
-        error_log("MXCHAT DEBUG: Using default Pinecone config (no multi-bot or bot is 'default')");
+        //error_log("MXCHAT DEBUG: Using default Pinecone config (no multi-bot or bot is 'default')");
         $addon_options = get_option('mxchat_pinecone_addon_options', array());
         $config = array(
@@ -622 +514 @@
             'namespace' => $addon_options['mxchat_pinecone_namespace'] ?? ''
         );
-        error_log("MXCHAT DEBUG: Default config - use_pinecone: " . ($config['use_pinecone'] ? 'true' : 'false'));
+        //error_log("MXCHAT DEBUG: Default config - use_pinecone: " . ($config['use_pinecone'] ? 'true' : 'false'));
         return $config;
     }
     
-    error_log("MXCHAT DEBUG: Calling filter 'mxchat_get_bot_pinecone_config' for bot: " . $bot_id);
+    //error_log("MXCHAT DEBUG: Calling filter 'mxchat_get_bot_pinecone_config' for bot: " . $bot_id);
     
     // Hook for multi-bot add-on to provide bot-specific Pinecone config
@@ -632 +524 @@
     
     if (!empty($bot_pinecone_config)) {
-        error_log("MXCHAT DEBUG: Got bot-specific config from filter");
-        error_log("  - use_pinecone: " . (isset($bot_pinecone_config['use_pinecone']) ? ($bot_pinecone_config['use_pinecone'] ? 'true' : 'false') : 'not set'));
-        error_log("  - host: " . ($bot_pinecone_config['host'] ?? 'not set'));
-        error_log("  - namespace: " . ($bot_pinecone_config['namespace'] ?? 'not set'));
+        //error_log("MXCHAT DEBUG: Got bot-specific config from filter");
+        //error_log("  - use_pinecone: " . (isset($bot_pinecone_config['use_pinecone']) ? ($bot_pinecone_config['use_pinecone'] ? 'true' : 'false') : 'not set'));
+        //error_log("  - host: " . ($bot_pinecone_config['host'] ?? 'not set'));
+        //error_log("  - namespace: " . ($bot_pinecone_config['namespace'] ?? 'not set'));
     } else {
-        error_log("MXCHAT DEBUG: Filter returned empty config!");
+        //error_log("MXCHAT DEBUG: Filter returned empty config!");
     }
     
     return is_array($bot_pinecone_config) ? $bot_pinecone_config : array();
 }    
+
+
 /**
  * Fetches vectors from Pinecone using provided IDs (for content selection feature)
  */
 public function fetch_pinecone_vectors_by_ids($pinecone_options, $vector_ids) {
-    //error_log('=== DEBUG: fetch_pinecone_vectors_by_ids started (content selection method) ===');
-    
     $api_key = $pinecone_options['mxchat_pinecone_api_key'] ?? '';
     $host = $pinecone_options['mxchat_pinecone_host'] ?? '';
 
-    //error_log('DEBUG: API key present: ' . (!empty($api_key) ? 'YES' : 'NO'));
-    //error_log('DEBUG: Host: ' . $host);
-    //error_log('DEBUG: Vector IDs count: ' . count($vector_ids));
-
     if (empty($api_key) || empty($host) || empty($vector_ids)) {
-        //error_log('DEBUG: Missing parameters for fetch by IDs (content selection)');
         return array();
     }
@@ -662 +549 @@
     try {
         $fetch_url = "https://{$host}/vectors/fetch";
-        //error_log('DEBUG: Fetch URL: ' . $fetch_url);
 
         // Pinecone fetch API allows fetching specific vectors by ID
@@ -679 +565 @@
 
         if (is_wp_error($response)) {
-            //error_log('DEBUG: Fetch by IDs WP error (content selection): ' . $response->get_error_message());
             return array();
         }
 
         $response_code = wp_remote_retrieve_response_code($response);
-        //error_log('DEBUG: Fetch response code (content selection): ' . $response_code);
         
         if ($response_code !== 200) {
-            $error_body = wp_remote_retrieve_body($response);
-            //error_log('DEBUG: Fetch failed with body (content selection): ' . $error_body);
             return array();
         }
@@ -696 +578 @@
 
         if (!isset($data['vectors'])) {
-            //error_log('DEBUG: No vectors key in response (content selection)');
             return array();
         }
@@ -730 +611 @@
         }
 
-        //error_log('DEBUG: Processed ' . count($processed_data) . ' records (content selection method)');
-        //error_log('=== DEBUG: fetch_pinecone_vectors_by_ids completed (content selection) ===');
-
         return $processed_data;
 
     } catch (Exception $e) {
-        //error_log('DEBUG: Exception in fetch_pinecone_vectors_by_ids (content selection): ' . $e->getMessage());
         return array();
     }
 }
-
-
     // ========================================
     // PINECONE DELETE OPERATIONS
     // ========================================
 
+/**
+ * Delete all vectors from Pinecone
+ */
 public function mxchat_delete_all_from_pinecone($pinecone_options) {
     $api_key = $pinecone_options['mxchat_pinecone_api_key'] ?? '';
@@ -758 +636 @@
 
     try {
-        // First, get all vector IDs
+        // First, get all vector IDs by scanning Pinecone directly
         $all_vector_ids = array();
 
-        // Try to get from cache first
-        $cached_vector_ids = get_option('mxchat_pinecone_vector_ids_cache', array());
-        if (!empty($cached_vector_ids)) {
-            $all_vector_ids = $cached_vector_ids;
-        } else {
-            // Use the correct method name that exists in your class
-            $records = $this->mxchat_get_recent_1k_entries($pinecone_options);
-            foreach ($records as $record) {
-                if (!empty($record->id)) {
-                    $all_vector_ids[] = $record->id;
-                }
+        // Get fresh data from Pinecone
+        $records = $this->mxchat_get_recent_1k_entries($pinecone_options);
+        foreach ($records as $record) {
+            if (!empty($record->id)) {
+                $all_vector_ids[] = $record->id;
             }
         }
@@ -794 +666 @@
             } else {
                 $failed_batches++;
-                //error_log('Failed to delete Pinecone batch: ' . $result['message']);
-            }
-        }
-
-        // CLEAR ALL RELEVANT CACHES - EXACTLY like your single delete
-        delete_transient('mxchat_pinecone_recent_1k_cache');
-        delete_option('mxchat_pinecone_vector_ids_cache');
-        delete_option('mxchat_pinecone_processed_cache');
-        delete_option('mxchat_processed_content_cache');
-        
-        // Also force refresh for next page load - EXACTLY like your single delete
-        $this->mxchat_refresh_after_new_content($pinecone_options);
+            }
+        }
 
         if ($failed_batches > 0) {
@@ -820 +682 @@
 
     } catch (Exception $e) {
-        //error_log('Pinecone delete all exception: ' . $e->getMessage());
         return array(
             'success' => false,
@@ -827 +688 @@
     }
 }
-
 
     /**
@@ -889 +749 @@
  */
 public function mxchat_delete_from_pinecone_by_vector_id($vector_id, $api_key, $host, $namespace = '') {
-    error_log('=== PINECONE DELETE OPERATION ===');
-    error_log('Vector ID: ' . $vector_id);
-    error_log('Host: ' . $host);
-    error_log('API Key: ' . (empty($api_key) ? 'EMPTY' : 'SET'));
+    //error_log('=== PINECONE DELETE OPERATION ===');
+    //error_log('Vector ID: ' . $vector_id);
+    //error_log('Host: ' . $host);
+    //error_log('API Key: ' . (empty($api_key) ? 'EMPTY' : 'SET'));
     
     // First, let's verify the vector exists before trying to delete
@@ -921 +781 @@
         $fetch_data = json_decode($fetch_body, true);
         
-        error_log('DEBUG: Fetch response: ' . print_r($fetch_data, true));
+        //error_log('DEBUG: Fetch response: ' . print_r($fetch_data, true));
         
         if (isset($fetch_data['vectors']) && isset($fetch_data['vectors'][$vector_id])) {
-            error_log('DEBUG: Vector EXISTS in this index before deletion');
+            //error_log('DEBUG: Vector EXISTS in this index before deletion');
         } else {
-            error_log('WARNING: Vector NOT FOUND in this index! It may be in a different bot\'s index');
+            //error_log('WARNING: Vector NOT FOUND in this index! It may be in a different bot\'s index');
             // You might want to return an error here
         }
     } else {
-        error_log('DEBUG: Could not fetch vector to verify existence');
+        //error_log('DEBUG: Could not fetch vector to verify existence');
     }
     
@@ -946 +806 @@
     }
     
-    error_log('DEBUG: Delete request body: ' . json_encode($request_body));
-    error_log('DEBUG: Delete endpoint: ' . $api_endpoint);
+    //error_log('DEBUG: Delete request body: ' . json_encode($request_body));
+    //error_log('DEBUG: Delete endpoint: ' . $api_endpoint);
 
     // Make the deletion request
@@ -962 +822 @@
     // Handle WordPress HTTP API errors
     if (is_wp_error($response)) {
-        error_log('DEBUG: WP Error: ' . $response->get_error_message());
+        //error_log('DEBUG: WP Error: ' . $response->get_error_message());
         return array(
             'success' => false,
@@ -973 +833 @@
     $response_body = wp_remote_retrieve_body($response);
     
-    error_log('DEBUG: Delete response code: ' . $response_code);
-    error_log('DEBUG: Delete response body: ' . $response_body);
+    //error_log('DEBUG: Delete response code: ' . $response_code);
+    //error_log('DEBUG: Delete response body: ' . $response_body);
 
     // Pinecone returns 200 for successful deletion (even if vector didn't exist)
     if ($response_code !== 200) {
-        error_log('DEBUG: Non-200 response from Pinecone');
+        //error_log('DEBUG: Non-200 response from Pinecone');
         return array(
             'success' => false,
@@ -1005 +865 @@
         
         if (isset($verify_data['vectors']) && isset($verify_data['vectors'][$vector_id])) {
-            error_log('ERROR: Vector STILL EXISTS after deletion attempt!');
+            //error_log('ERROR: Vector STILL EXISTS after deletion attempt!');
             return array(
                 'success' => false,
@@ -1011 +871 @@
             );
         } else {
-            error_log('SUCCESS: Vector confirmed deleted (or never existed)');
-        }
-    }
-    
-    error_log('=== END PINECONE DELETE OPERATION ===');
+            //error_log('SUCCESS: Vector confirmed deleted (or never existed)');
+        }
+    }
+    
+    //error_log('=== END PINECONE DELETE OPERATION ===');
 
     return array(
@@ -1151 +1011 @@
 
 
-    // ========================================
-    // VECTOR CACHE MANAGEMENT
-    // ========================================
-
-
-    /**
-     * Removes vector ID from cache array option
-     */
-     public function mxchat_remove_from_pinecone_vector_cache($vector_id) {
-         $cached_ids = get_option('mxchat_pinecone_vector_ids_cache', array());
-         $key = array_search($vector_id, $cached_ids);
-         if ($key !== false) {
-             unset($cached_ids[$key]);
-             update_option('mxchat_pinecone_vector_ids_cache', array_values($cached_ids));
-         }
-     }
-
-    /**
-     * Removes vector ID from processed content caches
-     */
-     public function mxchat_remove_from_processed_content_caches($vector_id) {
-         // Get all caches
-         $pinecone_cache = get_option('mxchat_pinecone_processed_cache', array());
-         $processed_cache = get_option('mxchat_processed_content_cache', array());
-
-         // We need to find the post ID that corresponds to this vector ID
-         // Vector ID is typically md5 of the source URL
-         $post_id_to_remove = null;
-
-         // Search through caches to find matching post
-         foreach ($pinecone_cache as $post_id => $cache_data) {
-             if (isset($cache_data['db_id']) && $cache_data['db_id'] === $vector_id) {
-                 $post_id_to_remove = $post_id;
-                 break;
-             }
-         }
-
-         // Also check the processed cache
-         if (!$post_id_to_remove) {
-             foreach ($processed_cache as $post_id => $cache_data) {
-                 if (isset($cache_data['db_id']) && $cache_data['db_id'] === $vector_id) {
-                     $post_id_to_remove = $post_id;
-                     break;
-                 }
-             }
-         }
-
-         // If we found the post ID, remove it from both caches
-         if ($post_id_to_remove) {
-             unset($pinecone_cache[$post_id_to_remove]);
-             unset($processed_cache[$post_id_to_remove]);
-
-             update_option('mxchat_pinecone_processed_cache', $pinecone_cache);
-             update_option('mxchat_processed_content_cache', $processed_cache);
-
-             //error_log('Removed post ID ' . $post_id_to_remove . ' from processed content caches');
-         } else {
-             // If we can't find by vector ID, we might need to reconstruct the URL
-             // and find the post ID that way
-             //error_log('Could not find post ID for vector ID: ' . $vector_id);
-         }
-     }
-
-
-    /**
-     * Retrieves and caches Pinecone API processed content
-     */
-     public function mxchat_get_pinecone_processed_content($pinecone_options) {
-         // First check local cache for immediate updates
-         $cached_data = get_option('mxchat_pinecone_processed_cache', array());
-
-         $api_key = $pinecone_options['mxchat_pinecone_api_key'] ?? '';
-         $host = $pinecone_options['mxchat_pinecone_host'] ?? '';
-
-         if (empty($api_key) || empty($host)) {
-             // Return only cached data if API credentials are missing
-             return $cached_data;
-         }
-
-         $pinecone_data = array();
-
-         try {
-             // Method 1: Try to get vectors using cached vector IDs first
-             $cached_vector_ids = get_option('mxchat_pinecone_vector_ids_cache', array());
-
-             if (!empty($cached_vector_ids)) {
-                 $pinecone_data = $this->fetch_pinecone_vectors_by_ids($pinecone_options, $cached_vector_ids);
-             }
-
-             // Method 2: If no cached IDs or fetch failed, use scanning approach
-             if (empty($pinecone_data)) {
-                 $pinecone_data = $this->mxchat_scan_pinecone_for_processed_content($pinecone_options);
-             }
-
-             // Method 3: Final fallback - try stats endpoint (if available)
-             if (empty($pinecone_data)) {
-                 $stats_url = "https://{$host}/describe_index_stats";
-
-                 $response = wp_remote_post($stats_url, array(
-                     'headers' => array(
-                         'Api-Key' => $api_key,
-                         'Content-Type' => 'application/json'
-                     ),
-                     'body' => json_encode(array()),
-                     'timeout' => 30
-                 ));
-
-                 if (!is_wp_error($response) && wp_remote_retrieve_response_code($response) === 200) {
-                     $body = wp_remote_retrieve_body($response);
-                     $stats_data = json_decode($body, true);
-
-                     // Log stats for debugging but don't rely on them for vector listing
-                     //error_log('Pinecone index stats: ' . print_r($stats_data, true));
-                 }
-             }
-
-         } catch (Exception $e) {
-             //error_log('Pinecone processed content exception: ' . $e->getMessage());
-         }
-
-         // Merge cached data with Pinecone data
-         // Cache takes priority for recent updates (within last 5 minutes)
-         $merged_data = $pinecone_data;
-
-         foreach ($cached_data as $post_id => $cache_item) {
-             $cache_timestamp = $cache_item['timestamp'] ?? 0;
-             $time_diff = current_time('timestamp') - $cache_timestamp;
-
-             // If cache item is recent (less than 5 minutes), prioritize it
-             if ($time_diff < 300) { // 5 minutes = 300 seconds
-                 $merged_data[$post_id] = $cache_item;
-             } else {
-                 // If not in Pinecone data and cache is old, keep cache but mark as potentially stale
-                 if (!isset($merged_data[$post_id])) {
-                     $merged_data[$post_id] = $cache_item;
-                 }
-             }
-         }
-
-         return $merged_data;
-     }
-
-
+
+/**
+ * Retrieves processed content from Pinecone API
+ */
+public function mxchat_get_pinecone_processed_content($pinecone_options) {
+    $api_key = $pinecone_options['mxchat_pinecone_api_key'] ?? '';
+    $host = $pinecone_options['mxchat_pinecone_host'] ?? '';
+
+    if (empty($api_key) || empty($host)) {
+        return array();
+    }
+
+    $pinecone_data = array();
+
+    try {
+        // Always get fresh data from Pinecone
+        $pinecone_data = $this->mxchat_scan_pinecone_for_processed_content($pinecone_options);
+
+        // Method 2: Final fallback - try stats endpoint (if available)
+        if (empty($pinecone_data)) {
+            $stats_url = "https://{$host}/describe_index_stats";
+
+            $response = wp_remote_post($stats_url, array(
+                'headers' => array(
+                    'Api-Key' => $api_key,
+                    'Content-Type' => 'application/json'
+                ),
+                'body' => json_encode(array()),
+                'timeout' => 30
+            ));
+
+            if (!is_wp_error($response) && wp_remote_retrieve_response_code($response) === 200) {
+                $body = wp_remote_retrieve_body($response);
+                $stats_data = json_decode($body, true);
+            }
+        }
+
+    } catch (Exception $e) {
+        // Log error but don't return cached data
+    }
+
+    return $pinecone_data;
+}
     // ========================================
     // HELPER METHODS

mxchat-basic/trunk/includes/class-mxchat-addons.php

@@ -191 +191 @@
      */
     public function enqueue_styles() {
-        $plugin_version = '2.4.3';
+        $plugin_version = '2.4.4';
 
         wp_enqueue_style(

mxchat-basic/trunk/includes/class-mxchat-admin.php

@@ -592 +592 @@
                 <div class="mxchat-pro-notification">
                     <div class="mxchat-pro-content">
-                        <h3>🚀 Limited Lifetime Offer: Save 30% on MxChat Pro, Agency, or Agency Plus!</h3>
-                    <p>Unlock <strong>unlimited access</strong> to our growing collection of powerful add-ons including Admin AI Assistant (ChatGPT-like experience), Forms Builder, AI Theme Generator, WooCommerce, Perplexity, and more – all included with your <strong>lifetime license!</strong></p>                    </div>
+                        <h3>🚀 Limited Lifetime Offer: Save 15% on MxChat Pro, Agency, or Agency Plus!</h3>
+                    <p>Unlock <strong>unlimited access</strong> to our growing collection of powerful add-ons including Admin AI Assistant (ChatGPT-like experience), Forms Builder, AI Theme Generator, WooCommerce, multi-bot, and more – all included with your <strong>lifetime license!</strong></p>                    </div>
                     <div class="mxchat-pro-cta">
                         <a href="https://mxchat.ai/" target="_blank" class="mxchat-button"><?php echo esc_html__('Upgrade Today', 'mxchat'); ?></a>
@@ -6531 +6531 @@
 public function mxchat_enqueue_admin_assets() {
     // Get plugin version (define this in your main plugin file)
-    $version = defined('MXCHAT_VERSION') ? MXCHAT_VERSION : '2.4.3';
+    $version = defined('MXCHAT_VERSION') ? MXCHAT_VERSION : '2.4.4';
 
     // Use file modification time for development (remove in production)
@@ -7253 +7253 @@
         }
         
-        // Clear bot-specific caches
-        $pinecone_manager->mxchat_clear_bot_caches($bot_id);
-        
-        // Clear bot-specific vector cache
-        delete_option('mxchat_pinecone_vector_ids_cache_' . $bot_id);
-        
-        // Clear bot-specific processed content caches
-        delete_option('mxchat_pinecone_processed_cache_' . $bot_id);
-        delete_option('mxchat_processed_content_cache_' . $bot_id);
-        
-        // Clear bot-specific transient cache
-        delete_transient('mxchat_pinecone_recent_1k_cache_' . $bot_id);
+        // No cache clearing needed since we removed caching
         
     } else {
@@ -7291 +7280 @@
     }
     
-    // Clear relevant cache
-    wp_cache_delete('all_prompts', 'mxchat_prompts');
-    wp_cache_delete('all_prompts_' . $bot_id, 'mxchat_prompts');
+    // No cache clearing needed since we removed caching
 
     error_log('=== DELETE ALL DEBUG END ===');

mxchat-basic/trunk/includes/class-mxchat-integrator.php

@@ -928 +928 @@
             $similarity_threshold = isset($current_options['similarity_threshold']) 
                 ? ((int) $current_options['similarity_threshold']) / 100 
-                : 0.75;
+                : 0.35;
             
             $testing_data['similarity_threshold'] = $similarity_threshold;
@@ -3622 +3622 @@
     $similarity_threshold = isset($current_options['similarity_threshold']) 
         ? ((int) $current_options['similarity_threshold']) / 100 
-        : 0.75;
+        : 0.35;
         
     $this->last_similarity_analysis['threshold_used'] = $similarity_threshold;
@@ -3821 +3821 @@
     $similarity_threshold = isset($current_options['similarity_threshold']) 
         ? ((int) $current_options['similarity_threshold']) / 100 
-        : 0.75;
+        : 0.35;
     
     $this->last_similarity_analysis['threshold_used'] = $similarity_threshold;
@@ -3998 +3998 @@
     return trim($content);
 }
+
+
 /**
  * Get role restriction for a single vector (with caching)
@@ -4505 +4507 @@
     }
 }
+
 private function mxchat_generate_response_openai_stream($selected_model, $api_key, $conversation_history, $relevant_content, $session_id, $testing_data = null) {
     try {
-         $bot_id = $this->get_current_bot_id($session_id);
+        $bot_id = $this->get_current_bot_id($session_id);
         
         // Get system prompt instructions using centralized function
@@ -4544 +4547 @@
         if (headers_sent() || !function_exists('curl_init')) {
             // Fallback to regular response with testing data
-            //error_log("MxChat: OpenAI streaming not possible, falling back to regular response");
             $regular_response = $this->mxchat_generate_response_openai(
                 $selected_model,
@@ -4560 +4562 @@
             if ($testing_data !== null) {
                 $response_data['testing_data'] = $testing_data;
-                //error_log("MxChat Testing: Added testing data to OpenAI fallback response");
             }
             
@@ -4591 +4592 @@
         $full_response = ''; // Accumulate full response for saving
         $stream_started = false;
+        $buffer = ''; // CRITICAL: Add persistent buffer for incomplete chunks
         
         // Buffer control for real-time streaming
-        curl_setopt($ch, CURLOPT_WRITEFUNCTION, function($ch, $data) use (&$full_response, &$stream_started, $testing_data) {
+        curl_setopt($ch, CURLOPT_WRITEFUNCTION, function($ch, $data) use (&$full_response, &$stream_started, &$buffer, $testing_data) {
             // Send testing data as the first event if available
             if (!$stream_started && $testing_data !== null) {
@@ -4599 +4601 @@
                 flush();
                 $stream_started = true;
-                //error_log("MxChat Testing: Sent testing data in OpenAI stream");
-            }
-            
-            // Process each chunk of data
-            $lines = explode("\n", $data);
+            }
+            
+            // CRITICAL FIX: Append new data to buffer
+            $buffer .= $data;
+            
+            // Process complete lines only
+            $lines = explode("\n", $buffer);
+            
+            // CRITICAL FIX: Keep the last incomplete line in the buffer
+            // The last element might be incomplete, so keep it in buffer
+            $buffer = array_pop($lines);
             
             foreach ($lines as $line) {
-                if (trim($line) === '' || strpos($line, 'data: ') !== 0) {
+                // Skip empty lines
+                if (trim($line) === '') {
+                    continue;
+                }
+                
+                // Only process lines that start with "data: "
+                if (strpos($line, 'data: ') !== 0) {
                     continue;
                 }
@@ -4612 +4626 @@
                 $json_str = substr($line, 6); // Remove 'data: ' prefix
                 
-                if ($json_str === '[DONE]') {
+                if (trim($json_str) === '[DONE]') {
                     echo "data: [DONE]\n\n";
                     flush();
@@ -4618 +4632 @@
                 }
                 
-                $json = json_decode($json_str, true);
-                if (isset($json['choices'][0]['delta']['content'])) {
+                // Try to decode JSON
+                $json = json_decode(trim($json_str), true);
+                if ($json && isset($json['choices'][0]['delta']['content'])) {
                     $content = $json['choices'][0]['delta']['content'];
-                    $full_response .= $content; // Accumulate
+                    $full_response .= $content; // Accumulate the full response
+                    
                     // Send as SSE format
                     echo "data: " . json_encode(['content' => $content]) . "\n\n";
@@ -4638 +4654 @@
             
             // Fallback to regular response
-            //error_log("MxChat: OpenAI streaming failed, falling back");
             $regular_response = $this->mxchat_generate_response_openai(
                 $selected_model,
@@ -4654 +4669 @@
             if ($testing_data !== null) {
                 $response_data['testing_data'] = $testing_data;
-                //error_log("MxChat Testing: Added testing data to OpenAI error fallback");
             }
             
@@ -4672 +4686 @@
         
     } catch (Exception $e) {
-        //error_log("MxChat OpenAI streaming exception: " . $e->getMessage());
-        
         // Fallback to regular response
         $regular_response = $this->mxchat_generate_response_openai(
@@ -4690 +4702 @@
         if ($testing_data !== null) {
             $response_data['testing_data'] = $testing_data;
-            //error_log("MxChat Testing: Added testing data to OpenAI exception fallback");
         }
         
@@ -4794 +4805 @@
         $full_response = ''; // Accumulate full response for saving
         $stream_started = false;
+        $buffer = ''; // CRITICAL: Add persistent buffer for incomplete chunks
 
         // Buffer control for real-time streaming
-        curl_setopt($ch, CURLOPT_WRITEFUNCTION, function($ch, $data) use (&$full_response, &$stream_started, $testing_data) {
+        curl_setopt($ch, CURLOPT_WRITEFUNCTION, function($ch, $data) use (&$full_response, &$stream_started, &$buffer, $testing_data) {
             // Send testing data as the first event if available
             if (!$stream_started && $testing_data !== null) {
@@ -4805 +4817 @@
             }
             
-            // Process each chunk of data
-            $lines = explode("\n", $data);
+            // CRITICAL FIX: Append new data to buffer
+            $buffer .= $data;
+            
+            // Process complete lines only
+            $lines = explode("\n", $buffer);
+            
+            // CRITICAL FIX: Keep the last incomplete line in the buffer
+            // The last element might be incomplete, so keep it in buffer
+            $buffer = array_pop($lines);
 
             foreach ($lines as $line) {
@@ -4822 +4841 @@
                     $json_str = substr($line, 6); // Remove 'data: ' prefix
 
-                    $json = json_decode($json_str, true);
+                    $json = json_decode(trim($json_str), true);
                     if (json_last_error() !== JSON_ERROR_NONE) {
                         continue;
@@ -5014 +5033 @@
         $full_response = ''; // Accumulate full response for saving
         $stream_started = false;
+        $buffer = ''; // CRITICAL: Add persistent buffer for incomplete chunks
         
         // Buffer control for real-time streaming
-        curl_setopt($ch, CURLOPT_WRITEFUNCTION, function($ch, $data) use (&$full_response, &$stream_started, $testing_data) {
+        curl_setopt($ch, CURLOPT_WRITEFUNCTION, function($ch, $data) use (&$full_response, &$stream_started, &$buffer, $testing_data) {
             // Send testing data as the first event if available
             if (!$stream_started && $testing_data !== null) {
@@ -5025 +5045 @@
             }
             
-            // Process each chunk of data
-            $lines = explode("\n", $data);
+            // CRITICAL FIX: Append new data to buffer
+            $buffer .= $data;
+            
+            // Process complete lines only
+            $lines = explode("\n", $buffer);
+            
+            // CRITICAL FIX: Keep the last incomplete line in the buffer
+            // The last element might be incomplete, so keep it in buffer
+            $buffer = array_pop($lines);
             
             foreach ($lines as $line) {
-                if (trim($line) === '' || strpos($line, 'data: ') !== 0) {
+                // Skip empty lines
+                if (trim($line) === '') {
+                    continue;
+                }
+                
+                // Only process lines that start with "data: "
+                if (strpos($line, 'data: ') !== 0) {
                     continue;
                 }
@@ -5035 +5068 @@
                 $json_str = substr($line, 6); // Remove 'data: ' prefix
                 
-                if ($json_str === '[DONE]') {
+                if (trim($json_str) === '[DONE]') {
                     echo "data: [DONE]\n\n";
                     flush();
@@ -5041 +5074 @@
                 }
                 
-                $json = json_decode($json_str, true);
-                if (isset($json['choices'][0]['delta']['content'])) {
+                // Try to decode JSON
+                $json = json_decode(trim($json_str), true);
+                if ($json && isset($json['choices'][0]['delta']['content'])) {
                     $content = $json['choices'][0]['delta']['content'];
                     $full_response .= $content; // Accumulate
@@ -5208 +5242 @@
         $full_response = ''; // Accumulate full response for saving
         $stream_started = false;
+        $buffer = ''; // CRITICAL: Add persistent buffer for incomplete chunks
         
         // Buffer control for real-time streaming
-        curl_setopt($ch, CURLOPT_WRITEFUNCTION, function($ch, $data) use (&$full_response, &$stream_started, $testing_data) {
+        curl_setopt($ch, CURLOPT_WRITEFUNCTION, function($ch, $data) use (&$full_response, &$stream_started, &$buffer, $testing_data) {
             // Send testing data as the first event if available
             if (!$stream_started && $testing_data !== null) {
@@ -5219 +5254 @@
             }
             
-            // Process each chunk of data
-            $lines = explode("\n", $data);
+            // CRITICAL FIX: Append new data to buffer
+            $buffer .= $data;
+            
+            // Process complete lines only
+            $lines = explode("\n", $buffer);
+            
+            // CRITICAL FIX: Keep the last incomplete line in the buffer
+            // The last element might be incomplete, so keep it in buffer
+            $buffer = array_pop($lines);
             
             foreach ($lines as $line) {
-                if (trim($line) === '' || strpos($line, 'data: ') !== 0) {
+                // Skip empty lines
+                if (trim($line) === '') {
+                    continue;
+                }
+                
+                // Only process lines that start with "data: "
+                if (strpos($line, 'data: ') !== 0) {
                     continue;
                 }
@@ -5229 +5277 @@
                 $json_str = substr($line, 6); // Remove 'data: ' prefix
                 
-                if ($json_str === '[DONE]') {
+                if (trim($json_str) === '[DONE]') {
                     echo "data: [DONE]\n\n";
                     flush();
@@ -5235 +5283 @@
                 }
                 
-                $json = json_decode($json_str, true);
-                if (isset($json['choices'][0]['delta']['content'])) {
+                // Try to decode JSON
+                $json = json_decode(trim($json_str), true);
+                if ($json && isset($json['choices'][0]['delta']['content'])) {
                     $content = $json['choices'][0]['delta']['content'];
-                    $full_response .= $content; // Accumulate
+                    $full_response .= $content; // Accumulate the full response
+                    
                     // Send as SSE format
                     echo "data: " . json_encode(['content' => $content]) . "\n\n";
@@ -6289 +6339 @@
 public function mxchat_enqueue_scripts_styles() {
     // Define version numbers for the styles and scripts
-    $chat_style_version = '2.4.3';
-    $chat_script_version = '2.4.3';
+    $chat_style_version = '2.4.4';
+    $chat_script_version = '2.4.4';
     // Enqueue the script
     wp_enqueue_script(
@@ -6904 +6954 @@
         : 'No system prompt configured';
     
-    // Get selected model
-    $selected_model = isset($current_options['model']) ? $current_options['model'] : 'gpt-4o';
+    // Get selected model - FIXED: Use $this->options instead of $current_options
+    $selected_model = isset($this->options['model']) ? $this->options['model'] : 'gpt-4o';
     
     // Get API key status (just check if they exist, don't expose the keys)
@@ -6938 +6988 @@
     }
     
-    // Get similarity threshold from main options (default 75%)
+    // Get similarity threshold from main options (default 35%)
     $similarity_threshold = isset($this->options['similarity_threshold']) 
         ? ((int) $this->options['similarity_threshold']) / 100 
-        : 0.75;
+        : 0.35;
     
     wp_send_json_success([
@@ -7112 +7162 @@
     $similarity_threshold = isset($this->options['similarity_threshold']) 
         ? ((int) $this->options['similarity_threshold']) / 100 
-        : 0.75;
+        : 0.35;
     
     $testing_data['similarity_threshold'] = $similarity_threshold;

mxchat-basic/trunk/js/chat-script.js

@@ -480 +480 @@
             // Log the error with code for debugging
             //console.log("Response data:", response.data);
-            ////console.error("API Error:", errorMessage, "Code:", errorCode);
+            //console.error("API Error:", errorMessage, "Code:", errorCode);
 
             // Format user-friendly error message
@@ -1225 +1225 @@
     
     function linkify(inputText) {
-    console.log('=== LINKIFY DEBUG START ===');
-    console.log('Input to linkify:', inputText);
-    console.log('Input type:', typeof inputText);
-    console.log('Input length:', inputText ? inputText.length : 'null/undefined');
+    //console.log('=== LINKIFY DEBUG START ===');
+    //console.log('Input to linkify:', inputText);
+    //console.log('Input type:', typeof inputText);
+    //console.log('Input length:', inputText ? inputText.length : 'null/undefined');
     
     if (!inputText) {
-        console.log('Empty input, returning empty string');
+        //console.log('Empty input, returning empty string');
         return '';
     }
     
     // Process markdown headers FIRST (before paragraph wrapping)
-    console.log('--- Processing Headers ---');
+    //console.log('--- Processing Headers ---');
     let processedText = formatMarkdownHeaders(inputText);
-    console.log('After headers:', processedText);
-    console.log('Headers changed:', processedText !== inputText);
+    //console.log('After headers:', processedText);
+    //console.log('Headers changed:', processedText !== inputText);
     
     // Process text styling (bold, italic, strikethrough)
-    console.log('--- Processing Text Styling ---');
-    const beforeStyling = processedText;
+    //console.log('--- Processing Text Styling ---');
+    //const beforeStyling = processedText;
     processedText = formatTextStyling(processedText);
-    console.log('After styling:', processedText);
-    console.log('Styling changed:', processedText !== beforeStyling);
+    //console.log('After styling:', processedText);
+    //console.log('Styling changed:', processedText !== beforeStyling);
     
     // Process code blocks BEFORE processing links to avoid conflicts
-    console.log('--- Processing Code Blocks ---');
+    //console.log('--- Processing Code Blocks ---');
     const beforeCodeBlocks = processedText;
     processedText = formatCodeBlocks(processedText);
-    console.log('After code blocks:', processedText);
-    console.log('Code blocks changed:', processedText !== beforeCodeBlocks);
+    //console.log('After code blocks:', processedText);
+    //console.log('Code blocks changed:', processedText !== beforeCodeBlocks);
     
     // NOW convert to paragraphs (this should be AFTER markdown processing)
-    console.log('--- Converting to Paragraphs ---');
+    //console.log('--- Converting to Paragraphs ---');
     const beforeParagraphs = processedText;
     processedText = convertNewlinesToBreaks(processedText);
-    console.log('After paragraph conversion:', processedText);
-    console.log('Paragraphs changed:', processedText !== beforeParagraphs);
+    //console.log('After paragraph conversion:', processedText);
+    //console.log('Paragraphs changed:', processedText !== beforeParagraphs);
     
     // Process markdown links
-    console.log('--- Processing Markdown Links ---');
+    //console.log('--- Processing Markdown Links ---');
     const beforeMarkdownLinks = processedText;
     const markdownLinkPattern = /\[([^\]]+)\]\((https?:\/\/[^\s)]+)\)/g;
     processedText = processedText.replace(markdownLinkPattern, (match, text, url) => {
-        console.log('Found markdown link:', match, 'text:', text, 'url:', url);
+        //console.log('Found markdown link:', match, 'text:', text, 'url:', url);
         const safeUrl = encodeURI(url);
         const safeText = sanitizeUserInput(text);
         return `<a href="${safeUrl}" target="${linkTarget}">${safeText}</a>`;
     });
-    console.log('After markdown links:', processedText);
-    console.log('Markdown links changed:', processedText !== beforeMarkdownLinks);
+    //console.log('After markdown links:', processedText);
+    //console.log('Markdown links changed:', processedText !== beforeMarkdownLinks);
 
     // Process phone numbers (tel:)
-    console.log('--- Processing Phone Numbers ---');
+    //console.log('--- Processing Phone Numbers ---');
     const beforePhone = processedText;
     const phonePattern = /\[([^\]]+)\]\((tel:[\d+\-\s()]+)\)/g;
     processedText = processedText.replace(phonePattern, (match, text, phone) => {
-        console.log('Found phone link:', match, 'text:', text, 'phone:', phone);
+        //console.log('Found phone link:', match, 'text:', text, 'phone:', phone);
         const safePhone = encodeURI(phone);
         const safeText = sanitizeUserInput(text);
         return `<a href="${safePhone}">${safeText}</a>`;
     });
-    console.log('After phone numbers:', processedText);
-    console.log('Phone numbers changed:', processedText !== beforePhone);
+    //console.log('After phone numbers:', processedText);
+    //console.log('Phone numbers changed:', processedText !== beforePhone);
 
     // Process mailto links
-    console.log('--- Processing Mailto Links ---');
+    //console.log('--- Processing Mailto Links ---');
     const beforeMailto = processedText;
     const mailtoPattern = /\[([^\]]+)\]\((mailto:[^\)]+)\)/g;
@@ -1298 +1298 @@
         return `<a href="${safeMailto}">${safeText}</a>`;
     });
-    console.log('After mailto links:', processedText);
-    console.log('Mailto links changed:', processedText !== beforeMailto);
+    //console.log('After mailto links:', processedText);
+    //console.log('Mailto links changed:', processedText !== beforeMailto);
 
     // Process standalone URLs (avoid already processed links)
-    console.log('--- Processing Standalone URLs ---');
+   //console.log('--- Processing Standalone URLs ---');
     const beforeStandaloneUrls = processedText;
     const urlPattern = /(^|[^">])(https?:\/\/[^\s<]+)(?![^<]*<\/a>)/gim;
     processedText = processedText.replace(urlPattern, (match, prefix, url) => {
-        console.log('Found standalone URL:', match, 'prefix:', prefix, 'url:', url);
+        //console.log('Found standalone URL:', match, 'prefix:', prefix, 'url:', url);
         const safeUrl = encodeURI(url);
         return `${prefix}<a href="${safeUrl}" target="${linkTarget}">${url}</a>`;
     });
-    console.log('After standalone URLs:', processedText);
-    console.log('Standalone URLs changed:', processedText !== beforeStandaloneUrls);
+    //console.log('After standalone URLs:', processedText);
+    //console.log('Standalone URLs changed:', processedText !== beforeStandaloneUrls);
     
     // Process www. URLs (avoid already processed links)
-    console.log('--- Processing WWW URLs ---');
+    //console.log('--- Processing WWW URLs ---');
     const beforeWwwUrls = processedText;
     const wwwPattern = /(^|[^">])(www\.[\S]+(\b|$))(?![^<]*<\/a>)/gim;
     processedText = processedText.replace(wwwPattern, (match, prefix, url) => {
-        console.log('Found www URL:', match, 'prefix:', prefix, 'url:', url);
+        //console.log('Found www URL:', match, 'prefix:', prefix, 'url:', url);
         const safeUrl = encodeURI(`http://${url}`);
         return `${prefix}<a href="${safeUrl}" target="${linkTarget}">${url}</a>`;
     });
-    console.log('After www URLs:', processedText);
-    console.log('WWW URLs changed:', processedText !== beforeWwwUrls);
-
-    console.log('=== FINAL RESULT ===');
-    console.log('Final processed text:', processedText);
-    console.log('Total transformation:', inputText !== processedText);
-    console.log('=== LINKIFY DEBUG END ===');
+    //console.log('After www URLs:', processedText);
+    //console.log('WWW URLs changed:', processedText !== beforeWwwUrls);
+
+    //console.log('=== FINAL RESULT ===');
+    //console.log('Final processed text:', processedText);
+    //console.log('Total transformation:', inputText !== processedText);
+    //console.log('=== LINKIFY DEBUG END ===');
     
     return processedText;

mxchat-basic/trunk/mxchat-basic.php

@@ -3 +3 @@
  * Plugin Name: MxChat
  * Description: AI chatbot for WordPress with OpenAI, Claude, xAI, DeepSeek, live agent, PDF uploads, WooCommerce, and training on website data.
- * Version: 2.4.3
+ * Version: 2.4.4
  * Author: MxChat
  * Author URI: https://mxchat.ai
@@ -17 +17 @@
 
 // Define plugin version constant for asset versioning
-define('MXCHAT_VERSION', '2.4.3');
+define('MXCHAT_VERSION', '2.4.4');
 
 function mxchat_load_textdomain() {
@@ -468 +468 @@
             }
             
-            // NEW: Run enabled_bots column migration for 2.4.3
-            if (version_compare($current_version, '2.4.3', '<')) {
+            // NEW: Run enabled_bots column migration for 2.4.4
+            if (version_compare($current_version, '2.4.4', '<')) {
                 mxchat_add_enabled_bots_column();
             }

mxchat-basic/trunk/readme.txt

@@ -6 +6 @@
 Tested up to: 6.8
 Requires PHP: 7.2
-Stable tag: 2.4.3
+Stable tag: 2.4.4
 License: GPLv2 or later
 License URI: https://www.gnu.org/licenses/gpl-2.0.html
@@ -14 +14 @@
 == Description ==
 
-[Documentation](https://mxchat.ai/documentation/) | [MxChat Pro](https://mxchat.ai/)
-
-### 🎥 Product Demo Videos:
-- [AI Theme Generator Add-On](https://www.youtube.com/watch?v=rSQDW2qbtRU&t) - Transform your chatbot's appearance in seconds with AI-powered design
-- [Admin Assistant Add-On](https://www.youtube.com/watch?v=AdEA1k-UCFM) - ChatGPT-like experience directly inside your WordPress dashboard
-- [WooCommerce Add-On](https://www.youtube.com/watch?v=WsqAppHRGdA) - Display product cards, recommendations, and supercharge your store
-- [MxChat Forms Add-On](https://www.youtube.com/watch?v=3MrWy5dRalA&t) - Convert conversations into data collection with smart forms that trigger during chats
-- [Chat with PDF & Word](https://www.youtube.com/watch?v=j_c45WWCTG0) - Let users upload and interact with documents
-
-[Explore all product videos on YouTube](https://www.youtube.com/@MxChat/videos)
+[Documentation](https://mxchat.ai/documentation/)
+
+### 📦 Optional Premium Add-Ons  
+Extend the free plugin with these optional premium features:  
+
+- [Forms Action Add-On](https://mxchat.ai/forms-action/) – Capture leads and data with custom in-chat forms  
+- [WooCommerce Add-On](https://mxchat.ai/woocommerce/) – AI-powered shopping assistance and product recommendations  
+- [AI Theme Customizer Add-On](https://mxchat.ai/ai-theme-customizer/) – Instantly design chatbot themes with natural language  
+- [Multi-Bot Add-On](https://mxchat.ai/multi-bot/) – Run unlimited AI chatbots with custom knowledge and personalities  
+- [Image Analysis Add-On](https://mxchat.ai/image-analysis/) – Enable AI-powered image analysis and OCR inside chats  
+
+👉 [Visit our website to view all add-ons](https://mxchat.ai)  
+
+### 🎥 Product Demo Videos  
+[Explore all product videos on YouTube](https://www.youtube.com/@MxChat/videos)  
 
 ## Why Choose MxChat AI Chatbot for Your WordPress Website?
@@ -34 +39 @@
 ✅ **Extensive Add-On Ecosystem**: Forms, moderation, recommendations, theme customization, and more  
 
-## 🔥 What's New in Version 2.4.2
-🤖 **NEW: Multi-Bot Manager Add-on Support** – Create and manage multiple specialized chatbots with dedicated knowledge databases for different purposes (support, sales, technical, etc.). Each bot can have its own Pinecone configuration and settings.  
+## 🔥 What's New in Version 2.4.4  
+
+🐞 **Bug Fixes**  
+- Default similarity is now accurate across all settings  
+- Improved streaming responses to prevent dropped characters or words  
+
+⚡ **Enhancements**  
+- Removed unnecessary Pinecone caching in the knowledge database for more accurate results  
 
 ## Core Features That Set MxChat Apart
@@ -171 +182 @@
 == Changelog ==
 
+= 2.4.4 - September 24, 2025 =
+- Bug Fix: Default similarity is now accurate across all settings.  
+- Bug Fix: Improved streaming responses to prevent dropped characters or words.  
+- Enhanced: Removed unnecessary Pinecone caching in the knowledge database for more accurate results.  
+
 = 2.4.3 - September 23, 2025 =
 - Added: Support for upcoming multi-bot update that allows for more customized settings such as individual chat models.
@@ -532 +548 @@
 == Upgrade Notice ==
 
-= 2.4.3 =
-- Added: Support for upcoming multi-bot update that allows for more customized settings such as individual chat models.
-- Improved: CSS for chatbot UI & more robust markdown support.
+= 2.4.4 =
+This update fixes similarity accuracy issues, improves streaming responses, and enhances knowledge database accuracy. Recommended for all users.  
 
 == License & Warranty ==