加入收藏 | 设为首页 | 会员中心 | 我要投稿 PHP编程网 - 黄冈站长网 (http://www.0713zz.com/)- 数据应用、建站、人体识别、智能机器人、语音技术!
当前位置: 首页 > 站长学院 > MySql教程 > 正文

借助mysql general log日志找出查询次数最多的SQL句子

发布时间:2022-06-11 15:44:17 所属栏目:MySql教程 来源:互联网
导读:我们知道不管是apache,iis及mysql都可以通过日志能判断程序性能与错误定位了,今天我们来介绍利用mysql general log日志找出查询次数最多的SQL句子. 查询最多的sql语句,开启general log: mysql show variables like %general%; +------------------+---------
  我们知道不管是apache,iis及mysql都可以通过日志能判断程序性能与错误定位了,今天我们来介绍利用mysql general log日志找出查询次数最多的SQL句子.
 
  查询最多的sql语句,开启general log:
 
  mysql> show  variables like '%general%';
  +------------------+-------------------------------------+
  | Variable_name | Value |
  +------------------+-------------------------------------+
  | general_log | OFF |
  | general_log_file | /usr/local/mysql/data/localhost.log |
  +------------------+-------------------------------------+
  mysql> set global general_log = "ON";
  analysis-general-log.py脚本:
 
  #!/usr/bin/python
   
  # sort and count mysql general log
  # Author: Jason
  # Created: UTC 2015-02-15 17:51:53
   
       sys.exit(1)
   
  logFo = open(logPath)
  match = 0
   
  for line in logFo:
      line = re.sub(r"\n","",line)
      if match == 0:
          # match line begin with numbers
          lineMatch = re.match(r"\s+[0-9]+\s+.*",line,flags=re.I)
          if lineMatch:
              lineTmp = lineMatch.group(0)
              match = match + 1
              continue
   
      elif match == 1:
          # match line begin with numbers
          lineMatch = re.match(r"\s+[0-9]+\s+.*",line,flags=re.I)
          if lineMatch:  --phpfensi.com
              # match only query
              lineMatchQuery = re.match(r".*Query\s+(.*)",lineTmp,flags=re.I)
              if lineMatchQuery:
                  lineTmp = lineMatchQuery.group(1)
                  # remove extra space
                  lineTmp = re.sub(r"\s+", " ",lineTmp)
                  # replace values (value) to values (x)
                  lineTmp = re.sub(r"values\s*\(.*?\)", "values (x)",lineTmp,flags=re.I)
                  # replace filed = 'value' to filed = 'x'
                  lineTmp = re.sub(r"(=|>|<|>=|<=)\s*('|\").*?\2","\\1 'x'",lineTmp)
                  # replace filed = value to filed = x
                  lineTmp = re.sub(r"(=|>|<|>=|<=)\s*[0-9]+","\\1 x",lineTmp)
                  # replace like 'value' to like 'x'
                  lineTmp = re.sub(r"like\s+('|\").*?\1","like 'x'",lineTmp,flags=re.I)
                  # replace in (value) to in (x)
                  lineTmp = re.sub(r"in\s+\(.*?\)","in (x)",lineTmp,flags=re.I)
                  # replace limit x,y to limit
                  lineTmp = re.sub(r"limit.*","limit",lineTmp,flags=re.I)
                   
                  print (lineTmp)
   
              match = 1
              lineTmp = lineMatch.group(0)
          else:    
              lineTmp += line
              match = 1
   
  logFo.close()
  使用方法:
 
  analysis-general-log.py general.log | sort | uniq -c | sort -nr
  1032 SELECT * FROM wp_comments WHERE ( comment_approved = 'x' OR comment_approved = 'x' ) AND comment_post_ID = x ORDER BY comment_date_gmt DESC
  653 SELECT post_id, meta_key, meta_value FROM wp_postmeta WHERE post_id in (x) ORDER BY meta_id ASC
  527 SELECT FOUND_ROWS()
  438 SELECT t.*, tt.* FROM wp_terms AS t INNER JOIN wp_term_taxonomy AS tt ON  
  218 SELECT tr.object_id FROM wp_term_relationships AS tr INNER JOIN wp_term_taxonomy AS tt ON tr.term_taxonomy_id = tt.term_taxonomy_id WHERE tt.taxonomy in (x) AND tt.term_id in (x) ORDER BY tr.object_id ASC
  217 SELECT wp_posts.* FROM wp_posts WHERE 1= x AND wp_posts.ID in (x) AND wp_posts.post_type = 'x' AND ((wp_posts.post_status = 'x')) ORDER BY wp_posts.menu_order ASC
  202 SELECT SQL_CALC_FOUND_ROWS wp_posts.ID FROM wp_posts WHERE 1= x AND wp_posts.post_type = 'x' AND (wp_posts.post_status = 'x') ORDER BY wp_posts.post_date DESC limit
  118 SET NAMES utf8
  115 SET SESSION sql_mode= 'x'
  115 SELECT @@SESSION.sql_mode
  112 SELECT option_name, option_value FROM wp_options WHERE autoload = 'x'
  111 SELECT user_id, meta_key, meta_value FROM wp_usermeta WHERE user_id in (x)  
  106 SELECT SQL_CALC_FOUND_ROWS wp_posts.ID FROM wp_posts WHERE 1= x AND wp_posts.post_type = 'x' AND (wp_posts.post_status = 'x') AND post_date > 'x' ORDER BY wp_posts.post_date DESC limit
  106 SELECT SQL_CALC_FOUND_ROWS wp_posts.ID FROM wp_posts WHERE 1= x AND wp_posts.post_type = 'x' AND (wp_posts.post_status = 'x') AND post_date > 'x' ORDER BY RAND() DESC limit
  105 SELECT SQL_CALC_FOUND_ROWS wp_posts.ID FROM wp_posts WHERE 1= x AND wp_posts.post_type = 'x' AND (wp_posts.post_status = 'x') AND post_date > 'x' ORDER BY wp_posts.comment_count DESC limit
  mysql general log日志清除技巧
 
  mysql general log日志不能直接删除,间接方法.
 
  USE mysql;
  CREATE TABLE gn2 LIKE general_log;
  RENAME TABLE general_log TO oldLogs, gn2 TO general_log;
 

(编辑:PHP编程网 - 黄冈站长网)

【声明】本站内容均来自网络,其相关言论仅代表作者个人观点,不代表本站立场。若无意侵犯到您的权利,请及时与联系站长删除相关内容!

    热点阅读