mysql源码安装

阅读量：6735 次

发布时间：2019-06-25

本文共 17466 字，大约阅读时间需要 58 分钟。

一．策划

1.1环境

操作系统CentOS-7-x86_64-Minimal-1708。内存配置至少2G，建议多核，能加快编译速速。swap区分配至少5G空间。

1.2介质

源码安装包：mysql-boost-5.7.23.tar，

下载地址：https://cdn.mysql.com//Downloads/MySQL-5.7/mysql-boost-5.7.22.tar.gz

创建实例的脚本；后附

1.3用户与组

软件属于mysql用户组下，mysql用户为拥有者，mysql用户密码为mysql。root用户有所有本地操作权限，root用户密码为mysql。

二．初始化

2.1清理环境

清理系统原有mysql及MariaDB，以防止后台进程的相互干扰，利用rpm指令的配套功能就可以实现。

[root@don ~]# rpm -qa |grep mysql

[root@don ~]# rpm -qa |grep mair

使用rpm工具，对返回的结果强制擦除

rpm -e --nodeps [ 返回的结果 ]

2.2安装所需的各依赖包

[root@don ~]# yum -y install gcc gcc-c++ readline-devel bzip2-devel rpm-build kernel-devel libaio libaio-devel elfutils-libelf-devel nfs-utils compat-libstdc++-33 compat-libcap1 cmake bison automake ncurses-devel xinetd openssl-devel numactl-libs

2.3修改系统内核参数

[root@don ~]# echo '* soft nofile 65535' >> /etc/security/limits.conf

[root@don ~]# echo '* hard nofile 65535' >> /etc/security/limits.conf

2.4创建用户与组

[root@don ~]# groupadd -g 6666 mysql

[root@don ~]# useradd -u 6666 -g mysql mysql

2.5创建目录

[root@don ~]# su - mysql

[mysql@don ~]$ mkdir -p /mysqldb/sofeware

[mysql@don ~]$ mkdir -p /mysqldb/base

[mysql@don ~]$ mkdir -p /mysqldb

2.6解压安装包

将源码安装包mysql-boost-5.7.23.tar放到/mysqldb/sofeware下

[mysql@don sofeware]$ pwd

/mysqldb/sofeware

[mysql@don sofeware]$ ls

mysql-boost-5.7.23.tar.gz

[mysql@don sofeware]$ tar xvf mysql-boost-5.7.23.tar.gz

**********************************************

[mysql@don sofeware]$ ls

mysql-5.7.23 mysql-boost-5.7.23.tar.gz

三．编译安装

3.1编译源码

进入解压后的文件夹

[mysql@don sofeware]$ cd mysql-5.7.23

切换到root用户

[mysql@don mysql-5.7.23]$ su

密码：

[root@don mysql-5.7.23]#

[root@don mysql-5.7.23]# cmake . -DCMAKE_INSTALL_PREFIX=/mysqldb/base -DENABLED_LOCAL_INFILE=ON -DDOWNLOAD_BOOST=1 -DWITH_BOOST=./boost/

DENABLED_LOCAL_INFILE=ON ：源码文件保存在当前路径下

DCMAKE_INSTALL_PREFIX=/mysqldb/base ：为源码指定安装目录

3.2源码安装

设备上的内核数目为4，所以参数配置为-j 4。

[root@don mysql-5.7.23]# make -j 4 && make install

某次安装期间报错，内容如下

[root@don ~]# top

产看内核资源，发现某次安装时的swap区为1G，已经全部用满，证明内存容量不足，

本次安装系统的内存为2G，同时swap区配置为8G时，发现编译安装时swap区使高峰期用量约为3G，所以当使用源码编译时，总内存量不能小于6G。

进入/mysqldb/base/bin目录下，验证安装。当返回帮助文档时，证明安装成功

[root@don bin]# pwd

/mysqldb/base/bin

[root@don bin]# ./mysql --help

3.3修正权限

编译安装需要root权限，当编译安装完成后，将软件属组权限还给mysql.

[root@don bin]# chown -R mysql:mysql /mysqldb/

3.4建立软链接

为方便MySQL其他配套组件使用，建立对应软链接。当提示软连接存在时，则跳过。

ln -s /mysqldb/mysql*/bin/mysql /usr/bin/mysql

ln -s /mysqldb/mysql*/bin/mysqladmin /usr/bin/mysqladmin

ln -s /mysqldb/mysql*/bin/mysql_config /usr/bin/mysql_config

ln -s /mysqldb/mysql*/lib/libmysqlclient.so.20 /usr/lib64/libmysqlclient.so.20

四．创建实例

4.1介质

init57_v1.4_20180402.sh #mysql8.0不同#：

#!/bin/bash

#目录、端口、实例名等信息的配置文件

INI_CFG=./init57.info

#IP

IP=""

#软件目录

SOFTDIR=""

#根目录

BASE_DIR=""

#实例名

INS_NAME=""

#实例名前缀

INS_NAME_PRE=""

#实例端口

INS_PORT=""

#server id

SERVER_ID=""

#实例根目录

INS_BASE_DIR=""

#管理员用户

ADMIN_USER=""

#管理员密码

ADMIN_PASSWD=""

#实例参数文件

INS_CNF=""

#初始化SQL文件

INIT_FILE=""

function Isok()

{

[ $? == "0" ] && echo "Complete OK !" || echo " Failed !!!";exit 128

}

#创建实例函数

function create_instance()

{

#1、创建实例相应目录

mkdir -p ${INS_BASE_DIR}/{bin,conf,data,binlog,log,tmp}

chmod -R 755 ${INS_BASE_DIR}

echo "alias tail_${INS_NAME}='tail -f -n 100 ${INS_BASE_DIR}/log/mysql.err'" >> ~/.bash_profile

echo "alias startup_${INS_NAME}='sh ${INS_BASE_DIR}/bin/startup.sh'" >> ~/.bash_profile

echo "alias shutdown_${INS_NAME}='sh ${INS_BASE_DIR}/bin/shutdown.sh'" >> ~/.bash_profile

echo "alias login_${INS_NAME}='sh ${INS_BASE_DIR}/bin/login.sh'" >> ~/.bash_profile

echo "****** 1、创建目录："

echo " 启动脚本目录：${INS_BASE_DIR}/bin"

echo " 配置文件目录：${INS_BASE_DIR}/conf"

echo " 数据目录：${INS_BASE_DIR}/data"

echo " binlog目录：${INS_BASE_DIR}/binlog"

echo " log目录：${INS_BASE_DIR}/log"

echo " 临时目录：${INS_BASE_DIR}/tmp"

#2、生成参数文件

cat <<EOF >${INS_CNF}

[mysqld]

#************** basic ***************

datadir =${INS_BASE_DIR}/data

basedir =${SOFTDIR}

tmpdir =${INS_BASE_DIR}/tmp

port =${INS_PORT}

socket =${INS_BASE_DIR}/mysql.sock

pid_file =${INS_BASE_DIR}/mysql.pid

show_compatibility_56 =on

#************** connection ***************

max_connections =2000

max_connect_errors =100000

max_user_connections =0

#************** sql timeout & limits ***************

#max_join_size =1000000

#max_execution_time =10000

#sql_safe_updates =0

lock_wait_timeout =60

autocommit =1

lower_case_table_names =1

thread_cache_size =64

disabled_storage_engines ="MyISAM,FEDERATED"

character_set_server =utf8

transaction-isolation ="READ-COMMITTED"

skip_name_resolve =ON

explicit_defaults_for_timestamp =ON

log_timestamps =SYSTEM

local_infile =OFF

event_scheduler =OFF

query_cache_type =OFF

query_cache_size =0

lc_messages =en_US

lc_messages_dir =${SOFTDIR}/share

init_connect ="set names utf8"

#sql_mode =NO_ENGINE_SUBSTITUTION,STRICT_TRANS_TABLES,NO_AUTO_CREATE_USER,NO_ZERO_DATE,NO_ZERO_IN_DATE,ERROR_FOR_DIVISION_BY_ZERO

#init_file =${INIT_FILE}

#init_slave

secure-file-priv =${INS_BASE_DIR}/tmp

#******************* err & slow & general ***************

log_error =${INS_BASE_DIR}/log/mysql.err

#log_output ="TABLE,FILE"

slow_query_log =ON

slow_query_log_file =${INS_BASE_DIR}/log/slow.log

long_query_time =1

log_queries_not_using_indexes =OFF #如果打开，会造成大量的slow log

general_log =OFF

general_log_file =${INS_BASE_DIR}/log/general.log

#************** binlog & relaylog ***************

expire_logs_days =7

sync_binlog =1

log-bin =${INS_BASE_DIR}/binlog/${INS_NAME}-bin

log-bin-index =${INS_BASE_DIR}/binlog/${INS_NAME}-bin.index

max_binlog_size =500M

binlog_format =ROW

binlog_rows_query_log_events =ON

binlog_cache_size =128k

binlog_stmt_cache_size =128k

max_binlog_cache_size =2G

max_binlog_stmt_cache_size =2G

relay_log =${INS_BASE_DIR}/binlog/${INS_NAME}-relay

relay_log_index =${INS_BASE_DIR}/binlog/${INS_NAME}-relay.index

max_relay_log_size =500M

relay_log_purge =ON

relay_log_recovery =ON

#*************** rpl_semi_sync ***************

loose_rpl_semi_sync_master_enabled =ON

loose_rpl_semi_sync_master_timeout =1000

loose_rpl_semi_sync_master_trace_level =32

loose_rpl_semi_sync_master_wait_for_slave_count =1

loose_rpl_semi_sync_master_wait_no_slave =ON

loose_rpl_semi_sync_master_wait_point =AFTER_SYNC

loose_rpl_semi_sync_slave_enabled =ON

loose_rpl_semi_sync_slave_trace_level =32

#*************** group commit ***************

binlog_group_commit_sync_delay =1

binlog_group_commit_sync_no_delay_count =1000

#*************** gtid ***************

gtid_mode =ON

enforce_gtid_consistency =ON

master_verify_checksum =ON

sync_master_info =1

#*************slave ***************

skip-slave-start =1

#read_only =ON

#super_read_only =ON

log_slave_updates =ON

server_id =${SERVER_ID}

report_host =$IP

report_port =${INS_PORT}

slave_load_tmpdir =${INS_BASE_DIR}/tmp

slave_sql_verify_checksum =ON

slave_preserve_commit_order =1

#*************** muti thread slave ***************

slave_parallel_type =LOGICAL_CLOCK

slave_parallel_workers =4

master_info_repository =TABLE

relay_log_info_repository =TABLE

#*************** buffer & timeout ***************

read_buffer_size =1M

read_rnd_buffer_size =2M

sort_buffer_size =1M

join_buffer_size =1M

tmp_table_size =64M

max_allowed_packet =64M

max_heap_table_size =64M

connect_timeout =10

wait_timeout =600

interactive_timeout =600

net_read_timeout =30

net_write_timeout =30

#*********** myisam ***************

skip_external_locking =ON

key_buffer_size =16M

bulk_insert_buffer_size =16M

concurrent_insert =ALWAYS

#***********open table ***************

open_files_limit =65000

table_open_cache =16000

table_definition_cache =16000

innodb_open_files =63000

#*********** innodb ***************

default_storage_engine =InnoDB

default_tmp_storage_engine =InnoDB

internal_tmp_disk_storage_engine =InnoDB

innodb_data_home_dir =${INS_BASE_DIR}/data

innodb_log_group_home_dir =${INS_BASE_DIR}/data

innodb_log_file_size =100M

innodb_log_files_in_group =2

innodb_undo_directory =${INS_BASE_DIR}/data

innodb_undo_log_truncate =on

innodb_max_undo_log_size =500M

innodb_undo_tablespaces =3

innodb_flush_log_at_trx_commit =2

innodb_fast_shutdown =1

innodb_flush_method =O_DIRECT

innodb_io_capacity =2000

innodb_io_capacity_max =4000

innodb_buffer_pool_size =500M

innodb_log_buffer_size =32M

innodb_autoinc_lock_mode =1

innodb_buffer_pool_load_at_startup =ON

innodb_buffer_pool_dump_at_shutdown =ON

innodb_buffer_pool_dump_pct =15

innodb_max_dirty_pages_pct =85

innodb_lock_wait_timeout =10

#innodb_locks_unsafe_for_binlog =1

innodb_old_blocks_time =1000

innodb_buffer_pool_instances =4

innodb_page_cleaners =4

innodb_strict_mode =ON

innodb_thread_concurrency =64

innodb_sort_buffer_size =64M

innodb_print_all_deadlocks =1

innodb_rollback_on_timeout =ON

innodb_adaptive_hash_index =0 #防止mysqld crash 20180103

EOF

echo "****** 2、生成参数文件："

echo " 实例${INS_NAME}的参数文件: ${INS_CNF}"

# 3、实例化数据库

echo "****** 3、初始化数据库："

#[ `echo $USER` == "root" ] && chown mysql:root $INS_BASE_DIR

${SOFTDIR}/bin/mysqld --defaults-file=${INS_CNF} \

--initialize-insecure --user=mysql \

--basedir=${SOFTDIR} \

--datadir=${INS_BASE_DIR}/data

#4、生成启动、关闭、登陆脚本

echo "****** 4、生成启动、关闭、登陆脚本："

cat <<EOF >${INS_BASE_DIR}/bin/startup.sh

#!/bin/bash

source /etc/profile

source ~/.bash_profile

export UMASK=0644

export UMASK_DIR=0750

## vars

SOFTDIR=${SOFTDIR}

DBHOME=${INS_BASE_DIR}

DBNAME=${INS_NAME}

CNF=\${DBHOME}/conf/\${DBNAME}.cnf

DATADIR=\${DBHOME}/data

## startup

nohup \${SOFTDIR}/bin/mysqld_safe --defaults-file=\${CNF} --datadir=\${DATADIR} >\${DBHOME}/nohup.out 2>&1 &

EOF

cat <<EOF >${INS_BASE_DIR}/bin/shutdown.sh

#!/bin/bash

source /etc/profile

source ~/.bash_profile

## vars

SOFTDIR=${SOFTDIR}

DBHOME=${INS_BASE_DIR}

DBNAME=${INS_NAME}

CNF=\${DBHOME}/conf/\${DBNAME}.cnf

SOCK=\${DBHOME}/mysql.sock

## shutdown

\${SOFTDIR}/bin/mysqladmin --defaults-file=\${CNF} -uroot -p -S\${SOCK} shutdown

EOF

cat <<EOF >${INS_BASE_DIR}/bin/login.sh

SOFTDIR=${SOFTDIR}

DBHOME=${INS_BASE_DIR}

DBNAME=${INS_NAME}

SOCK=\${DBHOME}/mysql.sock

\${SOFTDIR}/bin/mysql -uroot -p -S\${SOCK}

EOF

chmod 700 ${INS_BASE_DIR}/bin/startup.sh ${INS_BASE_DIR}/bin/shutdown.sh ${INS_BASE_DIR}/bin/login.sh

#5、修改管理员密码

echo "****** 5、修改管理员密码："

hostname=`hostname`

sh ${INS_BASE_DIR}/bin/startup.sh

sleep 5

${SOFTDIR}/bin/mysql -uroot -S${INS_BASE_DIR}/mysql.sock<<EOF

#install semi sync

install plugin rpl_semi_sync_slave soname 'semisync_slave.so';

install plugin rpl_semi_sync_master soname 'semisync_master.so';

#root

alter user 'root'@'localhost' identified by "oracle";

delete from mysql.user where user='root' and host=lower("${hostname}");

#备份用户

GRANT SELECT, RELOAD, SHOW DATABASES, SUPER, LOCK TABLES, REPLICATION CLIENT,REPLICATION SLAVE, SHOW VIEW, TRIGGER,EVENT ON *.* TO 'bkpuser'@'10.1.1.8' IDENTIFIED BY "oracle";

GRANT SELECT, RELOAD, SHOW DATABASES, SUPER, LOCK TABLES, REPLICATION CLIENT,REPLICATION SLAVE, SHOW VIEW, TRIGGER,EVENT ON *.* TO 'bkpuser'@'localhost' IDENTIFIED BY "oracle";

#监控用户

GRANT PROCESS, REPLICATION SLAVE, REPLICATION CLIENT ON *.* TO zabbix@localhost IDENTIFIED BY "oracle";

GRANT SELECT ON mysql.* TO zabbix@localhost;

#slave用户

GRANT REPLICATION SLAVE, REPLICATION CLIENT ON *.* TO 'replic'@'%' IDENTIFIED BY "oracle";

GRANT REPLICATION SLAVE, REPLICATION CLIENT ON *.* TO 'replic'@'localhost' IDENTIFIED BY "oracle";

flush privileges;

shutdown;

EOF

[ $? == "0" ] && echo " 密码修改成功!"

#修改配置文件，使半同步参数生效

sleep 5

sed -i 's/loose_//g' ${INS_CNF}

sh ${INS_BASE_DIR}/bin/startup.sh

echo "****** 6、网络监听:"

netstat -pltn 2>/dev/null |grep -E "Proto|$INS_PORT|mysql"

echo "****** 7、MySQL错误日志:"

grep -Ei "[error]|[warning]" $INS_BASE_DIR/log/mysql.err

}

if [ -f ${INI_CFG} ]; then

grep -v "#" ${INI_CFG} | while read line

IP=`echo ${line} | cut -d" " -f1`

SOFTDIR=`echo ${line} | cut -d" " -f2 | sed 's/\/$//'`

BASE_DIR=`echo ${line} | cut -d" " -f3 | sed 's/\/$//'`

INS_NAME_PRE=`echo ${line} | cut -d" " -f4`

INS_NAME=`echo ${line} | cut -d" " -f5`

INS_PORT=`echo ${line} | cut -d" " -f6`

SERVER_ID=`echo ${line} | cut -d" " -f7`

ADMIN_USER=`echo ${line} | cut -d" " -f8`

ADMIN_PASSWD=`echo ${line} | cut -d" " -f9`

INS_BASE_DIR=${BASE_DIR}/${INS_NAME_PRE}_${INS_NAME}

INS_CNF=${INS_BASE_DIR}/conf/${INS_NAME}.cnf

INIT_FILE=${INS_BASE_DIR}/conf/init_file.sql

echo "****** 实例${INS_NAME}信息: ******"

echo " IP: ${IP}"

echo " 软件目录: ${SOFTDIR}"

echo " 根目录: ${BASE_DIR}"

echo " 实例根目录: ${INS_BASE_DIR}"

echo " 实例名前缀: ${INS_NAME_PRE}"

echo " 实例名: ${INS_NAME}"

echo " 实例端口: ${INS_PORT}"

echo " server_id: ${SERVER_ID}"

echo " 管理员用户: ${ADMIN_USER}"

echo " 管理员密码: ${ADMIN_PASSWD}"

if [ `echo ${line} | awk '{print NF}'` != "9" ]; then

echo "ERROR：创建实例相应参数不够！"

echo "##############################################################################################"

echo -e "\n"

#判断端口与ibdata01文件是否存在，都不存在则创建实例。存在一个则创建失败

elif [ X"`netstat -ltn | grep ${INS_PORT}`" = X"" ] && [ ! -f ${INS_BASE_DIR}/data/ibdata01 ]; then

#调用创建实例函数

create_instance;

else

echo "ERROR：端口${INS_PORT}或${INS_BASE_DIR}/data/ibdata01文件存在，创建实例失败！"

echo "##############################################################################################"

echo -e "\n"

done

else

echo "ERROR：${INI_CFG}配置文件不存在！"

exit 1

4.2配置参数文件

将脚本发送到/mysqldb/sofeware路径下。配置initdb.info

[root@don sofeware]# vi initdb.info

IP ******************************************************本机IP 地址

SOFT_DIR ***********************************************软件根目录，本机为/mysqldb/base

INSTANCE_BASE_DIR **************************************实例根目录，自定义

INSTANCE_NAME_PREFIX **********************************实例前缀，自定义

INSTANCE_NAME *****************************************实例名，自定义

INSTANCE_PORT ******************************************实例端口号，建议范围22222-66666

SERVER_ID ***********************************************服务号，实例号后缀号码

ADMIN_USER *********************************************维护账号

ADMIN_PASSWD*******************************************维护密码

4.3运行脚本

注意，一定要在MySQL用户下运行。

[mysql@don sofeware]$ sh init57_v1.3_20180402.sh

运行结束后，将在规划中的/mysqldb下创建，三个实例

[mysql@don instance]$ ls

db_blue db_red db_yellow

同时，三个实例对应的mysqld服务进程同时存在系统中：

[mysql@don instance]$ ps -ef|grep mysql

mysql 78084 1 0 18:39 pts/0 00:00:00 /bin/sh /mysqldb/base/bin/mysqld_safe --defaults-file=/mysqldb/db_red/conf/red.cnf --datadir=/mysqldb/db_red/data

mysql 79811 78084 0 18:39 pts/0 00:00:00 /mysqldb/base/bin/mysqld --defaults-file=/mysqldb/db_red/conf/red.cnf --basedir=/mysqldb/base --datadir=/mysqldb/db_red/data --plugin-dir=/mysqldb/base/lib/plugin --log-error=/mysqldb/db_red/log/mysql.err --open-files-limit=65000 --pid-file=/mysqldb/db_red/mysql.pid --socket=/mysqldb/db_red/mysql.sock --port=22222

mysql 81577 1 0 18:40 pts/0 00:00:00 /bin/sh /mysqldb/base/bin/mysqld_safe --defaults-file=/mysqldb/db_blue/conf/blue.cnf --datadir=/mysqldb/db_blue/data

mysql 83304 81577 0 18:40 pts/0 00:00:00 /mysqldb/base/bin/mysqld --defaults-file=/mysqldb/db_blue/conf/blue.cnf --basedir=/mysqldb/base --datadir=/mysqldb/db_blue/data --plugin-dir=/mysqldb/base/lib/plugin --log-error=/mysqldb/db_blue/log/mysql.err --open-files-limit=65000 --pid-file=/mysqldb/db_blue/mysql.pid --socket=/mysqldb/db_blue/mysql.sock --port=22223

mysql 85070 1 0 18:40 pts/0 00:00:00 /bin/sh /mysqldb/base/bin/mysqld_safe --defaults-file=/mysqldb/db_yellow/conf/yellow.cnf --datadir=/mysqldb/db_yellow/data

mysql 86732 85070 0 18:40 pts/0 00:00:00 /mysqldb/base/bin/mysqld --defaults-file=/mysqldb/db_yellow/conf/yellow.cnf --basedir=/mysqldb/base --datadir=/mysqldb/db_yellow/data --plugin-dir=/mysqldb/base/lib/plugin --log-error=/mysqldb/db_yellow/log/mysql.err --open-files-limit=65000 --pid-file=/mysqldb/db_yellow/mysql.pid --socket=/mysqldb/db_yellow/mysql.sock --port=22224

五．登陆数据库

5.1关闭MySQL进程

进入实例db_red目录下bin文件夹，运行shutdown.sh脚本，关闭实例red的进程。同理，关闭其他实例进程。

[mysql@don bin]$ sh shutdown.sh

Enter password: mysql

[mysql@don bin]$ ps -ef|grep mysql

[root@don bin]# ps -ef|grep mysql

root 14023 1345 0 16:29 pts/0 00:00:00 su - mysql

mysql 14024 14023 0 16:29 pts/0 00:00:00 -bash

root 55137 14067 0 18:31 pts/0 00:00:00 su - mysql

mysql 55138 55137 0 18:31 pts/0 00:00:00 -bash

root 65693 65683 0 18:34 pts/0 00:00:00 su - mysql

mysql 65694 65693 0 18:34 pts/0 00:00:00 -bash

root 86869 19010 0 18:44 pts/1 00:00:00 grep --color=auto mysql

5.2启动进程

进入实例对应的bin目录下，运行startup.sh脚本

[mysql@don bin]$ ls

[mysql@don bin]$ sh startup.sh

[mysql@don bin]$ ps -ef|grep mysql

mysql 86938 1 0 19:00 pts/0 00:00:00 /bin/sh /mysqldb/base/bin/mysqld_safe --defaults-file=/mysqldb/db_red/conf/red.cnf --datadir=/mysqldb/db_red/data

mysql 88597 86938 1 19:00 pts/0 00:00:00 /mysqldb/base/bin/mysqld --defaults-file=/mysqldb/db_red/conf/red.cnf --basedir=/mysqldb/base --datadir=/mysqldb/db_red/data --plugin-dir=/mysqldb/base/lib/plugin --log-error=/mysqldb/db_red/log/mysql.err --open-files-limit=65000 --pid-file=/mysqldb/db_red/mysql.pid --socket=/mysqldb/db_red/mysql.sock --port=22222