1.基础环境介绍 Ubuntu12.04.5 openssh 都需要默认安装 源节点

ceph0.80.4 ceph-admin管理和客户端节点，ceph01,ceph02,ceph03集群节点， 网络万兆：192.168.100.11 集群节点硬盘需要3个。以上是基础配置


2.利用ice安装Calamari-server、ceph-deploy部署3节点Ceph环境，因为离线安装，所以/etc/apt/sources.list备份。 配好hostname。

每个节点需要写ceph-deploy的/etc/hostsip 需要在该/etc/hosts

ceph-deploy需要与其他节点之间免KEY

#ssh-keygen

#ssh-copy-idtest-ceph01 ceph02 ceph03


locale

exportLC_ALL="C"


3.配置ntp时间同步

3.1）搭建时间同步服务器

安装ntp apt-get installntp

3.2)修改ntp.conf备份基础

vim /etc/ntp.conf

# (Again, the addressis an example only.)

broadcast 160.17.5.255

3.3)启动服务

service ntpd start

# more information.

server ceph01

ntpdate -d ip

查看防火墙关闭

ufwdisable

Firewallstopped and disabled on system startup


4.在根目录下创建一个ceph_config目录解压包到这个目录下

执行安装脚步如下：

#pythonice_setup.py


chown-R www-data:www-data /var/log/calamari/

#calamari-ctl initialize

apt-keylist


ceph-deploycalamari connect ceph01 ceph02 ceph03 ceph04

#ceph-deployinstall ceph-admin ceph01 ceph02 ceph03 安装ceph集群

#ceph-deploynew test-ceph01 初始化mon并生成ceph.conf

修改ceph.conf文件

[global]

fsid =de882364-b3f9-45ce-b625-42acdbba3922

mon_initial_members =ceph01, ceph02, ceph03

mon_host =160.17.5.11,160.17.5.12,160.17.5.13

auth_cluster_required= cephx

auth_service_required= cephx

auth_client_required =cephx

filestore_xattr_use_omap= true

public_network =160.17.5.0/24

cluster_network =192.168.110.0/24

osd_pool_default_size= 3

osd_pool_default_min_size= 2

osd_pool_default_pg_num= 256

osd_pool_default_pgp_num= 256

osd_max_backfills = 3

osd_recovery_max_active= 5


ceph mon remove ceph01

mon_host =192.168.111.11,192.168.111.12,192.168.111.13



Ceph-deploymon create test-ceph01 创建可以是3台mon

ceph-deploy--overwrite-conf mon create ceph01

ceph-deploygatherkeys ceph01 ceph02 ceph03

环境有脏数据执行以下操作

Ceph-deployosd create --zap-disk ceph01:/dev/sdc ceph02:/dev/sdcceph03:/dev/sdc

强制安装

ceph-deploy--overwrite-conf osd create rceph01:/dev/sdb rceph02://dev/sdbrceph03:/dev/sdb


pkill-i salt-minion

salt-key-L 发现

salt-key-A 加入

节点需要安装网管的可以加入主机的名称

安装

#apt-getinstall tgt radosgw

#apt-getinstall libapache2-mod-fastcgi

先将节点ceph01节点生成ceph.client.radosgw.keyring的key拷贝到其他需要网管的节点

将节点ceph01文件分发到个节点的home下

./gateway.sh

./server

创建池

./pool.sh


选择网管节点

ceph-deploy--overwrite-conf config push ceph03