Tungsten Replication from Amazon RDS


//=== http://docs.continuent.com/tungsten-replicator-3.0/deployment-fromamazonrds.html

Roles: RDS instance, Tungsten Replicator, destination database instance(dest_db)

* no ssh access to RDS instance is provided yet?

* install Tungsten Replicator on a certain host
The replicator can be installed either within a standard (non-RDS) Amazon EC2 instance
or
on another host which can write to the dest_db

* read bin_log from RDS, transfer format and write to dest_db
- "Service Alpha" extracts the binary log information directly from RDS instance and loads into THL.
-- ("Service Alpha" is a utility running on Tungsten Replicator)
-- (THL: Transaction History Log )

- Tungsten Replicator then writes the information from the THL and writes the data to the target database.



//=== http://docs.continuent.com/tungsten-replicator-3.0/deployment-fromamazonrds-preparation.html

dest_db data format prerequisites : [take mysql for example]

* Table format should be updated to UTF8 by updating the MySQL configuration (/etc/mysql/my.cnf):
- character-set-server=utf8
- collation-server=utf8_general_ci

* To prevent timezone configuration storing zone adjusted values,
fix the timezone configuration to use UTC within the configuration file (my.cnf):
- default-time-zone='+00:00'


RDS instance config
http://docs.continuent.com/tungsten-replicator-3.0/deployment-fromamazonrds-rdsconfig.html

to change RDS config by RDS client
http://docs.continuent.com/tungsten-replicator-3.0/deployment-amazonrds-rdsconfig.html


//=== download and install Tungsten
http://docs.continuent.com/tungsten-replicator-3.0/deployment-fromamazonrds-installation.html

* Download the latest version of Tungsten Replicator.
https://code.google.com/p/tungsten-replicator/wiki/Downloads


Expand the release:
shell> tar zxf tungsten-replicator-3.0.1-64

Change to the staging directory:
shell> cd tungsten-replicator-3.0.1-64


Run tpm to install the replicator:
[shd create repli-user first]

shell> ./tools/tpm install alpha \
--install-directory=/opt/continuent \
--replication-user=tungsten \
--replication-password=secret \
--replication-port=3306 \
--direct-replication-port=3306 \
--privileged-master=false \
--skip-validation-check=MySQLDumpCheck \
--topology=direct \
--master=db1 \
--direct-datasource-host=xxxx.cnlhon44f2wq.eu-west-1.rds.amazonaws.com \
--direct-datasource-user=rds_user \
--direct-datasource-password=rds_password \
--start-and-report



//=== http://docs.continuent.com/continuent-tungsten-4.0/terminology-thl.html
Tungsten Replicator --> Continuent-Tungsten

THL: Transaction History Log

"... stores transactional data from different data servers in a universal format
that is then used to exchange and transfer the information between replicator instances.

Because the THL is stored and 'independently' managed from the data servers that it reads and writes,
the data can be moved, exchanged, and transmuted during processing.
..."""




.