Adding Nodes to Fault Groups

This blog post was authored by Sarah Lemaire.

Suppose you are adding new cluster nodes to your Vertica database. You want to add those nodes to particular fault groups without having to restart your Vertica database.

The following steps use the example of a database with five racks and fault groups, with 9 Vertica nodes in each. These steps show how to add five nodes:

• node010
• node020
• node030
• node040
• node050
=> SELECT parent_name, member_name FROM fault_groups ORDER BY 1,2; parent_name | member_name --------------+------------- verticadb502 | rack001 verticadb502 | rack002 verticadb502 | rack003 verticadb502 | rack004 verticadb502 | rack005 rack001 | node001 rack001 | node002 rack001 | node003 rack001 | node004 rack001 | node005 rack001 | node006 rack001 | node007 rack001 | node008 rack001 | node009 rack002 | node011 rack002 | node012 rack002 | node013 rack002 | node014 rack002 | node015 rack002 | node016 rack002 | node017 rack002 | node018 rack002 | node019 rack003 | node021 rack003 | node022 rack003 | node023 rack003 | node024 rack003 | node025 rack003 | node026 rack003 | node027 rack003 | node028 rack003 | node029 rack004 | node031 rack004 | node032 rack004 | node033 rack004 | node034 rack004 | node035 rack004 | node036 rack004 | node037 rack004 | node038 rack004 | node039 rack005 | node041 rack005 | node042 rack005 | node043 rack005 | node044 rack005 | node045 rack005 | node046 rack005 | node047 rack005 | node048 rack005 | node049 (50 rows) 1. Use admintools to add the nodes to your cluster, but do not rebalance. You’ll do that later.

2. Set all the new nodes to be PERMANENT. This enables Vertica to use this node to store data. => ALTER NODE node010 PERMANENT; => ALTER NODE node020 PERMANENT; => ALTER NODE node030 PERMANENT; => ALTER NODE node040 PERMANENT; => ALTER NODE node050 PERMANENT; 3. Add the new nodes to their respective fault groups. => ALTER FAULT GROUP rack001 ADD NODE node010; => ALTER FAULT GROUP rack002 ADD NODE node020; => ALTER FAULT GROUP rack003 ADD NODE node030; => ALTER FAULT GROUP rack004 ADD NODE node040; => ALTER FAULT GROUP rack005 ADD NODE node050; 4. Rebalance your cluster. => SELECT REBALANCE_CLUSTER(); REBALANCE_CLUSTER ------------------- REBALANCED (1 row) Check your fault group to make sure the nodes are aligned as desired. => SELECT parent_name, member_name FROM FAULT_GROUPS ORDER BY 1,2; parent_name | member_name --------------+------------- verticadb502 | rack001 verticadb502 | rack002 verticadb502 | rack003 verticadb502 | rack004 verticadb502 | rack005 rack001 | node001 rack001 | node002 rack001 | node003 rack001 | node004 rack001 | node005 rack001 | node006 rack001 | node007 rack001 | node008 rack001 | node009 rack001 | node010 rack002 | node011 rack002 | node012 rack002 | node013 rack002 | node014 rack002 | node015 rack002 | node016 rack002 | node017 rack002 | node018 rack002 | node019 rack002 | node020 rack003 | node021 rack003 | node022 rack003 | node023 rack003 | node024 rack003 | node025 rack003 | node026 rack003 | node027 rack003 | node028 rack003 | node029 rack003 | node030 rack004 | node031 rack004 | node032 rack004 | node033 rack004 | node034 rack004 | node035 rack004 | node036 rack004 | node037 rack004 | node038 rack004 | node039 rack004 | node040 rack005 | node041 rack005 | node042 rack005 | node043 rack005 | node044 rack005 | node045 rack005 | node046 rack005 | node047 rack005 | node048 rack005 | node049 rack005 | node050 (55 rows)