Oracle Exadata
Presentation by EasyReliable
Phone: +080-41156843
Email: easyreliable@gmail.com/support@easyreliable.com
https://easyreliable.com/software_training_prices/dba-training-courses/oracle-exadata/
Website: http://www.easyreliable.com
Agenda
- Exadata Machine Overview
- Exadata Hardware Architecture
- Exadata Software Architecture
Exadata Machine Overview
Oracle Exadata Machine is engineered system which is specially designed for Oracle Database on cluster architecture supported by Oracle RAC. There is no generic configuration. All components of Exadata are fully tuned as per Exadata requirement. It is combination of hardware and software which provide esteemed performance, scalability and availability. It is introduced in september 2008. In exadata, Private Interconnect is not used. It is accomplished by infiniband and clusterware files (voting disk and cluster registry) are stored in special ASM disk group named DBFS_DG . Oracle Provide different version of Exadata Machine V2,X2,X3,X4,X5,X6 , X7 And X8M
Advantage of Exadata
- Exadata is well-suited for consolidating multiple databases onto single Exadata system.
- It is used for Data warehouse( where large and complex queries are used ) and OLTP environment( supporting large transaction with quick and consistent response time)
- It is delivered with complete package of Software , Servers, Network and Storage
- There is single point of accountability, meaning that issues will never remain unresolved Since there is no need to wait for other vendors
- The best Oracle Database platform -Oracle Exadata's full-stack architecture improves the performance, scale, security, and availability of an enterprise’s Oracle databases. Available in Oracle Cloud Infrastructure, on-premises, and with Exadata Cloud@Customer, it incorporates more than 60 unique features that are coengineered with Oracle Database to accelerate OLTP, analytics, and machine-learning Exadata reduces capital costs and management expenses by enabling IT departments to consolidate hundreds of databases onto a single system, including running Oracle Autonomous Database Service and Exadata Database Service together on Cloud@Customer infrastructure deployed in their data centers.
Key Components include :
- Powerful and intelligent shared storage provide by Exadata Storage server
- High bandwidth and low latency cluster interconnect and storage networking provided using InfiniBand
- Powerful and well-balanced database servers joined together in cluster
Some of other hardware and software features are:
Hardware Components
1. Cisco network switch
2. KVM
3. PDU
4. Rack
5. Flash Cache
Software Components
1. Storage Software
2. Operating System (Linux/Solaris)
3. Oracle Database Software (11gr2,12c)
Exadata Hardware Architecture
Database Server – The Exadata Database Machine runs Oracle Database 11g/12c/19c RAC .The cluster and the database run on the servers known as database server or compute server. A full rack has 8 Database server running Oracle Linux or Oracle Solaris and 14 storage server and 16 core per storage server
Storage Server - The disks are not attached to the database server, as is normally the case with the direct attached storage, but rather to a different server known as the storage server (or just “cell”; there are 14 storage in a full rack). The Oracle Exadata Server Software runs in these cells on top of the OS.
Disks – Each cell has 12 disks. Depending on the configuration, these disks are either 600GB high performance or 2TB high capacity (GB here means 1 billion bytes, not 1024MB). You have a choice in the disk type while making the purchase.
Flash disks – Each cell has 3.2 tb of flash disks in High Capacity Storage server and Extreme Flash Storage server. These disks can be presented to the compute nodes as storage (to be used by the database) or used a secondary cache for the database cluster (called smart cache).
Infiniband Network – The cells and nodes are connected through infiniband for high speed and low latency. There are 3 infiniband switches for redundancy and throughput. Note: there are no fiber switches since there is no fiber component.
Ethernet switch – The outside world can communicate via infiniband, or by Ethernet. There is a set of Ethernet switches with ports open to the outside. The clients may connect to the nodes using Ethernet. DMAs and others connect to the nodes and cells using Ethernet as well. Backups are preferably via infiniband but they can be done through network as well.
KVM switch – There is a keyboard, video, and mouse switch to get direct access to the nodes and cells physically. This is used initially while setting up and when the network to the system is not available. In a normal environment you will not need to go near the Rack and access this KVM, not even for powering on and off the cells and nodes. Why not? You’ll learn why in the next installment. (Not all models have a KVM switch.)
Types of Exadata Machine
The Exadata Machine comes as a Full Rack, Half Rack or Quarter Rack , Eighth Rack.
Full Rack Database Machine- It has 8 Database Servers and 14 Exadata storage servers ,2 infiniband and one Ethernet switch .
Half Rack Database Machine- It has exactly half the capacity. It has 4 Database Servers and seven Exadata storage servers . It has 256 GB of memory per database server node.
Quarter Rack Database Machine -It consists of several virtual machines configured to provide two database servers and three Exadata Storage Servers and two infiniband switches
Eighth Rack Database Machine – Just like a Quarter Rack, It contain two database servers and three Exadata Storage Servers and two infiniband switches. However ,in an Eighth Rac ,half of database server and CPU cores are disabled
Exadata Software Architecture
- Restart server (RS) and Management Server (MS) run on both Database and storage server
- The Exadata Database Machine software architecture include
- Exadata Database Servers use Oracle Linux x86_64 as operating system
- Exadata Database Servers run 11g_r2 12c and 19c.
- ASM is required and provides a file system and volume manager.
- Oracle Database communicate with Exadata cells by using a special library called LIBCELL. It will communicate with Exadata cells by using iDB.
- The Database Resource Manager (DBRM) is integrated with Exadata Storage server I/O resource Manager(IORM). DBRM and IORM work together to ensure that I/O resources are allocated based on administrator-defined priority.
- Diskmon checks the storage network interface state and cell liveness.
- Management Server (MS) on Database server provides set of management and configuration functions. It work in cooperation with the DBMCLI command-line interface .
- Restart Server (RS) - It is used to start up and shut down the MS on Database server and monitor MS to automatically restart it if require.
- Software components that reside in each Database Server:
- Oracle Exadata Database Machine X8-M-2 comes with Oracle Linux KVM is the virtualization technology for systems that use RoCE Network Fabric. The ability to run Oracle Linux without OVM remains, and is the only option for 8-socket Database Servers.
- Exadata X8M Database Servers: can run Oracle Database 11g Release 2, 12c, 18c, and 19c. The database servers can be configured with all supported Oracle Database software releases; however, Oracle Grid Infrastructure 19c is required to support Oracle Database 19c. The precise patch release of Oracle software must be compatible with the Exadata Storage Server software and other Exadata software components. My Oracle Support note 888828.1 contains an up-to-date list of supported versions for the Exadata software components.
- LIBCELL: Oracle Database communicates with Exadata cells by using a special library called LIBCELL. In combination with the database kernel and ASM, LIBCELL transparently maps database I/O operations to Exadata Storage Server enhanced operations. LIBCELL communicates with Exadata cells by using the Intelligent Database protocol (iDB).
- iDB Protocol: The iDB protocol is a unique Oracle data transfer protocol that serves as the communications protocol among Oracle ASM, database instances, and storage cells.
The Exadata Storage Machine software architecture include
- CELLSRV is primary Exadata software component and provides the majority of Exadata storage services. CELLSRV is a multithreaded server. Primarily, CELLSRV communicates with Oracle Database to serve simple block requests, such as database buffer cache reads, and Smart Scan requests, such as table scans with projections and filters. CELLSRV also implements I/O Resource Management (IORM) and collects numerous statistics relating to its operations. Cellsrv is launched by cellrsomt by executable /opt/oracle/cell12.1.1.1.1_LINUX.X64_140712/cellsrv/bin/cellrsomt.
To check ,run below command on storage server
[celladmin@qr01celadm01 ~]$ ps -ef | grep "/cellsrv “
- Exadata Storage Servers use Oracle Linux x86_64 as operating system
- Restart Server (RS) - It is used to start up and shut down the Cell Server (CELLSRV) on storage server
To check ,run below command on storage server
[celladmin@qr01celadm01 ~]$ ps -ef | grep cellrs
- Management Server (MS). It also monitors these services to check if they need to be restarted. MS provides Exadata cell management and configuration. It works in cooperation with the Exadata cell command-line interface (CellCLI). In addition, MS is responsible for sending alerts and collects some statistics in addition to those collected by CELLSRV.
To check ,run below command on storage server
[celladmin@qr01celadm01 ~]$ ps -ef | grep msServer
Storage Network:
Exadata X8-M contains a storage network based on Remote Direct Memory Access over Converged Ethernet (RoCE). This provides high bandwidth and low latency access to the Exadata Storage Servers. Fault tolerance is built into the network architecture through the
use of multiple redundant network switches and network interface bonding•Server cluster: The database servers in Exadata are designed to be powerful and well balanced so that there are no bottlenecks within the server architecture. They are equipped with all of the components required for Oracle RAC, enabling customers to easily deploy Oracle RAC across a
single Exadata Database Machine. Where processing requirements exceed the capacity of a single Database Machine, customers can join multiple Database Machines together to create a single unified server cluster.
Cluster Interconnect:
The high bandwidth and low latency characteristics of the ultra-fast RoCE network are ideally suited to the requirements of the cluster interconnect. Because of this, Exadata X8M is configured by default to also use the RDMA network fabric as both the storage network and the cluster interconnect.
Exadata Network Architecture:
Starting with Oracle Exadata System Software release 19.3 and Oracle Exadata Database Machine X8M, RDMA over Converged Ethernet (RoCE) is used for the RDMA Network Fabric instead of InfiniBand. RDMA over RoCE Network Fabric uses different switches and cables from those used
by RDMA over InfiniBand Network Fabric.
To deploy Oracle Exadata Database Machine, ensure that you meet the minimum network requirements. Oracle Exadata Database Machine requires a minimum of three networks, and there are interfaces available for additional networks. Each network must be on a distinct and separate subnet from the others. Oracle recommends one common additional network for backup, which you can configure with OEDA.
Management Network: This required network connects to your existing management network, and is used for administrative work for all components of Oracle Exadata Database Machine. It connects the servers, Integrated Lights Out Manager (ILOM), and switches connected to the Ethernet switch in the rack.
Each Database Server and Storage Server has two network interfaces for management. One provides management access to the operating system through the embedded NET0 Ethernet port on Oracle Exadata Database Machine Two-Socket systems, or the NEM0/NET1 Ethernet port on Oracle Exadata Database Machine Eight-Socket systems.
The other network interface provides access to the ILOM through the NET MGT Ethernet port. Oracle Exadata Database Machines are delivered with the NET MGT and NET0 or NEM0/NET0 ports connected to the Ethernet switch in the rack. The NET0 or NEM0/NET0 port on the database servers should not be used for client or application network traffic. Cabling or configuration changes to these interfaces on Oracle Exadata Storage Servers is not permitted.
- InfiniBand ports for both the compute server and storage server are connected to each of the InfiniBand leaf switches; the spine switch is only used to connect the leaf switches or other Exadata racks.
- The ILOM port, marked “NET-MGMT” on the servers, is connected to the embedded Cisco switch.
- The NET0 management interface on both the compute server and storage server is connected to the Cisco switch. The Cisco switch uplinks to the data center network (not shown in Figure 1-3, ) to provide access to the administrative interfaces.
- The NET1 and NET2 interfaces on the compute servers are connected to the client data center network and serve as the “Client Access Network.” Typically, these are bonded to form a NET1-2 interface, which servers as the public network and VIP interface for the Oracle cluster.
- The Exadata Storage Servers have no direct connectivity to the client access network; they are accessed for administrative purposes via the administrative interface via the embedded Cisco switch.
No comments:
Post a Comment