1. Introduction
Over the past decade, the growth of internet traffic has significantly contributed to the increase in the amount of backbone network equipment required and the capacities of such equipment [
1]. This growth has resulted in an increase in the running cost and energy consumption. Energy consumption rather than cost has been considered as a major concern as it has been found to be a contributor of greenhouse gases which have a great impact on the environment.
Recently, many research efforts have been devoted to greening the internet to reduce its carbon footprint and impact on the environment [
2,
3]. In [
1], a MILP optimization model and energy efficient heuristics were developed to reduce power consumption for the IP over WDM networks. Results have shown that savings ranging from 25% to 45% can be achieved with the bypass Light path in comparison to the non-bypass. In [
4], the authors developed a MILP model to optimize the physical topology of the National Science Foundation (NSF) network topology with the objective of reducing total network power consumption considering the different approaches, nodal degrees, and topologies. Authors in [
4] also investigated the full mesh and star topologies and have shown significant savings in power that reach 95% and 92%, respectively. In [
4], the authors have considered the use of renewable energy to reduce energy consumption and hence reduce the emissions of greenhouse gases. The authors in [
4] have also studied the adaptive link rates for different loads and its impact on the total power consumption. Results have demonstrated that with the use of renewable energy and adaptive rates, energy savings can reach 65%. In [
5], the authors studied and investigated means of reducing the power consumption of IP over WDM networks with data centers. Authors have developed an MILP model to optimize the location of data centers and found that the routing approach, topology design, and number of data centers are the main factors that control the percentage of power savings that can be achieved while optimizing the locations of data centers. The authors in [
5] demonstrated that savings in energy consumption can be up to 73% if data centers are located near the renewable energy sources and a replication scheme is considered.
In this study, for the achievement of more power savings on top of previously proposed approaches, we implement the MILP model developed in [
1] to evaluate the NSF network with highly connected topology designs, such as the small-world, scale-free, and random complex networks to reduce energy consumption by efficiently utilizing communication links, router ports, and paths through means of grouping and consolidation.
The main contributions of our research are summarized as follows:
We investigated network-related factors/properties including the clustering coefficient, network diameter, average path length, and their impact on overall network power consumption in IP over WDM networks.
We improved the clustering coefficient and diameter of the NSFNet. The clustering coefficient indicates how good a node is connected to its neighbors’ neighbors. A high clustering coefficient indicates that the network is composed of many strong ties. Our results demonstrated a 246% increase in the clustering coefficient when compared with the current NSF design.
We improved the NSFNet path length. Our results, as shall be illustrated in a subsequent section, demonstrated that a reduction of 15% in the NSF network path length can be achieved with a small-world network design with p = 1.
The contribution of backbone networks to the total network power consumption is increasing significantly with the growing popularity of bandwidth-intensive applications. This growth has resulted in an increase in the running cost and energy consumption. Energy consumption, rather than cost, has been considered as a major concern as it has been found to be a contributor of greenhouse gases which have a great impact on the environment. In this work, with the implemented topology designs on the NSFNet, we have achieved power savings of up to 27% more than the previously proposed topology.
Implemented complex network designs, such as implementing the small-world, scale-free, and random networks on the NSFNet while maintaining the location of the nodes as well as the number of edges.
We have optimized the implemented new NSFNet physical topology (small-world, scale-free, and random) using Tucker’s MILP model under different traffic loads and time zones.
We have analyzed the characteristics of the different topologies and shown that physical topology optimization can be viewed as a design process with the aim of minimizing the average network path.
The remainder of this paper is organized as follows:
Section 2 presents the main properties of any network topology, with a focus on complex network properties such as the degree distribution, degree exponent, mean path length, and clustering coefficient.
In
Section 3, for consistency and completeness, we revisit the IP over WDM network architecture and briefly describe the current NSF network topology. In
Section 4, we demonstrate the complex network designs to be evaluated on the NSF node distribution. In
Section 5, we describe the MILP model implemented to evaluate the total network power consumption of the NSF network when complex network connectivity is implemented. In
Section 6, we provide the results and discussions. Finally,
Section 7 provides the conclusions and future insights.
3. Complex Network Designs
In this section, we review the complex networks, describe their properties, and justify recent interest by researchers for the consideration of such topologies in networks. The main models, covering random graphs, small-world network, and SFNs shall be described in this section.
Complex networks are found to be energy-efficient, robust, and fault-tolerant SFN physical topologies that display stability and a high degree of tolerance against physical impairments and link or node failures. In the occurrence of dynamic changes such as link failures or the removal of links from routing tables, these networks sustain and produce a new network that is still highly connected and able to deliver information and maintain delay with acceptable predefined performance measures. With the rich connectivity of the complex networks, the power consumption of the network can be reduced by grooming traffic on fewer links and putting underutilized links on sleep mode.
The main models of the complex networks, covering random graphs, small-world networks, and SFNs are briefly described in the following.
3.1. Random Networks
The purpose of random networks as first proposed by Erdos-Renyi (ER) in 1959 was to model networks with n nodes and generate a homogeneous graph G (n,p) by randomly selecting a pair of nodes with equal probability (p) and assign edges to connect them with the prespecified probability [
9]. The generated random graph has p[n(n−1)/2] randomly placed edges connecting a pair of nodes with independent probability (p). Random graphs have a low mean path length which is directly proportional to the network size [
7].
3.2. SFNs
The scale-free networks (SFNs), modeled by Barabási and Albert, are described as inhomogeneous networks and characterized by a power-law degree distribution [
8]. In SFNs, few nodes exist with a high number of links (hubs), and a high number of nodes with few links exist. The emergence of the SFN property is governed by growth and preferential attachment. When a new node is added into the network, the probability of the node’s attachment to other nodes will be higher to those with a higher degree. As a result, hubs will have higher rates of connecting new nodes than other nodes; hence, a skewed degree of distribution with a heavy tail is produced (power-law behavior). Networks with power-law behavior are said to be SFNs.
In SFNs, more than 60% of nodes can be reached through heavily connected hubs, demonstrating a fruitful property of SFNs, in addition to the low diameter property of such models. The larger the network or the number of added nodes, the smaller the diameter and the shorter the path is between any two nodes [
10].
3.3. Small-World Network
The small-world network was initially introduced by Watts and Strogatz to provide graphs that exhibit a high clustering coefficient with a small average shortest path length. A small-world network is a graph where most of its nodes are not adjacent to each other, however; the network has a low diameter, and most of its nodes can be reached by each other in a few hops. As the number of nodes in small-world networks increases, the diameter increases logarithmically, however; the number of links to interconnect nodes is kept to a minimum.
As illustrated in
Figure 1, the model starts with a ring structure that consists of a specified number of edges (
k) and nodes (
n) that remain unchanged throughout the realization process. With a predefined probability (
p), a few shortcuts are created to rewire and interconnect nodes with edges which are selected randomly. The number of generated shortcuts (
S) are governed by the predefined probability and can be calculated using Equation (3).
The clustering coefficient and path length properties are highly affected by edge rewiring, which is governed by the predefined (p). For p = 0, the network is unchanged. However, as the probability increases to approach 1, all edges are rewired, and the clustering coefficient and average path length become the lowest that can be attained. Modifying the probability of edge rewiring for values between 0 and 1 (e.g., p = 0.1), a small-world network will be generated with a high clustering coefficient, as with a regular graph, and a low diameter, as with a random graph.
4. Implementation of Small World, Random, and Scale-Free Networks on the NSF Network
In this section, we implement the small-world network, ER random network, and SFN on the NSF to produce different topologies using methods and codes presented in [
11] to further study the impact of such networks on the average path diameter, average clustering coefficient, and the total network power consumption.
The NSF network as illustrated in
Figure 2 consists of 14 nodes distributed in different states of the United States (US) with 21 bi-directional links. The network is referred to as the current NSF, and it has an average shortest path diameter of 2.175 and an average clustering coefficient of 0.0714.
To create SFN graphs to interconnect the 14 nodes of the current NSF network illustrated in
Figure 2, the algorithm described by Barabási and Albert in [
11] is implemented. Multiple runs of the algorithm generate different graphs and yield different ways of connecting the NSF 14 nodes with 21 edges. Each modeled complex network graph was run more than 10 times, and the samples provided in this work are our best graphs in terms of power consumption conservation. However, the mathematical MILP model for each sample has given the same results (optimum), regardless of the number of times the model was run. Samples of such generated SFN topologies are illustrated in
Figure 3. Vertices in red represent the nodes with dense connectivity (hubs).
To create small-world and random graphs to interconnect the 14 nodes of the current NSF network, the methods described by Watts and Strogatz in [
11,
12] are implemented.
Figure 4 and
Figure 5 illustrate samples of generated small-world and random graphs that mimic the NSF’s 14-node connectivity model.
The diameter of a network is the length of the shortest path between the farthest-distanced nodes. The cost metric is used to indicate which path is the shortest between all pairs of nodes. A cost measure of a graph can be the total distance, or the number of nodes traversed between every possible pair of source and destination nodes. Average path length is calculated by summing up all the shortest path lengths of all the source and destination pairs of nodes and dividing them by the total number of pairs.
From the results illustrated in
Figure 6, the current NSF network shows a relatively longer average shortest path when compared with the small-world network topology implemented in the NSF. It is observed from the results illustrated in
Figure 6 that as the rewiring probability is increased, more shortcuts between nodes are increased, and as a result the path length decreases. A small fraction change in the rewiring probability creates shortcuts which can connect widely separated nodes, and hence results in a significant reduction in the diameter of the whole network [
6]. Results illustrated in
Figure 6 demonstrate that a reduction of 15% in the NSF network path length can be achieved if a small-world network design with
p = 1 (as in
Figure 4d) is considered for interconnecting nodes in the NSF network.
Along with the shortest average path, small-world networks with
p = 1 have a high node clustering coefficient. The clustering coefficient indicates how good a node is connected to its neighbors’ neighbors. A high clustering coefficient indicates that the network comprises of many strong ties.
Table 1 defines and demonstrates how the node’s clustering coefficient can be calculated. If the node’s clustering coefficient is 1, the neighbors of that node are fully connected, and when the neighbors are poorly connected, the value of the clustering coefficient will be near 0 [
6]. Results illustrated in
Figure 7 demonstrate a 246% increase in the clustering coefficient when compared with the current NSF design.
To further study the impact of the implemented small-world, SFN, and random networks on the NSF network power consumption, in the following sections we briefly describe the IP over WDM networks, then present the MILP model implemented to evaluate the network power.
6. MILP Model
In this section, we study the impact of the implementation of the small-world, random, and SFN physical topologies on the total network power consumption of IP over WDM NSF network. For completeness, we re-introduce the MILP optimization model developed in [Tucker and Dong] for a non-bypass IP over WDM network to evaluate and compare such proposed designs with the current physical topology of the NSF network. The model shall minimize the network power consumption by optimizing the network resources. Optimizing network resources through dynamic approaches by switching off underutilized resources at low traffic demands and grouping, grooming, and consolidating traffic efficiently on fewer resources. The focus in this work is on the core network of the IP over WDM; the access network and aggregation routers are not considered in the evaluation study.
Before introducing the model, we list the notations and parameters used in the model as follows (
Table 2 and
Table 3).
The total network power consumption of the modeled network consists of:
- 2.
The power consumption of transponders
- 3.
The power consumption of EDFAs
- 4.
The power consumption of optical switches
- 5.
Total power consumption of aggregation ports
The total number of aggregation ports in each node:
- 6.
Power consumption of regenerators:
The MILP model is defined as follows:
Objective: Minimize NPC
The total network power consumption (NPC) is given in (11):
The objective function given in (11) aims to minimize the total network power consumption in the IP and optical layers. The total network power is composed of the power consumed by router ports, transponders, EDFAs, optical switches, aggregation ports, and regenerators.
Constraint (12) is the flow conservation constraint which ensures that incoming traffic is equal to outgoing traffic for every node, except when the node is a source or a destination. Constraint (13) is the link capacity constraint, where it is ensured that traversing traffic through any virtual link does not exceed its capacity. Constraint (14) is the flow conservation constraints for the optical layer. Constraint (14) ensures that the number of traversing wavelengths in a link should equal to the total incoming wavelengths except at the source and destinations nodes. Constraint (15) ensures that the sum of all wavelengths traversing a link should not exceed its capacity. Constraint (16) ensures that wavelengths in a physical link do not exceed the total number of wavelengths in the physical link.
7. Results and Discussion
The base evaluated network model is the NSF network, as illustrated in
Figure 2, and consists of 14 nodes located in different states of the United States (US) with 21 bi-directional links and with an average shortest path of 2.175. As depicted in
Figure 2, the nodes of the NSF are in four time zones: Eastern Standard Time (EST), Central Standard Time (CST), Mountain Standard Time (MST), and Pacific Standard Time (PST). There is a one hour difference between every two adjacent time zones. During the day and night, different nodes experience different traffic loads.
Figure 9 illustrates the traffic load in Gb/s between all node pairs for a period of 24 h. The traffic is generated using a gravity model based on the population of the city where the node is located [
14]. The average traffic load between node pairs varies between 20 to 120 Gb/s, and the peak occurs at 22:00.
In this work, we follow assumptions made in [
4] and assume that the traffic load between node pairs in the same time zone is random with a uniform distribution and no lower than 10 Gb/s [
4].
Table 4 shows the parameters used in the MILP model, in terms of number of wavelengths, capacity of a wavelength, distance between two adjacent EDFAs, and the energy consumption of different components in the network such as the router’s port, optical switch, multiplexer/demultiplexer, EDFA, regenerators, and transponders.
The MILP solver program used is AMPL/CPLEX on Lenovo with core i7 CPU, with a 2.8 GHz processor and 8 GB RAM [
19]. CPLEX and AMPL make a powerful modelling tool for solving optimization problems, developed by IBM and Bell laboratories, respectively [
19].
Given the traffic between nodes in the NSFNET network as depicted in
Figure 9, along with IP router ports power consumption in
Table 4, it is clear that the power consumption of the IP routers is the major contributor to the total power consumption of the network. The power optimized topologies will be supported by the minimum number of IP router ports. Hence, after traffic being groomed on a minimum number of ports, unused router ports will be eliminated from the total network power calculations and considered as being in sleep mode.
Multiple random experiments (around 15 experiments) were conducted to get different sample graph networks for each of the scale-free, random, and small-world network designs. Sample networks provided in
Figure 3,
Figure 4 and
Figure 5 are our best obtained graphs in terms of power consumption conservation. However, the mathematical MILP model for each sample gave the same results (optimum) regardless of the number of times the model was run for each topology.
In this work, we show that a re-design of the topology interconnection can be undertaken to improve energy efficiency in IP over WDM core networks. As previously discussed in
Section 4, the impact of the topology can greatly impact the average path length and clustering coefficient. In
Section 4, we have demonstrated that a small change of rewiring probability creates shortcuts that can connect widely separated nodes, and consequently result in a significant reduction on the network diameter. In addition to network diameter, we have also shown that the design of the topology interconnection impacts the node’s clustering coefficient, which is seen as a network property that indicates how weak or strong the ties between a node and its neighbors are. Reducing the diameter of a network while improving the clustering coefficient of the network’s nodes can effectively reduce the network average path length and the number of nodes traversed during traffic forwarding. Consequently, the overall number of used links and network active components such as IP routers, EDFAs, regenerators, OXC, and transponders needed to support traffic demands are reduced.
The results demonstrate that to achieve the best results in energy conservation, targeting energy efficiency in the IP layer to minimize the total number of routers’ line cards would be of great interest, as routers’ ports are found to be the main contributors of power consumption in the IP over WDM networks (825 W) [
15,
20]. In this regard, considering the MILP optimization model described in
Section 6, the network power consumption would be minimized by taking advantage of the introduced shortcuts using the redesigned topology interconnection and optimizing the network resources by means of grooming traffic demands on fewer links and putting underutilized router ports on sleep mode.
In this work, we have assessed the network power consumption of the redesign NSF topology for different average node’s mean degrees (k = 4 and 6) to evaluate its impact on energy conservation of the implemented SWN described in
Section 4.
As can be observed from
Figure 10, with k = 4, energy savings achieved can reach 14.4% as the rewiring probability approaches to 1. The results illustrated in
Figure 10 along with topology design for k = 4 in
Figure 4, demonstrate that when
p = 0, the effect on power consumption reduction is minimal; however, as the wiring probability in the SWN increases, more shortcuts introduced. Shortcuts have an impact on decreasing the average path length (diameter) of the network, as widely distant nodes can be closer and reached with a fewer number of nodes traversed, and hence the result of a significant reduction in energy consumption as the number of network resources utilized (router ports, transponders, EDFAs, optical switches, and regenerators) to support traffic demands between nodes are lowered.
Figure 11 illustrates the SWN with k = 6; it is observed that it is possible to further reduce power consumption to 28% if the average nodal degree is increased from 4 to 6. It is also notable that with the increase in k, the network diameter is decreased, and power consumption of the network can be reduced as traffic can be groomed on fewer links and underutilized resources can be put on sleep mode.
Figure 12 presents the saving percentages that can be achieved for the different rewiring probability with k = 4 and 6, respectively.
SCF and random networks illustrated in
Figure 3 and
Figure 5, respectively, evaluated using the MILP model described in
Section 6 to assess the power consumption and compare with current and SWN NSF networks in order to find out if savings can be achieved. Results demonstrated in
Figure 13 illustrate that the random design is not as efficient as the SWN in energy savings. However, with the SCF savings can reach 13% when compared to the current NSF design.
The existence of hubs in the SFN reduces the network diameter and makes 60% of nodes reachable through them. This is due to the fact that the smaller the diameter, the shorter the average path length, the less the number of nodes traversed, the less links and devices used, and the less the power consumed.
Random graphs, as depicted in
Figure 5 and
Figure 6, have a slightly higher average path length than the current SWN. Path length is directly proportional with the network diameter as the larger the network diameter, the longer the path is between any two nodes, which justifies the increase in the power consumption.
This study was based on modeling the NSF network which consists of 14 nodes to prove the possibility of minimizing energy consumption when applying the scale-free, random, and small-world networks to the NSF network is less complex to analyze in terms of the number of variables, especially when optimized using MILP. Larger networks with a higher number of nodes and links appear to be an “NP complete problem”, with very high complexity. Solution to such problems with networks with high number of nodes and edges requires a design of heuristic algorithm which shall be considered for future work.