Abstract
This chapter introduces economic modeling based on artificial intelligence techniques. It introduces issues such as economic data modeling and knowledge discovery, including data mining and causality versus correlation. It also outlines some of the common errors in economic modeling with regard to data handling, modeling, and data interpretation. It surveys the relevant econometric methods and motivates for the use of artificial intelligence methods.
Access provided by Autonomous University of Puebla. Download chapter PDF
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
1.1 Introduction
This chapter introduces the topic of economic modeling (Baumol and Blinder 1982; Caldwell 1994; Holcombe 1989; Lange 1945; de Marchi and Blaug 1991). In this book, modeling is defined as the process of creating mathematical and conceptual frameworks for describing economic phenomena. In other words, the outcome of a modeling process, as defined in this book, is a conceptual or mathematical framework that describes how various concepts in economics actually work. The mechanisms, whether mathematical or conceptual, adopted in this book are based on an artificial intelligence framework. Artificial intelligence has been successfully applied to problems such as missing data estimation (Marwala 2009), engineering (Marwala 2010), political science (Marwala and Lagazio 2011a) and condition monitoring (Marwala 2012).
In this book, we define artificial intelligence techniques as mathematical or conceptual processes that are inspired by how nature works. For example, in describing how the gross domestic product is influenced by variables such as average educational levels and international trade volume, we could use a neural network which is based on how a human brain works, to construct a mathematical model that will relate these variables to the gross domestic product. This book will follow this line of thinking, of applying artificial intelligence methods, to describe how various aspects of the economy actually work.
1.2 Economic Concepts
In this section we describe various economic matters that are addressed in this book, and these include the stock market, options, derivatives, industrialization, economic development and political stability.
1.2.1 Stock Market
One important component of the economy that is considered in this chapter is the stock market (Hamilton 1922; Preda 2009). When companies are listed in the stock market, their net worth is calculated and part of the company is offered to the public to buy shares of that company. This instrument of listing a company in the stock market and thus allowing the public to buy shares in the company is vital for a company to be able to raise financial capital. One additional element that comes about as a result of publicly trading shares is that the price of the stock can end up not reflecting the intrinsic value of the shares. This may result in the over-pricing or underpricing of stock as a result of the lack of knowledge of the real value of stock. For a trader in the stock market, whose primary objective is to maximize financial returns, it is important for there to be instruments that would enable the trader to be able to predict the future price of stocks. In this book, we apply artificial intelligence to predict the future prices of stocks. Applying artificial intelligence techniques for stock market prediction has been conducted quite extensively in the past by practitioners such as Lunga and Marwala (2006), Leke and Marwala (2005) as well as Khoza and Marwala (2011).
1.2.2 Options and Derivatives
As described by Pires and Marwala (2004, 2005), many corporations and companies are exposed to risk in many ways. If a firm’s business model is based on exports, then it is exposed to the volatility of the exchange rate. For instance, a diamond mining company is exposed to risk from the diamond price because if the diamond price drops then the mining concern can lose money. Corporations seek to protect themselves from this risk and so what they normally do is that they enter into an agreement to sell diamond at a particular fixed exchange rate and diamond price for the future months. This contract is fixed and the company will neither make nor lose any extra money. The two contracts, the company takes, are known as futures contracts. Because the contract doesn’t permit the owner to require any additional money if diamond price increases or the exchange rate weakens, then the company doesn’t pay a premium for the contracts. This reduction of risk is called hedging (Ross et al. 2001).
Another mechanism in which companies hedge against this risk is by acquiring options. An option is the right, not the obligation, to buy or sell an underlying asset at a later date, which is called maturity date, by fixing the price of the asset at the present time (Hull 2003). An option that affords the owner the right to buy the asset is called a call option and an option that affords the owner the right to sell the asset is called a put option.
There are two types of options and these are European and American styled options. European options are exercised on the maturity date and American options are exercised on any date leading up to the maturity date. In the example above, with the diamond mining company, the company could buy a commodity put option, permitting the company to sell diamond at a particular price at a fixed time and purchase an exchange rate call option permitting the company to trade at a particular exchange rate at a later date. Options differ from futures in that the owner of the option is offered the right and not the obligation to exercise and thus make them valuable and so companies can benefit from favourable situations in the market and still protect themselves from unattractive effects in the market. The difference between futures and options is that if an unwanted state of affairs happens, then the owner loses the premium that was paid to buy the option. Because of this reason, options are acquired at a premium and there is difficulty identifying the value of this premium. Black and Scholes (1973) formulated a model for pricing options but the difficulty with their model was that it was only applicable for pricing European options (Hull 2003). American options are more difficult to price (Hull 2003) because there is a second random process in the contract because it is not known when the option will be exercised and thus offers the owner of the option an extra level of flexibility (Jarrow and Turnbull 2000).
1.2.3 Economic Development
In this chapter we apply the concept of a developmental state to understand economic development. In order to understand the concept of a developmental state, it is important to highlight some of the characteristics of a developmental state (Thompson 1996; Woo-Cumings 1999). Developmental states generally put strong emphasis on technical education and the development of numeracy and computer skills within the population. This technically oriented education is strategically used to capacitate government structures particularly the bureaucracy. What emerges out of this strategy is that the political and bureaucratic layers are populated by extremely educated people who have sufficient tools of analysis to be able to take leadership initiatives, based on sound scientific basis, at every level of decision making nodes within the government structure. Developmental states have been observed to be able to efficiently distribute and allocate resources and, therefore, invest optimally in critical areas that are the basis of industrialization such as education. The other characteristic that has been observed in successful developmental states is economic nationalism and emphasis on market share over profit. They protect their embryonic domestic industries and focus on aggressive acquisition of foreign technology. This they achieve by deploying their most talented students to overseas universities located in strategic and major centres of the innovation world and also by effectively utilizing their foreign missions (Marwala 2006). Furthermore, they encourage and reward foreign companies that invest in building productive capacity such as manufacturing plants with the aim that the local industrial sector will in time be able to learn vital success factors from these companies. On constructing a harmonious social-industrial complex, developmental states strike a strategic alliance between the state, labour and industry in order to increase critical measures such as productivity, job security and industrial expansion. Even though developmental states do not create enemies unnecessarily and do not participate in the unnecessary criticism of countries with strategic technologies that they would like to acquire, they are, however, sceptical of copying foreign values without translating and infusing them with local characteristics.
1.2.4 Industrialization
The objective of a developmentally oriented state is to create a society in which the citizens are intellectually, socially, economically, and politically empowered. In order to accomplish this objective, certain conditions need to be in place to mobilize social, economic, and political forces to capacitate the state to stimulate the productive forces that would ensure that this goal is achieved. One viewpoint concerning the instrument through which these productive forces can be galvanized is to reorient the country such that adequate productive forces are unleashed to advance industrialization (Marwala 2005a, b; Xing and Marwala 2011).
One critical aspect of industrialization is manufacturing. Building a manufacturing base in a country requires many factors to be in place such as a large number of engineers as well as access to minerals such as copper. The goal of industrialization is to create a country that produces goods and services with high added values. For example, instead of exporting minerals unprocessed, people can be employed to beneficiate these minerals and manufacture goods such as watches and thus add economic value to the final products. The process by which countries add aggregate economic values to the products and services they offer is directly dependant on the level of industrialization in the country’s economy.
1.2.5 Political Stability
One important aspect of building a vital economy in a country is political stability, which is characterized by the absence of conflict. One important characteristic of a progressive society is a society which is situated within a state that is at peace with itself, its neighbors, and the international community. Consequently, a democratic society as a matter of principle should aspire for global peace and inspire a culture of the highest form of human development (Marwala and Lagazio 2011a).
Granted that peace is a necessary condition to construct an economically stable society it is, consequently, important to comprehend the anatomy of militarized interstate conflicts and use this understanding to build peaceful, stable, and economically prosperous states in a peaceful and stable international context. The ability to scientifically understand the causes of militarized interstate conflict and then to apply this knowledge to build and spread peace in the international context is indisputably an essential initiative. This book proposes an artificial intelligence perspective to unpack some of the complex behaviours that interstate conflicts display in order to understand the fundamental drivers of war and, therefore, detect early instances of tensions in the international relations arena and, thereby, maximize economic activities (Marwala and Lagazio 2011b).
When a business concern intends to invest in a country, the first criterion to investigate is the stability of a country. Militarized interstate conflict is defined as a threat of military conflict by a country on another (Marwala and Lagazio 2011b). This phenomenon has been modeled extensively and quite successfully using artificial intelligence in the past. Tettey and Marwala (2006a) successfully applied a neuro-fuzzy system for conflict management whereas Habtemariam et al. (2005) successfully applied support vector machines for modeling and managing militarized interstate conflict. Marwala and Lagazio (2004) successfully applied the multi-layered neural networks and genetic algorithms to model and then control militarized interstate disputes, while Tettey and Marwala (2006b) applied a neuro-fuzzy system and genetic algorithms for modeling and controlling militarized interstate disputes. On modeling militarized interstate disputes, it is often important to extract information from the observed data in a linguistic fashion so that these can be used for policy formulation. Tettey and Marwala (2007) applied a neuro-fuzzy system to extract such information from a conflict dataset, while Crossingham et al. (2008) applied optimized rough sets and standard rough sets to extract information from an interstate conflict database.
1.3 Econometrics
Econometrics is a field that applies mathematics and statistics to study economics (Lamy 2012; Spanos 2012; Baldauf and Santos Silva 2012). This is essentially achieved by building mathematical models to explain economic phenomena. Suppose we would like to build a model that relates car sales to inflation: this necessarily implies that there exists a causal relationship between inflation and car sales. Mathematically speaking, this relationship may be written as follows:
The function f can be models such as neural networks or even be linear or linguistic in the case of fuzzy logic. There are three main criticisms that are leveled at traditional econometric modeling and these are described in the next sub-sections.
1.3.1 Linear Assumptions
Traditional econometric models usually assume that relationships are linear, and this assumption is not valid for the majority of the real world cases (Pesaran 1987; Swann 2008). Therefore, it has become essential to build models that are non-linear (Moffitt 1980; Adcock 1995). A neural network has been found to be useful in modeling highly non-linear data because the order of non-linearity is derived or learned directly from the data and not assumed as is the case in many traditional non-linear models.
1.3.2 Static Models
Once the model in Eq. 1.1 is identified, it is generally assumed that the model is valid for all times, which is obviously not the case. It is, therefore, important to build a model that autonomously adapts while it is in use, and traditional econometric techniques have not been very successful in addressing this shortcoming. With the advent of evolutionary programming, it has become quite possible to build models that evolve (Marwala 2005a, b; Nguyen et al. 2012). This book will also address the issue of constructing dynamic models as opposed to building static models within the context of economic modeling.
1.3.3 Causality Versus Correlation
The issue of causality is a problem that has concerned philosophers for many years (Simon and Rescher 1966; Kar et al. 2011; Fallahi 2011). For example, the relationship in Eq. 1.1 inherently assumes causality, that is, the fact that inflation levels influence car sales. However, it might be that this is not the case and what is really the truth is that variables inflation and car sales are just correlated. This book will address this matter.
This book will deal with the problems of static models, linear assumptions, and causality versus correlation problem by applying artificial intelligence which is described in the next section.
1.4 Artificial Intelligence
This section presents an overview of artificial intelligence techniques which are applied for economic modeling in this book.
1.4.1 Neural Networks
One important type of artificial intelligence techniques is a neural network. Neural networks are computational tools that may be viewed as being inspired by how the brain functions and applying this framework to construct mathematical models. Neural networks estimate functions of arbitrary complexity using given data. Supervised neural networks are used to represent a mapping from an input vector onto an output vector, while unsupervised networks are used to classify the data without prior knowledge of the classes involved. In essence, neural networks can be viewed as generalized regression models that have the ability to model data of arbitrary complexities. There are many types of neural networks and the most common neural network architectures are the multilayer perceptron (MLP) and the radial basis function (RBF) (Bishop 1995). Neural networks have been applied successfully in many different areas of varying complexities. Soares et al. (2006) applied neural networks in flight control, while Shukla et al. (2012) applied neural networks for software maintenance. Xing et al. (2010) applied neural networks for machine clustering while Nelwamondo et al. (2009) applied neural networks and dynamic programming for missing data estimation in biomedical applications. Because of these extensive successes of neural networks, this book will apply neural networks for modelling economic data.
1.4.2 Support Vector Machines
Support vector machines are supervised learning approaches used largely for classification, and originated from statistical learning theory and were first introduced by Vapnik (1998). The use of support vector machines to model complex systems has been a subject of research for many years. Successful implementations of support vector machines to model complicated systems include Marwala et al. (2007) who applied this method for damage detection in structures, Msiza et al. (2007) who applied this method for forecasting the water demand time series, as well as Patel and Marwala (2009) who applied support vector machines for caller behavior classification. Due to these successful applications of support vector machines, this book also applies support vector machines for modelling economic data.
1.4.3 Autoassociative Networks
An auto-associative network is a model that is trained to recall its inputs. These networks are sometimes called auto-encoders or memory networks (Kramer 1992; Fu and Yan 1995; Marseguerra and Zoia 2006; Marwala 2012; Turova 2012). This means that, whenever an input is presented to the network, the output is the predicted input. These networks have been used in a number of applications including novelty detection, feature selection, and data compression. In this book, we propose to use auto-associative networks to construct a missing data estimation technique predictive system, which was described by Marwala (2009). Auto-associative networks have been applied successfully in many diverse areas such as HIV modelling (Leke et al. 2006), damage detection in structures (Zhou et al. 2011), and for predicting internet stability (Marais and Marwala 2004).
1.4.4 Rough Sets
Rough set theory, which was proposed by Pawlak (1991), is a mathematical method which models vagueness and uncertainty. It allows one to approximate sets that are difficult to explain even with accessible information (Marwala 2012). As observed by many researchers in the past, the advantages of rough sets, as with many other artificial intelligence methods, are that they do not require inflexible a priori assumptions about the mathematical characteristics of such complex relationships, as generally required for the multivariate statistical methods (Machowski and Marwala 2005; Crossingham et al. 2009; Marwala and Lagazio 2011a). Rough set theory is premised on the assumption that the information of interest is associated with some information from its universe of discourse (Crossingham and Marwala 2007, 2009; Marwala and Crossingham 2008, 2009; Marwala 2012). This technique is useful in that unlike neural networks, for example where the identified model is a strictly mathematical concept, in rough sets method the identified model that describes the data is in terms of natural language. Because of this reason, rough sets are useful in economics because they in a sense represent a formal technique for knowledge extraction from data.
1.4.5 Incremental Learning
Incremental learning methods are approaches that are able to learn incrementally. Incremental learning is suitable for modelling dynamically time-varying systems where the operating conditions change with time (Pang et al. 2012; Clemente et al. 2012; Khreich et al. 2012). It is also suitable when the data set accessible is inadequate and does not completely characterize the system (Marwala 2012; Cavalin et al. 2012; Martínez-Rego et al. 2012; Li et al. 2012a). Another advantage of incremental learning is that it can take into account the new conditions that may be presented by the newly acquired data. For example, suppose a model for predicting inflation is built, the concept of incremental learning can be applied so that every month when new inflation data set comes out, the model is updated without having to reconstruct it entirely. In this book we apply incremental learning techniques that are based on ensemble methods.
Ensemble learning is a method where multiple models are identified and combined to solve a specific problem (Rogova 1994; Polikar 2006). Ensemble learning is usually applied to increase the performance of a model (Zhang et al. 2012a; Li et al. 2012b; Hu et al. 2012; Ñanculef et al. 2012). In this book, ensemble based methods are applied for incremental learning in the modeling of economic data.
1.4.6 Multi-agent Systems
Agents are computer systems that are located in specific environments and are capable of autonomous action in this environment with the aim of meeting its objectives (Marivate et al. 2008; Wooldridge 2004; Baig 2012; Hu 2012). Intelligent agents are agents that are capable of reacting to changes in their environment and they possess social ability such as communication, as well as interaction and the ability to use artificial intelligence to achieve their objectives by being proactive (Wooldridge 2004; Rudowsky 2004; Zhang et al. 2012b). Agents are active, modeled to achieve specific tasks, and are able to autonomously act and take decisions (Hu 2012; Chen and Wang 2012). In an object oriented framework, objects are passive, non-oriented and modeled to represent things (Weisfeld 2009; Schach 2006; Abadi and Cardelli 1998). Consequently, the agent modeling method can be viewed as a more powerful manifestation of localized computational units that execute definite tasks while objects model real-world “things” with particular characteristics. A multi-agent system (MAS) is a combination of multiple agents in one system to solve a problem (Baig 2012). These systems have agents that are able to solve problems that are simpler than the total system. They can communicate with one another and support each other in realizing larger and more complex objectives (Hurwitz and Marwala 2007; van Aardt and Marwala 2005). Multi-agent systems have been applied in simulating trading systems (Mariano et al. 2001) and industrial automation (Wagner 2002).
1.4.7 Genetic Algorithms
The genetic algorithm approach is a population-based, probabilistic method that is intended to identify a solution to a problem from a population of possible solutions (Velascoa et al. 2012; Goyal and Aggarwal 2012). It is inspired by Darwin’s theory of natural evolution where the principle of ‘the survival of the fittest’ applies and members of the population compete to survive and reproduce while the weaker ones disappear from the population (Darwin 1859). Each individual is allocated a fitness value in accordance to how well it achieves the aim of solving the problem. New and more evolutionary fit individual solutions are created during a cycle of generations, where selection and re-combination operations, analogous to gene transfer are applied to the current individuals. This continues until a termination condition is satisfied. Genetic algorithms have been applied successfully in many areas such as engineering (Marwala 2002), control systems (Marwala 2004), and condition monitoring of buildings (Marwala and Chakraverty 2006).
1.4.8 Particle Swarm Optimization
The particle swarm optimization (PSO) method was proposed by Kennedy and Eberhart (1995). This technique was inspired by algorithms that model the “flocking behavior” seen in birds. Researchers in artificial life (Reynolds 1987; Heppner and Grenander 1990) developed simulations of bird flocking. In the context of optimization, the concept of birds finding a roost is analogous to a process of finding an optimal solution. PSO is a stochastic, population-based evolutionary algorithm that is extensively used for the optimization of complex problems (Marwala 2010). It is based on socio-psychological principles that are inspired by swarm intelligence, which gives understanding into social behavior and has contributed to engineering applications. Society enables an individual to influence and learn to solve problems by communicating and interacting with other individuals and, in that way, develop similar approach of solving problems. Thus, swarm intelligence is driven by two factors (Kennedy and Eberhart 1995; Marwala 2009, 2010, 2012):
-
1.
Group knowledge.
-
2.
Individual knowledge.
Each member of a swarm always behaves by balancing between its individual knowledge and the group knowledge.
1.4.9 Control Systems
A control system is essentially a procedure where the input of a system is manipulated to obtain a particular desired outcome (Marwala and Lagazio 2004; Boesack et al. 2010; Zhu et al. 2012). To realize this, a model that describes the relationship between the input and the outcome needs to be identified. For example, suppose we have a model that describes the relationship between the growth domestic product (GDP) and the interest rate to the inflation rate. Such a relationship can be identified using various methods such as neural networks. After this model that predicts inflation rate given the interest rate and GDP has been identified, the following stage is to apply a control system to identify the interest rate that gives the desired inflation rate. This involves an optimization procedure such as genetic algorithms or particle swarm optimization. In economics, this process is called inflation targeting. Control techniques have been applied successfully in many diverse fields such as brewing (Marwala 2004), water supply systems (Wu et al. 2012), and political science (Marwala et al. 2009).
1.5 Common Mistakes in Data Modeling
The prospect of artificial intelligence for application in economic modeling has been apparent to virtually everyone to have even experimented in the fields since their inception. Efforts to make such artificial intelligence applications accepted within the economic modeling space have generally been unsuccessful, and not without justifications. Mistakes have continued to give knowledge and theories that have passed superficial academic enquiry, but have demonstrated to be unsuccessful when applied to actual real world data. As identified by Hurwitz and Marwala (2012), a number of common mistakes will be probed, demonstrating how they frequently slip past cursory academic inquiry, and then displaying how they fail when applied to actual real data and why. It is intended that with attention paid to common shortcomings, researchers can circumvent these drawbacks and improve the uses of these methods within the economic modeling arena. Even though many of these errors overlap in individual implementations, this chapter intends to tackle them on an individual basis in order to more easily circumvent these mistakes in the future.
1.5.1 Insufficient Datasets
According to Hurwitz and Marwala (2012), conventional trading strategies are complicated systems, usually entailing a cycle of prediction, evaluation, feedback, and recalibration when designed. The cycle contains a feedback element but not necessarily the predictive technique. This cycle comprises the designer predicting price movements then evaluating trades based on price movements. The intention for recalibration feedback going into both prediction and evaluation instruments is that in many more complex systems the actual trading based on the predictions will be updated, as well as the predictions themselves. Because of this cycle, it becomes essential to have a strictly unseen set of data to evaluate performance. Normally, trading systems use a training data set and a verification data set (de Oliveira et al. 2011; Lam 2004; Kim 2002; Bao and Yang 2008) and this is not adequate, as neither the predictive system nor the evaluation system ever see the second set of data during the optimization phase. This is nevertheless inadequate, as the calibration of the training system is conducted with the results of the verification set taken into account, necessitating a totally unseen validation set to be used so as to validate if the system is truly generalizing. Overlooking this critical phase can give a system result that has merely been tweaked by the designer to fit the specific data, without essentially being able to function correctly in a general setting. The results will obviously appear satisfactory as the system has been calibrated precisely to fit the data being used even while the designer has not planned this to be the case. In the case that the trading mechanism is revisited after the validation set has been utilized, a new set of unseen validation data must be achieved.
1.5.2 Inappropriate Scaling
As identified by Hurwitz and Marwala (2012), this error is characterized by expressing the normally large target values of the predicted variable as its actual value (Kaastra and Boyd 1996), instead of scaling the data to some appropriate level within (or near) the range of the training data. The justification is to offer a precise understanding of the actual target values.
The actual data and the predicted data will appear to be close in the initial prediction, but experience difficulty to reach the higher values in the range for the later values. The actual errors in this initial prediction will obviously be very low, being underestimated by the scale of the data, despite their being fairly clearly unusable for any undertaking that necessitates the prediction. Actually, the errors characteristic of the system are frequently hidden by using unsuitable measures of accuracy or performance. It is actually far more risky to commit this error if the target data is reasonably bounded, as the evident lack of fit will not be obvious, and what is in effect an unusable prediction can certainly be confused for a performing predictive system, and leads to all the dangers characteristic in trading upon poor information.
The reason for this discrepancy is the high quantitative value of the predictive results, which offer a low registered error for what is really a large trading error. Considering a prediction for a given input–output set with the correct value being 1,025 and the system’s predicted value being 1,010. The actual error in root mean squares (RMS) terms is small, while the effect on predictions is actually quite high, considering a daily expected fluctuation of approximately 15 cents, which explains why an error that appears so small is actually significant enough to render a predictive system unusable. The clear recommendation is to first pre-process the data and as part of that process to scale the data. Depending on the nature of the historical share price fluctuations, a scaling factor of anything from the maximum historical price recorded to a fractional amount larger than the maximum historical price can be applied. It is recommended, even though not necessarily relevant to this particular error that one also scales input data for ease of training and convergence.
1.5.3 Time-Series Tracking
This error occurs in time series modeling where the predictive system predicts the previous day’s price as the present price which satisfies the error minimization function’s requirement (Hurwitz and Marwala 2012). This error emanates when an attempt is made to do an exact price prediction based upon the time-series data of historical prices of the self-same share. Unfortunately, any trading based upon such a system is completely unusable as it cannot ever predict an accurate price movement unless by some coincidence every single day’s new close is the same as that of the day before. To avoid this error, it is then necessary for the user to reconsider the input–output pairs for the system to learn from and consider change in prices as an output rather than the price itself. When trading, the direction of price movement is actually far more important than the precise amount, and this distinction is critical if a trading system is to be successful.
1.5.4 Inappropriate Measures of Performance
The problem here lies not with the measurements themselves, but rather on the reliance on them for validating the success of a trading system. These methods often obscure problems in the system design by looking like successful computational intelligence systems by the standard computational measures (Hurwitz and Marwala 2012). This includes graphs of receiver operating characteristics (ROC) curve and other typical computational measures of performance. If any of the preceding errors had been made, they would not be detected by the usual performance measures since they only measure the performance of the system based on the given input and output values. This is a dangerous error to commit, as the system is still concealing any mistakes made, but the user is satisfied to carry on, secure in the success of the system, verified by an inappropriate measure of performance. Dependence on these measures arises naturally to users in this field as they form the benchmark of most computational intelligence and machine learning approaches, and are, therefore, likely to be utilized almost out of practice.
Instead of the above, the user should set up a trading simulator, and apply the designed predictor to simulate trading based on its predictions. By performing actual trades based upon the predictions, many of the errors described will be quickly identified, as the actual trading results will be poor, or at best highly erratic. The nature of the errors will often become apparent when measuring performance in this manner, matching those described within each section, making it a much more useful measure of performance both during and after the system design process.
1.6 Data Handling
There are many ways in which economic data can be handled when used in economic modeling. The choices on how economic data are handled sometimes have effects which artificial intelligence modeling method to be used. In this section, we describe three domains that could be used to model economic data and these are time, frequency and time-frequency domains.
1.6.1 Time Domain Analysis
Time domain data is un-processed data taken over a time history. For example, if we consider GDP data as a function of time, this will be said to be in the time domain. From this data in the time domain, essential statistical features such as means, variance, Kurtosis can be extracted (Marwala 2012). Normally when these data are used, some of the statistical analysis such as variance and means are used. Lima and Xiao (2007) used economic data in the time domain to evaluate whether shocks last forever while Kling and Bessler (1985) compared multivariate forecasting procedures for economic time series analysis. Bittencourt (2012) studied the inflation and economic growth in Latin America in the time domain, while Greasley and Oxley (1998) compared British and American economic and industrial performance between years 1860 and 1993 in the time domain. Even though studying economic phenomena in the time domain is useful, it is sometimes necessary to study economic data in the frequency domain which is described in the next section.
1.6.2 Frequency Domain
The measured economic data in the time domain (time series) can be transformed into the frequency domain using Fourier transforms (Fourier 1822). As an example, the GDP versus time data can be transformed into the frequency domain using the Fourier transform and then this signal can be represented in magnitude and phase versus frequency data. The data in the frequency domain will have a series of peaks and troughs with each peak corresponding to the frequency of each cycle that makes the data. McAdam and Mestre (2008) evaluated macro-economic models in the frequency domain, while Tiwari (2012) conducted an empirical investigation of causality between producers ‘price and consumers’ price indices in Australia in the frequency domain. Gradojevic (2012) applied frequency domain analysis to study foreign exchange order flows while Grossmann and Orlov (2012) studied the exchange rate misalignments in the frequency domain.
1.6.3 Time-Frequency Domain
Most economic data are highly non-linear and non-stationary signals. None stationary signals are those whose frequency components change as a function of time (Larson 2007; Marwala 2012). To analyze non-stationary signals, the application of the Fast Fourier Transform method is not satisfactory. Consequently, time-frequency methods that concurrently display the time and frequency components of the signals are essential. Some of the time-frequency methods that have been used are: the Short-Time Fourier Transform (STFT), Wavelet Transform (WT) and Wigner-Ville Distribution (WVD). Gallegati (2008) applied wavelet analysis in stock market analysis, while Yogo (2008) applied wavelet analysis for measuring business cycles. Furthermore, Benhmad (2012) applied wavelet analysis for modeling nonlinear Granger causality between the oil price and the U.S. dollar.
1.7 Outline of the Book
In Chap. 2, data modeling techniques in economic modeling are studied. These methods include concepts such as mean, variance and fractals and how these vital concepts are applied to economics. Frequency and time-frequency analysis techniques are also studied.
Chapter 3 introduces the Bayesian and the evidence frameworks to construct an automatic relevance determination method. These techniques are described in detail, relevant literature reviews are conducted and their use is justified. The automatic relevance determination technique is then applied to determine the relevance of economic variables that are essential for driving inflation rate. Conclusions are drawn and are explained within the context of economic sciences.
Chapter 4 describes the multi-layered perceptron, radial basis functions, and support vector machines and apply these to economic modeling. The maximum-likelihood techniques are implemented to train these networks.
Chapter 5 introduces Bayesian support vector machines and multi-layer pereceptron for option pricing. European styled options can be priced using the Black-Scholes equation and are only exercised at the end of the period but American options can be exercised at any time during the period and are, therefore, more complex due to the second random process they introduce. These techniques are implemented using a Bayesian approach to model American options and the results are compared.
Chapter 6 introduces a rough set approach to economic modeling. A rough set theory based predictive model is implemented for the financial markets. The theory can be used to extract a set of reducts and a set of trading rules based on trading data.
Chapter 7 introduces an autoassociative network, with optimization methods, for modeling economic data. The autoassociative network is created using the multi-layered perceptron network while the optimization techniques which are implemented are genetic algorithms, particle swarm optimization, and simulated annealing. The results obtained for modeling inflation are then compared.
Chapter 8 explores the issue of treating a predictive system as a missing data problem, that is, correlation exercise and compares it to treating it as a cause and effect exercise, that is, feed-forward network. An auto-associative neural network is combined with a genetic algorithm and then applied to missing economic data estimation. The results of the missing data imputation approach are compared to those from a feed-forward neural network.
Chapter 9 examines the use of a genetic algorithm in order to perform the task of constantly rebalancing a portfolio targeting specific risk and return characteristics. Results of targeting both the risk and return are investigated and are compared as well as optimizing the non-targeted variable in order to create efficient portfolios.
Chapter 10 introduces real-time approaches to economic modeling. This chapter assumes that a complete model is the one that is able to continuously self-adapt to the changing environment. In this chapter, an incremental algorithm that is created to classify the direction of movement of the stock market is proposed and applied.
Chapter 11 introduces multi-agent approaches within game theoretic framework and applies this to model a sock market. This multi-agent system learns by using neural networks and adapts using genetic programming.
Chapter 12 applies control approaches to economic modeling and applies this to inflation targeting. In this chapter, a control system approach that is based on artificial intelligence is adopted to analyze the inflation targeting strategy.
Chapter 13 explores the role of trade in maintaining peace and, therefore, healthy economic activities. This is done by constructing the relationship between independent variables Allies, Contingency, Distance, Major Power, Capability, Democracy as well as Dependency which indicates inter-country trade and the dependent variable Interstate Conflict.
In Chap. 14 conclusions are drawn and future and emerging areas in economic modeling are identified and emerging opportunities are drawn.
1.8 Conclusions
This chapter introduced economic modeling based on artificial intelligence methods. It introduced issues such as economic data handling and modeling as well as prediction, knowledge discovery including data mining, and causality versus correlation. It also outlined some of the common problems in economic modeling with regards to data handling, modeling, and data interpretation. It surveyed the relevant econometric methods and motivated for the use of artificial intelligence methods.
References
Abadi M, Cardelli L (1998) A theory of objects. Springer, Berlin
Adcock C (1995) Non-linear dynamics chaos and econometrics. Int J Forecast 11:599–601
Baig ZA (2012) Multi-agent systems for protecting critical infrastructures: a survey. J Netw Comput Appl 35:1151–1161
Baldauf M, Santos Silva JMC (2012) On the use of robust regression in econometrics. Econ Lett 114:124–127
Bao D, Yang Z (2008) Intelligent stock trading system by turning point confirming and probabilistic reasoning. Expert Syst Appl 34:620–627
Baumol W, Blinder A (1982) Economics: principles and policy. Harcourt Brace Jovanovich, New York
Benhmad F (2012) Modeling nonlinear Granger causality between the oil price and U.S. dollar: a wavelet based approach. Econ Model 29:1505–1514
Bishop CM (1995) Neural networks for pattern recognition. Oxford University Press, Oxford
Bittencourt M (2012) Inflation and economic growth in Latin America: some panel time-series evidence. Econ Model 29:333–340
Black F, Scholes M (1973) The pricing of options and corporate liabilities. J Politic Econ 81:637–659
Boesack CD, Marwala T, Nelwamondo FV (2010) Application of GA-fuzzy controller design to automatic generation control. In: Proceedings of the IEEE IWACI, Suzhou, 2010, pp 227–232
Caldwell B (1994) Beyond positivism: economic methodology in the twentieth century. Routledge, New York
Cavalin PR, Sabourin R, Suen CY (2012) LoGID: an adaptive framework combining local and global incremental learning for dynamic selection of ensembles of HMMs. Pattern Recogn 45:3544–3556
Chen YM, Wang B-Y (2012) A study on modeling of human spatial behavior using multi-agent technique. Expert Syst Appl 39:3048–3060
Clemente IA, Heckmann M, Wrede B (2012) Incremental word learning: efficient HMM initialization and large margin discriminative adaptation. Speech Comm 54:1029–1048
Crossingham B, Marwala T (2007) Using optimisation techniques to granulise rough set partitions. Comput Models Life Sci 952:248–257, American Institute of Physics
Crossingham B, Marwala T, Lagazio M (2008) Optimized rough sets for modelling interstate conflict. In: Proceedings of the IEEE international conference on systems, man, and cybernetics, Singapore, pp 1198–1204
Crossingham B, Marwala T, Lagazio M (2009) Evolutionarily optimized rough sets partitions. ICIC Expr Lett 3:241–246
Darwin C (1859) On the origin of species., Chapter XIV. John Murray Publisher, London. ISBN 0-8014-1319-2
de Marchi NB, Blaug M (1991) Appraising economic theories: studies in the methodology of research programs. Edward Elgar Publishing, Brookfield
de Oliveira FA, Zarate LE, de Azevedo Reis M, Nobre CN (2011) The use of artificial neural networks in the analysis and prediction of stock prices. In: Proceedings of the IEEE international conference on systems, man, and cybernetics, Anchorage, 2011, pp 2151–2155
Fallahi F (2011) Causal relationship between energy consumption (EC) and GDP: a Markov-switching (MS) causality. Energy 36:4165–4170
Fourier JB (1822) Théorie Analytique de la Chaleur. Chez Firmin Didot, père et fils, Paris
Fu AMN, Yan H (1995) Distributive properties of main overlap and noise terms in autoassociative memory networks. Neural Nets 8:405–410
Gallegati M (2008) Wavelet analysis of stock returns and aggregate economic activity. Comput Stat Data Anal 52:3061–3074
Goyal MK, Aggarwal A (2012) Composing signatures for misuse intrusion detection system using genetic algorithm in an offline environment. Adv Intell Syst Comput 176:151–157
Gradojevic N (2012) Frequency domain analysis of foreign exchange order flows. Econ Lett 115:73–76
Greasley D, Oxley L (1998) Comparing British and American economic and industrial performance 1860–1993: a time series perspective. Explor Econ Hist 35:171–195
Grossmann A, Orlov AG (2012) Exchange rate misalignments in frequency domain. Int Rev Econ Finance 24:185–199
Habtemariam E, Marwala T, Lagazio M (2005) Artificial intelligence for conflict management. In: Proceedings of the IEEE international joint conference on neural networks, Montreal, 2005, pp 2583–2588
Hamilton WP (1922) The stock market baraometer. Wiley, New York
Heppner F, Grenander U (1990) A stochastic non-linear model for coordinated bird flocks. In: Krasner S (ed) The ubiquity of chaos, 1st edn. AAAS Publications, Washington, DC
Holcombe R (1989) Economic models and methodology. Greenwood Press, New York
Hu G (2012) Robust consensus tracking of a class of second-order multi-agent dynamic systems. Syst Contr Lett 61:134–142
Hu J, Fennel K, Mattern JP, Wilkin J (2012) Data assimilation with a local Ensemble Kalman Filter applied to a three-dimensional biological model of the Middle Atlantic Bight. J Mar Syst 94:145–156
Hull JC (2003) Options, futures and other derivatives. Prentice Hall, Upper Saddle River
Hurwitz E, Marwala T (2007) Multi-agent modeling using intelligent agents in a game of Lerpa. http://arxiv.org/ftp/arxiv/papers/0705/0705.0693.pdf. Last accessed in 7 March 2013
Hurwitz E, Marwala T (2012) Common mistakes when applying computational intelligence and machine learning to stock market modelling. http://arxiv.org/ftp/arxiv/papers/1208/1208.4429.pdf. Last accessed in 7 March 2013
Jarrow RA, Turnbull SM (2000) Derivative securities. South-Western College Publishing, Cambridge, MA
Kaastra L, Boyd M (1996) Designing a neural network for forecasting financial and economic time series. Neurocomputing 10:215–236
Kar M, Nazlıoğlu Ş, Ağır H (2011) Financial development and economic growth nexus in the MENA countries: bootstrap panel granger causality analysis. Econ Model 28:685–693
Kennedy J, Eberhart R (1995) Particle swarm optimization. Proc IEEE Int Conf Neural Netw 4:1942–1948
Khoza M, Marwala T (2011) A rough set theory based predictive model for stock prices. In: Proceedings of the IEEE 12th international symposium on computer intelligent and information, Budapest, Hungary, pp 57–62
Khreich W, Granger E, Miri A, Sabourin R (2012) A survey of techniques for incremental learning of HMM parameters. Info Sci 197:105–130
Kim K (2002) Financial time series forecasting using support vector machines. Neurocomputing 55:307–319
Kling JL, Bessler DA (1985) A comparison of multivariate forecasting procedures for economic time series. Int J Forecast 1:5–24
Kramer MA (1992) Autoassociative neural networks. Comp Chem Eng 16:313–328
Lam M (2004) Neural network techniques for financial performance prediction: integrating fundamental and technical analysis. Decis Support Syst 37:567–581
Lamy L (2012) The econometrics of auctions with asymmetric anonymous bidders. J Econ 167:113–132
Lange OR (1945) The scope and method of economics. Rev Econ Stud 13:19–32
Larson DR (2007) Unitary systems and wavelet sets. In: Wavelet Analysis and Applications by Qian, Tao; Vai, Mang I.; Xu, Yuesheng (Eds.) Birkhäuser, 2007, pp 143–171
Leke B, Marwala T (2005) Optimization of the stock market input time-window using Bayesian neural networks. In: Proceedings of the IEEE international conference on service operations, logistics and informatics, Beijing, 2005, pp 883–894
Leke BB, Marwala T, Tettey T (2006) Autoencoder networks for HIV classification. Curr Sci 91:1467–1473
Li H, Zhang T, Qiu R, Ma L (2012a) Grammar-based semi-supervised incremental learning in automatic speech recognition and labeling. Energy Procedia 17B:1843–1849
Li K, Liu Z, Han Y (2012b) Study of selective ensemble learning methods based on support vector machine. Phys Procedia 33:1518–1525
Lima LR, Xiao Z (2007) Do shocks last forever? Local persistency in economic time series. J Macroecon 29:103–122
Lunga D, Marwala T (2006) Online forecasting of stock market movement direction using the improved incremental algorithm. Lect Notes Comput Sci 4234:440–449
Machowski LA, Marwala T (2005) Using object oriented calculation process framework and neural networks for classification of image shapes. Int J Innovative Comput Info Contr 1:609–623
Marais E, Marwala T (2004) Predicting global internet instability caused by worms using neural networks. In: Proceedings of the annual symposium of the Pattern Recognition Association of South Africa, Cape Town, 2004, pp 81–85
Mariano P, Pereira C, Correira L, Ribeiro R, Abramov V, Szirbik N, Goossenaerts J, Marwala T, de Wilde P (2001) Simulation of a trading multi-agent system. Proc IEEE Int Conf Syst Man Cybern 5:3378–3384
Marivate V, Ssali G, Marwala T (2008) An intelligent multi-agent recommender system for human capacity building. In: Proceedings of the 14th IEEE Mediterranean electrotechnical conference, Ajaccio, 2008, pp 909–915
Marseguerra M, Zoia A (2006) The autoassociative neural network in signal analysis III. Enhancing the reliability of a NN with application to a BWR. Ann Nucl Energy 33:475–489
Martínez-Rego D, Fontenla-Romero O, Alonso-Betanzos A (2012) Nonlinear single layer neural network training algorithm for incremental, nonstationary and distributed learning scenarios. Pattern Recogn 45:4536–4546
Marwala T (2002) Finite element updating using wavelet data and genetic algorithm, Amer Inst of Aeronaut and Astronaut. J Aircraft 39:709–711
Marwala T (2004) Control of complex systems using Bayesian neural networks and genetic algorithm. Int J Eng Simu 5:28–37
Marwala T (2005a) Evolutionary optimization methods in finite element model updating. In: Proceedings of the international modal analysis conference, Orlando, Florida
Marwala T (2005b) Strategies and tactics for increasing economic participation. Umrabulo 24:41–43
Marwala T (2006) Skills necessary for the advancement of South Africa. Umrabulo 26:60–61
Marwala T (2009) Computational intelligence for missing data imputation, estimation and management: knowledge optimization techniques. IGI Global Publications, New York
Marwala T (2010) Finite element model updating using computational intelligence techniques. Springer, London
Marwala T (2012) Condition monitoring using computational intelligence methods. Springer, London
Marwala T, Chakraverty S (2006) Fault classification in structures with incomplete measured data using autoassociative neural networks and genetic algorithm. Curr Sci 90:542–548
Marwala T, Crossingham B (2008) Neuro-rough models for modelling HIV. In: Proceedings of the IEEE international conference on systems, man, and cybernetics, Singapore, 2008, pp 3089–3095
Marwala T, Crossingham B (2009) Bayesian rough sets. ICIC Express Lett 3:115–120
Marwala T, Lagazio M (2004) Modelling and controlling interstate conflict. In: Proceedings of the IEEE international joint conference on neural networks, Budapest, 2004, pp 1233–1238
Marwala T, Lagazio M (2011a) Militarized conflict modeling using computational intelligence techniques. Springer, London
Marwala T, Lagazio M (2011b) The anatomy of interstate conflicts: an artificial intelligence perspective. Think 30:40–42
Marwala T, Mahola U, Chakraverty S (2007) Fault classification in cylinders using multi-layer perceptrons, support vector machines and Gaussian mixture models. Comput Assisted Mech Eng Sci 14:307–316
Marwala T, Lagazio M, Tettey T (2009) An integrated human-computer system for controlling interstate disputes. Int J Comput Appl 31:2402–2410
McAdam P, Mestre R (2008) Evaluating macro-economic models in the frequency domain: a note. Econ Model 25:1137–1143
Moffitt R (1980) Disequilibrium econometrics and non-linear budget constraints. Econ Lett 5:49–52
Msiza IS, Nelwamondo FV, Marwala T (2007) Artificial neural networks and support vector machines for water demand time series forecasting. In: Proceedings of the IEEE international conference on systems, man, and cybernetics, Montreal, 2007, pp 638–643
Ñanculef R, Valle C, Allende H, Moraga C (2012) Training regression ensembles by sequential target correction and resampling. Inf Sci 195:154–174
Nelwamondo FV, Golding D, Marwala T (2009) A dynamic programming approach to missing data estimation using neural networks. Inf Sci. doi:10.1016/j.ins.2009.10.008
Nguyen TT, Yang S, Branke J (2012) Evolutionary dynamic optimization: a survey of the state of the art. Swarm Evol Comput 6:1–24
Pang Y, Deng J, Yuan Y (2012) Incremental threshold learning for classifier selection. Neurocomputing 89:89–95
Patel PB, Marwala T (2009) Genetic algorithms, neural networks, fuzzy inference system, support vector machines for call performance classification. In: Proceedings of the IEEE international conference on machine learning and applications, San Antonio, 2009, pp 415–420
Pawlak Z (1991) Rough sets – theoretical aspects of reasoning about data. Kluwer Academic Publishers, Dordrecht
Pesaran MH (1987) Econometrics. In: The new Palgrave: a dictionary of economics, vol 2. Macmillan/Stockton Press/Maruzen, London/New York/Tokyo, p 8
Pires MM, Marwala T (2004) Option pricing using neural networks and support vector machines. In: Proceedings of the IEEE international conference on systems, man, and cybernetics, The Hague, 2004, pp 1279–1285
Pires MM, Marwala T (2005) American option pricing using Bayesian multi-layer perceptrons and Bayesian support vector machines. In: Proceedings of the IEEE 3rd international conference on computational cybernetis, Mauritius, 2005, pp 219–224
Polikar R (2006) Ensemble based systems in decision making. IEEE Circuits Syst Manag 6:21–45
Preda A (2009) Framing finance: the boundaries of markets and modern capitalism. University of Chicago Press, Chicago
Reynolds CW (1987) Flocks, herds and schools: a distributed behavioral model. Comput Graph 2:25–34
Rogova G (1994) Combining the results of several neural network classifiers. Neural Netw 7:777–781
Ross S, Westerfield RW, Jordan BD, Firer C (2001) Fundamentals of corporate finance. McGraw-Hill Book Company, Sydney
Rudowsky I (2004) Intelligent agents. Commun Assoc Inf Syst 14:275–290
Schach S (2006) Object-oriented and classical software engineering. McGraw-Hill, New York
Shukla R, Shukla M, Misra AK, Marwala T, Clarke WA (2012) Dynamic software maintenance effort estimation modeling using neural network, rule engine, and multi-regression approach. Lect Notes Comput Sci 7336:157–169
Simon H, Rescher N (1966) Cause and counterfactual. Philos Sci 33:323–340
Soares F, Burken J, Marwala T (2006) Neural network applications in advanced aircraft flight control system, a hybrid system, a flight test demonstration. Lect Notes Comput Sci 4234:684–691
Spanos A (2012) Philosophy of econometrics. In: Philosophy of Economics, editor, U. Maki, general editors D. Gabbay, P. Thagard, and J. Woods, Elsevier, Philos Econ 12:329–393
Swann GMP (2008) Putting econometrics in its place: a new direction in applied economics. Edward Elgar Publishing, Brookfield
Tettey T, Marwala T (2006) Controlling interstate conflict using neuro-fuzzy modeling and genetic algorithms. In: Proceedings of the 10th IEEE international conference on intelligent engineering systems, London, 2006, pp 30–44
Tettey T, Marwala T (2006b) Neuro-fuzzy modeling and fuzzy rule extraction applied to conflict management. Lect Notes Comput Sci 4234:1087–1094
Tettey T, Marwala T (2007) Conflict modelling and knowledge extraction using computational intelligence methods. In: Proceedings of the 11th IEEE international conference on intelligent engineering systems, Budapest, Hungary, pp 161–166
Thompson M (1996) Late industrialisers, late democratisers: developmental states in the Asia-Pacific. Third World Q 17:625–647
Tiwari AK (2012) An empirical investigation of causality between producers‘ price and consumers’ price indices in Australia in frequency domain. Econ Model 29:1571–1578
Turova TS (2012) The emergence of connectivity in neuronal networks: from bootstrap percolation to auto-associative memory. Brain Res 1434:277–284
van Aardt B, Marwala T (2005) A study in a hybrid centralised-swarm agent community. In: Proceedings of the IEEE 3rd international conference on computational cybernetics, Mauritius, 2005, pp 169–174
Vapnik V (1998) Statistical learning theory. Wiley-Interscience, New York
Velascoa N, Dejax P, Guéret C, Prins C (2012) A non-dominated sorting genetic algorithm for a bi-objective pick-up and delivery problem. Eng Optim 44:305–325
Wagner T (2002) An agent-oriented approach to industrial automation systems. Lect Notes Comput Sci 2592:314–328
Weisfeld M (2009) The object-oriented thought process. Addison-Wesley, Boston, MA
Woo-Cumings M (1999) The developmental state. Cornell University Press, New York
Wooldridge M (2004) An introduction to multiagent systems. Wiley, New York
Wu Z, Zhang Y, Shen Z, Guan J, Li S, Liu X, Zhang R (2012) System of water supply based on blind source separation. Lect Notes Electr Eng 136:55–59
Xing B, Marwala T (2011) The role of remanufacturing in building a developmental state. Think 33:18–20
Xing B, Gao W-J, Nelwamondo FV, Battle K, Marwala T (2010) Part-machine clustering: the comparison between adaptive resonance theory neural network and ant colony system. Book Ser Lect Notes Electr Eng 67:747–755
Yogo M (2008) Measuring business cycles: a wavelet analysis of economic time series. Econ Lett 100:208–212
Zhang Q, Chen S, Yu C (2012a) Impulsive consensus problem of second-order multi-agent systems with switching topologies. Commun Nonlinear Sci Numer Simul 17:9–16
Zhang S, Wong H-S, Shen Y (2012b) Generalized adjusted rand indices for cluster ensembles. Pattern Recognit 45:2214–2226
Zhou HF, Ni YQ, Ko JM (2011) Structural damage alarming using auto-associative neural network technique: exploration of environment-tolerant capacity and setup of alarming threshold. Mech Syst Signal Process 25:1508–1526
Zhu Q, Yang D, Zhu G (2012) Moving track control system of agriculture oriented mobile robot. Adv Intell Soft Comput 149:179–184
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag London
About this chapter
Cite this chapter
Marwala, T. (2013). Introduction to Economic Modeling. In: Economic Modeling Using Artificial Intelligence Methods. Advanced Information and Knowledge Processing. Springer, London. https://doi.org/10.1007/978-1-4471-5010-7_1
Download citation
DOI: https://doi.org/10.1007/978-1-4471-5010-7_1
Published:
Publisher Name: Springer, London
Print ISBN: 978-1-4471-5009-1
Online ISBN: 978-1-4471-5010-7
eBook Packages: Computer ScienceComputer Science (R0)