Not the answer you're looking for? This tells us that the amount of information in a message or text is directly proportional to the amount of surprise available in the message. Secondly, here is the Python code for computing entropy for a given DNA/Protein sequence: Finally, you can execute the function presented above. Excel calculated that 0.33 of a child visited a health clinic, and oddly enough, it wasnt wrong, How to do Causal Inference using Synthetic Controls. ML 101: Gini Index vs. Entropy for Decision Trees (Python) The Gini Index and Entropy are two important concepts in decision trees and data science. How can I access environment variables in Python? entropy ranges between 0 to 1: Low entropy means the distribution varies (peaks and valleys). Can I change which outlet on a circuit has the GFCI reset switch? rev2023.1.18.43175. Requires one of --shannon (to calculate the Shannon entropy) or --metric (to calculate the Shannon entropy normalised by input size).. Takes input fdom stdin by default, but can read from a file with . In other words, a variable is nothing but a unit of storage. The formula for calculating information gain can be obtained by:- C4.5. The higher the entropy the more the information content. Entropy is introduced by Claude Shannon and hence it is named so after him. Instantly share code, notes, and snippets. Entropy. When was the term directory replaced by folder? Data Scientist who loves to share some knowledge on the field. inherent in the possible outcomes of a discrete random variable. So both of them become the leaf node and can not be furthered expanded. Similarly, you can compute the entropy of other clusters. A Python module to calculate Multiscale Entropy of a time series. Now, how does the decision tree algorithm use this measurement of impurity to build the tree? https://doi.org/10.1002/j.1538-7305.1948.tb01338.x. Our next task is to find which node will be next after root. Thanks for contributing an answer to Cross Validated! Next, we will define our function with one parameter. governed by the discrete distribution pk [1]. Usage Command Line. Default is 0. This shows us the entropy and IG calculation for two attributes: outlook and wind. We want to calculate the information gain (or entropy reduction). Is it OK to ask the professor I am applying to for a recommendation letter? As this has been my first deep dive into data mining, I have found many of the math equations difficult to intuitively understand, so here's a simple guide to one of my favorite parts of the project, entropy based . You can do those manually in python and then you can compute the entropy for each cluster as explained above. if messages consisting of sequences of symbols from a set are to be Books in which disembodied brains in blue fluid try to enslave humanity. The project files can be found in the rec directory. The English meaning of the word entropy is: it is a state of disorder, confusion, and disorganization. The entropy at the root node is 1. Python is a simple high-level and an open-source language used for general-purpose programming. By observing closely on equations 1.2, 1.3 and 1.4; we can come to a conclusion that if the data set is completely homogeneous then the impurity is 0, therefore entropy is 0 (equation 1.4), but if the data set can be equally divided into two classes, then it is completely non-homogeneous & impurity is 100%, therefore entropy is 1 (equation 1.3). Looking to protect enchantment in Mono Black. Data and code you can see below : . We can define a function to calculate the entropy of a group of samples based on the ratio of samples that belong to class 0 and class 1. H(X) = [(1/3 * log2 (1/3)) + (2/3 * log2 (2/3))] = 0.9184. How can I remove a key from a Python dictionary? See: This predicament where you would have to decide and this decision of yours that can lead to results with equal probability is nothing else but said to be the state of maximum uncertainty. There are also other types of measures which can be used to calculate the information gain. Site design / logo 2023 Stack Exchange Inc; user contributions licensed under CC BY-SA. Low entropy means the distribution varies (peaks and valleys). Assuming that the data set has m rows, that is, m samples, and the last column of each row is the label of the sample, the code for calculating the information entropy . To view the purposes they believe they have legitimate interest for, or to object to this data processing use the vendor list link below. We also use third-party cookies that help us analyze and understand how you use this website. Now, we can quantify the level of uncertainty in a whole probability distribution using the equation of Shannon entropy as below: It measures or quantifies the average uncertainty of x as the number of bits. You can find column's entropy in pandas with the following script. Elements of Information Lets look at this concept in depth. . Calculate Entropy and Information Gain for Decision Tree Learning. How can I translate the names of the Proto-Indo-European gods and goddesses into Latin? The entropy measures the amount of information present in a variable. In data science, entropy pretty much refers to the same. Calculation of Entropy in Python. 4. Python for the Life Sciences: A Gentle Introduction to Python for Life Scientists Paperback by Alexander Lancaster, Bioinformatics with Python Cookbook by Tiago Antao, Bioinformatics Programming Using Python: Practical Programming for Biological Data by Mitchell L. Model. If qk is not None, then compute the relative entropy D = sum (pk * log (pk / qk)). A Deeper Look into the Extreme Value Theorem. An example of data being processed may be a unique identifier stored in a cookie. The purpose is if we feed any new data to this . Then your entropy of cluster $i$ will be: Would Marx consider salary workers to be members of the proleteriat? Iterative Dichotomiser 3 (ID3) This algorithm is used for selecting the splitting by calculating information gain. Notify me of follow-up comments by email. You can mention your comments and suggestions in the comment box. The training examples are sorted to the corresponding descendant nodes. parallel coordinates plots . Therefore, the aim is to find out the attributes and within those attributes the threshold such that when the data is split into two, we achieve the maximum possible homogeneity or in other words, results in the maximum drop in the entropy within the two tree levels. # calculating the Entropy and Information Gain for: Learning with Trees, # http://www.autonlab.org/tutorials/infogain.html. # Let's try calculating the entropy after splitting by all the values in "cap-shape" new_entropy = proportionate_class . Their inductive bias is a preference for small trees over longer tress. In scenario 3, when we have only one flavor of the coffee pouch, caramel latte, and have removed all the pouches of cappuccino flavor, then the uncertainty or the surprise is also completely removed and the aforementioned entropy is zero. Will all turbine blades stop moving in the event of a emergency shutdown, "ERROR: column "a" does not exist" when referencing column alias, How to see the number of layers currently selected in QGIS. The root node is the original data, branch nodes are the decision rules whereas the leaf nodes are the output of the decisions and these nodes cannot be further divided into branches. A nice property of the Gini index is that it is always between 0 and 1, and this may make . Connect and share knowledge within a single location that is structured and easy to search. . Card trick: guessing the suit if you see the remaining three cards (important is that you can't move or turn the cards). element i is the (possibly unnormalized) probability of event Bell System Technical Journal, 27: 379-423. Mathematical Formula for Entropy. The idea with Gini index is the same as in entropy in the sense that the more heterogenous and impure a feature is, the higher the Gini index. To subscribe to this RSS feed, copy and paste this URL into your RSS reader. If you would like to change your settings or withdraw consent at any time, the link to do so is in our privacy policy accessible from our home page.. At every branch, the entropy computed for the target column is the weighted entropy. Now I want to add a new column with the title adjusted.This column I want to calculate with numpy.isclose function with a tolerance of 2 (plus or minus 1). At times, the challenge is that the tree is restricted meaning it is forced to stop growing or the features are exhausted to use to break the branch into smaller leaf nodes, in such a scenario the objective variable is not homogenous and the outcome is still a mix of the car types. The entropy and information gain for the above three scenarios is as follows: The estimation of Entropy and Information Gain at the node level: We have the following tree with a total of four values at the root node that is split into the first level having one value in one branch (say, Branch 1) and three values in the other branch (Branch 2). For instance, if you have 10 points in cluster i and based on the labels of your true data you . It is not computed directly by entropy, but it can be computed It means the objective function is to decrease the impurity (i.e. Decision Tree, a supervised learning technique, is a hierarchical if-else statement which is nothing but a collection of rules or is also known as the splitting criteria that are based on comparison operators on the features. 4 Classes: Max entropy is 2; 8 Classes: Max entropy is 3; 16 Classes: Max entropy is 4; Information Gain. The degree to which a system has no pattern is known as entropy . Finally, we will get: So Humidity gives us the most information at this stage. We are building the next-gen data science ecosystem https://www.analyticsvidhya.com, Studies AI at Friedrich Alexander University Erlangen Nuremberg, Germany, Real Oh, damn! moments from data engineers, Using Text Features along with Categorical and Numerical Features, Linear Regression in RMake a prediction in 15 lines of code, Automate Feature Engineering and New data set with important features, Principal Component Analysis on the list of SMILES from Pihkal using GlobalChem and IUPAC. Russels teapot, or would serology suitable for historical reconstructions of COVID-19? . How do I submit an offer to buy an expired domain? To review, open the file in an editor that reveals hidden Unicode characters. """ /// <summary> /// returns the # of unique characters in a . By observing closely on equations 1.2, 1.3 and 1.4; we can come to a conclusion that if the data set is completely homogeneous then the impurity is 0, therefore entropy is 0 (equation 1.4), but if . Lets find the attribute that should be tested at the Sunny descendant. the entropy for a data set containing real data (or samples of distribution) can be calculated by computing the PDF (probability distribution function) of that data set. In 1948, Claude E. Shannon, mathematician, and electrical engineer, published a paper on A Mathematical Theory of Communication, in which he had addressed the issues of measure of information, choice, and uncertainty. The steps in ID3 algorithm are as follows: Calculate entropy for dataset. So, Outlook will be the root of our tree. Python calculation of information entropy example. In this part of code of Decision Tree on Iris Datasets we defined the decision tree classifier (Basically building a model). In case, I had only caramel latte coffeepouches or cappuccino pouches then we know what the outcome would have been and hence the uncertainty (or surprise) will be zero. as: The cross entropy can be calculated as the sum of the entropy and The goal is to minimize this impurity as much as possible at the leaf (or the end-outcome) nodes. For example, These two examples should make us clear that how we can calculate information gain. We shall estimate the entropy for . The program needs to discretize an attribute based on the following criteria. H(pk) gives a tight lower bound for the average number of units of How can I delete a file or folder in Python? To Define Information Gain precisely, we begin by defining a measure which is commonly used in information theory called Entropy. List of resources for halachot concerning celiac disease. It only takes a minute to sign up. Books in which disembodied brains in blue fluid try to enslave humanity. http://www.cs.csi.cuny.edu/~imberman/ai/Entropy%20and%20Information%20Gain.htm, gain(D, A) = entropy(D) SUM ( |Di| / |D| * entropy(Di) ). So, the information gain by the Wind attribute is 0.048. The index (i) refers to the number of possible categories. April 17, 2022. How could one outsmart a tracking implant? Do peer-reviewers ignore details in complicated mathematical computations and theorems? . You get several features that you can use to determine whether a person has breast cancer. Can I change which outlet on a circuit has the GFCI reset switch? This article was published as a part of the Data Science Blogathon. python <experiment_file.py> print_config. Entropy is measured between 0 and 1. 1. In other word we can say, Entropy is the measurement of homogeneity. Information Gain. Figure 3 visualizes our decision tree learned at the first stage of ID3. H(X) = [(0.50 * log2(0.50)) + (0.50 * log2(0.50))] = 1, H(X) = [(1.0 * log2(1.0) + (0 * log2(0)] ~= 0. Python code. It is mandatory to procure user consent prior to running these cookies on your website. qk when it is actually pk. I need to calculate the Entropy. How to tell a vertex to have its normal perpendicular to the tangent of its edge? The code was written and tested using Python 3.6 . This flow-chart consists of the Root node, the Branch nodes, and the Leaf nodes. The information gain (Gain(S,A) of an attribute A relative to a collection of data set S, is defined as-. Lets calculate the information gain by the Outlook attribute. It has many open-source libraries and Pandas is one of them. In python, cross-entropy loss can . By clicking Post Your Answer, you agree to our terms of service, privacy policy and cookie policy. Learn more about bidirectional Unicode characters. In this tutorial, youll learn how the algorithm works, how to choose different parameters for your . Making statements based on opinion; back them up with references or personal experience. encoded and transmitted over a noiseless channel, then the Shannon entropy About. Browse other questions tagged, Start here for a quick overview of the site, Detailed answers to any questions you might have, Discuss the workings and policies of this site, Learn more about Stack Overflow the company, $$ H(i) = -\sum\limits_{j \in K} p(i_{j}) \log_2 p(i_{j})$$, $$ H(i) = -\left(\frac{6}{10} \log \frac{6}{10} + \frac{3}{10} \log \frac{3}{10} + \frac{1}{10} \log \frac{1}{10}\right)$$, $$H = \sum\limits_{i \in C} H(i) \frac{N_{i}}{N}$$. The work was aimed at the problem of how best to encode the information a sender wants to transmit. Calculate the Shannon entropy/relative entropy of given distribution (s). MathJax reference. information needed per symbol if the symbols occur with frequencies Entropy-based-discretization-python. . Pandas can be used to read and write data in a dataset of . How were Acorn Archimedes used outside education? To do so, we calculate the entropy for each of the decision stump's leaves, and take the average of those leaf entropy values (weighted by the number of samples in each leaf). How to upgrade all Python packages with pip? Learn more about bidirectional Unicode characters. as the Kullback-Leibler divergence. Hence, it is a graphical depiction of all the possible outcomes to a problem based on certain conditions or as said rules. The focus of this article is to understand the working of entropy by exploring the underlying concept of probability theory, how the formula works, its significance, and why it is important for the Decision Tree algorithm. The decision tree algorithm learns that it creates the tree from the dataset via the optimization of the cost function. Explore and run machine learning code with Kaggle Notebooks | Using data from multiple data sources We and our partners use data for Personalised ads and content, ad and content measurement, audience insights and product development. So the Sample Space S=5 here. This tutorial presents a Python implementation of the Shannon Entropy algorithm to compute Entropy on a DNA/Protein sequence. Because of the subtle interaction between attribute selection heuristic used by ID3 and the particular training examples it encounters, it is difficult to characterize precisely the inductive bias exhibited by ID3. Entropy or Information entropy is the information theory's basic quantity and the expected value for the level of self-information. It returns us the information about an arbitrary dataset that how impure/non-homogeneous the data set is.Given a collection of examples/dataset S, containing positive and negative examples of some target concept, the entropy of S relative to this boolean classification is-, To illustrate this equation, we will do an example that calculates the entropy of our data set in Fig: 1. In this section, we will see how to implement a decision tree using python. Information theory is a subfield of mathematics concerned with transmitting data across a noisy channel. Now, its been a while since I have been talking about a lot of theory stuff. K-means clustering and vector quantization (, Statistical functions for masked arrays (, https://doi.org/10.1002/j.1538-7305.1948.tb01338.x. The term impure here defines non-homogeneity. We have to understand by looking at the training examples which classifier will be the best for the dataset. How can citizens assist at an aircraft crash site? Shannon Entropy is applicable in many fields including bioinformatics. The values are calculated in steps by changing the threshold value from 0 to 1 gradually. import numpy as np from math import e import pandas as pd """ Usage: pandas_entropy (df ['column1']) """ def pandas_entropy (column, base=None): vc = pd.Series (column).value_counts (normalize=True, sort=False) base = e if base is None else base return - (vc * np.log . We're calculating entropy of a string a few places in Stack Overflow as a signifier of low quality. Calculate the Shannon entropy/relative entropy of given distribution(s). Calculate the information entropy of a string, file, etc. 4. 5. The entropy of a dataset is used to measure the impurity of a dataset and we will use this kind of informativeness measure in our calculations. Cross Validated is a question and answer site for people interested in statistics, machine learning, data analysis, data mining, and data visualization. the formula CE = -sum(pk * log(qk)). Perform entropy based discretization calculating values for entropy and best information gain over a given dataset Dataset consist of 3 answers of user between ages 8 and 95 These answers are either yes (E) or no (H) giving a total of 8 combinations (2^3) Taking variable split ages between ages 9 and 95 the code calculates the information split and gain for . number of units of information needed per symbol if the encoding is Thomas M. Cover and Joy A. Thomas. (1948), A Mathematical Theory of Communication. Homogeneity in the target variable means that there is a record of only one type in the outcome i.e. The formula for calculating information entropy: n is the number of categories, p(xi) is the probability of the i-th category. I have close to five decades experience in the world of work, being in fast food, the military, business, non-profits, and the healthcare sector. rev2023.1.18.43175. The cross-entropy loss function is an optimization function that is used for training classification models which classify the data by predicting the probability (value between 0 and 1) of whether the data belong to one class or another. Each sample is described with five nominal/categorical attributes whose names are listed in the . Wall shelves, hooks, other wall-mounted things, without drilling? Therefore. Information Gain is the pattern observed in the data and is the reduction in entropy. (Depending on the number of classes in your dataset, entropy can be greater than 1 but it means the same thing , a very high level of disorder. Claude E. Shannon had expressed this relationship between the probability and the heterogeneity or impurity in the mathematical form with the help of the following equation: The uncertainty or the impurity is represented as the log to base 2 of the probability of a category (pi). What information am I referring to? Feature Selection Techniques in Machine Learning, Confusion Matrix for Multi-Class Classification. The information gain of the 4 attributes of Figure 1 dataset are: Remember, the main goal of measuring information gain is to find the attribute which is most useful to classify training set. It is a must to know for anyone who wants to make a mark in Machine Learning and yet it perplexes many of us. Browse other questions tagged, Where developers & technologists share private knowledge with coworkers, Reach developers & technologists worldwide. I am leaving this portion for the readers to do the calculation on their own. Should be in I am working with one data set. Data Science. Entropy is one of the key aspects of Machine Learning. Information entropy is generally measured in terms of bits which are also known as Shannons or otherwise called bits and even as nats. How Intuit improves security, latency, and development velocity with a Site Maintenance - Friday, January 20, 2023 02:00 - 05:00 UTC (Thursday, Jan Were bringing advertisements for technology courses to Stack Overflow. The information gain for the above tree is the reduction in the weighted average of the entropy. Services. Microsoft Azure joins Collectives on Stack Overflow. probability of success of the event, qi= Probability of Y = 0 i.e. Peaks and valleys ) write data in a dataset of root node, the Branch nodes, and leaf... Fluid try to enslave humanity our function with one parameter can not be furthered expanded I and based the. Fluid try to enslave humanity our decision tree algorithm use this measurement of impurity to build tree. Mathematical computations and theorems after root Outlook and wind rec directory or entropy reduction ) and. Occur with frequencies Entropy-based-discretization-python word we can calculate information gain for the dataset via the optimization the... We & # x27 ; s basic quantity and the leaf nodes classifier... Must to know for anyone who wants to make a mark in Learning... Who loves to share some knowledge on the labels of your true data you work was aimed at problem. Calculation on their own being processed may be a unique identifier stored a! 1, and disorganization hooks, other wall-mounted things, without drilling want to calculate information... & # x27 ; s basic quantity and the leaf nodes as signifier! Do I submit an offer to buy an expired domain /// returns the # of unique characters in a of! I and based on opinion ; back them up with references or personal experience many fields including bioinformatics,... Have to understand by looking at the training examples are sorted to the tangent of edge. Buy an expired domain logo 2023 Stack Exchange Inc ; user contributions licensed under CC BY-SA from... Of cluster $ I $ will be the best for the readers to do the calculation on own. Trees over longer tress aspects of Machine Learning over a noiseless channel, compute... Cluster as explained above the reduction in entropy for decision tree algorithm learns that it creates the from... Cluster I and based on the following criteria references or personal experience was and! Theory of Communication consider salary workers to be members of the cost function for general-purpose programming information this. About a lot of theory stuff ) this algorithm is used for selecting the splitting by calculating information gain the... Symbol if the symbols occur with frequencies Entropy-based-discretization-python characters in a cookie used for the. Outlook will be the best for the level of self-information simple high-level an! Many open-source libraries and pandas is one of the entropy and information gain the! Selecting the splitting by calculating information gain precisely, we will get: so Humidity gives us the entropy each! Attribute that should be tested at the problem of how best to the... ), a mathematical theory of Communication hence, it is always 0... Those manually in Python and then you can mention your comments and suggestions in the possible of... Journal, 27: 379-423 general-purpose programming, Where developers & technologists share private knowledge with,. Is structured and easy to search encoding is Thomas M. Cover and Joy A. Thomas unit of storage to... Which outlet on a circuit has the GFCI reset switch of our tree, file, etc of your data! -Sum ( pk * log ( qk ) ) nothing but a unit of storage then compute the and..., 27: 379-423 pk * log ( qk ) ) suggestions in the rec directory other types of which... Using Python 3.6 Would Marx consider salary workers calculate entropy of dataset in python be members of the event, probability... S ) is 0.048 = sum ( pk * log ( qk ) ) best for above. To the corresponding descendant nodes change which outlet on a DNA/Protein sequence looking at the training which... Have its normal perpendicular to the tangent of its edge entropy on circuit. A unit of storage the readers to do the calculation on their own Python module to calculate information. An expired domain: it is a must to know for anyone who calculate entropy of dataset in python to transmit to., it is named so after him technologists worldwide the expected value for the above tree is the pattern in. Connect and share knowledge within a single location that is structured and easy to search & ;! Implementation of the root node, the Branch nodes, and disorganization flow-chart. Pattern observed in the comment box of homogeneity low quality to running These on... And write data in a dataset of type in the possible outcomes to a problem based on the of! Be furthered expanded help us analyze and understand how you use this measurement impurity. Do those manually in Python and then you can compute the entropy measures amount! Theory & # x27 ; s entropy in pandas with the following script as or. Python module to calculate the information gain for decision tree using Python one data set average the... Presents a Python implementation of the cost function to implement a decision on. Rec directory calculate information gain precisely, we will see how to implement a decision tree learns! Your website entropy or information entropy is applicable in many fields including bioinformatics attribute based on the field Outlook. Is not None, then compute the entropy measures the amount of information in... Use third-party cookies that help us analyze and understand how you use this measurement impurity. Have its normal perpendicular to the corresponding descendant nodes this website shelves,,... To encode the information content all the possible outcomes to a problem based the! References or personal experience to for a recommendation letter presents a Python module to calculate the theory..., Outlook will be next after root of all the possible outcomes of a discrete random.... Using Python the formula for calculating information gain for decision tree on Iris Datasets we defined the decision classifier. Valleys ) in pandas with the following criteria: 379-423 we begin by defining a measure which is commonly in! Calculating information gain can be used to calculate the Shannon entropy is: it always. Details in complicated mathematical computations and theorems a key from a Python implementation of the word entropy one. Read and write data in a noiseless channel, then the Shannon entropy/relative entropy of a string, file etc... Stored in a variable which a System has no pattern is known as Shannons or called! Entropy the more the information entropy of given distribution ( s ) and disorganization ask. Use to determine whether a person has breast cancer statements based on certain conditions or as said rules theory... Algorithm to compute entropy on a DNA/Protein sequence entropy and information gain be! To our terms of bits which are also other types of measures which can used. Homogeneity in the small Trees over longer tress of code of decision tree.... Paste this URL into your RSS reader or Would serology suitable for historical of. Bell System Technical Journal, 27: 379-423 perpendicular to calculate entropy of dataset in python number of categories... Or as said rules mention your comments and suggestions in the data science Blogathon calculate entropy of dataset in python.... Will define our function with one parameter books in which disembodied brains in blue fluid try to enslave.... Governed by the wind attribute is 0.048 discretize an attribute based on opinion ; back up... Qi= probability of Y = 0 i.e be used to read and write data in a cookie learns that creates. A few places in Stack Overflow as a part of the event, qi= probability event... ( 1948 ), a variable this concept in depth entropy or information is! For the readers to do the calculation on their own wind attribute is 0.048 observed in the and. Quantization (, Statistical functions for masked arrays (, https:.... Data across a noisy channel threshold value from 0 to 1 gradually only one type in the box! Python 3.6 project files can be used to calculate Multiscale entropy of given (! And an open-source language used for general-purpose programming reduction in the comment box the information! Technical Journal, 27: 379-423 calculation for two attributes: Outlook and wind entropy pretty refers. Pandas is one of the Shannon entropy/relative entropy of a string a few places in Stack as! Share knowledge within a single location that is structured and easy to search Overflow as a signifier of low.. ) this algorithm is used for selecting the splitting by calculating information gain of... This shows us the entropy for example, These two examples should make clear... Words, a variable the decision tree learned at the training examples are sorted to the number of units information... Shannon and hence it is a state of disorder, confusion, and disorganization mathematics concerned transmitting... Compute the entropy and information gain can be found in the data and is reduction! Vector quantization (, Statistical functions for masked arrays (, Statistical functions for masked arrays,... 0 i.e has no pattern is known as Shannons or otherwise called bits and even as nats used read... Including bioinformatics unnormalized ) probability of event Bell System Technical Journal, 27:.! Gain is the ( possibly unnormalized ) probability of event Bell System Journal! Decision tree algorithm learns that it is always between 0 and 1, this! Some knowledge on the labels of your true data you quantization (,:! Read and write data in a variable is nothing but a unit of storage inductive bias is a of. 1: low entropy means the distribution varies ( peaks and valleys ) the of... ) refers to the number of units of information needed per symbol if the occur., confusion, and disorganization in ID3 algorithm are as follows: calculate and... Pandas can be calculate entropy of dataset in python to calculate the information content probability of event Bell System Technical,!
Florida Man August 19,
Articles C