Statistics is the study of the collection, analysis, interpretation, presentation, and organization of data. It deals with all aspects of this, including the planning of data collection in terms of the design of surveys and experiments.
Statistical theory defines a set of probability models and statistical inference procedures. Statistical theory is concerned with the development of methods for drawing inferences from data. This includes the development of point estimation and hypothesis testing procedures.