Month: June 2013

Big Data still in naivety proves Elusive to Big Picture and Randomness

Big Data as it exists today is not necessarily a tool that creates the Big Picture. Most systems that exists today are designed based on predicated methods. These rely on known variables, the only constraint unknown are the values of the variables. Predicated system are constrained to create newer insight as they are bounded by system boundaries defined by known variables. The new emergent variables can be considered as the non-causal agents until the newer order of the complex system begins to emerge; in which the newer variables manifests.

To develop wider and deeper insight about the behavior of the complex system as the system driven by entropy moves from one order to next; it does require to bring into its realm the possible newer variables. Lack of adequate techniques (Bayesian network included) in discerning all the variables that affect the system behavior creates uncertainty. Predicated system as such are blind sighted to such uncertainties. This creates inadequacies in methods when dealing with the randomness in the system. Emergence of newer variables that begin to affect the system behavior become the newer causes. Predicated system cannot hone on the variables that  lie dormant as the non-causal agents.

The hidden non-causal agents can be discovered by creating 2nd order generative semantic models. Predicative systems as such are not designed to dramatically alter its behavior; but only reflect the behavior constrained by those variables considered in its initial design

Implicate Order as Ecosystem Consciousness, where Knowledge exits Non-localized and Represented as Probabilistic Ontology – Complexity Theory

Exploring Implicate Order as a way for modeling the ecosystem knowledge that exists non-localized, and also that the knowledge  are formations as evidence those are probabilistically deterministic. This means the ecosystem knowledge representation requires probabilistic ontology. Also, what is evident in a system is – in the method there exists Cartesian dilemma, This means the method used to study the macro behavior and the micro behavior both follow different mathematical scheme. Almost all micro behaviors are characterized by Cartesian methods, these breakdown when they are scaled to study macro behavior. This particular vexation is the reason why arriving at unified equation in physics is fleeting that reconciles macro physics with quantum behavior. Probing for a way to describe a system with such dilemma, Implicate Order was hypothesized by David Bohm as an ontology to fit the probabilistic paradigm.

Every system strategically has a challenge to resolve at macro level pertinent to a “context” – for instance healthcare management efficiency and then at micro level it is challenge to be met at “functional” level – example personalized healthcare delivery – which is efficacy. These two combined seems to present a compelling complex problem.

Integrative approach involving Bioinformatics, Quantum Maths, A.I and linguistics semantic allows us to develop algorithmic methods suitable to represent the ecosystem. These approaches help in creating a probabilistic ontology as envisioned in the implicate order. Furthermore, the way probabilistic inferencing keeps growing as the system progress in time continuum they provide a means to study Complex Adaptive System and also the Generative development.

Most common method in creating the probabilistic inference has been Bayesian network. But these are being contested as suitable for a lower order complex system, where the data is held constant and hypothesis are random. When the system complexity becomes messy, meaning both the hypothesis and the data become random, then we need advanced knowledge graphing methods.

Ingine Inc, for its cognitive computing platform BioIngine proposes “Hyperbolic Dirac Net” as a way to render Bayes Net into true Bayesian by overcoming the acyclic constraints. The approach incorporates a certain advancement to Bayesian statistics which makes it reversible. In general, reversibility, cyclic paths and feedback abound in the real world, especially the medical domain which is as such probabilistic and we need probabilistic knowledge networks that are general graphs, or even more diffuse fields of influence, not DAGs. In our response as the Hyperbolic Dirac Net (HDN), “Dirac” relates to use of Paul A. M. Dirac’s view of quantum mechanics (QM). QM is not only a standard system for representing probabilistic observation and inference from it in physics, but also it manages and even promotes concepts like reversibility and cycles. The significance of “hyperbolic” is that it relates to a particular type of imaginary number rediscovered by Dirac. Dirac notation entities, Q-UEL tags, and the analogous building blocks of an HDN all have complex probabilities better described as probability amplitudes.

There are several developments going on in the area of probabilistic modeling. Stanford has begun to offer free course on probabilistic graphical modeling based on Bayesian. In the link below go to preview link to access entire video coursework. Awesome coursework for beginners in system modeling.