System and Method for Extremely Efficient Image and Pattern Recognition and Artificial Intelligence Platform
Claim Score by NHIP
Abstract
Specification covers new algorithms, methods, and systems for: Artificial Intelligence; the first application of General-AI (versus Specific, Vertical, or Narrow-AI) (as humans can do) (which also includes Explainable-AI or XAI); addition of reasoning, inference, and cognitive layers/engines to learning module/engine/layer; soft computing; Information Principle; Stratification; Incremental Enlargement Principle; deep-level/detailed recognition, e.g., image recognition (e.g., for action, gesture, emotion, expression, biometrics, fingerprint, tilted or partial-face, OCR, relationship, position, pattern, and object); Big Data analytics; machine learning; crowd-sourcing; classification; clustering; SVM; similarity measures; Enhanced Boltzmann Machines; Enhanced Convolutional Neural Networks; optimization; search engine; ranking; semantic web; context analysis; question-answering system; soft, fuzzy, or un-sharp boundaries/impreciseness/ambiguities/fuzziness in class or set, e.g., for language analysis; Natural Language Processing (NLP); Computing-with-Words (CWW); parsing; machine translation; music, sound, speech, or speaker recognition; video search and analysis (e.g. “intelligent tracking”, with detailed recognition); image annotation; image or color correction; data reliability; Z-Number; Z-Web; Z-Factor; rules engine; playing games; control system; autonomous vehicles or drones; self-diagnosis and self-repair robots; system diagnosis; medical diagnosis/images; genetics; drug discovery; biomedicine; data mining; event prediction; financial forecasting (e.g., for stocks); economics; risk assessment; fraud detection (e.g., for cryptocurrency); e-mail management; database management; indexing and join operation; memory management; data compression; event-centric social network; social behavior; drone/satellite vision/navigation; smart city/home/appliances/IoT; and Image Ad and Referral Networks, for e-commerce, e.g., 3D shoe recognition, from any view angle.

Term
6.2 yearsto projected expiry
Projected expiry 20 November 2032, counted from filing; an application has no term until it is granted.
- Priority
- Filed
- Published
- Today
- Projected expiry
31 claims: 3 independent, 28 dependent
- 1A method for image recognition in an image or video recognition platform, with explainability, said method comprising:an interface receiving an image or video;wherein said image or video recognition platform comprises a cognition layer;said interface sending said image or video to said cognition layer;said interface receiving a first hybrid data;wherein said first hybrid data comprises non-image data;wherein said non-image data comprises one or more of the following: voice, music, sound piece, text, number, table, diagram, or graph;said interface sending said non-image data to said cognition layer;said cognition layer communicating with a knowledge base repository;said cognition layer communicating with an experience database;said cognition layer communicating with a rules engine;said cognition layer analyzing said image or video and said non-image data simultaneously;said cognition layer obtaining first properties and parameters from said image or video and said non-image data;said cognition layer explaining portions of said image or video with said first properties and parameters;said cognition layer sending said explanation of said portions of said image or video to a first analyzer;said first analyzer communicating with an object database;said first analyzer comparing said explanation of said portions of said image or video against said object database;said first analyzer recognizing each of said portions of said image or video, as a set of object names or identifiers;said first analyzer sending said set of object names or identifiers from said recognized each of said portions of said image or video, to said cognition layer;andsaid cognition layer sending said set of object names or identifiers to an output device.
- 2A method for image recognition in an image or video recognition platform, with explainability, said method comprising:an interface receiving an image or video;wherein said image or video recognition platform comprises a cognition layer;said interface sending said image or video to said cognition layer;said interface receiving a first hybrid data;wherein said first hybrid data comprises non-image data;wherein said non-image data comprises one or more of the following: voice, music, sound piece, text, number, table, diagram, or graph;said interface sending said non-image data to said cognition layer;said cognition layer communicating with a knowledge base repository;said cognition layer communicating with a contradiction analysis subsystem;said cognition layer analyzing said image or video and said non-image data simultaneously;said cognition layer obtaining first properties and parameters from said image or video and said non-image data;said cognition layer explaining portions of said image or video with said first properties and parameters;said cognition layer sending said explanation of said portions of said image or video to a first analyzer;said first analyzer communicating with an object database;said first analyzer comparing said explanation of said portions of said image or video against said object database;said first analyzer recognizing each of said portions of said image or video, as a set of object names or identifiers;said first analyzer sending said set of object names or identifiers from said recognized each of said portions of said image or video, to said cognition layer;andsaid cognition layer sending said set of object names or identifiers to an output device.
- 3Broadest claimClaim Score 28, narrow(NHIP)A method for image recognition in an image or video recognition platform, with explainability, said method comprising:an interface receiving an image or video;wherein said image or video recognition platform comprises a cognition layer;said interface sending said image or video to said cognition layer;said interface receiving a first hybrid data;wherein said first hybrid data comprises non-image data;wherein said non-image data comprises one or more of the following: voice, music, sound piece, text, number, table, diagram, or graph;said interface sending said non-image data to said cognition layer;said cognition layer communicating with a logic subsystem;said cognition layer communicating with an inference subsystem;said cognition layer analyzing said image or video and said non-image data simultaneously;said cognition layer obtaining first properties and parameters from said image or video and said non-image data;said cognition layer explaining portions of said image or video with said first properties and parameters;said cognition layer sending said explanation of said portions of said image or video to a first analyzer;said first analyzer communicating with an object database;said first analyzer comparing said explanation of said portions of said image or video against said object database;said first analyzer recognizing each of said portions of said image or video, as a set of object names or identifiers;said first analyzer sending said set of object names or identifiers from said recognized each of said portions of said image or video, to said cognition layer;andsaid cognition layer sending said set of object names or identifiers to an output device.
Independent claims3
3,685 paragraphs in 9 sections, as filed
RELATED APPLICATIONS
The current application is the Continuation of another pending application, named Zadeh-101-cipcipcip, Ser. No. 16/729,944, filed 30, Dec. 2019, titled “System and Method for Extremely Efficient Image and Pattern Recognition and Artificial Intelligence Platform”, now allowed (which is named “Our Continuation Application”, here). “Our Continuation Application” claims the benefit of and takes the priority of the earlier filing dates of the following U.S. provisional application No. 62/786,469, filed 30 Dec. 2018, called ZAdvanced-6-prov, titled “System and Method for Extremely Efficient image and Pattern Recognition and General-Artificial Intelligence Platform”. “Our Continuation Application” is also a CIP (Continuation-in-part) of another co-pending U.S. application Ser. No., 15/919170, filed 12 Mar. 2018, called Zadeh-101-cip-cip, now as patent Ser. No. 11/074,495, issued on 2021 Jul. 27, titled “System and Method for Extremely Efficient Image and Pattern Recognition and Artificial Intelligence Platform”, which is a CIP (Continuation-in-part) of another co-pending U.S. application Ser. No. 14/218,923, filed 18, Mar. 2014, called Zadeh-101-CIP, which is now issued as U.S. Pat. No. 9,916,538 on 13 Mar. 2018, which is a CIP (Continuation-in-part) of another co-pending U.S. application Ser. No., 13/781,303; filed Feb. 28, 2013, called ZAdvanced-1, now U.S. Pat. No. 8,873,813, issued on 28 Oct. 2014, which claims the benefit of and takes the priority of the earlier filing date of the following U.S. provisional application No. 61/701,789, filed Sep. 17, 2012, called ZAdvanced-1-prov. The application 14/218,923 also claims the benefit of and takes the priority of the earlier filing dates of the following U.S. provisional application numbers: 61/802,810, filed Mar. 18, 2013, called ZAdvanced-2-prov; and 61/832,816, filed Jun. 8, 2013, called ZAdvanced-3-prov; and 61/864,633, filed Aug. 11, 2013, called ZAdvanced-4-prov; and 61/871,860, filed Aug. 29, 2013, called ZAdvanced-5-prov. The application Ser. No. 14/218,923 is also a CIP (Continuation-in-part) of another co-pending U.S. application Ser. No. 14/201,974, filed 10Mar. 2014, called Zadeh-101-Cont-4, now as U.S. Pat. No. 8,949,170. issued on 3 Feb. 2015, which is a Continuation of another U.S. application Ser. No., 13/953,047, filed Jul. 29, 2013, called Zadeh-101-Cont-3, now U.S. Pat. No. 8,694,459, issued on 8 Apr. 2014, which is also a Continuation of another co-pending application, 13/621,135, filed Sep. 15, 2012, now issued as U.S. Pat. No. 8,515,890, on Aug. 20, 2013, which is also a Continuation of Ser. No. 13/621,164, filed Sep. 15, 2012, now issued as U.S. Pat. No. 8,463,735, which is a Continuation of another application, Ser. No. 13/423,758, filed Mar. 19, 2012, now issued as U.S. Pat. No. 8,311,973, which, in turn, claims the benefit of the U.S. provisional application No. 61/538,824, filed on Sep. 24, 2011. The current application incorporates by reference all of the applications and patents/provisionals mentioned above, including all their Appendices and attachments (Packages), and it claims benefits to and takes the priority of the earlier filing dates of all the provisional and utility applications or patents mentioned above. Please note that most of the Appendices and attachments (Packages) to the specifications for the above-mentioned applications and patents (such as U.S. Pat. No. 8,311,973) are available for public view, e.g., through Public Pair system at the USPTO web site (www.uspto.gov), with some of their listings given below in the next section:
ATTACHED PACKAGES AND APPENDICES TO PRIOR SPECIFICATIONS E.G., U.S. PAT. NO. 8,311,973 and ZADEH-101-CIP):
(All incorporated by reference, herein, in the current application.)
In addition to the provisional cases above, the teachings of all 33 packages (the PDF files, named “Packages 1-33”) attached with some of the parent cases' filings (as Appendices) (such as U.S. Pat. No. 8,311,973 (i.e., Zadeh-101 docket)) are incorporated herein by reference to this current disclosure.
Furthermore, “Appendices 1-5” of Zadeh-10<sup>-</sup>1-GIP (i.e., 14/218,923) are incorporated herein by reference to this current disclosure.
To reduce the size of the appendices/disclosure, these Packages (Packages 1-33) and Appendices (Appendices 1-5) are not repeated here again, but they may be referred to/incorporated. in, in the future from time to time in the current or the children/related applications, both in spec or claims, as our own previous teachings.
However, the new Appendices attached to this current application is now numbered after the appendices mentioned above, i.e., starting with Appendix 6, for this current application, to make it easier to refer to them in the future.
Please note that Appendices 1-5 (of Zadeh-101-CIP (i.e., Ser. No. 14/218,923)) are identified as: <ul id="ul0001" list-style="none"><li id="ul0001-0001" num="0000"><ul id="ul0002" list-style="none"><li id="ul0002-0001" num="0008">Appendix 1: article about “Approximate Z-Number Evaluation based on Categorical Sets of Probability Distributions” (11 pages)</li><li id="ul0002-0002" num="0009">Appendix 2: hand-written technical notes, formulations, algorithms, and derivations (5 pages)</li><li id="ul0002-0003" num="0010">Appendix 3: presentation about “Approximate Z-Number Evaluation Based on Categorical Sets of Probability Distributions” (30 pages)</li><li id="ul0002-0004" num="0011">Appendix 4: presentation with FIGS. from B1 to B19 (19 pages)</li><li id="ul0002-0005" num="0012">Appendix 5: presentation about “SVM Classifier” (22 pages)</li></ul></li></ul>
Please note that Appendices 6-10 (of Zadeh-101-CIP-C IP (i.e., the current application)) are identified as: <ul id="ul0003" list-style="none"><li id="ul0003-0001" num="0000"><ul id="ul0004" list-style="none"><li id="ul0004-0001" num="0014">Appendix 6: article/journal/technical/research/paper about “The Information Principle”, by Prof. Lotfi Zadeh. Information Sciences, submitted 16 May 2014, published 2015 (10 pages)</li><li id="ul0004-0002" num="0015">Appendix 7: presentation/conference/talk/invited/keynote speaker/lecture about “Stratification, target set reachability, and incremental enlargement principle”, by Prof. Lotti Zadeh, UC Berkeley, World Conference on Soft Computing, May 22, 2016 (14 pages, each page including 9 slides, for a total of 126 slides) (first version prepared on Feb. 8, 2016)</li><li id="ul0004-0003" num="0016">Appendix 8: article about “Stratification, quantization, target set reachability, and incremental enlargement principle”, by Prof. Lotfi Zadeh, for Information Sciences, received 4 Jul. 2016 (17 pages) (first version prepared on Feb. 5, 2016)</li><li id="ul0004-0004" num="0017">Appendix 9: This shows the usage of visual search terms for our image search engine (1 page), which is the first in the industry. It shows an example for shoes (component or parts matching, from various shoes), using ZAC/our technology and platform. For example, it shows the search for: “side look like shoe number 1, heel look like shoe number 2, and toe look like shoe number 3”, based on what the user is looking/searching for. In general, we can have a combination of conditions, e.g.: (R<sub>1 </sub>AND R<sub>2 </sub>AND . . . AND R<sub>n</sub>), or any logical search terms or combinations or operators, e.g., [R<sub>1 </sub>OR (R<sub>2 </sub>AND R<sub>3</sub>)], which is very helpful for e-commerce or websites/e-stores.</li><li id="ul0004-0005" num="0018">Appendix 10: “Brief Introduction to AI and Machine Learning”, for conventional tools and methods, sometimes used or referred to in this invention, for completeness and as support of the main invention, or just for the purpose of comparison with the conventional tools and methods.</li></ul></li></ul>
Please note that Appendices 11-13 (of ZAdvanced-6-prov) are identified as: <ul id="ul0005" list-style="none"><li id="ul0005-0001" num="0000"><ul id="ul0006" list-style="none"><li id="ul0006-0001" num="0020">Appendix 11: “ZAC General-AI Platform for 31) Object Recognition & Search from any Direction (Revolutionary Image Recognition & Search Platform)”, for descriptions and details of General-AI Platform, which includes Explainable-AI (or XAI or X-AI or Explainable-Artificial Intelligence), as well. This also describes ZAC features and advantages over NN (or CNN or Deep CNN or Deep Convolutional Neural Net or ResNet). This also describes applications, markets, and use cases/examples/embodiments for ZAC tech/algotithms/platform.</li><li id="ul0006-0002" num="0021">Appendix 12: ZAC platform and operation, with features, architecture, modules, layers, and components. This also describes ZAC features and advantages over NN (or CNN or Deep CNN or Deep Convolutional Neural Net or ResNet).</li><li id="ul0006-0003" num="0022">Appendix 13: Some examples/embodiments/tech descriptions for ZAC tech/platform (General-AI Platform).</li></ul></li></ul>
Please note that Appendix 14 (of Zadeh-101-cip-cip-cip) (i.e., the current ion) is identified as ZAC Explainable-AI, which is a component of ZAC General-AI Platform. This also describes applications, markets, and use cases/examples/embodiments for ZAC tech/algorithms/platform. This also describes ZAC features and advantages over NN (or CNN or Deep CNN or Deep Convolutional Neural Net or ResNet).
Please note that Packages 1-33 (of U.S. Pat. No. 8,311,973) are also one of the inventor's (Prof. Lotfi Zadeh's) own previous technical teachings, and thus, they may be referred to (from time-to-time) for further details or explanations, by the reader, if needed.
Please note that Packages 1-25 had already been submitted (and filed) with our provisional application for one of the parent cases.
Packages 1-12 and 15-22 are marked accordingly at the bottom of each page or slide (as the identification). The other Packages (Packages 13-14 and 23-33) are identified here: <ul id="ul0007" list-style="none"><li id="ul0007-0001" num="0000"><ul id="ul0008" list-style="none"><li id="ul0008-0001" num="0027">Package 13: 1 page, with 3 slides, starting with “<figref idref="DRAWINGS">FIG. 1</figref>, Membership function of A and probability density function of X”</li><li id="ul0008-0002" num="0028">Package 14: 1 page, with 5 slides, starting with “<figref idref="DRAWINGS">FIG. 1</figref>. f-transformation and f-geometry. Note that fuzzy figures, as shown, are not hand drawn. They should be visualized as hand drawn figures.”</li><li id="ul0008-0003" num="0029">Package 23: 2-page text, titled “The Concept of a Z-number—a New Direction in Computation, Lotfi A. Zadeh, Abstract” (dated Mar. 28, 2011)</li><li id="ul0008-0004" num="0030">Package 24: 2-page text, titled “Prof. Lotfi Zadeh. The Z-mouse—a visual means of entry and retrieval of fuzzy data”</li><li id="ul0008-0005" num="0031">Package 25: 12-page article, titled “Toward Extended Fuzzy Logic A First Step, Abstract”</li><li id="ul0008-0006" num="0032">Package 26: 2-page text, titled “Can mathematics deal with computational problems which are stated in a natural language?, Lotfi A. Zadeh, Sep. 30, 2011, Abstract” (Abstract dated Sep. 30, 2011)</li><li id="ul0008-0007" num="0033">Package 27: 15 pages, with 131 slides, titled “Can Mathematics Deal with Computational Problems Which are Stated in a Natural Language?, Lotfi A. Zadeh” (dated Feb. 2, 2012)</li><li id="ul0008-0008" num="0034">Package 28: 14 pages, with 123 slides, titled “Can Mathematics Deal with Computational Problems Which are Stated in a Natural Language?, Lotfi A. Zadeh” (dated Oct. 6, 201 1)</li><li id="ul0008-0009" num="0035">Package 29: 33 pages, with 289 slides, titled “Computing with Words—Principal Concepts and Ideas, Lotfi A. Zadeh” (dated Jan. 9, 2012)</li><li id="ul0008-0010" num="0036">Package 30: 23 pages, with 205 slides, titled “Computing with Words—Principal Concepts and Ideas, Lotfi A. Zadeh” (dated May 10, 2011)</li><li id="ul0008-0011" num="0037">Package 31: 3 pages, with 25 slides, titled “Computing with Words—Principal Concepts and Ideas, Lotfi A. Zadeh” (dated Nov. 29, 2011)</li><li id="ul0008-0012" num="0038">Package 32: 9 pages, with 73 slides, titled “Z-NUMBERS—A NEW DIRECTION IN THE ANALYSIS OF UNCERTAIN AND IMPRECISE SYSTEMS, Lotfi A. Zadeh” (dated Jan. 20, 2012)</li><li id="ul0008-0013" num="0039">Package 33: 15 pages, with 131 slides, titled “PRI CISIATION OF MEANING—A KEY TO SEMANTIC COMPUTING, Lotfi A. Zadeh” (dated Jul. 22, 2011)</li></ul></li></ul>
Please note that all the Packages and Appendices (prepared by one or more of the inventors here) were also identified by their PDF file names, as they were submitted to the USPTO electronically.
BACKGROUND OF THE INVENTION
Professor Lotfi A. Zadeh, one of the inventors of the current disclosure and some of the parent cases, is the “Father of Fuzzy Logic”. He first introduced the concept of Fuzzy Set and Fuzzy Theory in his famous paper, in 1965 (as a professor of University of California, at Berkeley). Since then, many people have worked on the Fuzzy Logic technology and science, Dr. Zadeh has also developed many other concepts related to Fuzzy Logic. He has invented Computation-with-Words (CWW or CW), e.g., for natural language processing (NLP) and analysis, as well as semantics of natural languages and computational theory of perceptions, for many diverse applications, which we address here, as well, as some of our new/innovative methods and systems are built based on those concepts/theories, as their novel/advanced extensions/additions/versions/extractions/branches/fields. One of his last revolutionary inventions is called Z-numbers, named after him (“Z” from Zadeh), which is one of the many subjects of the (many) current inventions. That is, some of the many embodiments of the current inventions are based on or related to Z-numbers. The concept of Z-numbers was first published in a recent paper, by Dr. Zadeh, called “A Note on Z-Nutnbers”, Information Sciences 181 (2011) 2923-2932.
However, in addition, there are many other embodiments in the current disclosure that deal with other important and innovative topics/subjects, e.g., related to General AI, versus Specific or Vertical or Narrow AI, machine learning, using/requiring only a small number of training samples (same as humans can do), learning one concept and use it in another context or environment (same as humans can do), addition of reasoning and cognitive layers to the learning module (same as humans can do), continuous learning and updating the learning machine continuously (same as humans can do), simultaneous learning and recognition (at the same time) (same as humans can do), and conflict and contradiction resolution (same as humans can do), with application, e.g., for image recognition, application for any pattern recognition, e.g., sound or voice, application for autonomous or driverless cars, application for security and biometrics, e.g., partial or covered or tilted or rotated face recognition, or emotion and feeling detections, application for playing games or strategic scenarios, application for fraud detection or verification/validation, e.g., for banking or cryptocurrency or tracking fund or certificates, application for medical imaging and medical diagnosis and medical procedures and drug developments and genetics, application for control systems and robotics, application for prediction, forecasting, and risk analysis, e.g., for weather forecasting, economy, oil price, interest rate, stock price, insurance premium, and social unrest indicators/parameters, and the like.
In the real world, uncertainty is a pervasive phenomenon. Much of the information on which decisions are based is uncertain. Humans have a remarkable capability to make rational decisions based on information which is uncertain, imprecise and/or incomplete. Formalization of this capability is one of the goals of these current inventions, in one embodiment.
Here are some of the publications on the related subjects, for some embodiments:
[1] R. Ash, Basic Probability Theory, Dover Publications, 2008.
[2] J-C. Buisson, Nutri-Educ, a nutrition software application for balancing meals, using fuzzy arithmetic and heuristic search algorithms, Artificial Intelligence in Medicine 42, (3), (2008) 213-227.
[3] E. Trillas, C. Moraga, S. Guadarrama, S. Cubillo and E. Castifieira, Computing with Antonyms. In: M, Nikravesh, J. Kacprzyk and L. A. Zadeh (Eds.). Forging New Frontiers: Fuzzy Pioneers I, Studies in Fuzziness and Soft Computing Vol 217, Springer-Verlag, Berlin Heidelberg 2007, pp. 133-153.
[4] R. R. Yager, On measures of specificity. In: O. Kaynak, L. A. Zadeh, B. Turksen, I. J. Rudas (Eds.), Computational Intelligence: Soft Computing and Fuzzy-Neuro Integration with Applications, Springer-Verlag, Berlin, 1998, pp. 94-113.
[5] L. A. Zadeh, Calculus of fuzzy restrictions. In: L. A. Zadeh, K. S. Fu, K. Tanaka, and M. Shimura (Eds.), Fuzzy sets and Their Applications to Cognitive and Decision Processes, Academic Press, N.Y., 1975, pp. 1-39.
[6] L. A. Zadeh. The concept of a linguistic variable and its application to approximate reasoning,
Part I: Information Sciences 8 (1975) 199-249;
Part II: Information Sciences 8 (1975) 301-357;
Part III: Information Sciences 9 (1975) 43-80.
[7] L. A. Zadeh, Fuzzy logic and the calculi of fuzzy rules and fuzzy graphs, Multiple-Valued Logic 1, (1996) 1-38.
[8] L. A. Zadeh, From computing with numbers to computing with words—from manipulation of measurements to manipulation of perceptions, IEEE Transactions on Circuits and Systems 45, (1999) 105-119.
[9] L. A. Zadeh. The Z-mouse—a visual means of entry and retrieval of fuzzy data, posted on BISC Forum, Jul. 30, 2010. A more detailed description may be found in Computing with Words—principal concepts and ideas, Colloquium PowerPoint presentation, University of Southern California, Los Angeles, Calif., Oct. 22, 2010.
As one of the applications mentioned here in this disclosure, for comparisons, some of the search engines or question-answering engines in the market (in the recent years) are (or were): Google®, Yahoo®, Autonomy, IBM®, Fast Search, Powerset® (by Xerox® PARC and bought by Microsoft®), Microsoft® Bing, Wolfram®, AskJeeves, Collarity, Vivisimeo®,Endeca,®, Media River, Hakia®, Ask.com®, AltaVista, Excite, Go Network, HotBot®, Lycos®, Northern Light, and Like.com.
Other references on some of the related subjects are:
[1] A. R. Aronson, B. E. Jacobs, J. Minker, A note on fuzzy deduction, J. ACM27 (4) (1980). 599-603.
[2] A. Bardossy, L. Duckstein, Fuzzy Rule-based Modelling with Application to Geophysical, Biological and Engineering Systems, CRC Press, 1995.
[3] T. Berners-Lee, J. Hendler, O. Lassila. The semantic web, Scientific American 284 (5) (2001), 34-43.
[4] S. Brin, L. Page. The anatomy of a large-scale hypertextual web search engine, Computer Networks 30 (1-7) (1998), 107-117.
[5] W. J. H. J. Bronnenberg, M. C. Bunt, S. P. J. Lendshergen, R. H. J. Scha,W. J. Schoenmakers, E. P. C. van Utteren. The question answering system PHLIQA1, in: L. Bola (Ed.), Natural Language Question Answering Systems, Macmillan, 1980.
[6] L. S. Coles, Techniques for information retrieval using an inferential question-answering system with natural language input, SRI Report, 1972.
[7] A. Di Nola, S. Sessa., W. Pedrycz,W. Pei-Zhuang, Fuzzy relation equation under a class of triangular norms: a survey and new results, in: Fuzzy Sets for intelligent Systems, Morgan Kaufmann Publishers, San Mateo, Calif., 1993, pp. 166-189.
[8] A. Di Nola, S. Sessa, W. Pedrycz, F Sanchez, Fuzzy Relation Equations and their Applications to Knowledge Engineering, Kluwer Academic Publishers, Dordrecht, 1989.
[9] D. Dubois, H. Prade, Gradual inference rules in approximate reasoning. Inform. Sci. 61 (1-2) 1992), 103-122.
[10] D. Hey, R. R. Yager, Essentials of Fuzzy Modeling and Control, Wiley-Interscience, 1994.
[11] J. A. Goguen. The logic of inexact concepts, Synthese 19 (1969), 325-373.
[12] M. Jarnshidi, A. Titli, L. A. Zadeh, S. Boverie (Eds.), Applications of Fuzzy Logic—Towards High Machine Intelligence Quotient Systems, Environmental and Intelligent Manufacturing Systems Series, vol. 9, Prentice-Hall, Upper Saddle River, N.J., 1997.
[13] A. Kaufmann, M. M. Gupta. Introduction to Fuzzy Arithmetic: Theory and Applications, Van Nostrand, N.Y., 1985.
[14] D. B. Lenat, CYC: a large-scale investment in knowledge infrastructure, Comm.ACM38 (η) (1995), 32-38.
[15] E. H. Mamdani, S. Assilian, An experiment in linguistic synthesis with a fuzzy logic controller. Int. J. Man-Machine Studies 7 (1975), 1-13.
[16] J. R. McSkimin, J. Minker. The use of a semantic network in a deductive question-answering system, in: IJCAI, 1977, pp. 50-58.
[17] R. E. Moore. Interval Analysis, SIAM Studies in Applied Mathematics, vol. 2, Philadelphia, Pa., 1979.
[18] M. Nagao, J. Tsujii, Mechanism of deduction in a question-answering system with natural language input, in: ICJAI, 1973, pp. 285-290.
[19] B. H. Partee (Ed.), Montague Grammar, Academic Press, N.Y., 1976.
[20] W. Pedrycz, F. Gomide. Introduction to Fuzzy Sets, MIT Press, Cambridge, Ma., 1998.
[21] F. Rossi, P. Codognet (Eds.), Soft Constraints, Special issue on Constraints, vol. 8, N. 1, Kluwer Academic Publishers, 2003.
[22] G. Shafer, A Mathematical Theory of Evidence, Princeton University Press, Princeton, N.J., 1976.
[23] M. K. Smith, C. Welty, D. McGuinness (Eds.), OWL Web Ontology Language Guide, W3C Working Draft 31,2003.
[24] L. A. Zadeh. Fuzzy sets. Inform, and Control 8 (1965), 338-353.
[25] L. A. Zadeh, Probability measures of fuzzy events, J. Math. Anal. Appl. 23 (1968), 421-427.
[26] L. A. Zadeh, Outline of a new approach to the analysis of complex systems and decision processes, IEEE Trans. on Systems Man Cybernet. 3 (1973), 28-44.
[27] L. A. Zadeh, On the analysis of large scale systems, in: H. Gottinger (Ed.), Systems Approaches and Environment Problems, Vandenhoeck and Ruprecht, Gottingen, 1974, pp. 23-37.
[28] L. A. Zadeh. The concept of a linguistic variable and its application to approximate reasoning, Part I. Inform. Sci. 8 (1975), 199-249;Part II. Inform. Sci. 8 (1975), 301-357;Part III, Inform. Sci. 9 (1975), 43-80.
[29] L. A. Zadeh, Fuzzy sets and information granularity, in: M. Gupta, R. Ragade, R. Yager (Eds.), Advances in Fuzzy Set Theory and Applications, North-Holland Publishing Co, Amsterdam, 1979, pp. 3-18.
[30] L. A. Zadeh, A theory of approximate reasoning, in: J. Hayes, D. Michie, L. I. Mikulich (Eds.), Machine Intelligence, vol. 9,Halstead Press, N.Y., 1979, pp. 149-194.
[31] L. A. Zadeh, Test-score semantics for natural languages and meaning representation via PRUF, in: B. Rieger (Ed.), Empirical Semantics, Brockmeyer, Bochum, W. Germany, 1982, pp. 281-349. Also Technical Memorandum 246, AI Center, SRI International, Menlo Park, Calif., 1981.
[32] L. A. Zadeh, A computational approach to fuzzy quantifiers in natural languages, Computers and Mathematics 9 (1983), 149-184.
[33] L. A. Zadeh, A fuzzy-set-theoretic approach to the compositionality of meaning: propositions, dispositions and canonical forms, J. Semantics 3 (1983), 253-272.
[34] L. A. Zadeh, Precisiation of meaning via translation into PRUF, in: L. Vaina, J. Hintikka (Eds.), Cognitive Constraints on Communication, Reidel, Dordrecht, 1984, pp. 373-402.
[35] L. A. Zadeh, Outline of a computational approach to meaning and knowledge representation based on a concept of a generalized assignment statement, in: M. Thoma, A. Wyner (Eds.), Proceedings of the International Seminar on Artificial Intelligence and Man-Machine Systems, Springer-Verlag, Heidelberg, 1986, pp. 198-211.
[36] L, A. Zadeh, Fuzzy logic and the calculi of fuzzy rules and fuzzy graphs, Multiple-Valued Logic 1 (1996), 1-38.
[37] L. A. Zadeh, Toward a theory of fuzzy information granulation and its centrality in human reasoning and fuzzy logic, Fuzzy Sets and Systems 90 (1997), 111-127.
[38] L. A. Zadeh, From computing with numbers to computing with words from manipulation of measurements to manipulation of perceptions, IEEE Trans. on Circuits and Systems 45 (1) (1999), 105-119.
[39] L. A. Zadeh, Toward a perception-based theory of probabilistic reasoning with imprecise probabilities, J. Statist. Plana. inference 105 (2002), 233-264.
[40] L. A, Zadeh, Precisiated natural language (PNL), AI Magazine 25 (3) (2004), 74-91.
[41] L. A. Zadeh, A note on web intelligence, world knowledge and fuzzy logic, Data and Knowledge Engineering 50 (2004), 291-304.
[42] L. A. Zadeh, Toward a generalized theory of uncertainty (GTIJ)—an outline, inform Sci. 172 (2005), 1-40.
[43] J. Ationa, R. Corchuelo, J. Pena, D. Ruiz, Coping with web knowledge, in: Advances in Web Intelligence, Springer-Verlag, Berlin, 2003, pp. 165-178.
[44] A. Bargiela, W. Pedrycz, Granular Computing—An Introduction, Kluwer Academic Publishers, Boston, 2003.
[45] Z. Bubnicki, Analysis and Decision Making in Uncertain Systems, Springer-Verlag, 2004.
[46] P. P. Chen, Entity-relationship Approach to Information Modeling and Analysis, North-Holland, 1983.
[47] M. Craven, D. DiPasquo, D. Freitag, A. McCallum, T. Mitchell, K. Nigam, S. Slattery, Learning to construct knowledge bases from the world wide web, Artificial Intelligence 118 (1-2) (2000), 69-113.
[48] M. J. Cresswell, Logic and Languages, Methuen, London, UK, 1973.
[49] D. Dubois, H. Prade, On the use of aggregation operations in information fusion processes, Fuzzy Sets and Systems 142 (1) (2004), 143-161.
[50] T. F. Gamat, Language, Logic and Linguistics, University of Chicago Press, 1996.
[51] M. Mares, Computation over Fuzzy Quantities, CRC, Boca Raton, Fla., 1994.
[52] V. Novak, I. Perfilieva, J. Mockor, Mathematical Principles of Fuzzy Logic, Kluwer Academic Publishers, Boston, 1999.
[53] V. Novak, I. Perfilieva (Eds.), Discovering the World with Fuzzy Logic, Studies in Fuzziness and Soft Computing, Physica-Verlag, Heidelberg, 2000.
[54] Z. Pawlak, Rough Sets: Theoretical Aspects of Reasoning about Data, Kluwer Academic Publishers, Dordrecht, 1991.
[55] M. K. Smith, C. Welty, What is ontology? Ontology: towards a new synthesis, in: Proceedings of the Second International Conference on Formal Ontology in Information Systems, 2002.
However, none of the prior art, teaches the features mentioned in our invention disclosure.
There are a lot of research going on today, focusing on the search engine, analytics, Big Data processing, natural language processing, economy forecasting, dealing with reliability and certainty, medical diagnosis, pattern recognition, object recognition, biometrics, security analysis, risk analysis, fraud detection, satellite image analysis, machine generated data, machine learning, training samples, and the like.
For example, see the article by Technology Review, published by MIT, “Digging deeper in search web”, Jan. 29, 2009, by Kate Greene, or search engine by σ<sub>x</sub>)OGLE®, MICROSOFT® (BINGT), or YAHOO®, or APPLE® SIRI, or WOLFRAM® ALPHA computational knowledge engine, or AMAZON engine, or FACEBOOK® engine, or ORACLE® database, or YANDEX® search engine in Russia, or PICASA® (σ<sub>x</sub>)OGLE®) web albums, or YOUTUBE® (σ<sub>x</sub>)OGLE®) engine, or ALIBABA (Chinese supplier connection), or SPUNK® (for Big Data), or MICROSTRATEGY® (for business intelligence), or QUID (or KAGGLE, ZESTFINANCE, APIXIO, DATAMEER, BLUEKAI, GNIP, RETAILNEXT, or RECOMMIND) (for Big Data), or paper by Viola-Jones, Viola et al., at Conference on Computer Vision and Pattern Recognition, 2001, titled “Rapid object detection using a boosted cascade of simple features”, from Mitsubishi and Compaq research labs, or paper by AIex Pentland et al., Feb 2000, at Computer, IEEE, titled “Face recognition for smart environments”, or σ<sub>x</sub>)OGLE® official bldg; publication, May 16, 2012, titled “Introducing the knowledge graph: things, not strings”, or the article by Technology Review, published by MIT, “The future of search”, Jul. 16, 2007, by Kate Greene, or the article by Technology Review, published by MIT, “Microsoft searches for group advantage”, Jan. 30, 2009, by Robert Lemos, or the article by Technology Review, published by MIT, “WOLFRAM ALPHA and σ<sub>x</sub>)OGLE face off”, May 5, 2009, by David Talbot, or the paper by Devarakonda et at, at International Journal of Software Engineering (JJSE), Vol. 2, Issue 1, 2011, titled “Next generation search engines for information retrieval”, or paper by Nair-Hinton, titled “Implicit mixtures of restricted Boltzmann machines”, NIPS, pp. 1145-1152, 2009, or paper by Nair, V. and Hinton, G. E., titled “3-D Object recognition with deep belief nets”, published in Advances in Neural Information Processing Systems 22, (Y. Bengio, D. Schuurmans, J. lafferty, C. K. I. Williams, and A. Culotta (Eds.)), pp 1339-1347. Other research groups include those headed by Andrew Ng, Yoshna Bengio, Fei Fei Li, Ashutosh Saxena, LeCun, Michael I. Jordan, Zoubin Ghahramani, and others in companies and universities around the world.
However, none of the prior art teaches the features mentioned in our invention disclosure, even in combination.
SUMMARY OF THE INVENTION
For one embodiment: Decisions are based on information. To be useful, information must be reliable. Basically, the concept of a Z-number relates to the issue of reliability of information. A Z-number, Z, has two components, Z=(A, B). The first component, A, is a restriction (constraint) on the values which a real-valued uncertain variable, X, is allowed to take. The second component, B, is a measure of reliability (certainty) of the first component. Typically, A and B are described in a natural language. Example: (about 45 minutes, very sure). An important issue relates to computation with Z-numbers. Examples are: What is the sum of (about 45 minutes, very sure) and (about 30 minutes, sure)? What is the square root of (approximately 100, likely)? Computation with Z-numbers falls within the province of Computing with Words (CW or CWW). In this disclosure, the concept of a Z-number is introduced and methods of computation with Z-numbers are shown. The concept of a Z-number has many applications, especially in the realms of economics, decision analysis, risk assessment, prediction, anticipation, rule-based characterization of imprecise functions and relations, and biomedicine. Different methods, applications, and systems are discussed. Other Fuzzy inventions and concepts are also discussed. Many non-Fuzzy-related inventions and concepts are also discussed.
For other embodiments: Specification also covers new algorithms, methods, and systems for artificial intelligence, soft computing, and deep/detailed learning/recognition, e.g., image recognition (e.g., for action, gesture, emotion, expression, biometrics, fingerprint, facial, OCR (text), background, relationship, position, pattern, and object), large number of images (“Big Data”) analytics, machine learning, training schemes, crowd-sourcing (using experts or humans), feature space, clustering, classification, similarity measures, optimization, search engine, ranking, question-answering system, soft (fuzzy or unsharp) boundaries/impreciseness/ambiguities/fuzziness in language, Natural Language Processing (NLP), Computing-with-Words (CWW), parsing, machine translation, sound and speech recognition, video search and analysis (e.g. tracking), image annotation, geometrical abstraction, image correction, semantic web, context analysis, data reliability (e.g.,using Z-number (e.g., “About 45 minutes; Very sure”)), rules engine, control system, autonomous vehicle (e.g., self-parking), self-diagnosis and self-repair robots, system diagnosis, medical diagnosis, biomedicine, data mining, event prediction, financial forecasting, economics, risk assessment, e-mail management, database management, indexing and join operation, memory management, and data compression.
Other topics/inventions covered are, e.g.: <ul id="ul0009" list-style="none"><li id="ul0009-0001" num="0000"><ul id="ul0010" list-style="none"><li id="ul0010-0001" num="0121">Method and System for Identification or Verification for an Object, a Person, or their Attributes</li><li id="ul0010-0002" num="0122">System and Method for Image Recognition and Matching for Targeted Advertisement</li><li id="ul0010-0003" num="0123">System and Method for Analyzing Ambiguities in Language for Natural Language Processing</li><li id="ul0010-0004" num="0124">Application of Z-Webs and Z-factors to Analytics, Search Engine, Learning, Recognition, Natural Language, and Other Utilities</li><li id="ul0010-0005" num="0125">Method and System for Approximate Z-Number Evaluation based on Categorical Sets of Probability Distributions</li><li id="ul0010-0006" num="0126">Image and Video Recognition and Application to Social Network and Image and Video Repositories</li><li id="ul0010-0007" num="0127">System and Method for Image Recognition for Event-Centric Social Networks</li><li id="ul0010-0008" num="0128">System and Method for Image Recognition for Image Ad Network</li><li id="ul0010-0009" num="0129">System and Method for Increasing Efficiency of Support Vector Machine Classifiers</li></ul></li></ul>
Other topics/inventions covered are, e.g.: <ul id="ul0011" list-style="none"><li id="ul0011-0001" num="0000"><ul id="ul0012" list-style="none"><li id="ul0012-0001" num="0131">Information Principle</li><li id="ul0012-0002" num="0132">Stratification</li><li id="ul0012-0003" num="0133">Incremental Enlargement Principle</li><li id="ul0012-0004" num="0134">Deep/detailed Machine Learning and training schemes</li><li id="ul0012-0005" num="0135">Image recognition (e.g., for action, gesture, emotion, expression, biometrics, fingerprint, facial (e.g. using eigenface), monument and landmark, OCR, background, partial object, relationship, position, pattern, texture, and object)</li><li id="ul0012-0006" num="0136">Basis functions</li><li id="ul0012-0007" num="0137">Image and video auto-annotation</li><li id="ul0012-0008" num="0138">Focus window</li><li id="ul0012-0009" num="0139">Modified/Enhanced Boltzmann Machines</li><li id="ul0012-0010" num="0140">Feature space translation</li><li id="ul0012-0011" num="0141">Geometrical abstraction</li><li id="ul0012-0012" num="0142">Image correction</li><li id="ul0012-0013" num="0143">Semantic web</li><li id="ul0012-0014" num="0144">Context analysis</li><li id="ul0012-0015" num="0145">Data reliability</li><li id="ul0012-0016" num="0146">Correlation layer</li><li id="ul0012-0017" num="0147">Clustering</li><li id="ul0012-0018" num="0148">Classification</li><li id="ul0012-0019" num="0149">Support Vector Machines</li><li id="ul0012-0020" num="0150">Similarity measures</li><li id="ul0012-0021" num="0151">Optimization</li><li id="ul0012-0022" num="0152">Z-number</li><li id="ul0012-0023" num="0153">Z-factor</li><li id="ul0012-0024" num="0154">Z-web</li><li id="ul0012-0025" num="0155">Rules engine</li><li id="ul0012-0026" num="0156">Control system</li><li id="ul0012-0027" num="0157">Robotics</li><li id="ul0012-0028" num="0158">Search engine</li><li id="ul0012-0029" num="0159">Ranking</li><li id="ul0012-0030" num="0160">Question-answering system</li><li id="ul0012-0031" num="0161">Soft boundaries & Fuzziness in language</li><li id="ul0012-0032" num="0162">Natural Language Processing (NLP)</li><li id="ul0012-0033" num="0163">System diagnosis</li><li id="ul0012-0034" num="0164">Medical diagnosis</li><li id="ul0012-0035" num="0165">Big Data analytics</li><li id="ul0012-0036" num="0166">Event prediction</li><li id="ul0012-0037" num="0167">Financial forecasting</li><li id="ul0012-0038" num="0168">Computing with Words (CWW)</li><li id="ul0012-0039" num="0169">Parsing</li><li id="ul0012-0040" num="0170">Soft boundaries & Fuzziness in clustering & classification</li><li id="ul0012-0041" num="0171">Soft boundaries & Fuzziness in recognition</li><li id="ul0012-0042" num="0172">Machine translation</li><li id="ul0012-0043" num="0173">Risk assessment</li><li id="ul0012-0044" num="0174">e-mail management</li><li id="ul0012-0045" num="0175">Database management</li><li id="ul0012-0046" num="0176">Indexing and join operation</li><li id="ul0012-0047" num="0177">Memory management</li><li id="ul0012-0048" num="0178">Sound and speech recognition</li><li id="ul0012-0049" num="0179">Video search & analysis (e.g. tracking)</li><li id="ul0012-0050" num="0180">Data compression</li><li id="ul0012-0051" num="0181">Crowd sourcing (e.g., with experts or SMEs)</li><li id="ul0012-0052" num="0182">Event-centric social networking (based on image)</li><li id="ul0012-0053" num="0183">Energy</li><li id="ul0012-0054" num="0184">Transportation</li><li id="ul0012-0055" num="0185">Distribution of materials</li><li id="ul0012-0056" num="0186">Optimization</li><li id="ul0012-0057" num="0187">Scheduling</li></ul></li></ul>
We have also introduced the first Image Ad Network, powered by our next generation image search engine.
We have introduced our novel “ZAC™ Image Recognition Platform”, which applies learning based on General-AI algorithms. This way, we need much smaller number of training samples to train (the same as humans do), e.g., for evaluating or analyzing a 3-D object/image, e.g., a complex object, such as a shoe, from any direction or angle. To our knowledge, nobody has solved this problem, yet. This is the “Holy Grail” of image recognition. Having/requiring much smaller number of training samples to train is also the “Holy Grail” of AI and machine learning. So, here, we have achieved 2 major scientific and technical milestones/breakthroughs that others have failed to obtain. (These results had been originally reported in our parent cases, as well.)
In addition, to our knowledge, this is the first successful example of application of General-AI algorithms, systems, and methods in any field, application, industry, university, research, paper, experiment, demo, or usage.
With other methods in the industry/universities, e.g., Deep Learning or Convolutional Neural Networks or Deep Reinforcement Learning (maximizing a cumulative reward function) or variations of Neural Networks (e.g., Capsule Networks, recently introduced by Prof. Hinton, Sara Sabour, and Nicholas Frosst, from Google and U. of Toronto), these cannot be done at all, even with much larger number of training samples and much larger CPU/GPU computing time/power and much longer training time periods.
So, we have a significant advantage over the other methods in the industry/universities, as these tasks cannot be done by other methods at all.
Even for the conventional/much easier/very specific tasks, where the other AI methods are applicable/useful, we still have a huge advantage over them, by some orders of magnitude, in terms of cost, efficiency, size, training time, computing/resource requirements, battery lifetime, flexibility, and detection/recognition/prediction accuracy.
These shortcomings/failures/limitations of the other methods/systems/algorithms/results in the AI/machine learning industry/universities have been expressed/confirmed by various AI/machine learning people/researchers. For example, Prof. Hinton, a Google Fellow and a pioneer in AI from U. of Toronto, in an interview (GIGAOM, Jan. 16, 2017), stated that, “One problem we still haven't solved is getting neural nets to generalize well front small amounts of data, and I suspect that this may require radical changes in the types of neuron we use”. In addition, in another interview (Axion, Sep. 15, 2017), he strongly cast doubts about AI's current methodologies, and said that, “My view is throw it all away and start again”, Similarly, Mr. Suleyman (the head of Applied AI, now at DeepMind/Google) stated in an interview at TechCrunch (Dec. 5, 2016) that he thinks that the “general AI is still a long way off”.
So, to our knowledge, beyond the futuristic movies, wish-lists, science fiction novels, and generic non-scientific or non-technical articles (which have no basis/reliance/foundation on theory or experiment or proper/complete teachings), nobody has been successful in the application/usage/demonstration of General-AI, yet, in the AI industry or academia around the world. Thus, our demo/ZAC General-AI image Recognition Software Platform here is a very significant breakthrough in the field/science of AI and machine learning technology. (These results had been originally reported in our parent cases, as well.)
Please note that General-AI is also called/referred to as General Artificial Intelligence (GAI), or Artificial General Intelligence (AGI), or General-Purpose AI, or Strong Artificial Intelligence (AI), or True AI, or as we call it, Thinking-AI, or Reasoning-AI, or Cognition-AI, or Flexible-AI, or Full-Coverage-AI, or Comprehensive-AI, which can perform tasks that was never specifically trained for, e.g., in different context/environment, to recycle/re-use the experience and knowledge, using reasoning and cognition layers, usually in a completely different or unexpected or very new situation/condition/environment (same as what a human can do). Accordingly, we have shown here in this disclosure a new/novel/revolutionary architecture, system, method, algorithm, theory, and technique, to implement General-AI, e.g., for 3-D image/object recognition from any directions and other applications discussed here.
Our technology here (based on General-AI) is in contrast to (versus) Specific AI (or Vertical or Functional or Narrow or Weak AI) (or as we have coined the phrase, “Dumb-AI”), because, e.g., a Specific AI machine trained for face recognition cannot do any other tasks, e.g., finger-print recognition or medical imaging recognition. That is, the Specific AI machine cannot carry over/learn from any experience or knowledge that it has gained from one domain (face recognition) into another/new domain (finger-print or medical imaging), which it has not seen before (or was not trained for before). So, Specific AI has a very limited scope/“intelligence”/functionality/usage/re-usability/flexibility/usefulness.
Please note that the conventional/current state-of-the-art technologies in the industry/academia (e.g., Convolutional Neural Nets or Deep Learning) are based on the Specific AI, which has some major/serious theoretical/practical limits. For example, it cannot perform a 3-D image/object recognition from all directions, or cannot carry over/learn from any experience or knowledge in another domain, or requires extremely large number of training samples (which may not be available at all, or is impractical, or is too expensive, or takes too long to gather or train), or requires extremely large neural network (which cannot converge in the training stage, due to too much degree of freedom, or tends to memorize (rather than learn) the patterns (which is not good for out-of-sample recognition accuracy)), or requires extremely large computing power (which is impractical, or is too expensive, or is not available, or still cannot converge in the training stage). So, they have serious theoretical/practical limitations.
In addition, in Specific AI, if a new class of objects is added/introduced/found to the universe of all objects (e.g., a new animal/species is discovered), the training has to be done from scratch. Otherwise, training on just the last object will bias the whole learning machine, which is not good/accurate for recognition later on. Thus, all weights/biases or parameters in the learning machine must be erased completely, and the whole learning, with the new class added/mixed randomly with previous ones, must be repeated again from scratch, with all parameters erased and re-done/calculated again. So, the solution is not cumulative, or scalable, or practical, at all, e.g., for daily learning or continuous learning, as is the case for most practical situations, or as how the humans or most animals do/learn/recognize. So, they have serious theoretical/practical limitations.
Furthermore, for Specific AI, the learning phase cannot be mixed with the training phase. That is, they are not simultaneous, in the same period of time. So, during the training phase, the machine is useless or idle for all practical purposes, as it cannot recognize anything properly at that time. This is not how humans learn/recognize on a daily basis. So, they have serious theoretical/practical limitations.
General-AI solves/overcomes all of the above problems, as shown/discussed here in this disclosure. So, it has a huge advantage, for many reasons, as stated here, over Specific-AI.
It is also noteworthy that using smaller CPU/GPU power enables easier integration in mobile devices and wearables and IoT and telephones and watches, as an example, which, otherwise, drains the battery very quickly, and thus, requires much bigger battery or frequent recharging, which is not practical for most situations at all.
The industries/applications for our inventions are, e.g.: <ul id="ul0013" list-style="none"><li id="ul0013-0001" num="0000"><ul id="ul0014" list-style="none"><li id="ul0014-0001" num="0204">a Mobile devices (e.g., phones, wearable devices, eyeglasses, tablets)</li><li id="ul0014-0002" num="0205">Smart devices & connected/Internet appliances</li><li id="ul0014-0003" num="0206">The Internet of Things (IoT), as the network of physical devices, vehicles, home appliances, wearables, mobile devices, stationary devices, wireless or cellular devices, BlueTooth or WiFi devices, and the like, embedded with electronics, software, sensors, actuators, mechanical parts, switches, and/or connectivity, which enables these objects to connect and exchange data/commands/info/trigger events,</li><li id="ul0014-0004" num="0207">Natural Language Processing</li><li id="ul0014-0005" num="0208">Photo albums & web sites containing pictures</li><li id="ul0014-0006" num="0209">Video libraries & web sites</li><li id="ul0014-0007" num="0210">Image and video search & summarization & directory & archiving & storage</li><li id="ul0014-0008" num="0211">Image & video Big Data analytics</li><li id="ul0014-0009" num="0212">Smart Camera</li><li id="ul0014-0010" num="0213">Smart Scanning Device</li><li id="ul0014-0011" num="0214">Social networks</li><li id="ul0014-0012" num="0215">Dating sites</li><li id="ul0014-0013" num="0216">Tourism</li><li id="ul0014-0014" num="0217">Real estate</li><li id="ul0014-0015" num="0218">Manufacturing</li><li id="ul0014-0016" num="0219">Biometrics</li><li id="ul0014-0017" num="0220">Security</li><li id="ul0014-0018" num="0221">Satellite or aerial images</li><li id="ul0014-0019" num="0222">Medical</li><li id="ul0014-0020" num="0223">Financial forecasting</li><li id="ul0014-0021" num="0224">Robotics vision & control</li><li id="ul0014-0022" num="0225">Control systems & optimization</li><li id="ul0014-0023" num="0226">Autonomous vehicles</li></ul></li></ul>
We have the following usage examples: object/face recognition; rules engines & control modules; Computation with Words & soft boundaries; classification &. search; information web; data search & organizer & data mining & marketing data analysis; search for similar-looking locations or monuments; search for similar-looking properties; defect analysis; fingerprint, iris, and face recognition; Face/emotion/expression recognition, monitoring, tracking; recognition & information extraction, for security & map; diagnosis, using images & rules engines; and Pattern and data analysis & prediction; image ad network; smart cameras and phones; mobile and wearable devices; searchable albums and videos; marketing analytics; social network analytics; dating sites; security; tracking and monitoring; medical records and diagnosis and analysis, based on images; real estate and tourism, based on building, structures, and landmarks; maps and location services and security/intelligence, based on satellite or aerial images; big data analytics; deep image recognition and search platform; deep/detailed machine learning; object recognition (e.g., shoe, bag, clothing, watch, earring, tattoo, pants, hat, cap, jacket, tie, medal, wrist band, necklace, pin, decorative objects, fashion accessories, ring, food, appliances, equipment, tools, machines, cars, electrical devices, electronic devices, office supplies, office objects, factory objects, and the like).
Here, we also introduce Z-webs, including Z-factors and Z-nodes, for the understanding of relationships between objects, subjects, abstract ideas, concepts, or the like, including face, car, images, people, emotions, mood, text, natural language, voice, music, video, locations, formulas, facts, historical data, landmarks, personalities, ownership, family, friends, love, happiness, social behavior, voting behavior, and the like, to be used for many applications in our life, including on the search engine, analytics, Big Data processing, natural language processing, economy forecasting, face recognition, dealing with reliability and certainty, medical diagnosis, pattern recognition, object recognition, biometrics, security analysis, risk analysis, fraud detection, satellite image analysis, machine generated data analysis, machine learning, training samples, extracting data or patterns (from the video, images, text, or music, and the like), editing video or images, and the like. Z-factors include reliability factor, confidence factor, expertise factor, bias factor, truth factor, trust factor, validity factor, “trustworthiness of speaker”, “sureness of speaker”, “statement helpfulness”, “expertise of speaker”, “speaker's truthfulness”, “perception of speaker (or source of information)”, “apparent confidence of speaker”, “broadness of statement”, and the like, which is associated with each Z-node in the Z-web.
For one embodiment/example, e.g., we have “Usually, people wear short sleeve and short pants in Summer.”, as a rule number N given by an SME, e.g., human expert. The word “short” is a fuzzy parameter for both instances above. The sentence above is actually expressed as a Z-number, as described before, invented recently by Prof. Lotfi Zadeh, one of our inventors here. The collection of these rules can simplify the recognition of objects in the images, with higher accuracy and speed, e.g., as a hint, e.g., during Summer vacation, the pictures taken probably contain shirts with short sleeves, as a clue to discover or confirm or examine the objects in the pictures, e.g., to recognize or examine the existence of shirts with short sleeves, in the given pictures, taken during the Summer vacation. Having other rules, added in, makes the recognition faster and more accurate, as they can be in the web of relationships connecting concepts together, e.g., using our concept of Z-web, described before, or using semantic web. For example, the relationship between 4th of July and Summer vacation, as well as trip to Florida, plus shirt and short sleeve, in the image or photo, can all be connected through the Z-web, as nodes of the web, with Z numbers or probabilities in between on connecting branches, between each 2 parameters or concepts or nodes, as described before in this disclosure and in our prior parent applications.
In addition, there are many other embodiments in the current disclosure that deal with other important and innovative topics/subjects, e.g., related to General AI, versus Specific or Vertical or Narrow AI, machine learning, using/requiring only a small number of training samples (same as humans can do), learning one concept and use it in another context or environment (same as humans can do), addition of reasoning and cognitive layers to the learning module (same as humans can do), continuous learning and updating the learning machine continuously (same as humans can do), simultaneous learning and recognition (at the same time) (same as humans can do), and conflict and contradiction resolution (same as humans can do), with application, e.g., for image recognition, application for any pattern recognition, e.g., sound or voice, application for autonomous or driverless cars, application for security and biometrics, e.g., partial or covered or tilted or rotated face recognition, or emotion and feeling detections, application for playing games or strategic scenarios, application for fraud detection or verification/validation, e.g., for banking or cryptocurrency or tracking fund or certificates, application for medical imaging and medical diagnosis and medical procedures and drug developments and genetics, application for control systems and robotics, application for prediction, forecasting, and risk analysis, e.g., for weather forecasting, economy, oil price, interest rate, stock price, insurance premium, and social unrest indicators/parameters, and the like. (These results had been originally reported in our parent cases, as well.)
In one embodiment, we present a brief description of the basics of stratified programming (SP). SP is a computational system in which the objects of computation are in the main, nested strata of data centering on a target set, T. SP has a potential for significant applications in many fields, among them, robotics, optimal control, planning, multiobjective optimization, exploration, search, and Big Data. In spirit, SP has some similarity to dynamic programing (DP), but conceptually it is much easier to understand and much easier to implement. An interesting question which relates to neuro science is: Is the human brain employ stratification to store information? It will be natural to represent a concept such as a chair as a collection of strata with one or more strata representing a type of chair.
Underlining of our approach is a model, call it FSM. FSM is a finite state system. The importance of FSM as a model varies from use of digitalization (granulation, quantization) to almost any kind of system that can be approximated by a finite state system. The most important part is the concept of reachability of a target set in minimum number of steps. The objective of minimum number of steps serves as a basis for verification of the step of FSM state space. A concept which plays a key role in our approach is the target set reachability. Reachability involves moving (transitioning) FSM from a state ω to a state in target state, T, in a minimum number of steps. To this end, the state space, W, is stratified through the use of what is called the incremental enlargement principle. Reachability is also related to the concept of accessibility.
For the current inventions, we can combine/attach/integrate/connect any and all the systems and methods (or embodiments or steps or sub-components or algorithms or techniques or examples) of our own prior applications/teachings/spec/appendices/FIGS., which we have priority claim for, as mentioned in the current spec/application, to provide very efficient and fast algorithms for image processing, learning machines, NLT, pattern recognition, classification, SVM, deep/detailed analysis/discovery, and the like, for all the applications and usages mentioned here in this disclosure, with all tools, systems, and methods provided here.
BRIEF DESCRIPTION OF THE DRAWINGS
<figref idref="DRAWINGS">FIG. 1</figref> shows membership function of A and probability density function of X.
<figref idref="DRAWINGS">FIG. 2(<i>a</i>)</figref> shows f-mark of approximately 3.
<figref idref="DRAWINGS">FIG. 2(<i>b</i>)</figref> shows f-mark of a Z-number.
<figref idref="DRAWINGS">FIG. 3</figref> shows interval-valued approximation to a trapezoidal fuzzy set.
<figref idref="DRAWINGS">FIG. 4</figref> shows cointension, the degree of goodness of fit of the intension of definiens to the intension of definiendum.
<figref idref="DRAWINGS">FIG. 5</figref> shows structure of the new tools.
<figref idref="DRAWINGS">FIG. 6</figref> shows basic bimodal distribution.
<figref idref="DRAWINGS">FIG. 7</figref> shows the extension principle.
<figref idref="DRAWINGS">FIG. 8</figref> shows precisiation, translation into GCL.
<figref idref="DRAWINGS">FIG. 9</figref> shows the modalities of m-precisiation.
<figref idref="DRAWINGS">FIGS. 10(<i>a</i>)-(<i>b</i>)</figref> depict various types of normal distribution with respect to a membership function, in one embodiment.
<figref idref="DRAWINGS">FIGS. 10(<i>c</i>)-(<i>d</i>)</figref> depict various probability measures and their corresponding restrictions, in one embodiment.
<figref idref="DRAWINGS">FIG. 11(<i>a</i>)</figref> depicts a parametric membership function with respect to a parametric normal distribution, in one embodiment.
<figref idref="DRAWINGS">FIGS. 11(<i>b</i>)-(<i>e</i>)</figref> depict the probability measures for various values of probability distribution parameters, in one embodiment.
<figref idref="DRAWINGS">FIG. 11(<i>f</i>)</figref> depicts the restriction on probability measure, in one embodiment.
<figref idref="DRAWINGS">FIGS. 11(<i>g</i>)-(<i>h</i>)</figref> depict the restriction imposed on various values of probability distribution parameters, in one embodiment.
<figref idref="DRAWINGS">FIG. 11(<i>i</i>)</figref> depicts the restriction relationships between the probability measures, in one embodiment.
<figref idref="DRAWINGS">FIG. 12(<i>a</i>)</figref> depicts a membership function, in one embodiment.
<figref idref="DRAWINGS">FIG. 12(<i>b</i>)</figref> depicts a restriction on probability measure, in one embodiment.
<figref idref="DRAWINGS">FIG. 12(<i>c</i>)</figref> depicts a functional dependence, in one embodiment.
<figref idref="DRAWINGS">FIG. 12(<i>d</i>)</figref> depicts a membership function, in one embodiment.
<figref idref="DRAWINGS">FIGS. 12(<i>e</i>)-(<i>h</i>)</figref> depict the probability measures for various values of probability distribution parameters, in one embodiment.
<figref idref="DRAWINGS">FIGS. 12(<i>i</i>)-(<i>j</i>)</figref> depict the restriction imposed on various values of probability distribution parameters, in one embodiment.
<figref idref="DRAWINGS">FIGS. 12(<i>k</i>)-(<i>l</i>)</figref> depict a restriction on probability measure, in one embodiment.
<figref idref="DRAWINGS">FIGS. 12(<i>m</i>)-(<i>n</i>)</figref> depict the restriction (per ω bin) imposed on various values of probability distribution parameters, in one embodiment.
<figref idref="DRAWINGS">FIG. 12(<i>o</i>)</figref> depicts a restriction on probability measure, in one embodiment.
<figref idref="DRAWINGS">FIG. 13(<i>a</i>)</figref> depicts a membership function, in one embodiment.
<figref idref="DRAWINGS">FIGS. 13(<i>b</i>)-(<i>c</i>)</figref> depict the probability measures for various values of probability distribution parameters, in one embodiment.
<figref idref="DRAWINGS">FIGS. 13(<i>d</i>)-(<i>e</i>)</figref> depict the restriction (per ω bin) imposed on various values of probability distribution parameters, in one embodiment.
<figref idref="DRAWINGS">FIGS. 13(<i>f</i>)-(<i>g</i>)</figref> depict a restriction on probability measure, in one embodiment.
<figref idref="DRAWINGS">FIG. 14(<i>a</i>)</figref> depicts a membership function, in one embodiment.
<figref idref="DRAWINGS">FIGS. 14(<i>b</i>)-(<i>c</i>)</figref> depict the probability measures for various values of probability distribution parameters, in one embodiment.
<figref idref="DRAWINGS">FIG. 14(<i>d</i>)</figref> depicts a restriction on probability measure, in one embodiment.
<figref idref="DRAWINGS">FIG. 15(<i>a</i>)</figref> depicts determination of a test score in a diagnostic system/rules engine, in one embodiment.
<figref idref="DRAWINGS">FIG. 15(<i>b</i>)</figref> depicts use of training set in a diagnostic system/rules engine, in one embodiment.
<figref idref="DRAWINGS">FIG. 16(<i>a</i>)</figref> depicts a membership function, in one embodiment.
<figref idref="DRAWINGS">FIG. 16(<i>b</i>)</figref> depicts a restriction on probability measure, in one embodiment.
<figref idref="DRAWINGS">FIG. 16(<i>c</i>)</figref> depicts membership function tracing using a functional dependence, in one embodiment.
<figref idref="DRAWINGS">FIG. 16(<i>d</i>)</figref> depicts membership function determined using extension principle for functional dependence, in one embodiment.
<figref idref="DRAWINGS">FIGS. 16(<i>e</i>)-(<i>f</i>)</figref> depict the probability measures for various values of probability distribution parameters, in one embodiment.
<figref idref="DRAWINGS">FIG. 16(<i>g</i>)</figref> depicts the restriction imposed on various values of probability distribution parameters, in one embodiment.
<figref idref="DRAWINGS">FIGS. 16(<i>h</i>)-(<i>i</i>)</figref> depict the probability measures for various values of probability distribution parameters, in one embodiment.
<figref idref="DRAWINGS">FIG. 16(<i>j</i>)</figref> depicts the restriction (per ω bin) imposed on various values of probability distribution parameters, in one embodiment.
<figref idref="DRAWINGS">FIG. 16(<i>k</i>)</figref> depicts a restriction on probability measure, in one embodiment.
<figref idref="DRAWINGS">FIG. 17(<i>a</i>)</figref> depicts a membership function, in one embodiment.
<figref idref="DRAWINGS">FIG. 17(<i>b</i>)</figref> depicts the probability measures for various values of probability distribution parameters, in one embodiment.
<figref idref="DRAWINGS">FIG. 17(<i>c</i>)</figref> depicts a restriction on probability measure, in one embodiment.
<figref idref="DRAWINGS">FIG. 18(<i>a</i>)</figref> depicts the determination of a membership function, in one embodiment.
<figref idref="DRAWINGS">FIG. 18(<i>b</i>)</figref> depicts a membership function, in one embodiment.
<figref idref="DRAWINGS">FIG. 18(<i>c</i>)</figref> depicts a restriction on probability measure, in one embodiment.
<figref idref="DRAWINGS">FIG. 19(<i>a</i>)</figref> depicts a membership function, in one embodiment.
<figref idref="DRAWINGS">FIG. 19(<i>b</i>)</figref> depicts a restriction on probability measure, in one embodiment.
<figref idref="DRAWINGS">FIG. 20(<i>a</i>)</figref> depicts a membership function, in one embodiment.
<figref idref="DRAWINGS">FIG. 20(<i>b</i>)</figref> depicts a restriction on probability measure, in one embodiment.
<figref idref="DRAWINGS">FIGS. 21(<i>a</i>)-(<i>b</i>)</figref> depict a membership function and a fuzzy map, in one embodiment.
<figref idref="DRAWINGS">FIGS. 22(<i>a</i>)-(<i>b</i>)</figref> depict various types of fuzzy map, in one embodiment.
<figref idref="DRAWINGS">FIG. 23</figref> depicts various cross sections of a fuzzy map, in one embodiment.
<figref idref="DRAWINGS">FIG. 24</figref> depicts an application of uncertainty to a membership function, in one embodiment.
<figref idref="DRAWINGS">FIG. 25</figref> depicts various cross sections of a fuzzy map at various levels of uncertainty, in one embodiment.
<figref idref="DRAWINGS">FIG. 26(<i>a</i>)</figref> depicts coverage of fuzzy map and a membership function, in one embodiment.
<figref idref="DRAWINGS">FIG. 26(<i>b</i>)</figref> depicts coverage of fuzzy map and a membership function at a cross section of fuzzy map, in one embodiment.
<figref idref="DRAWINGS">FIGS. 27 and 28</figref>(<i>a</i>) depict application of extension principle to fuzzy maps in functional dependence, in one embodiment.
<figref idref="DRAWINGS">FIG. 28(<i>b</i>)</figref> depicts the determination of fuzzy map, in one embodiment.
<figref idref="DRAWINGS">FIG. 28(<i>c</i>)</figref> depicts the determination of fuzzy map, in one embodiment.
<figref idref="DRAWINGS">FIG. 29</figref> depicts the determination parameters of fuzzy map, e.g., close fit and coverage, in one embodiment.
<figref idref="DRAWINGS">FIGS. 30 and 31</figref> depict application of uncertainty variation to fuzzy maps and use of parametric uncertainty, in one embodiment.
<figref idref="DRAWINGS">FIG. 32</figref> depicts use of parametric uncertainty, in one embodiment.
<figref idref="DRAWINGS">FIGS. 33(<i>a</i>)-(<i>b</i>)</figref> depict laterally/horizontally fuzzied map, in one embodiment.
<figref idref="DRAWINGS">FIG. 34</figref> depicts laterally and vertically fuzzied map, in one embodiment.
<figref idref="DRAWINGS">FIG. 35(<i>a</i>)-(<i>d</i>)</figref> depict determination of a truth value in predicate of a fuzzy rule involving a fuzzy map, in one embodiment.
<figref idref="DRAWINGS">FIG. 36(<i>a</i>)</figref> shows bimodal lexicon (PNL).
<figref idref="DRAWINGS">FIG. 36(<i>b</i>)</figref> shows analogy between precisiation and modelization.
<figref idref="DRAWINGS">FIG. 37</figref> shows an application of fuzzy integer programming, which specifies a region of intersections or overlaps, as the solution region.
<figref idref="DRAWINGS">FIG. 38</figref> shows the definition of protoform of p.
<figref idref="DRAWINGS">FIG. 39</figref> shows protoforms and PF-equivalence.
<figref idref="DRAWINGS">FIG. 40</figref> shows a gain diagram for a situation where (as an example) Alan has severe back pain, with respect to the two options available to Alan.
<figref idref="DRAWINGS">FIG. 41</figref> shows the basic structure of PNL.
<figref idref="DRAWINGS">FIG. 42</figref>. shows the structure of deduction database, DDB.
<figref idref="DRAWINGS">FIG. 43</figref> shows a case in which the trustworthiness of a speaker is high (or the speaker is “trustworthy”).
<figref idref="DRAWINGS">FIG. 44</figref> shows a case in which the “sureness” of a speaker of a statement is high.
<figref idref="DRAWINGS">FIG. 45</figref> shows a case in which the degree of “helpfulness” for a statement (or information or data) is high (or the statement is “helpful”).
<figref idref="DRAWINGS">FIG. 46</figref> shows a listener which or who listens to multiple sources of information or data, cascaded or chained together, supplying information to each other.
<figref idref="DRAWINGS">FIG. 47</figref> shows a method employing fuzzy rules.
<figref idref="DRAWINGS">FIG. 48</figref> shows a system for credit card fraud detection.
<figref idref="DRAWINGS">FIG. 49</figref> shows a financial management system, relating policy, rules, fuzzy sets, and hedges (e.g. high risk, medium risk, or low risk).
<figref idref="DRAWINGS">FIG. 50</figref> shows a system for combining multiple fuzzy models.
<figref idref="DRAWINGS">FIG. 51</figref> shows a feed-forward fuzzy system.
<figref idref="DRAWINGS">FIG. 52</figref> shows a fuzzy feedback system, performing at different periods.
<figref idref="DRAWINGS">FIG. 53</figref> shows an adaptive fuzzy system,
<figref idref="DRAWINGS">FIG. 54</figref> shows a fuzzy cognitive map.
<figref idref="DRAWINGS">FIG. 55</figref> is an example of the fuzzy cognitive map for the credit card fraud relationships.
<figref idref="DRAWINGS">FIG. 56</figref> shows how to build a fuzzy model, going through iterations, to validate a model, based on some thresholds or conditions.
<figref idref="DRAWINGS">FIG. 57</figref> shows a backward chaining inference engine.
<figref idref="DRAWINGS">FIG. 58</figref> shows a procedure on a system for finding the value of a goal, to fire (or trigger or execute) a rule (based on that value) (e.g. for Rule N, from a policy containing Rules R, K, L, M, N, and G).
<figref idref="DRAWINGS">FIG. 59</figref> shows a forward chaining inference engine (system), with a pattern matching engine that matches the current data state against the predicate of each rule, to find the ones that should be executed (or fired).
<figref idref="DRAWINGS">FIG. 60</figref> shows a fuzzy system, with multiple (If . . . Then . . . ) rules.
<figref idref="DRAWINGS">FIG. 61</figref> shows a system for credit card fraud detection, using a fuzzy SQL suspect determination module, in which fuzzy predicates are used in relational database queries.
<figref idref="DRAWINGS">FIG. 62</figref> shows a method of conversion of the digitized speech into feature vectors.
<figref idref="DRAWINGS">FIG. 63</figref> shows a system for language recognition or determination, with various membership values for each language (e.g. English, French, and German).
<figref idref="DRAWINGS">FIG. 64</figref> is a system for the search engine.
<figref idref="DRAWINGS">FIG. 65</figref> is a system for the search engine.
<figref idref="DRAWINGS">FIG. 66</figref> is a system for the search engine.
<figref idref="DRAWINGS">FIG. 67</figref> is a system for the search engine.
<figref idref="DRAWINGS">FIG. 68</figref> is a system for the search engine.
<figref idref="DRAWINGS">FIG. 69</figref> is a system for the search engine.
<figref idref="DRAWINGS">FIG. 70</figref> shows the range of reliability factor or parameter, with 3 designations of Low, Medium, and High.
<figref idref="DRAWINGS">FIG. 71</figref> shows a variable strength link between two subjects, which can also be expressed in the fuzzy domain, e.g. as: very strong link, strong link, medium link, and weak link, for link strength membership function.
<figref idref="DRAWINGS">FIG. 72</figref> is a system for the search engine.
<figref idref="DRAWINGS">FIG. 73</figref> is a system for the search engine.
<figref idref="DRAWINGS">FIG. 74</figref> is a system for the search engine.
<figref idref="DRAWINGS">FIG. 75</figref> is a system for the search engine.
<figref idref="DRAWINGS">FIG. 76</figref> is a system for the search engine.
<figref idref="DRAWINGS">FIG. 77</figref> is a system for the search engine.
<figref idref="DRAWINGS">FIG. 78</figref> is a system for the search engine.
<figref idref="DRAWINGS">FIG. 79</figref> is a system for the search engine.
<figref idref="DRAWINGS">FIG. 80</figref> is a system for the search engine.
<figref idref="DRAWINGS">FIG. 81</figref> is a system for the search engine.
<figref idref="DRAWINGS">FIG. 82</figref> is a system for the search engine.
<figref idref="DRAWINGS">FIG. 83</figref> is a system for the search engine.
<figref idref="DRAWINGS">FIG. 84</figref> is a system for the search engine.
<figref idref="DRAWINGS">FIG. 85</figref> is a system for the pattern recognition and search engine.
<figref idref="DRAWINGS">FIG. 86</figref> is a system of relationships and designations for the pattern recognition and search engine.
<figref idref="DRAWINGS">FIG. 87</figref> is a system for the search engine.
<figref idref="DRAWINGS">FIG. 88</figref> is a system for the recognition and search engine.
<figref idref="DRAWINGS">FIG. 89</figref> is a system for the recognition and search engine.
<figref idref="DRAWINGS">FIG. 90</figref> is a method for the multi-step recognition and search engine.
<figref idref="DRAWINGS">FIG. 91</figref> is a method for the multi-step recognition and search engine.
<figref idref="DRAWINGS">FIG. 92</figref> is a method for the multi-step recognition and search engine.
<figref idref="DRAWINGS">FIG. 93</figref> is an expert system.
<figref idref="DRAWINGS">FIG. 94</figref> is a system for stock market.
<figref idref="DRAWINGS">FIG. 95</figref> is a system for insurance.
<figref idref="DRAWINGS">FIG. 96</figref> is a system for prediction or optimization.
<figref idref="DRAWINGS">FIG. 97</figref> is a system based on rules.
<figref idref="DRAWINGS">FIG. 98</figref> is a system for a medical equipment.
<figref idref="DRAWINGS">FIG. 99</figref> is a system for medical diagnosis.
<figref idref="DRAWINGS">FIG. 100</figref> is a system for a robot.
<figref idref="DRAWINGS">FIG. 101</figref> is a system for a car.
<figref idref="DRAWINGS">FIG. 102</figref> is a system for an autonomous vehicle.
<figref idref="DRAWINGS">FIG. 103</figref> is a system for marketing or social networks.
<figref idref="DRAWINGS">FIG. 104</figref> is a system for sound recognition.
<figref idref="DRAWINGS">FIG. 105</figref> is a system for airplane or target or object recognition.
<figref idref="DRAWINGS">FIG. 106</figref> is a system for biomettics and security.
<figref idref="DRAWINGS">FIG. 107</figref> is a system for sound or song recognition.
<figref idref="DRAWINGS">FIG. 108</figref> is a system using Z-numbers.
<figref idref="DRAWINGS">FIG. 109</figref> is a system for a search engine or a question-answer system.
<figref idref="DRAWINGS">FIG. 110</figref> is a system for a search engine.
<figref idref="DRAWINGS">FIG. 111</figref> is a system for a search engine.
<figref idref="DRAWINGS">FIG. 112</figref> is a system for the recognition and search engine.
<figref idref="DRAWINGS">FIG. 113</figref> is a system for a search engine.
<figref idref="DRAWINGS">FIG. 114</figref> is a system for the recognition and search engine.
<figref idref="DRAWINGS">FIG. 115</figref> is a system for the recognition and search engine.
<figref idref="DRAWINGS">FIG. 116</figref> is a method for the recognition engine.
<figref idref="DRAWINGS">FIG. 117</figref> is a system for the recognition or translation engine.
<figref idref="DRAWINGS">FIG. 118</figref> is a system for the recognition engine for capturing body gestures or body parts' interpretations or emotions (such as cursing or happiness or anger or congratulations statement or success or wishing good luck or twisted eye brows or blinking with only one eye or thumbs up or thumbs down).
<figref idref="DRAWINGS">FIG. 119</figref> is a system for Fuzzy Logic or Z-numbers.
<figref idref="DRAWINGS">FIG. 120(<i>a</i>)-(<i>b</i>)</figref> show objects, attributes, and values in an example illustrating an embodiment.
<figref idref="DRAWINGS">FIG. 120(<i>c</i>)</figref> shows querying based on attributes to extract generalized facts/rules/functions in an example illustrating an embodiment.
<figref idref="DRAWINGS">FIG. 120(<i>d</i>)-(<i>e</i>)</figref> show objects, attributes, and values in an example illustrating an embodiment.
<figref idref="DRAWINGS">FIG. 120(<i>f</i>)</figref> shows Z-valuation of object/record based on candidate distributions in an example illustrating an embodiment.
<figref idref="DRAWINGS">FIG. 120(<i>g</i>)</figref> shows memberships functions used in valuations related to an object/record in an example illustrating an embodiment.
<figref idref="DRAWINGS">FIG. 120(<i>h</i>)</figref> shows the aggregations of test scores for candidate distributions in an example illustrating an embodiment.
<figref idref="DRAWINGS">FIG. 121(<i>a</i>)</figref> shows ordering in a list containing fuzzy values in an example illustrating an embodiment.
<figref idref="DRAWINGS">FIG. 121(<i>b</i>)</figref> shows use of sorted lists and auxiliary queues in joining lists on the value of common attributes in an example illustrating an embodiment.
<figref idref="DRAWINGS">FIG. 122(<i>a</i>)-(<i>b</i>)</figref> show parametric fuzzy map and color/grey scale attribute in an example illustrating an embodiment.
<figref idref="DRAWINGS">FIG. 123(<i>a</i>)-(<i>b</i>)</figref> show a relationship between similarity measure and fuzzy map parameter and precision attribute in an example illustrating an embodiment.
<figref idref="DRAWINGS">FIG. 124(<i>a</i>)-(<i>b</i>)</figref> show fuzzy map, probability distribution, and the related score in an example illustrating an embodiment.
<figref idref="DRAWINGS">FIG. 125(<i>a</i>)</figref> shows crisp and fuzzy test scores for candidate probability distributions based on fuzzy map, Z-valuation, fuzzy restriction, and test score aggregation in an example illustrating an embodiment.
<figref idref="DRAWINGS">FIG. 125(<i>b</i>)</figref> shows MIN operation for test score aggregation via alphα-cuts of membership functions in an example illustrating an embodiment.
<figref idref="DRAWINGS">FIG. 126</figref> shows one embodiment for the Z-number estimator or calculator device or system.
<figref idref="DRAWINGS">FIG. 127</figref> shows one embodiment for context analyzer system.
<figref idref="DRAWINGS">FIG. 128</figref> shows one embodiment for analyzer system, with multiple applications.
<figref idref="DRAWINGS">FIG. 129</figref> shows one embodiment for intensity correction, editing, or mapping.
<figref idref="DRAWINGS">FIG. 130</figref> shows one embodiment for multiple recognizers.
<figref idref="DRAWINGS">FIG. 131</figref> shows one embodiment for multiple sub-classifiers and experts.
<figref idref="DRAWINGS">FIG. 132</figref> shows one embodiment for Z-web, its components, and multiple contexts associated with it.
<figref idref="DRAWINGS">FIG. 133</figref> shows one embodiment for classifier for head, face, and emotions.
<figref idref="DRAWINGS">FIG. 134</figref> shows one embodiment for classifier for head or face, with age and rotation parameters.
<figref idref="DRAWINGS">FIG. 135</figref> shows one embodiment for face recognizer.
<figref idref="DRAWINGS">FIG. 136</figref> shows one embodiment for modification module for faces and eigenface generator module.
<figref idref="DRAWINGS">FIG. 137</figref> shows one embodiment for modification module for faces and eigenface generator module.
<figref idref="DRAWINGS">FIG. 138</figref> shows one embodiment for face recognizer.
<figref idref="DRAWINGS">FIG. 139</figref> shows one embodiment for Z-web.
<figref idref="DRAWINGS">FIG. 140</figref> shows one embodiment for classifier for accessories.
<figref idref="DRAWINGS">FIG. 141</figref> shows one embodiment for tilt correction.
<figref idref="DRAWINGS">FIG. 142</figref> shows one embodiment for context analyzer.
<figref idref="DRAWINGS">FIG. 143</figref> shows one embodiment for recognizer for partially hidden objects.
<figref idref="DRAWINGS">FIG. 144</figref> shows one embodiment for Z-web.
<figref idref="DRAWINGS">FIG. 145</figref> shows one embodiment for Z-web.
<figref idref="DRAWINGS">FIG. 146</figref> shows one embodiment for perspective analysis.
<figref idref="DRAWINGS">FIG. 147</figref> shows one embodiment for Z-web, for recollection.
<figref idref="DRAWINGS">FIG. 148</figref> shows one embodiment for Z-web and context analysis,
<figref idref="DRAWINGS">FIG. 149</figref> shows one embodiment for feature and data extraction.
<figref idref="DRAWINGS">FIG. 150</figref> shows one embodiment for Z-web processing.
<figref idref="DRAWINGS">FIG. 151</figref> shows one embodiment for Z-web and Z-factors.
<figref idref="DRAWINGS">FIG. 152</figref> shows one embodiment for Z-web analysis.
<figref idref="DRAWINGS">FIG. 153</figref> shows one embodiment for face recognition integrated with email and video conferencing systems.
<figref idref="DRAWINGS">FIG. 154</figref> shows one embodiment for editing image for advertising.
<figref idref="DRAWINGS">FIG. 155</figref> shows one embodiment for Z-web and emotion determination.
<figref idref="DRAWINGS">FIG. 156</figref> shows one embodiment for Z-web and food or health analyzer.
<figref idref="DRAWINGS">FIG. 157</figref> shows one embodiment for a backward chaining inference engine.
<figref idref="DRAWINGS">FIG. 158</figref> shows one embodiment for a backward chaining flow chart.
<figref idref="DRAWINGS">FIG. 159</figref> shows one embodiment for a forward chaining inference engine.
<figref idref="DRAWINGS">FIG. 160</figref> shows one embodiment for a fuzzy reasoning inference engine.
<figref idref="DRAWINGS">FIG. 161</figref> shows one embodiment for a decision tree method or system.
<figref idref="DRAWINGS">FIG. 162</figref> shows one embodiment for a fuzzy controller.
<figref idref="DRAWINGS">FIG. 163</figref> shows one embodiment for an expert system.
<figref idref="DRAWINGS">FIG. 164</figref> shows one embodiment for determining relationship and distances in images.
<figref idref="DRAWINGS">FIG. 165</figref> shows one embodiment for multiple memory unit storage.
<figref idref="DRAWINGS">FIG. 166</figref> shows one embodiment for pattern recognition.
<figref idref="DRAWINGS">FIG. 167</figref> shows one embodiment for recognition and storage.
<figref idref="DRAWINGS">FIG. 168</figref> shows one embodiment for elastic model.
<figref idref="DRAWINGS">FIG. 169</figref> shows one embodiment for set of basis functions or filters or eigenvectors.
<figref idref="DRAWINGS">FIG. 170</figref> shows one embodiment for an eye model for basis object.
<figref idref="DRAWINGS">FIG. 171</figref> shows one embodiment for a recognition system.
<figref idref="DRAWINGS">FIG. 172</figref> shows one embodiment for a Z-web.
<figref idref="DRAWINGS">FIG. 173</figref> shows one embodiment for a Z-web analysis.
<figref idref="DRAWINGS">FIG. 174</figref> shows one embodiment for a Z-web analysis.
<figref idref="DRAWINGS">FIG. 175</figref> shows one embodiment for a search engine.
<figref idref="DRAWINGS">FIG. 176</figref> shows one embodiment for multiple type transformation.
<figref idref="DRAWINGS">FIG. 177</figref> shows one embodiment for 2 face models for analysis or storage.
<figref idref="DRAWINGS">FIG. 178</figref> shows one embodiment for set of basis functions.
<figref idref="DRAWINGS">FIG. 179</figref> shows one embodiment for windows for calculation of “integral image”, for sum of pixels, for any given initial image, as an intermediate step for our process.
<figref idref="DRAWINGS">FIG. 180</figref> shows one embodiment for an illustration of restricted Boltzmann machine.
<figref idref="DRAWINGS">FIG. 181</figref> shows one embodiment for three-level RBM.
<figref idref="DRAWINGS">FIG. 182</figref> shows one embodiment for stacked RBMs.
<figref idref="DRAWINGS">FIG. 183</figref> shows one embodiment for added weights between visible units in an RBM.
<figref idref="DRAWINGS">FIG. 184</figref> shows one embodiment for a deep auto-encoder.
<figref idref="DRAWINGS">FIG. 185</figref> shows one embodiment for correlation of labels with learned features.
<figref idref="DRAWINGS">FIG. 186</figref> shows one embodiment for degree of correlation or conformity from a network.
<figref idref="DRAWINGS">FIG. 187</figref> shows one embodiment for sample/label generator from model, used for training.
<figref idref="DRAWINGS">FIG. 188</figref> shows one embodiment for classifier with multiple label layers for different models.
<figref idref="DRAWINGS">FIG. 189</figref> shows one embodiment for correlation of position with features detected by the network.
<figref idref="DRAWINGS">FIG. 190</figref> shows one embodiment for inter-layer fan-out links.
<figref idref="DRAWINGS">FIG. 191</figref> shows one embodiment for selecting and mixing expert classifiers/feature detectors.
<figref idref="DRAWINGS">FIGS. 192<i>a</i>-<i>b </i></figref>show one embodiment for non-uniform segmentation of data.
<figref idref="DRAWINGS">FIGS. 193<i>a</i>-<i>b </i></figref>show one embodiment for non-uniform radial segmentation of data.
<figref idref="DRAWINGS">FIGS. 194<i>a</i>-<i>b </i></figref>show one embodiment for non-uniform segmentation in vertical and horizontal directions.
<figref idref="DRAWINGS">FIGS. 195<i>a</i>-<i>b </i></figref>show one embodiment for non-uniform transformed segmentation of data.
<figref idref="DRAWINGS">FIG. 196</figref> shows one embodiment for clamping mask data to a network.
<figref idref="DRAWINGS">FIGS. 197</figref><i>a, b, c </i>show one embodiment for clamping thumbnail size data to network.
<figref idref="DRAWINGS">FIG. 198</figref> shows one embodiment for search for correlating objects and concepts.
<figref idref="DRAWINGS">FIGS. 199<i>a</i>-<i>b </i></figref>show one embodiment for variable field of focus, with varying resolution.
<figref idref="DRAWINGS">FIG. 200</figref> shows one embodiment for learning via partially or mixed labeled training sets.
<figref idref="DRAWINGS">FIG. 201</figref> shows one embodiment for learning correlations between labels for auto-annotation.
<figref idref="DRAWINGS">FIG. 202</figref> shows one embodiment for correlation between blocking and blocked features, using labels.
<figref idref="DRAWINGS">FIG. 203</figref> shows one embodiment for indexing on search system.
<figref idref="DRAWINGS">FIGS. 204<i>a</i>-<i>b </i></figref>show one embodiment for (a) factored weights in higher order Boltzmann machine, and (b) CRBM for detection and learning from data series.
<figref idref="DRAWINGS">FIGS. 205</figref><i>a, b, c </i>show one embodiment for (a) variable frame size with CRBM, mapping to a previous frame, and (c) mapping from a previous frame to a dynamic mean.
<figref idref="DRAWINGS">FIG. 206</figref> shows an embodiment for Z web.
<figref idref="DRAWINGS">FIG. 207</figref> shows an embodiment for Z web.
<figref idref="DRAWINGS">FIG. 208</figref> shows an embodiment for video capture.
<figref idref="DRAWINGS">FIG. 209</figref> shows an embodiment for video capture.
<figref idref="DRAWINGS">FIG. 210</figref> shows an embodiment for image relations.
<figref idref="DRAWINGS">FIG. 211</figref> shows an embodiment for entities.
<figref idref="DRAWINGS">FIG. 212</figref> shows an embodiment for matching.
<figref idref="DRAWINGS">FIG. 213</figref> shows an embodiment for URI, and plug-in.
<figref idref="DRAWINGS">FIG. 214</figref> shows an embodiment for image features.
<figref idref="DRAWINGS">FIG. 215</figref> shows an embodiment for analytics.
<figref idref="DRAWINGS">FIG. 216</figref> shows an embodiment for analytics.
<figref idref="DRAWINGS">FIG. 217</figref> shows an embodiment for analytics.
<figref idref="DRAWINGS">FIG. 218</figref> shows an embodiment for search.
<figref idref="DRAWINGS">FIG. 219</figref> shows an embodiment for search.
<figref idref="DRAWINGS">FIG. 220</figref> shows an embodiment for image features.
<figref idref="DRAWINGS">FIG. 221</figref> shows an embodiment for image features.
<figref idref="DRAWINGS">FIG. 222</figref> shows an embodiment for image features.
<figref idref="DRAWINGS">FIG. 223</figref> shows an embodiment for image features.
<figref idref="DRAWINGS">FIG. 224</figref> shows an embodiment for correlation layer.
<figref idref="DRAWINGS">FIG. 225<i>a</i></figref>-b show an embodiment for individualized correlators.
<figref idref="DRAWINGS">FIG. 226</figref> shows an embodiment for correlation layer.
<figref idref="DRAWINGS">FIG. 227</figref> shows an embodiment for video.
<figref idref="DRAWINGS">FIG. 228</figref> shows an embodiment for video.
<figref idref="DRAWINGS">FIG. 229</figref> shows an embodiment for movie.
<figref idref="DRAWINGS">FIG. 230</figref> shows an embodiment for social network.
<figref idref="DRAWINGS">FIG. 231</figref> shows an embodiment for feature space.
<figref idref="DRAWINGS">FIG. 232</figref> shows an embodiment for correlator.
<figref idref="DRAWINGS">FIG. 233</figref> shows an embodiment for relations.
<figref idref="DRAWINGS">FIG. 234</figref> shows an embodiment for events.
<figref idref="DRAWINGS">FIG. 235</figref> shows an embodiment for dating.
<figref idref="DRAWINGS">FIG. 236</figref> shows an embodiment for annotation.
<figref idref="DRAWINGS">FIG. 237</figref> shows an embodiment for catalog.
<figref idref="DRAWINGS">FIG. 238</figref> shows an embodiment for image analyzer.
<figref idref="DRAWINGS">FIG. 239</figref> shows an embodiment for “see and shop”.
<figref idref="DRAWINGS">FIG. 240</figref> shows an embodiment for “see and shop”.
<figref idref="DRAWINGS">FIG. 241</figref> shows an embodiment for “see and shop”.
<figref idref="DRAWINGS">FIG. 242</figref> shows an embodiment for “see and shop”.
<figref idref="DRAWINGS">FIG. 243<i>a</i>-<i>e </i></figref>show an embodiment for app and browser.
<figref idref="DRAWINGS">FIG. 244</figref> shows an embodiment for “see and shop”.
<figref idref="DRAWINGS">FIG. 245</figref> shows an embodiment for image analyzer.
<figref idref="DRAWINGS">FIG. 246</figref> shows an embodiment for image analyzer.
<figref idref="DRAWINGS">FIG. 247</figref> shows an embodiment for image analyzer.
<figref idref="DRAWINGS">FIG. 248</figref> shows an embodiment for image network.
<figref idref="DRAWINGS">FIG. 249</figref> shows an embodiment for “see and shop”.
<figref idref="DRAWINGS">FIG. 250</figref> shows an embodiment for “see and shop”.
<figref idref="DRAWINGS">FIG. 251</figref> shows an embodiment for “see and shop”.
<figref idref="DRAWINGS">FIG. 252</figref> shows an embodiment for “see and shop”.
<figref idref="DRAWINGS">FIG. 253</figref> shows an embodiment for “see and shop”.
<figref idref="DRAWINGS">FIG. 254</figref> shows an embodiment for leverage model of data points at the margin.
<figref idref="DRAWINGS">FIG. 255</figref> shows an embodiment for balancing torques at pivot point q with leverage projected on IV Ŵ<sub>⊥</sub>.
<figref idref="DRAWINGS">FIG. 256</figref> shows an embodiment for projection of x<sub>i </sub>on Ŵ<sub>∥</sub>.
<figref idref="DRAWINGS">FIG. 257</figref> shows an embodiment for tilt in Ŵ<sub>∥</sub>.
<figref idref="DRAWINGS">FIG. 258</figref> shows an embodiment for reduction of slack error by tilting Ê<sub>∥</sub> based on center of masses of data points that violate the margin (shown in darker color).
<figref idref="DRAWINGS">FIG. 259</figref> shows an embodiment for limiting the tilt based on data obtained in projection scan along Ŵ<sub>∥</sub>.
<figref idref="DRAWINGS">FIG. 260</figref> shows an embodiment for image analysis.
<figref idref="DRAWINGS">FIG. 261</figref> shows an embodiment for different configurations.
<figref idref="DRAWINGS">FIG. 262</figref> shows an embodiment for image analysis.
<figref idref="DRAWINGS">FIG. 263</figref> shows an embodiment for image analysis.
<figref idref="DRAWINGS">FIG. 264</figref> shows an embodiment for image analysis.
<figref idref="DRAWINGS">FIG. 265</figref> shows an embodiment for image analysis.
<figref idref="DRAWINGS">FIG. 266</figref> shows an embodiment for circuit implementation.
<figref idref="DRAWINGS">FIG. 267</figref> shows an embodiment for feature detection.
<figref idref="DRAWINGS">FIG. 268</figref> shows an embodiment for robots for self-repair, cross-diagnosis, and cross-repair. It can include temperature sensors for failure detections, current or voltage or power measurements and meters for calibrations, drifts, and failures detections/corrections/adjustments, microwave or wave analysis and detection, e.g., frequency, for failures detections/corrections/adjustments, and the like. It can use AI for pattern recognition to detect or predict the failures on software and hardware sides or virus detection or hacking detection. It can talk to another/sister robot to fix or diagnose each other or verify or collaborate with each other, with data and commands.
<figref idref="DRAWINGS">FIG. 269</figref> shows an example of state-of-the-art learning system by others, in industry or academia, to show their limitations, e.g., for frozen/fixed weights and biases, after the training phase.
<figref idref="DRAWINGS">FIG. 270</figref> shows an example of state-of-the-art learning system by others, in industry or academia, to show their limitations, e.g., for frozen/fixed weights and biases, after the training phase.
<figref idref="DRAWINGS">FIG. 271</figref> shows an embodiment for ZAC Learning and Recognition Platform, using Inference Layer, Reasoning Layer, and Cognition Laver, recursively, for our General-AI method, with dynamic and changing parameters in the learning machine (in contrast to the machines by others), which enables the Simultaneous/Continuous Learning and Recognition Process (as we call it “SCLRP”), similar to humans. This is a major shift in learning technology/science/process, with a quantum leap improvement, which means that there is no need to re-train from scratch, or erase the whole learning machine weights and biases to re-train the system with the new objects/classes (in contrast to the machines by others), similar to humans. (The details of components are shown and described elsewhere in this disclosure.)
<figref idref="DRAWINGS">FIG. 272</figref> shows an embodiment for ZAC Learning and Recognition Platform, using Inference Layer, Reasoning Layer, and Cognition Laver, for our General-AI method, with knowledge base and cumulative learning, for new classes of objects, with interaction with multiple (C) modules (e.g., 3), which is scalable, with detailed learning, with each module learning a feature specific to/specialized for that module.
<figref idref="DRAWINGS">FIG. 273</figref> shows an embodiment for ZAC Learning and Recognition Platform, using Inference Layer, Reasoning Layer, and Cognition Layer, for our General-AI method, with the details, including Inference engine, Reasoning engine, and Cognition engine, and their corresponding databases for storage/updates.
<figref idref="DRAWINGS">FIG. 274</figref> shows an embodiment for ZAC Learning and Recognition Platform, using Inference engine, with an example of how it works, for our General-AI method.
<figref idref="DRAWINGS">FIG. 275</figref> shows an embodiment for ZAC Learning and Recognition Platform, using Reasoning engine and Cognition engine, with an example of how it works, for our General-AI method.
<figref idref="DRAWINGS">FIG. 276</figref> shoes an embodiment for ZAC Learning and Recognition Platform, using expressions used for modules, e.g., based on logical expressions, e.g., for Inference engine, Reasoning engine, and Cognition engine, for our General-AI method.
<figref idref="DRAWINGS">FIG. 277</figref> shows an embodiment for ZAC Learning and Recognition Platform, using Inference engine, Reasoning engine, and Cognition engine, with a controller and a central processor, for our General-AI method.
<figref idref="DRAWINGS">FIG. 278</figref> shows an embodiment for ZAC Learning and Recognition Platform, for our General-AI method, working with the stratification module and Z-Web, e.g., for image recognition, e.g., of 3-D objects, from any direction, in 3-D, e.g., shoes.
<figref idref="DRAWINGS">FIG. 279</figref> shows an embodiment for ZAC Learning and Recognition Platform, for our General-AI method, working with the Information Principle module and Z-Web, e.g., for image recognition.
<figref idref="DRAWINGS">FIG. 280</figref> shows an embodiment for ZAC Learning and Recognition Platform, for our General-AI method, working with the Information module and Z-Web, e.g., for image recognition.
<figref idref="DRAWINGS">FIG. 281</figref> shows an embodiment/example for Restriction, used for Information Principle module.
<figref idref="DRAWINGS">FIG. 282</figref> shows an embodiment for ZAC Learning and Recognition Platform, for our General-AI method, working with the Information module and Z-Web, e.g., for image recognition.
<figref idref="DRAWINGS">FIG. 283</figref> shows an embodiment for redundancies on both system and components-level, for a system, so that if any part is disconnected/failed/replaced for repair, the other system or component will take over, so that there will be no interruptions in the circuit/system/operation/software performance, used for diagnosis and repair procedures, e.g., for robots or AI systems.
<figref idref="DRAWINGS">FIG. 284</figref> shows an embodiment for various applications and vertical usages for our/ZAC General-AI platform.
<figref idref="DRAWINGS">FIG. 285</figref> shows an embodiment for cognition layer for complex combined data for our/ZAC General-AI platform.
<figref idref="DRAWINGS">FIG. 286</figref> shows an embodiment for cognition layer for complex combined data for our/ZAC General-AI platform.
<figref idref="DRAWINGS">FIG. 287</figref> shows an embodiment for cognition layer for complex combined data for our/ZAC General-AI platform.
<figref idref="DRAWINGS">FIG. 288</figref> shows an embodiment for cognition layer for complex combined data for our/ZAC Explainable-AI system and its components/modules/devices, as one type or example for such a system.
<figref idref="DRAWINGS">FIG. 289</figref> shows an embodiment for our/ZAC AI Platform/system and its components/modules/devices, as one type or example.
<figref idref="DRAWINGS">FIG. 290</figref> shows an embodiment for our/ZAC cross-domain system and its components/modules/devices, as one type or example.
<figref idref="DRAWINGS">FIG. 291</figref> shows an embodiment for our/ZAC generalization system and its components/modules/devices, as one type or example.
<figref idref="DRAWINGS">FIG. 292</figref> shows an embodiment for our/ZAC generalization/abstraction system and its components/modules/devices, as one type or example.
<figref idref="DRAWINGS">FIG. 293</figref> shows an embodiment for our/ZAC intelligent tracking system and its components/modules/devices, as one type or example.
<figref idref="DRAWINGS">FIG. 294</figref> shows an embodiment for cognition layer for complex combined data for our/ZAC Explainable-AI system and its components/modules/devices, as one type or example for such a system.
<figref idref="DRAWINGS">FIG. 295</figref> shows an embodiment for cognition layer for complex combined data for our/ZAC Explainable-AI system and its components/modules/devices, as one type or example for such a system.
<figref idref="DRAWINGS">FIG. 296</figref> shows an embodiment for cognition layer for complex combined data for our/ZAC Explainable-AI system and its components/modules/devices, as one type or example for such a system.
<figref idref="DRAWINGS">FIG. 297</figref> shows an embodiment for cognition layer for complex hybrid data for our/ZAC Explainable-AI system and its components/modules/devices, as one type or example for such a system.
DETAILED DESCRIPTION OF THE EMBODIMENTS
This disclosure has many embodiments, systems, methods, algorithms, inventions, vertical applications, usages, topics, functions, variations, and examples. We divided them into sections for ease of reading, but they are all related and can be combined as one system, or as combination of subsystems and modules, in any combinations or just alone. We start here with the embodiment Z-number, and other inventions/embodiments will follow below after this section.
Z-Numbers:
A Z-number is an ordered pair of fuzzy numbers, (A, B). For simplicity, in one embodiment, A and B are assumed to be trapezoidal fuzzy numbers. A Z-number is associated with a real-valued uncertain variable, X, with the first component, A, playing the role of a fuzzy restriction, R(X), on the values which X can take, written as X is A, where A is a fuzzy set. What should be noted is that, strictly speaking, the concept of a restriction has greater generality than the concept of a constraint. A probability distribution is a restriction but is not a constraint (see L. A. Zadeh, Calculus of fuzzy restrictions. In: L. A. Zadeh, K. S. Fu, K. Tanaka, and M. Shimura (Eds.), Fuzzy sets and Their Applications to Cognitive and Decision Processes, Academic Press, N.Y., 1975, pp. 1-39). A restriction may be viewed as a generalized constraint (see L. A. Zadeh, Generalized theory of uncertainty (GTU)—principal concepts and ideas, Computational Statistics &. Data Analysis 51, (2006) 15-46). In this embodiment only, the terms restriction and constraint are used interchangeably.
The restriction
R(X): X is A,
is referred to as a possibilistic restriction (constraint), with A playing the role of the possibility distribution of X. More specifically,
<br /><i>R</i>(<i>X</i>): <i>X </i>is <i>A</i>→Poss(<i>X=u</i>)=μ<sub>A</sub>(<i>u</i>)
where μ<sub>A </sub>is the membership function of A, and u is a generic value of X. μ<sub>A </sub>may be viewed as a constraint which is associated with R(X), meaning that μ<sub>A</sub>(u) is the degree to which u satisfies the constraint.
When X is a random variable, the probability distribution of X plays the role of a probabilistic restriction on X. A probabilistic restriction is expressed as:
R(X): X isp p
where p is the probability density function of X. In this case,
<br /><i>R</i>(<i>X</i>): <i>X </i>isp <i>p</i>→Prob(<i>u≤X≤u+du</i>)=<i>p</i>(<i>u</i>)<i>du </i>
Note Generally, the term “restriction” applies to X is R. Occasionally, “restriction” applies to R. Context serves to disambiguate the meaning of “restriction.”
The ordered triple (X,A, B) is referred to as a Z-valuation. A Z-valuation is equivalent to an assignment statement, X is (A, B). X is an uncertain variable if A is not a singleton. In a related way, uncertain computation is a system of computation in which the objects of computation are not values of variables but restrictions on values of variables. In this embodiment/section, unless stated to the contrary, X is assumed to be a random variable. For convenience, A is referred to as a value of X, with the understanding that, strictly speaking, A is not a value of X but a restriction on the values which X can take. The second component, B, is referred to as certainty. Certainty concept is related to other concepts, such as sureness, confidence, reliability, strength of belief, probability, possibility, etc. However, there are some differences between these concepts.
In one embodiment, when X is a random variable, certainty may be equated to probability. Informally, B may be interpreted as a response to the question: How sure are you that X is A? Typically, A and B are perception-based and are described in a natural language. Example: (about 45 minutes, usually.) A collection of Z-valuations is referred to as Z-information. It should he noted that much of everyday reasoning and decision-making is based, in effect, on Z-information. For purposes of computation. when A and B are described in a natural language, the meaning of A and B is precisiated (graduated) through association with membership functions, μ<sub>A </sub>and μ<sub>B</sub>, respectively, <figref idref="DRAWINGS">FIG. 1</figref>.
The membership function of A, μ<sub>A</sub>, may be elicited by asking a succession of questions of the form: To what degree does the number, a, fit your perception of A? Example: To what degree does 50 minutes fit your perception of about 45 minutes? The same applies to B. The fuzzy set, A, may be interpreted as the possibility distribution of X. The concept of a Z-number may be generalized in various ways. In particular, X may be assumed to take values in R<sup>n</sup>, in which case A is a Cartesian product of fuzzy numbers. Simple examples of Z-valuations are:
(anticipated budget deficit, close to 2 million dollars, very likely)
(population of Spain, about 45 million, quite sure)
(degree of Robert's honesty, very high. absolutely)
(degree of Robert's honesty, high, not sure)
(travel time by car from Berkeley to San Francisco, about 30 minutes, usually)
(price of oil in the near future, significantly over 100 dollars/barrel, very likely)
It is important to note that many propositions in a natural language are expressible as Z-valuations. Example: The proposition, p,
p: Usually, it takes Robert about an hour to get home from work,
is expressible as a Z-valuation:
(Robert's travel time from office to home, about one hour, usually)
If X is a random variable, then X is A represents a fuzzy event in R, the real line. The probability of this event, p, may be expressed as (see L. A. Zadeh, Probability measures of fuzzy events, Journal of Mathematical Analysis and Applications 23 (2), (1968) 421-427.):
<maths id="MATH-US-00001" num="00001"><math overflow="scroll"><mrow><mrow><mi>p</mi><mo>=</mo><mrow><munder><mo>∫</mo><mi>R</mi></munder><mo></mo><mrow><mrow><msub><mi>μ</mi><mi>A</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow></mrow><mo>,</mo></mrow></math></maths><img file="US2022121884A1_D0001.tif" /><img file="US2022121884A1_D0002.tif" /><img file="US2022121884A1_D0003.tif" /><img file="US2022121884A1_D0004.tif" /><img file="US2022121884A1_D0005.tif" /><img file="US2022121884A1_D0006.tif" /><img file="US2022121884A1_D0007.tif" /><img file="US2022121884A1_D0008.tif" /><img file="US2022121884A1_D0009.tif" /><img file="US2022121884A1_D0010.tif" /><img file="US2022121884A1_D0011.tif" /><img file="US2022121884A1_D0012.tif" /><img file="US2022121884A1_D0013.tif" /><img file="US2022121884A1_D0014.tif" /><img file="US2022121884A1_D0015.tif" /><img file="US2022121884A1_D0016.tif" /><img file="US2022121884A1_D0017.tif" /><img file="US2022121884A1_D0018.tif" /><img file="US2022121884A1_D0019.tif" /><img file="US2022121884A1_D0020.tif" /><img file="US2022121884A1_D0021.tif" /><img file="US2022121884A1_D0022.tif" /><img file="US2022121884A1_D0023.tif" /><img file="US2022121884A1_D0024.tif" /><img file="US2022121884A1_D0025.tif" /><img file="US2022121884A1_D0026.tif" /><img file="US2022121884A1_D0027.tif" /><img file="US2022121884A1_D0028.tif" /><img file="US2022121884A1_D0029.tif" /><img file="US2022121884A1_D0030.tif" /><img file="US2022121884A1_D0031.tif" /><img file="US2022121884A1_D0032.tif" /><img file="US2022121884A1_D0033.tif" /><img file="US2022121884A1_D0034.tif" /><img file="US2022121884A1_D0035.tif" /><img file="US2022121884A1_D0036.tif" /><img file="US2022121884A1_D0037.tif" /><img file="US2022121884A1_D0038.tif" /><img file="US2022121884A1_D0039.tif" /><img file="US2022121884A1_D0040.tif" /><img file="US2022121884A1_D0041.tif" /><img file="US2022121884A1_D0042.tif" /><img file="US2022121884A1_D0043.tif" /><img file="US2022121884A1_D0044.tif" /><img file="US2022121884A1_D0045.tif" /><img file="US2022121884A1_D0046.tif" /><img file="US2022121884A1_D0047.tif" /><img file="US2022121884A1_D0048.tif" /><img file="US2022121884A1_D0049.tif" /><img file="US2022121884A1_D0050.tif" /><img file="US2022121884A1_D0051.tif" /><img file="US2022121884A1_D0052.tif" /><img file="US2022121884A1_D0053.tif" /><img file="US2022121884A1_D0054.tif" /><img file="US2022121884A1_D0055.tif" /><img file="US2022121884A1_D0056.tif" /><img file="US2022121884A1_D0057.tif" /><img file="US2022121884A1_D0058.tif" /><img file="US2022121884A1_D0059.tif" /><img file="US2022121884A1_D0060.tif" /><img file="US2022121884A1_D0061.tif" /><img file="US2022121884A1_D0062.tif" /><img file="US2022121884A1_D0063.tif" /><img file="US2022121884A1_D0064.tif" /><img file="US2022121884A1_D0065.tif" /><img file="US2022121884A1_D0066.tif" /><img file="US2022121884A1_D0067.tif" /><img file="US2022121884A1_D0068.tif" /><img file="US2022121884A1_D0069.tif" /><img file="US2022121884A1_D0070.tif" /><img file="US2022121884A1_D0071.tif" /><img file="US2022121884A1_D0072.tif" /><img file="US2022121884A1_D0073.tif" /><img file="US2022121884A1_D0074.tif" /><img file="US2022121884A1_D0075.tif" /><img file="US2022121884A1_D0076.tif" /><img file="US2022121884A1_D0077.tif" /><img file="US2022121884A1_D0078.tif" /><img file="US2022121884A1_D0079.tif" /><img file="US2022121884A1_D0080.tif" /><img file="US2022121884A1_D0081.tif" /><img file="US2022121884A1_D0082.tif" /><img file="US2022121884A1_D0083.tif" /><img file="US2022121884A1_D0084.tif" /><img file="US2022121884A1_D0085.tif" /><img file="US2022121884A1_D0086.tif" /><img file="US2022121884A1_D0087.tif" /><img file="US2022121884A1_D0088.tif" /><img file="US2022121884A1_D0089.tif" /><img file="US2022121884A1_D0090.tif" /><img file="US2022121884A1_D0091.tif" /><img file="US2022121884A1_D0092.tif" /><img file="US2022121884A1_D0093.tif" /><img file="US2022121884A1_D0094.tif" /><img file="US2022121884A1_D0095.tif" /><img file="US2022121884A1_D0096.tif" /><img file="US2022121884A1_D0097.tif" /><img file="US2022121884A1_D0098.tif" /><img file="US2022121884A1_D0099.tif" /><img file="US2022121884A1_D0100.tif" /><img file="US2022121884A1_D0101.tif" /><img file="US2022121884A1_D0102.tif" /><img file="US2022121884A1_D0103.tif" /><img file="US2022121884A1_D0104.tif" /><img file="US2022121884A1_D0105.tif" /><img file="US2022121884A1_D0106.tif" /><img file="US2022121884A1_D0107.tif" /><img file="US2022121884A1_D0108.tif" /><img file="US2022121884A1_D0109.tif" /><img file="US2022121884A1_D0110.tif" /><img file="US2022121884A1_D0111.tif" /><img file="US2022121884A1_D0112.tif" />
where p<sub>X </sub>is the underlying (hidden) probability density of X. In effect, the Z-valuation (X,A, B) may be viewed as a restriction (generalized constraint) on X defined by:
Prob(X is A) is B.
What should be underscored is that in a Z-number, (A, B), the underlying probability distribution, p<sub>X</sub>, is not known. What is known is a restriction on p<sub>X </sub>which may be expressed as:
<maths id="MATH-US-00002" num="00002"><math overflow="scroll"><mrow><munder><mo>∫</mo><mi>R</mi></munder><mo></mo><mrow><msub><mi>μ</mi><mi>A</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow><mo></mo><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>is</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>B</mi></mrow></mrow></math></maths><img file="US2022121884A1_D0113.tif" /><img file="US2022121884A1_D0114.tif" /><img file="US2022121884A1_D0115.tif" /><img file="US2022121884A1_D0116.tif" /><img file="US2022121884A1_D0117.tif" /><img file="US2022121884A1_D0118.tif" /><img file="US2022121884A1_D0119.tif" /><img file="US2022121884A1_D0120.tif" /><img file="US2022121884A1_D0121.tif" /><img file="US2022121884A1_D0122.tif" /><img file="US2022121884A1_D0123.tif" /><img file="US2022121884A1_D0124.tif" /><img file="US2022121884A1_D0125.tif" /><img file="US2022121884A1_D0126.tif" /><img file="US2022121884A1_D0127.tif" /><img file="US2022121884A1_D0128.tif" /><img file="US2022121884A1_D0129.tif" /><img file="US2022121884A1_D0130.tif" /><img file="US2022121884A1_D0131.tif" /><img file="US2022121884A1_D0132.tif" /><img file="US2022121884A1_D0133.tif" /><img file="US2022121884A1_D0134.tif" /><img file="US2022121884A1_D0135.tif" /><img file="US2022121884A1_D0136.tif" /><img file="US2022121884A1_D0137.tif" /><img file="US2022121884A1_D0138.tif" /><img file="US2022121884A1_D0139.tif" /><img file="US2022121884A1_D0140.tif" /><img file="US2022121884A1_D0141.tif" /><img file="US2022121884A1_D0142.tif" /><img file="US2022121884A1_D0143.tif" /><img file="US2022121884A1_D0144.tif" /><img file="US2022121884A1_D0145.tif" /><img file="US2022121884A1_D0146.tif" /><img file="US2022121884A1_D0147.tif" /><img file="US2022121884A1_D0148.tif" /><img file="US2022121884A1_D0149.tif" /><img file="US2022121884A1_D0150.tif" /><img file="US2022121884A1_D0151.tif" /><img file="US2022121884A1_D0152.tif" /><img file="US2022121884A1_D0153.tif" /><img file="US2022121884A1_D0154.tif" /><img file="US2022121884A1_D0155.tif" /><img file="US2022121884A1_D0156.tif" /><img file="US2022121884A1_D0157.tif" /><img file="US2022121884A1_D0158.tif" /><img file="US2022121884A1_D0159.tif" /><img file="US2022121884A1_D0160.tif" /><img file="US2022121884A1_D0161.tif" /><img file="US2022121884A1_D0162.tif" /><img file="US2022121884A1_D0163.tif" /><img file="US2022121884A1_D0164.tif" /><img file="US2022121884A1_D0165.tif" /><img file="US2022121884A1_D0166.tif" /><img file="US2022121884A1_D0167.tif" /><img file="US2022121884A1_D0168.tif" /><img file="US2022121884A1_D0169.tif" /><img file="US2022121884A1_D0170.tif" /><img file="US2022121884A1_D0171.tif" /><img file="US2022121884A1_D0172.tif" /><img file="US2022121884A1_D0173.tif" /><img file="US2022121884A1_D0174.tif" /><img file="US2022121884A1_D0175.tif" /><img file="US2022121884A1_D0176.tif" /><img file="US2022121884A1_D0177.tif" /><img file="US2022121884A1_D0178.tif" /><img file="US2022121884A1_D0179.tif" /><img file="US2022121884A1_D0180.tif" /><img file="US2022121884A1_D0181.tif" /><img file="US2022121884A1_D0182.tif" /><img file="US2022121884A1_D0183.tif" /><img file="US2022121884A1_D0184.tif" /><img file="US2022121884A1_D0185.tif" /><img file="US2022121884A1_D0186.tif" /><img file="US2022121884A1_D0187.tif" /><img file="US2022121884A1_D0188.tif" /><img file="US2022121884A1_D0189.tif" /><img file="US2022121884A1_D0190.tif" /><img file="US2022121884A1_D0191.tif" /><img file="US2022121884A1_D0192.tif" /><img file="US2022121884A1_D0193.tif" /><img file="US2022121884A1_D0194.tif" /><img file="US2022121884A1_D0195.tif" /><img file="US2022121884A1_D0196.tif" /><img file="US2022121884A1_D0197.tif" /><img file="US2022121884A1_D0198.tif" /><img file="US2022121884A1_D0199.tif" /><img file="US2022121884A1_D0200.tif" /><img file="US2022121884A1_D0201.tif" /><img file="US2022121884A1_D0202.tif" /><img file="US2022121884A1_D0203.tif" /><img file="US2022121884A1_D0204.tif" /><img file="US2022121884A1_D0205.tif" /><img file="US2022121884A1_D0206.tif" /><img file="US2022121884A1_D0207.tif" /><img file="US2022121884A1_D0208.tif" /><img file="US2022121884A1_D0209.tif" /><img file="US2022121884A1_D0210.tif" /><img file="US2022121884A1_D0211.tif" /><img file="US2022121884A1_D0212.tif" /><img file="US2022121884A1_D0213.tif" /><img file="US2022121884A1_D0214.tif" /><img file="US2022121884A1_D0215.tif" /><img file="US2022121884A1_D0216.tif" /><img file="US2022121884A1_D0217.tif" /><img file="US2022121884A1_D0218.tif" /><img file="US2022121884A1_D0219.tif" /><img file="US2022121884A1_D0220.tif" /><img file="US2022121884A1_D0221.tif" /><img file="US2022121884A1_D0222.tif" /><img file="US2022121884A1_D0223.tif" /><img file="US2022121884A1_D0224.tif" />
Note: In this embodiment only, the term “probability distribution” is not used in its strict technical sense.
In effect, a Z-number may be viewed as a summary of p<sub>X</sub>. It is important to note that in everyday decision-making, most decisions are based on summaries of information. Viewing a Z-number as a summary is consistent with this reality. In applications to decision analysis, a basic problem which arises relates to ranking of Z-numbers. Example: is (approximately 100, likely) greater than (approximately 90, very likely)? Is this a meaningful question? We are going to address these questions below.
An immediate consequence of the relation between p<sub>X </sub>and B is the following. If Z=(A, B) then Z′=(A′,1-B), where A′ is the complement of A and Z′ plays the role of the complement of Z. 1-B is the antonym of B (see, e.g., E. Trillas, C. Moraga, S. Guadarrama, S. Cubillo and E. Castiñeira, Computing with Antonyms. In: M. Nikravesh, J. Kacprzyk and L. A. Zadeh (Eds.). Forging New Frontiers: Fuzzy Pioneers I, Studies in Fuzziness and Soft Computing Vol 217, Springer-Verlag, Berlin Heidelberg 2007, pp. 133-153.).
An important qualitative attribute of a Z-number is informativeness. Generally, but not always, a Z-number is informative if its value has high specificity, that is, is tightly constrained (see, for example, R. R. Yager. On measures of specificity. In: O. Kaynak, L. A, Zadeh, B, Turksen, I. J. Rudas (Eds.), Computational intelligence: Soft Computing and Fuzzy-Neuro Integration with Applications, Springer-Verlag, Berlin, 1998, pp. 94-113), and its certainty is high. Informativeness is a desideratum when a Z-number is a basis for a decision. It is important to know that if the informativeness of a Z-number is sufficient to serve as a basis for an intelligent decision.
The concept of a Z-number is after the concept of a fuzzy granule (see, for example, L. A. Zadeh, Fuzzy sets and information granularity. In: M. Gupta, R. Ragade, R. Yager (Eds.), Advances in Fuzzy Set Theory and Applications, North-Holland Publishing Co., Amsterdam, 1979, pp. 3-18. Also, see L. A. Zadeh, Possibility theory and soft data analysis. In: L. Cobb, R. M. Thrall (Eds.), Mathematical Frontiers of the Social and Policy Sciences, Westview Press, Boulder, Colo., 1981, pp, 69-129. Also, see L.A<sub>— </sub>Zadeh, Generalized theory of uncertainty (GTU)—principal concepts and ideas, Computational Statistics & Data Analysis 51, (2006) 15-46.). It should be noted that the concept of a Z-number is much more general than the concept of confidence interval in probability theory. There are some links between the concept of a Z-number, the concept of a fuzzy random number and the concept of a fuzzy random variable (see, e.g J. J. Buckley, J. J. Leonard, Chapter 4: Random fuzzy numbers and vectors. In: Monte Carlo Methods in Fuzzy Optimization, Studies in Fuzziness and Soft Computing 222, Springer-Verlag, Heidelberg, Germany, 2008. Also, see A. Kaufman, M. M. Gupta. Introduction to Fuzzy Arithmetic: Theory and Applications, Van Nostrand Reinhold Company, New York, 1985. Also, see C. V. Negoita, D. A. Ralescu, Applications of Fuzzy. Sets to Systems Analysis, Wiley, N.Y., 1975).
A concept which is closely related to the concept of a Z-number is the concept of a Z<sup>+</sup>-number. Basically, a Z<sup>+</sup>-number, Z<sup>+</sup>, is a combination of a fuzzy number, A, and a random number, R, written as an ordered pair Z<sup>+</sup>=(A,R). In this pair, A plays the same role as it does in a Z-number, and R is the probability distribution of a random number. Equivalently, R may be viewed as the underlying probability distribution of X in the Z-valuation (X,A, B). Alternatively, a Z<sup>+</sup>-number may be expressed as (A,p<sub>X</sub>) or (pA,p<sub>X</sub>), where 1.<sub>2</sub>k is the membership function of A. A Z<sup>+</sup>-valuation is expressed as (X,A,p<sub>X</sub>) or, equivalently, as (X,μ<sub>A</sub>,p<sub>X</sub>), where p<sub>X </sub>is the probability distribution (density) of X. A Z<sup>+</sup>-number is associated with what is referred to as a bimodal distribution, that is, a distribution which combines the possibility and probability distributions of X. Informally, these distributions are compatible if the centroids of μ<sub>A </sub>and p<sub>X </sub>are coincident, that is,
<maths id="MATH-US-00003" num="00003"><math overflow="scroll"><mrow><mrow><munder><mo>∫</mo><mi>R</mi></munder><mo></mo><mrow><mi>u</mi><mo>·</mo><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo>·</mo><mi>du</mi></mrow></mrow><mo>=</mo><mfrac><mrow><munder><mo>∫</mo><mi>R</mi></munder><mo></mo><mrow><mi>u</mi><mo>·</mo><mrow><msub><mi>μ</mi><mi>A</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo>·</mo><mi>du</mi></mrow></mrow><mrow><munder><mo>∫</mo><mi>R</mi></munder><mo></mo><mrow><mrow><msub><mi>μ</mi><mi>A</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo>·</mo><mi>du</mi></mrow></mrow></mfrac></mrow></math></maths><img file="US2022121884A1_D0225.tif" /><img file="US2022121884A1_D0226.tif" /><img file="US2022121884A1_D0227.tif" /><img file="US2022121884A1_D0228.tif" /><img file="US2022121884A1_D0229.tif" /><img file="US2022121884A1_D0230.tif" /><img file="US2022121884A1_D0231.tif" /><img file="US2022121884A1_D0232.tif" /><img file="US2022121884A1_D0233.tif" /><img file="US2022121884A1_D0234.tif" /><img file="US2022121884A1_D0235.tif" /><img file="US2022121884A1_D0236.tif" /><img file="US2022121884A1_D0237.tif" /><img file="US2022121884A1_D0238.tif" /><img file="US2022121884A1_D0239.tif" /><img file="US2022121884A1_D0240.tif" /><img file="US2022121884A1_D0241.tif" /><img file="US2022121884A1_D0242.tif" /><img file="US2022121884A1_D0243.tif" /><img file="US2022121884A1_D0244.tif" /><img file="US2022121884A1_D0245.tif" /><img file="US2022121884A1_D0246.tif" /><img file="US2022121884A1_D0247.tif" /><img file="US2022121884A1_D0248.tif" /><img file="US2022121884A1_D0249.tif" /><img file="US2022121884A1_D0250.tif" /><img file="US2022121884A1_D0251.tif" /><img file="US2022121884A1_D0252.tif" /><img file="US2022121884A1_D0253.tif" /><img file="US2022121884A1_D0254.tif" /><img file="US2022121884A1_D0255.tif" /><img file="US2022121884A1_D0256.tif" /><img file="US2022121884A1_D0257.tif" /><img file="US2022121884A1_D0258.tif" /><img file="US2022121884A1_D0259.tif" /><img file="US2022121884A1_D0260.tif" /><img file="US2022121884A1_D0261.tif" /><img file="US2022121884A1_D0262.tif" /><img file="US2022121884A1_D0263.tif" /><img file="US2022121884A1_D0264.tif" /><img file="US2022121884A1_D0265.tif" /><img file="US2022121884A1_D0266.tif" /><img file="US2022121884A1_D0267.tif" /><img file="US2022121884A1_D0268.tif" /><img file="US2022121884A1_D0269.tif" /><img file="US2022121884A1_D0270.tif" /><img file="US2022121884A1_D0271.tif" /><img file="US2022121884A1_D0272.tif" /><img file="US2022121884A1_D0273.tif" /><img file="US2022121884A1_D0274.tif" /><img file="US2022121884A1_D0275.tif" /><img file="US2022121884A1_D0276.tif" /><img file="US2022121884A1_D0277.tif" /><img file="US2022121884A1_D0278.tif" /><img file="US2022121884A1_D0279.tif" /><img file="US2022121884A1_D0280.tif" /><img file="US2022121884A1_D0281.tif" /><img file="US2022121884A1_D0282.tif" /><img file="US2022121884A1_D0283.tif" /><img file="US2022121884A1_D0284.tif" /><img file="US2022121884A1_D0285.tif" /><img file="US2022121884A1_D0286.tif" /><img file="US2022121884A1_D0287.tif" /><img file="US2022121884A1_D0288.tif" /><img file="US2022121884A1_D0289.tif" /><img file="US2022121884A1_D0290.tif" /><img file="US2022121884A1_D0291.tif" /><img file="US2022121884A1_D0292.tif" /><img file="US2022121884A1_D0293.tif" /><img file="US2022121884A1_D0294.tif" /><img file="US2022121884A1_D0295.tif" /><img file="US2022121884A1_D0296.tif" /><img file="US2022121884A1_D0297.tif" /><img file="US2022121884A1_D0298.tif" /><img file="US2022121884A1_D0299.tif" /><img file="US2022121884A1_D0300.tif" /><img file="US2022121884A1_D0301.tif" /><img file="US2022121884A1_D0302.tif" /><img file="US2022121884A1_D0303.tif" /><img file="US2022121884A1_D0304.tif" /><img file="US2022121884A1_D0305.tif" /><img file="US2022121884A1_D0306.tif" /><img file="US2022121884A1_D0307.tif" /><img file="US2022121884A1_D0308.tif" /><img file="US2022121884A1_D0309.tif" /><img file="US2022121884A1_D0310.tif" /><img file="US2022121884A1_D0311.tif" /><img file="US2022121884A1_D0312.tif" /><img file="US2022121884A1_D0313.tif" /><img file="US2022121884A1_D0314.tif" /><img file="US2022121884A1_D0315.tif" /><img file="US2022121884A1_D0316.tif" /><img file="US2022121884A1_D0317.tif" /><img file="US2022121884A1_D0318.tif" /><img file="US2022121884A1_D0319.tif" /><img file="US2022121884A1_D0320.tif" /><img file="US2022121884A1_D0321.tif" /><img file="US2022121884A1_D0322.tif" /><img file="US2022121884A1_D0323.tif" /><img file="US2022121884A1_D0324.tif" /><img file="US2022121884A1_D0325.tif" /><img file="US2022121884A1_D0326.tif" /><img file="US2022121884A1_D0327.tif" /><img file="US2022121884A1_D0328.tif" /><img file="US2022121884A1_D0329.tif" /><img file="US2022121884A1_D0330.tif" /><img file="US2022121884A1_D0331.tif" /><img file="US2022121884A1_D0332.tif" /><img file="US2022121884A1_D0333.tif" /><img file="US2022121884A1_D0334.tif" /><img file="US2022121884A1_D0335.tif" /><img file="US2022121884A1_D0336.tif" />
The scalar product of μ<sub>A </sub>and p<sub>X</sub>, μ<sub>A</sub>·p<sub>X</sub>, is the probability measure, P<sub>A</sub>, of A. More concretely,
<maths id="MATH-US-00004" num="00004"><math overflow="scroll"><mrow><mrow><msub><mi>μ</mi><mi>A</mi></msub><mo>·</mo><msub><mi>p</mi><mi>X</mi></msub></mrow><mo>=</mo><mrow><msub><mi>P</mi><mi>A</mi></msub><mo>=</mo><mrow><munder><mo>∫</mo><mi>R</mi></munder><mo></mo><mrow><mrow><msub><mi>μ</mi><mi>A</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D0337.tif" /><img file="US2022121884A1_D0338.tif" /><img file="US2022121884A1_D0339.tif" /><img file="US2022121884A1_D0340.tif" /><img file="US2022121884A1_D0341.tif" /><img file="US2022121884A1_D0342.tif" /><img file="US2022121884A1_D0343.tif" /><img file="US2022121884A1_D0344.tif" /><img file="US2022121884A1_D0345.tif" /><img file="US2022121884A1_D0346.tif" /><img file="US2022121884A1_D0347.tif" /><img file="US2022121884A1_D0348.tif" /><img file="US2022121884A1_D0349.tif" /><img file="US2022121884A1_D0350.tif" /><img file="US2022121884A1_D0351.tif" /><img file="US2022121884A1_D0352.tif" /><img file="US2022121884A1_D0353.tif" /><img file="US2022121884A1_D0354.tif" /><img file="US2022121884A1_D0355.tif" /><img file="US2022121884A1_D0356.tif" /><img file="US2022121884A1_D0357.tif" /><img file="US2022121884A1_D0358.tif" /><img file="US2022121884A1_D0359.tif" /><img file="US2022121884A1_D0360.tif" /><img file="US2022121884A1_D0361.tif" /><img file="US2022121884A1_D0362.tif" /><img file="US2022121884A1_D0363.tif" /><img file="US2022121884A1_D0364.tif" /><img file="US2022121884A1_D0365.tif" /><img file="US2022121884A1_D0366.tif" /><img file="US2022121884A1_D0367.tif" /><img file="US2022121884A1_D0368.tif" /><img file="US2022121884A1_D0369.tif" /><img file="US2022121884A1_D0370.tif" /><img file="US2022121884A1_D0371.tif" /><img file="US2022121884A1_D0372.tif" /><img file="US2022121884A1_D0373.tif" /><img file="US2022121884A1_D0374.tif" /><img file="US2022121884A1_D0375.tif" /><img file="US2022121884A1_D0376.tif" /><img file="US2022121884A1_D0377.tif" /><img file="US2022121884A1_D0378.tif" /><img file="US2022121884A1_D0379.tif" /><img file="US2022121884A1_D0380.tif" /><img file="US2022121884A1_D0381.tif" /><img file="US2022121884A1_D0382.tif" /><img file="US2022121884A1_D0383.tif" /><img file="US2022121884A1_D0384.tif" /><img file="US2022121884A1_D0385.tif" /><img file="US2022121884A1_D0386.tif" /><img file="US2022121884A1_D0387.tif" /><img file="US2022121884A1_D0388.tif" /><img file="US2022121884A1_D0389.tif" /><img file="US2022121884A1_D0390.tif" /><img file="US2022121884A1_D0391.tif" /><img file="US2022121884A1_D0392.tif" /><img file="US2022121884A1_D0393.tif" /><img file="US2022121884A1_D0394.tif" /><img file="US2022121884A1_D0395.tif" /><img file="US2022121884A1_D0396.tif" /><img file="US2022121884A1_D0397.tif" /><img file="US2022121884A1_D0398.tif" /><img file="US2022121884A1_D0399.tif" /><img file="US2022121884A1_D0400.tif" /><img file="US2022121884A1_D0401.tif" /><img file="US2022121884A1_D0402.tif" /><img file="US2022121884A1_D0403.tif" /><img file="US2022121884A1_D0404.tif" /><img file="US2022121884A1_D0405.tif" /><img file="US2022121884A1_D0406.tif" /><img file="US2022121884A1_D0407.tif" /><img file="US2022121884A1_D0408.tif" /><img file="US2022121884A1_D0409.tif" /><img file="US2022121884A1_D0410.tif" /><img file="US2022121884A1_D0411.tif" /><img file="US2022121884A1_D0412.tif" /><img file="US2022121884A1_D0413.tif" /><img file="US2022121884A1_D0414.tif" /><img file="US2022121884A1_D0415.tif" /><img file="US2022121884A1_D0416.tif" /><img file="US2022121884A1_D0417.tif" /><img file="US2022121884A1_D0418.tif" /><img file="US2022121884A1_D0419.tif" /><img file="US2022121884A1_D0420.tif" /><img file="US2022121884A1_D0421.tif" /><img file="US2022121884A1_D0422.tif" /><img file="US2022121884A1_D0423.tif" /><img file="US2022121884A1_D0424.tif" /><img file="US2022121884A1_D0425.tif" /><img file="US2022121884A1_D0426.tif" /><img file="US2022121884A1_D0427.tif" /><img file="US2022121884A1_D0428.tif" /><img file="US2022121884A1_D0429.tif" /><img file="US2022121884A1_D0430.tif" /><img file="US2022121884A1_D0431.tif" /><img file="US2022121884A1_D0432.tif" /><img file="US2022121884A1_D0433.tif" /><img file="US2022121884A1_D0434.tif" /><img file="US2022121884A1_D0435.tif" /><img file="US2022121884A1_D0436.tif" /><img file="US2022121884A1_D0437.tif" /><img file="US2022121884A1_D0438.tif" /><img file="US2022121884A1_D0439.tif" /><img file="US2022121884A1_D0440.tif" /><img file="US2022121884A1_D0441.tif" /><img file="US2022121884A1_D0442.tif" /><img file="US2022121884A1_D0443.tif" /><img file="US2022121884A1_D0444.tif" /><img file="US2022121884A1_D0445.tif" /><img file="US2022121884A1_D0446.tif" /><img file="US2022121884A1_D0447.tif" /><img file="US2022121884A1_D0448.tif" />
It is this relation that links the concept of a Z-number to that of a Z<sup>+</sup>-number. More concretely,
<br /><i>Z</i>(<i>A, B</i>)=<i>Z</i><sup>+</sup>(<i>A,μ</i><sub>A</sub><i>·p</i><sub>X </sub>is <i>B</i>)
What should be underscored is that in the case of a Z-number what is known is not p<sub>X </sub>but a restriction on p<sub>X </sub>expressed as: μ<sub>A</sub>·p<sub>X </sub>is B. B<sub>Y </sub>definition, a Z<sup>+</sup>-number carries more information than a Z-number. This is the reason why it is labeled a Z<sup>+</sup>-number. Computation with Z<sup>+</sup>-numbers is a portal to computation with Z-numbers.
The concept of a bimodal distribution is of interest in its own right. Let X be a real-valued variable taking values in U. For our purposes, it is convenient to assume that U is a finite set, U={u<sub>1</sub>, . . . , u<sub>n</sub>}. We can associate with X a possibility distribution, μ, and a probability distribution, p, expressed as:
<br />μ=μ<sub>1</sub><i>/u</i><sub>1</sub>+. . . +μ<sub>n</sub><i>/u</i><sub>n </sub>
<br /><i>p=p</i><sub>1</sub><i>\u</i><sub>1</sub><i>+. . . +p</i><sub>n</sub><i>\u</i><sub>n </sub>
in which μ<sub>i</sub>/u<sub>i </sub>means that μ<sub>i</sub>i=1, . . . n, is the possibility that X=u<sub>i</sub>. Similarly, means that p<sub>i </sub>is the probability that X=u<sub>i</sub>.
The possibility distribution, μ, may be combined with the probability distribution, p, through what is referred to as confluence. More concretely,
<br />μ:<i>p</i>=(μ<sub>1</sub><i>, p</i><sub>1</sub>)/<i>u</i><sub>1</sub>+. . . +(μ<sub>n</sub><i>, p</i><sub>n</sub>)/<i>u</i><sub>η </sub>
As was noted earlier, the scalar product, expressed as μ·p, is the probability measure of A. In terms of the bimodal distribution, the Z<sup>+</sup>-valuation and the Z-valuation associated with X may be expressed as:
<br />(X, A, p<sub>X</sub>)
<br />(X, A, B), μ<sub>A</sub>·p<sub>X </sub>is B,
respectively, with the understanding that B is a possibilistic restriction on μ<sub>A</sub>·p<sub>X</sub>.
Both Z and Z<sup>+</sup> may be viewed as restrictions on the values which X may take, written as: X is Z and X is Z<sup>+</sup>, respectively. Viewing Z and Z<sup>+</sup> as restrictions on X adds important concepts to representation of information and characterization of dependencies. In this connection, what should be noted is that the concept of a fuzzy if-then rule plays a pivotal role in most applications of fuzzy logic. What follows is a very brief discussion of what are referred to as Z-rules—if-then rules in which the antecedents and/or consequents involve Z-numbers or Z<sup>+</sup>-numbers.
A basic fuzzy if-then rule may be expressed as: if X is A then Y is B, where A and B are fuzzy numbers. The meaning of such a rule is defined as:
<br />if X is A then Y is B→(X,Y) is A×B
where A×B is the Cartesian product of A and B. It is convenient to express a generalization of the basic if-then rule to Z-numbers in terms of Z-valuations. More concretely, if (X, A<sub>X</sub>, B<sub>X</sub>) then (Y, A<sub>Y</sub>, B<sub>Y</sub>)
EXAMPLES
<ul id="ul0015" list-style="none"><li id="ul0015-0001" num="0000"><ul id="ul0016" list-style="none"><li id="ul0016-0001" num="0617">if (anticipated budget deficit, about two million dollars, very likely) then (reduction in staff, about ten percent, very likely)</li><li id="ul0016-0002" num="0618">if (degree of Robert's honesty, high, not sure) then (offer a position, not, sure)</li><li id="ul0016-0003" num="0619">if (X, small) then (Y, large, usually.)</li></ul></li></ul>
An important question relates to the meaning of Z-rules and Z<sup>+</sup>-rules. The meaning of a Z<sup>+</sup>-rule may be expressed as:
<br />if (X,A<sub>X</sub>,p<sub>X</sub>) then (Y, A<sub>Y</sub>, p<sub>Y</sub>)→(X,Y) is (A<sub>X</sub>×A<sub>Y</sub>,p<sub>X</sub>p<sub>Y</sub>)
where a<sub>X</sub>×A<sub>Y </sub>is the Cartesian product A<sub>X </sub>and A<sub>Y </sub>
Z-rules have the important applications in decision analysis and modeling of complex systems, especially in the realm of economics (for example, stock market and specific stocks) and medicine (e.g. diagnosis and analysis).
A problem which plays a key role in many applications of fuzzy logic, especially in the realm of fuzzy control, is that of interpolation. More concretely, the problem of interpolation may be formulated as follows. Consider a collection of fuzzy if-then rules of the form:
<br />if X is A<sub>i </sub>then Y is B<sub>i</sub>, i=1, . . . , n
where the A<sub>i </sub>and B<sub>i </sub>are fuzzy sets with specified membership functions, If X is A, where A is not one of the A<sub>i</sub>, then what is the restriction on Y?
The problem of interpolation may be generalized m various ways. A generalization to Z-numbers may be described as follows. Consider a collection Z-rules of the form:
<br />if X is A<sub>i </sub>then usually (Y is B<sub>i</sub>), i=1,
where the A<sub>i </sub>and B<sub>i </sub>are fuzzy sets. Let A be a fuzzy set which is not one of the A<sub>i</sub>. What is the restriction on Y expressed as a Z-number? An answer to this question would add a useful formalism to the analysis of complex systems and decision processes.
Representation of Z-numbers can be facilitated through the use of what is called a Z-mouse. Basically, a Z-mouse is a visual means of entry and retrieval of fuzzy data.
The cursor of a Z-mouse is a circular fuzzy mark, called an f-mark, with a trapezoidal distribution of light intensity. This distribution is interpreted as a trapezoidal membership function of a fuzzy set. The parameters of the trapezoid are controlled by the user. A fuzzy number such as “approximately 3” is represented as an f-mark on a scale, with 3 being the centroid of the f-mark (<figref idref="DRAWINGS">FIG. 2<i>a</i></figref>). The size of the f-mark is a measure of the user's uncertainty about the value of the number. As was noted already, the Z-mouse interprets an f-mark as the membership function of a trapezoidal fuzzy set. This membership function serves as an object of computation. A Z-mouse can be used to draw curves and plot functions.
A key idea which underlies the concept of a Z-mouse is that visual interpretation of uncertainty is much more natural than its description in natural language or as a membership function of a fuzzy set. This idea is closely related to the remarkable human capability to precisiate (graduate) perceptions, that is, to associate perceptions with degrees, As an illustration, if I am asked “What is the probability that Obama will be reelected?” I would find it easy to put an f-mark on a scale from 0 to I. Similarly, I could put an f-mark on a scale from 0 to 1 if I were asked to indicate the degree to which I like my job. It is of interest to note that a Z-mouse could be used as an informative means of polling, making it possible to indicate one's strength of feeling about an issue. Conventional polling techniques do not assess strength of feeling.
Using a Z-mouse, a Z-number is represented as two f-marks on two different scales (<figref idref="DRAWINGS">FIG. 2<i>b</i></figref>). The trapezoidal fuzzy sets which are associated with the f-marks serve as objects of computation.
Computation with Z-Numbers:
What is meant by computation with Z-numbers? Here is a simple example. Suppose that I intend to drive from Berkeley to San Jose via Palo Alto. The perception-based information which I have may be expressed as Z-valuations: (travel time from Berkeley to Palo Alto, about an hour, usually) and (travel time from Palo Alto to San Jose, about twenty-five minutes, usually.) How long will it take me to drive from Berkeley to San Jose? In this case, we are dealing with the sum of two Z-numbers (about an hour, usually) and (about twenty-five minutes, usually.) Another example: What is the square root of (A, B)? Computation with Z-numbers falls within the province of Computing with Words (CW or CWW). Example: What is the square root of a Z-number?
Computation with Z<sup>+</sup>-numbers is much simpler than computation with Z-numbers. Assume that * is a binary operation whose operands are Z<sup>+</sup>-numbers, Z<sup>+</sup><sub>X</sub>=(A<sub>X</sub>,R<sub>X</sub>) and Z<sup>+</sup><sub>Y</sub>=(A<sub>Y</sub>,R<sub>Y</sub>.) By definition,
<br /><i>Z</i><sup>+</sup><sub>X</sub><i>*Z</i><sup>+</sup><sub>Y</sub>=(<i>A</i><sub>X</sub><i>*A</i><sub>Y</sub><i>, R</i><sub>X</sub><i>*R</i><sub>Y</sub>)
with the understanding that the meaning of * in R<sub>X</sub>*R<sub>Y </sub>is not the same as the meaning of * in A<sub>X</sub>*A<sub>Y</sub>. In this expression, the operands of * in A<sub>X</sub>*A<sub>Y </sub>are fuzzy numbers; the operands of * in R<sub>X</sub>*R<sub>Y </sub>are probability distributions.
Example: Assume that * is sum. In this case, A<sub>X</sub>+A<sub>Y </sub>is defined by:
<br />μ<sub>(A</sub><sub><sub2>X</sub2></sub><sub>+A</sub><sub><sub2>y</sub2></sub><sub>)</sub>(<i>v</i>)=sup<sub>u</sub>(μ<sub>A</sub><sub><sub2>X</sub2></sub>(<i>u</i>) {circumflex over ( )}μ<sub>A</sub><sub><sub2>Y</sub2></sub>(<i>v−u</i>)), {circumflex over ( )}=min
Similarly, assuming that R<sub>X </sub>and R<sub>Y </sub>are independent, the probability density function of R<sub>X</sub>*R<sub>Y </sub>is the convolution, ∘, of the probability density functions of R<sub>X </sub>and R<sub>Y</sub>. Denoting these probability density fiinctions as p<sub>R</sub><sub><sub2>X </sub2></sub>and p<sub>R</sub><sub><sub2>y</sub2></sub>, respectively, we have:
<maths id="MATH-US-00005" num="00005"><math overflow="scroll"><mrow><mrow><msub><mi>p</mi><mrow><msub><mi>R</mi><mi>X</mi></msub><mo>+</mo><msub><mi>R</mi><mi>Y</mi></msub></mrow></msub><mo></mo><mrow><mo>(</mo><mi>v</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><munder><mo>∫</mo><mi>R</mi></munder><mo></mo><mrow><mrow><msub><mi>p</mi><msub><mi>R</mi><mi>X</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>p</mi><msub><mi>R</mi><mi>Y</mi></msub></msub><mo></mo><mrow><mo>(</mo><mrow><mi>v</mi><mo>-</mo><mi>u</mi></mrow><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D0449.tif" /><img file="US2022121884A1_D0450.tif" /><img file="US2022121884A1_D0451.tif" /><img file="US2022121884A1_D0452.tif" /><img file="US2022121884A1_D0453.tif" /><img file="US2022121884A1_D0454.tif" /><img file="US2022121884A1_D0455.tif" /><img file="US2022121884A1_D0456.tif" /><img file="US2022121884A1_D0457.tif" /><img file="US2022121884A1_D0458.tif" /><img file="US2022121884A1_D0459.tif" /><img file="US2022121884A1_D0460.tif" /><img file="US2022121884A1_D0461.tif" /><img file="US2022121884A1_D0462.tif" /><img file="US2022121884A1_D0463.tif" /><img file="US2022121884A1_D0464.tif" /><img file="US2022121884A1_D0465.tif" /><img file="US2022121884A1_D0466.tif" /><img file="US2022121884A1_D0467.tif" /><img file="US2022121884A1_D0468.tif" /><img file="US2022121884A1_D0469.tif" /><img file="US2022121884A1_D0470.tif" /><img file="US2022121884A1_D0471.tif" /><img file="US2022121884A1_D0472.tif" /><img file="US2022121884A1_D0473.tif" /><img file="US2022121884A1_D0474.tif" /><img file="US2022121884A1_D0475.tif" /><img file="US2022121884A1_D0476.tif" /><img file="US2022121884A1_D0477.tif" /><img file="US2022121884A1_D0478.tif" /><img file="US2022121884A1_D0479.tif" /><img file="US2022121884A1_D0480.tif" /><img file="US2022121884A1_D0481.tif" /><img file="US2022121884A1_D0482.tif" /><img file="US2022121884A1_D0483.tif" /><img file="US2022121884A1_D0484.tif" /><img file="US2022121884A1_D0485.tif" /><img file="US2022121884A1_D0486.tif" /><img file="US2022121884A1_D0487.tif" /><img file="US2022121884A1_D0488.tif" /><img file="US2022121884A1_D0489.tif" /><img file="US2022121884A1_D0490.tif" /><img file="US2022121884A1_D0491.tif" /><img file="US2022121884A1_D0492.tif" /><img file="US2022121884A1_D0493.tif" /><img file="US2022121884A1_D0494.tif" /><img file="US2022121884A1_D0495.tif" /><img file="US2022121884A1_D0496.tif" /><img file="US2022121884A1_D0497.tif" /><img file="US2022121884A1_D0498.tif" /><img file="US2022121884A1_D0499.tif" /><img file="US2022121884A1_D0500.tif" /><img file="US2022121884A1_D0501.tif" /><img file="US2022121884A1_D0502.tif" /><img file="US2022121884A1_D0503.tif" /><img file="US2022121884A1_D0504.tif" /><img file="US2022121884A1_D0505.tif" /><img file="US2022121884A1_D0506.tif" /><img file="US2022121884A1_D0507.tif" /><img file="US2022121884A1_D0508.tif" /><img file="US2022121884A1_D0509.tif" /><img file="US2022121884A1_D0510.tif" /><img file="US2022121884A1_D0511.tif" /><img file="US2022121884A1_D0512.tif" /><img file="US2022121884A1_D0513.tif" /><img file="US2022121884A1_D0514.tif" /><img file="US2022121884A1_D0515.tif" /><img file="US2022121884A1_D0516.tif" /><img file="US2022121884A1_D0517.tif" /><img file="US2022121884A1_D0518.tif" /><img file="US2022121884A1_D0519.tif" /><img file="US2022121884A1_D0520.tif" /><img file="US2022121884A1_D0521.tif" /><img file="US2022121884A1_D0522.tif" /><img file="US2022121884A1_D0523.tif" /><img file="US2022121884A1_D0524.tif" /><img file="US2022121884A1_D0525.tif" /><img file="US2022121884A1_D0526.tif" /><img file="US2022121884A1_D0527.tif" /><img file="US2022121884A1_D0528.tif" /><img file="US2022121884A1_D0529.tif" /><img file="US2022121884A1_D0530.tif" /><img file="US2022121884A1_D0531.tif" /><img file="US2022121884A1_D0532.tif" /><img file="US2022121884A1_D0533.tif" /><img file="US2022121884A1_D0534.tif" /><img file="US2022121884A1_D0535.tif" /><img file="US2022121884A1_D0536.tif" /><img file="US2022121884A1_D0537.tif" /><img file="US2022121884A1_D0538.tif" /><img file="US2022121884A1_D0539.tif" /><img file="US2022121884A1_D0540.tif" /><img file="US2022121884A1_D0541.tif" /><img file="US2022121884A1_D0542.tif" /><img file="US2022121884A1_D0543.tif" /><img file="US2022121884A1_D0544.tif" /><img file="US2022121884A1_D0545.tif" /><img file="US2022121884A1_D0546.tif" /><img file="US2022121884A1_D0547.tif" /><img file="US2022121884A1_D0548.tif" /><img file="US2022121884A1_D0549.tif" /><img file="US2022121884A1_D0550.tif" /><img file="US2022121884A1_D0551.tif" /><img file="US2022121884A1_D0552.tif" /><img file="US2022121884A1_D0553.tif" /><img file="US2022121884A1_D0554.tif" /><img file="US2022121884A1_D0555.tif" /><img file="US2022121884A1_D0556.tif" /><img file="US2022121884A1_D0557.tif" /><img file="US2022121884A1_D0558.tif" /><img file="US2022121884A1_D0559.tif" /><img file="US2022121884A1_D0560.tif" />
Thus,
<br /><i>Z</i><sup>+</sup><sub>X</sub><i>+Z</i><sup>+</sup><sub>Y</sub>=(<i>A</i><sub>X</sub><i>+A</i><sub>Y</sub><i>, P</i><sub>R</sub><sub><sub2>X</sub2></sub><i>∘P</i><sub>R</sub><sub><sub2>y</sub2></sub>)
It should be noted that the assumption that R<sub>X </sub>and R<sub>Y </sub>are independent implies worst case analysis.
More generally, to compute Z<sub>X</sub>*Z<sub>Y </sub>what is needed is the extension principle of fuzzy logic (see, e.g., L. A. Zadeh, Probability measures of fuzzy events, Journal of Mathematical Analysis and Applications 23 (2), (1968) 421-427.). Basically, the extension principle is a rule for evaluating a function when what are known are not the values of arguments but restrictions on the values of arguments. In other words, the rule involves evaluation of the value of a function under less than complete information about the values of arguments.
Note. Originally, the term “extension principle” was employed to describe a rule which serves to extend the domain of definition of a function from numbers to fuzzy numbers. In this disclosure, the term “extension principle” has a more general meaning which is stated in terms of restrictions. What should be noted is that, more generally, incompleteness of information about the values of arguments applies also to incompleteness of information about functions, in particular, about functions which are described as collections of if-then rules.
There are many versions of the extension principle. A basic version was given in the article: (L.A, Zadeh, Fuzzy sets. Information and Control 8, (1965) 338-353). In this version, the extension principle may be described as:
<maths id="MATH-US-00006" num="00006"><math overflow="scroll"><mrow><mi>Y</mi><mo>=</mo><mrow><mi>f</mi><mo></mo><mrow><mo>(</mo><mi>X</mi><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D0561.tif" /><img file="US2022121884A1_D0562.tif" /><img file="US2022121884A1_D0563.tif" /><img file="US2022121884A1_D0564.tif" /><img file="US2022121884A1_D0565.tif" /><img file="US2022121884A1_D0566.tif" /><img file="US2022121884A1_D0567.tif" /><img file="US2022121884A1_D0568.tif" /><img file="US2022121884A1_D0569.tif" /><img file="US2022121884A1_D0570.tif" /><img file="US2022121884A1_D0571.tif" /><img file="US2022121884A1_D0572.tif" /><img file="US2022121884A1_D0573.tif" /><img file="US2022121884A1_D0574.tif" /><img file="US2022121884A1_D0575.tif" /><img file="US2022121884A1_D0576.tif" /><img file="US2022121884A1_D0577.tif" /><img file="US2022121884A1_D0578.tif" /><img file="US2022121884A1_D0579.tif" /><img file="US2022121884A1_D0580.tif" /><img file="US2022121884A1_D0581.tif" /><img file="US2022121884A1_D0582.tif" /><img file="US2022121884A1_D0583.tif" /><img file="US2022121884A1_D0584.tif" /><img file="US2022121884A1_D0585.tif" /><img file="US2022121884A1_D0586.tif" /><img file="US2022121884A1_D0587.tif" /><img file="US2022121884A1_D0588.tif" /><img file="US2022121884A1_D0589.tif" /><img file="US2022121884A1_D0590.tif" /><img file="US2022121884A1_D0591.tif" /><img file="US2022121884A1_D0592.tif" /><img file="US2022121884A1_D0593.tif" /><img file="US2022121884A1_D0594.tif" /><img file="US2022121884A1_D0595.tif" /><img file="US2022121884A1_D0596.tif" /><img file="US2022121884A1_D0597.tif" /><img file="US2022121884A1_D0598.tif" /><img file="US2022121884A1_D0599.tif" /><img file="US2022121884A1_D0600.tif" /><img file="US2022121884A1_D0601.tif" /><img file="US2022121884A1_D0602.tif" /><img file="US2022121884A1_D0603.tif" /><img file="US2022121884A1_D0604.tif" /><img file="US2022121884A1_D0605.tif" /><img file="US2022121884A1_D0606.tif" /><img file="US2022121884A1_D0607.tif" /><img file="US2022121884A1_D0608.tif" /><img file="US2022121884A1_D0609.tif" /><img file="US2022121884A1_D0610.tif" /><img file="US2022121884A1_D0611.tif" /><img file="US2022121884A1_D0612.tif" /><img file="US2022121884A1_D0613.tif" /><img file="US2022121884A1_D0614.tif" /><img file="US2022121884A1_D0615.tif" /><img file="US2022121884A1_D0616.tif" /><img file="US2022121884A1_D0617.tif" /><img file="US2022121884A1_D0618.tif" /><img file="US2022121884A1_D0619.tif" /><img file="US2022121884A1_D0620.tif" /><img file="US2022121884A1_D0621.tif" /><img file="US2022121884A1_D0622.tif" /><img file="US2022121884A1_D0623.tif" /><img file="US2022121884A1_D0624.tif" /><img file="US2022121884A1_D0625.tif" /><img file="US2022121884A1_D0626.tif" /><img file="US2022121884A1_D0627.tif" /><img file="US2022121884A1_D0628.tif" /><img file="US2022121884A1_D0629.tif" /><img file="US2022121884A1_D0630.tif" /><img file="US2022121884A1_D0631.tif" /><img file="US2022121884A1_D0632.tif" /><img file="US2022121884A1_D0633.tif" /><img file="US2022121884A1_D0634.tif" /><img file="US2022121884A1_D0635.tif" /><img file="US2022121884A1_D0636.tif" /><img file="US2022121884A1_D0637.tif" /><img file="US2022121884A1_D0638.tif" /><img file="US2022121884A1_D0639.tif" /><img file="US2022121884A1_D0640.tif" /><img file="US2022121884A1_D0641.tif" /><img file="US2022121884A1_D0642.tif" /><img file="US2022121884A1_D0643.tif" /><img file="US2022121884A1_D0644.tif" /><img file="US2022121884A1_D0645.tif" /><img file="US2022121884A1_D0646.tif" /><img file="US2022121884A1_D0647.tif" /><img file="US2022121884A1_D0648.tif" /><img file="US2022121884A1_D0649.tif" /><img file="US2022121884A1_D0650.tif" /><img file="US2022121884A1_D0651.tif" /><img file="US2022121884A1_D0652.tif" /><img file="US2022121884A1_D0653.tif" /><img file="US2022121884A1_D0654.tif" /><img file="US2022121884A1_D0655.tif" /><img file="US2022121884A1_D0656.tif" /><img file="US2022121884A1_D0657.tif" /><img file="US2022121884A1_D0658.tif" /><img file="US2022121884A1_D0659.tif" /><img file="US2022121884A1_D0660.tif" /><img file="US2022121884A1_D0661.tif" /><img file="US2022121884A1_D0662.tif" /><img file="US2022121884A1_D0663.tif" /><img file="US2022121884A1_D0664.tif" /><img file="US2022121884A1_D0665.tif" /><img file="US2022121884A1_D0666.tif" /><img file="US2022121884A1_D0667.tif" /><img file="US2022121884A1_D0668.tif" /><img file="US2022121884A1_D0669.tif" /><img file="US2022121884A1_D0670.tif" /><img file="US2022121884A1_D0671.tif" /><img file="US2022121884A1_D0672.tif" /><maths id="MATH-US-00006-2" num="00006.2"><math overflow="scroll"><mfrac><mrow><mrow><mi>R</mi><mo></mo><mrow><mo>(</mo><mi>X</mi><mo>)</mo></mrow></mrow><mo>:</mo><mrow><mi>X</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>is</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mrow><mi>A</mi><mo></mo><mrow><mo>(</mo><mrow><mi>constraint</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>on</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>u</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>is</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mrow><msub><mi>μ</mi><mi>A</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow></mrow><mo>)</mo></mrow></mrow></mrow></mrow><mtable><mtr><mtd><mrow><mrow><mrow><mi>R</mi><mo></mo><mrow><mo>(</mo><mi>Y</mi><mo>)</mo></mrow></mrow><mo>:</mo><mrow><msub><mi>μ</mi><mi>Y</mi></msub><mo></mo><mrow><mo>(</mo><mi>v</mi><mo>)</mo></mrow></mrow></mrow><mo>=</mo><mrow><msub><mi>sup</mi><mi>u</mi></msub><mo></mo><mrow><msub><mi>μ</mi><mi>A</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mrow><mrow><mi>f</mi><mo></mo><mrow><mo>(</mo><mi>A</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mi>R</mi><mo></mo><mrow><mo>(</mo><mi>Y</mi><mo>)</mo></mrow></mrow></mrow><mo>)</mo></mrow></mtd></mtr></mtable></mfrac></math></maths><img file="US2022121884A1_D0673.tif" /><img file="US2022121884A1_D0674.tif" /><img file="US2022121884A1_D0675.tif" /><img file="US2022121884A1_D0676.tif" /><img file="US2022121884A1_D0677.tif" /><img file="US2022121884A1_D0678.tif" /><img file="US2022121884A1_D0679.tif" /><img file="US2022121884A1_D0680.tif" /><img file="US2022121884A1_D0681.tif" /><img file="US2022121884A1_D0682.tif" /><img file="US2022121884A1_D0683.tif" /><img file="US2022121884A1_D0684.tif" /><img file="US2022121884A1_D0685.tif" /><img file="US2022121884A1_D0686.tif" /><img file="US2022121884A1_D0687.tif" /><img file="US2022121884A1_D0688.tif" /><img file="US2022121884A1_D0689.tif" /><img file="US2022121884A1_D0690.tif" /><img file="US2022121884A1_D0691.tif" /><img file="US2022121884A1_D0692.tif" /><img file="US2022121884A1_D0693.tif" /><img file="US2022121884A1_D0694.tif" /><img file="US2022121884A1_D0695.tif" /><img file="US2022121884A1_D0696.tif" /><img file="US2022121884A1_D0697.tif" /><img file="US2022121884A1_D0698.tif" /><img file="US2022121884A1_D0699.tif" /><img file="US2022121884A1_D0700.tif" /><img file="US2022121884A1_D0701.tif" /><img file="US2022121884A1_D0702.tif" /><img file="US2022121884A1_D0703.tif" /><img file="US2022121884A1_D0704.tif" /><img file="US2022121884A1_D0705.tif" /><img file="US2022121884A1_D0706.tif" /><img file="US2022121884A1_D0707.tif" /><img file="US2022121884A1_D0708.tif" /><img file="US2022121884A1_D0709.tif" /><img file="US2022121884A1_D0710.tif" /><img file="US2022121884A1_D0711.tif" /><img file="US2022121884A1_D0712.tif" /><img file="US2022121884A1_D0713.tif" /><img file="US2022121884A1_D0714.tif" /><img file="US2022121884A1_D0715.tif" /><img file="US2022121884A1_D0716.tif" /><img file="US2022121884A1_D0717.tif" /><img file="US2022121884A1_D0718.tif" /><img file="US2022121884A1_D0719.tif" /><img file="US2022121884A1_D0720.tif" /><img file="US2022121884A1_D0721.tif" /><img file="US2022121884A1_D0722.tif" /><img file="US2022121884A1_D0723.tif" /><img file="US2022121884A1_D0724.tif" /><img file="US2022121884A1_D0725.tif" /><img file="US2022121884A1_D0726.tif" /><img file="US2022121884A1_D0727.tif" /><img file="US2022121884A1_D0728.tif" /><img file="US2022121884A1_D0729.tif" /><img file="US2022121884A1_D0730.tif" /><img file="US2022121884A1_D0731.tif" /><img file="US2022121884A1_D0732.tif" /><img file="US2022121884A1_D0733.tif" /><img file="US2022121884A1_D0734.tif" /><img file="US2022121884A1_D0735.tif" /><img file="US2022121884A1_D0736.tif" /><img file="US2022121884A1_D0737.tif" /><img file="US2022121884A1_D0738.tif" /><img file="US2022121884A1_D0739.tif" /><img file="US2022121884A1_D0740.tif" /><img file="US2022121884A1_D0741.tif" /><img file="US2022121884A1_D0742.tif" /><img file="US2022121884A1_D0743.tif" /><img file="US2022121884A1_D0744.tif" /><img file="US2022121884A1_D0745.tif" /><img file="US2022121884A1_D0746.tif" /><img file="US2022121884A1_D0747.tif" /><img file="US2022121884A1_D0748.tif" /><img file="US2022121884A1_D0749.tif" /><img file="US2022121884A1_D0750.tif" /><img file="US2022121884A1_D0751.tif" /><img file="US2022121884A1_D0752.tif" /><img file="US2022121884A1_D0753.tif" /><img file="US2022121884A1_D0754.tif" /><img file="US2022121884A1_D0755.tif" /><img file="US2022121884A1_D0756.tif" /><img file="US2022121884A1_D0757.tif" /><img file="US2022121884A1_D0758.tif" /><img file="US2022121884A1_D0759.tif" /><img file="US2022121884A1_D0760.tif" /><img file="US2022121884A1_D0761.tif" /><img file="US2022121884A1_D0762.tif" /><img file="US2022121884A1_D0763.tif" /><img file="US2022121884A1_D0764.tif" /><img file="US2022121884A1_D0765.tif" /><img file="US2022121884A1_D0766.tif" /><img file="US2022121884A1_D0767.tif" /><img file="US2022121884A1_D0768.tif" /><img file="US2022121884A1_D0769.tif" /><img file="US2022121884A1_D0770.tif" /><img file="US2022121884A1_D0771.tif" /><img file="US2022121884A1_D0772.tif" /><img file="US2022121884A1_D0773.tif" /><img file="US2022121884A1_D0774.tif" /><img file="US2022121884A1_D0775.tif" /><img file="US2022121884A1_D0776.tif" /><img file="US2022121884A1_D0777.tif" /><img file="US2022121884A1_D0778.tif" /><img file="US2022121884A1_D0779.tif" /><img file="US2022121884A1_D0780.tif" /><img file="US2022121884A1_D0781.tif" /><img file="US2022121884A1_D0782.tif" /><img file="US2022121884A1_D0783.tif" /><img file="US2022121884A1_D0784.tif" /><maths id="MATH-US-00006-3" num="00006.3"><math overflow="scroll"><mrow><mi>subject</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>to</mi></mrow></math></maths><img file="US2022121884A1_D0785.tif" /><img file="US2022121884A1_D0786.tif" /><img file="US2022121884A1_D0787.tif" /><img file="US2022121884A1_D0788.tif" /><img file="US2022121884A1_D0789.tif" /><img file="US2022121884A1_D0790.tif" /><img file="US2022121884A1_D0791.tif" /><img file="US2022121884A1_D0792.tif" /><img file="US2022121884A1_D0793.tif" /><img file="US2022121884A1_D0794.tif" /><img file="US2022121884A1_D0795.tif" /><img file="US2022121884A1_D0796.tif" /><img file="US2022121884A1_D0797.tif" /><img file="US2022121884A1_D0798.tif" /><img file="US2022121884A1_D0799.tif" /><img file="US2022121884A1_D0800.tif" /><img file="US2022121884A1_D0801.tif" /><img file="US2022121884A1_D0802.tif" /><img file="US2022121884A1_D0803.tif" /><img file="US2022121884A1_D0804.tif" /><img file="US2022121884A1_D0805.tif" /><img file="US2022121884A1_D0806.tif" /><img file="US2022121884A1_D0807.tif" /><img file="US2022121884A1_D0808.tif" /><img file="US2022121884A1_D0809.tif" /><img file="US2022121884A1_D0810.tif" /><img file="US2022121884A1_D0811.tif" /><img file="US2022121884A1_D0812.tif" /><img file="US2022121884A1_D0813.tif" /><img file="US2022121884A1_D0814.tif" /><img file="US2022121884A1_D0815.tif" /><img file="US2022121884A1_D0816.tif" /><img file="US2022121884A1_D0817.tif" /><img file="US2022121884A1_D0818.tif" /><img file="US2022121884A1_D0819.tif" /><img file="US2022121884A1_D0820.tif" /><img file="US2022121884A1_D0821.tif" /><img file="US2022121884A1_D0822.tif" /><img file="US2022121884A1_D0823.tif" /><img file="US2022121884A1_D0824.tif" /><img file="US2022121884A1_D0825.tif" /><img file="US2022121884A1_D0826.tif" /><img file="US2022121884A1_D0827.tif" /><img file="US2022121884A1_D0828.tif" /><img file="US2022121884A1_D0829.tif" /><img file="US2022121884A1_D0830.tif" /><img file="US2022121884A1_D0831.tif" /><img file="US2022121884A1_D0832.tif" /><img file="US2022121884A1_D0833.tif" /><img file="US2022121884A1_D0834.tif" /><img file="US2022121884A1_D0835.tif" /><img file="US2022121884A1_D0836.tif" /><img file="US2022121884A1_D0837.tif" /><img file="US2022121884A1_D0838.tif" /><img file="US2022121884A1_D0839.tif" /><img file="US2022121884A1_D0840.tif" /><img file="US2022121884A1_D0841.tif" /><img file="US2022121884A1_D0842.tif" /><img file="US2022121884A1_D0843.tif" /><img file="US2022121884A1_D0844.tif" /><img file="US2022121884A1_D0845.tif" /><img file="US2022121884A1_D0846.tif" /><img file="US2022121884A1_D0847.tif" /><img file="US2022121884A1_D0848.tif" /><img file="US2022121884A1_D0849.tif" /><img file="US2022121884A1_D0850.tif" /><img file="US2022121884A1_D0851.tif" /><img file="US2022121884A1_D0852.tif" /><img file="US2022121884A1_D0853.tif" /><img file="US2022121884A1_D0854.tif" /><img file="US2022121884A1_D0855.tif" /><img file="US2022121884A1_D0856.tif" /><img file="US2022121884A1_D0857.tif" /><img file="US2022121884A1_D0858.tif" /><img file="US2022121884A1_D0859.tif" /><img file="US2022121884A1_D0860.tif" /><img file="US2022121884A1_D0861.tif" /><img file="US2022121884A1_D0862.tif" /><img file="US2022121884A1_D0863.tif" /><img file="US2022121884A1_D0864.tif" /><img file="US2022121884A1_D0865.tif" /><img file="US2022121884A1_D0866.tif" /><img file="US2022121884A1_D0867.tif" /><img file="US2022121884A1_D0868.tif" /><img file="US2022121884A1_D0869.tif" /><img file="US2022121884A1_D0870.tif" /><img file="US2022121884A1_D0871.tif" /><img file="US2022121884A1_D0872.tif" /><img file="US2022121884A1_D0873.tif" /><img file="US2022121884A1_D0874.tif" /><img file="US2022121884A1_D0875.tif" /><img file="US2022121884A1_D0876.tif" /><img file="US2022121884A1_D0877.tif" /><img file="US2022121884A1_D0878.tif" /><img file="US2022121884A1_D0879.tif" /><img file="US2022121884A1_D0880.tif" /><img file="US2022121884A1_D0881.tif" /><img file="US2022121884A1_D0882.tif" /><img file="US2022121884A1_D0883.tif" /><img file="US2022121884A1_D0884.tif" /><img file="US2022121884A1_D0885.tif" /><img file="US2022121884A1_D0886.tif" /><img file="US2022121884A1_D0887.tif" /><img file="US2022121884A1_D0888.tif" /><img file="US2022121884A1_D0889.tif" /><img file="US2022121884A1_D0890.tif" /><img file="US2022121884A1_D0891.tif" /><img file="US2022121884A1_D0892.tif" /><img file="US2022121884A1_D0893.tif" /><img file="US2022121884A1_D0894.tif" /><img file="US2022121884A1_D0895.tif" /><img file="US2022121884A1_D0896.tif" /><maths id="MATH-US-00006-4" num="00006.4"><math overflow="scroll"><mrow><mi>v</mi><mo>=</mo><mrow><mi>f</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D0897.tif" /><img file="US2022121884A1_D0898.tif" /><img file="US2022121884A1_D0899.tif" /><img file="US2022121884A1_D0900.tif" /><img file="US2022121884A1_D0901.tif" /><img file="US2022121884A1_D0902.tif" /><img file="US2022121884A1_D0903.tif" /><img file="US2022121884A1_D0904.tif" /><img file="US2022121884A1_D0905.tif" /><img file="US2022121884A1_D0906.tif" /><img file="US2022121884A1_D0907.tif" /><img file="US2022121884A1_D0908.tif" /><img file="US2022121884A1_D0909.tif" /><img file="US2022121884A1_D0910.tif" /><img file="US2022121884A1_D0911.tif" /><img file="US2022121884A1_D0912.tif" /><img file="US2022121884A1_D0913.tif" /><img file="US2022121884A1_D0914.tif" /><img file="US2022121884A1_D0915.tif" /><img file="US2022121884A1_D0916.tif" /><img file="US2022121884A1_D0917.tif" /><img file="US2022121884A1_D0918.tif" /><img file="US2022121884A1_D0919.tif" /><img file="US2022121884A1_D0920.tif" /><img file="US2022121884A1_D0921.tif" /><img file="US2022121884A1_D0922.tif" /><img file="US2022121884A1_D0923.tif" /><img file="US2022121884A1_D0924.tif" /><img file="US2022121884A1_D0925.tif" /><img file="US2022121884A1_D0926.tif" /><img file="US2022121884A1_D0927.tif" /><img file="US2022121884A1_D0928.tif" /><img file="US2022121884A1_D0929.tif" /><img file="US2022121884A1_D0930.tif" /><img file="US2022121884A1_D0931.tif" /><img file="US2022121884A1_D0932.tif" /><img file="US2022121884A1_D0933.tif" /><img file="US2022121884A1_D0934.tif" /><img file="US2022121884A1_D0935.tif" /><img file="US2022121884A1_D0936.tif" /><img file="US2022121884A1_D0937.tif" /><img file="US2022121884A1_D0938.tif" /><img file="US2022121884A1_D0939.tif" /><img file="US2022121884A1_D0940.tif" /><img file="US2022121884A1_D0941.tif" /><img file="US2022121884A1_D0942.tif" /><img file="US2022121884A1_D0943.tif" /><img file="US2022121884A1_D0944.tif" /><img file="US2022121884A1_D0945.tif" /><img file="US2022121884A1_D0946.tif" /><img file="US2022121884A1_D0947.tif" /><img file="US2022121884A1_D0948.tif" /><img file="US2022121884A1_D0949.tif" /><img file="US2022121884A1_D0950.tif" /><img file="US2022121884A1_D0951.tif" /><img file="US2022121884A1_D0952.tif" /><img file="US2022121884A1_D0953.tif" /><img file="US2022121884A1_D0954.tif" /><img file="US2022121884A1_D0955.tif" /><img file="US2022121884A1_D0956.tif" /><img file="US2022121884A1_D0957.tif" /><img file="US2022121884A1_D0958.tif" /><img file="US2022121884A1_D0959.tif" /><img file="US2022121884A1_D0960.tif" /><img file="US2022121884A1_D0961.tif" /><img file="US2022121884A1_D0962.tif" /><img file="US2022121884A1_D0963.tif" /><img file="US2022121884A1_D0964.tif" /><img file="US2022121884A1_D0965.tif" /><img file="US2022121884A1_D0966.tif" /><img file="US2022121884A1_D0967.tif" /><img file="US2022121884A1_D0968.tif" /><img file="US2022121884A1_D0969.tif" /><img file="US2022121884A1_D0970.tif" /><img file="US2022121884A1_D0971.tif" /><img file="US2022121884A1_D0972.tif" /><img file="US2022121884A1_D0973.tif" /><img file="US2022121884A1_D0974.tif" /><img file="US2022121884A1_D0975.tif" /><img file="US2022121884A1_D0976.tif" /><img file="US2022121884A1_D0977.tif" /><img file="US2022121884A1_D0978.tif" /><img file="US2022121884A1_D0979.tif" /><img file="US2022121884A1_D0980.tif" /><img file="US2022121884A1_D0981.tif" /><img file="US2022121884A1_D0982.tif" /><img file="US2022121884A1_D0983.tif" /><img file="US2022121884A1_D0984.tif" /><img file="US2022121884A1_D0985.tif" /><img file="US2022121884A1_D0986.tif" /><img file="US2022121884A1_D0987.tif" /><img file="US2022121884A1_D0988.tif" /><img file="US2022121884A1_D0989.tif" /><img file="US2022121884A1_D0990.tif" /><img file="US2022121884A1_D0991.tif" /><img file="US2022121884A1_D0992.tif" /><img file="US2022121884A1_D0993.tif" /><img file="US2022121884A1_D0994.tif" /><img file="US2022121884A1_D0995.tif" /><img file="US2022121884A1_D0996.tif" /><img file="US2022121884A1_D0997.tif" /><img file="US2022121884A1_D0998.tif" /><img file="US2022121884A1_D0999.tif" /><img file="US2022121884A1_D1000.tif" /><img file="US2022121884A1_D1001.tif" /><img file="US2022121884A1_D1002.tif" /><img file="US2022121884A1_D1003.tif" /><img file="US2022121884A1_D1004.tif" /><img file="US2022121884A1_D1005.tif" /><img file="US2022121884A1_D1006.tif" /><img file="US2022121884A1_D1007.tif" /><img file="US2022121884A1_D1008.tif" />
where A is a fuzzy set, <sub>h</sub>A is the membership function of A, μ<sub>Y </sub>is the membership function of Y, and u and v are generic values of X and Y, respectively.
A discrete version of this rule is:
<maths id="MATH-US-00007" num="00007"><math overflow="scroll"><mrow><mi>Y</mi><mo>=</mo><mrow><mi>f</mi><mo></mo><mrow><mo>(</mo><mi>X</mi><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D1009.tif" /><img file="US2022121884A1_D1010.tif" /><img file="US2022121884A1_D1011.tif" /><img file="US2022121884A1_D1012.tif" /><img file="US2022121884A1_D1013.tif" /><img file="US2022121884A1_D1014.tif" /><img file="US2022121884A1_D1015.tif" /><img file="US2022121884A1_D1016.tif" /><img file="US2022121884A1_D1017.tif" /><img file="US2022121884A1_D1018.tif" /><img file="US2022121884A1_D1019.tif" /><img file="US2022121884A1_D1020.tif" /><img file="US2022121884A1_D1021.tif" /><img file="US2022121884A1_D1022.tif" /><img file="US2022121884A1_D1023.tif" /><img file="US2022121884A1_D1024.tif" /><img file="US2022121884A1_D1025.tif" /><img file="US2022121884A1_D1026.tif" /><img file="US2022121884A1_D1027.tif" /><img file="US2022121884A1_D1028.tif" /><img file="US2022121884A1_D1029.tif" /><img file="US2022121884A1_D1030.tif" /><img file="US2022121884A1_D1031.tif" /><img file="US2022121884A1_D1032.tif" /><img file="US2022121884A1_D1033.tif" /><img file="US2022121884A1_D1034.tif" /><img file="US2022121884A1_D1035.tif" /><img file="US2022121884A1_D1036.tif" /><img file="US2022121884A1_D1037.tif" /><img file="US2022121884A1_D1038.tif" /><img file="US2022121884A1_D1039.tif" /><img file="US2022121884A1_D1040.tif" /><img file="US2022121884A1_D1041.tif" /><img file="US2022121884A1_D1042.tif" /><img file="US2022121884A1_D1043.tif" /><img file="US2022121884A1_D1044.tif" /><img file="US2022121884A1_D1045.tif" /><img file="US2022121884A1_D1046.tif" /><img file="US2022121884A1_D1047.tif" /><img file="US2022121884A1_D1048.tif" /><img file="US2022121884A1_D1049.tif" /><img file="US2022121884A1_D1050.tif" /><img file="US2022121884A1_D1051.tif" /><img file="US2022121884A1_D1052.tif" /><img file="US2022121884A1_D1053.tif" /><img file="US2022121884A1_D1054.tif" /><img file="US2022121884A1_D1055.tif" /><img file="US2022121884A1_D1056.tif" /><img file="US2022121884A1_D1057.tif" /><img file="US2022121884A1_D1058.tif" /><img file="US2022121884A1_D1059.tif" /><img file="US2022121884A1_D1060.tif" /><img file="US2022121884A1_D1061.tif" /><img file="US2022121884A1_D1062.tif" /><img file="US2022121884A1_D1063.tif" /><img file="US2022121884A1_D1064.tif" /><img file="US2022121884A1_D1065.tif" /><img file="US2022121884A1_D1066.tif" /><img file="US2022121884A1_D1067.tif" /><img file="US2022121884A1_D1068.tif" /><img file="US2022121884A1_D1069.tif" /><img file="US2022121884A1_D1070.tif" /><img file="US2022121884A1_D1071.tif" /><img file="US2022121884A1_D1072.tif" /><img file="US2022121884A1_D1073.tif" /><img file="US2022121884A1_D1074.tif" /><img file="US2022121884A1_D1075.tif" /><img file="US2022121884A1_D1076.tif" /><img file="US2022121884A1_D1077.tif" /><img file="US2022121884A1_D1078.tif" /><img file="US2022121884A1_D1079.tif" /><img file="US2022121884A1_D1080.tif" /><img file="US2022121884A1_D1081.tif" /><img file="US2022121884A1_D1082.tif" /><img file="US2022121884A1_D1083.tif" /><img file="US2022121884A1_D1084.tif" /><img file="US2022121884A1_D1085.tif" /><img file="US2022121884A1_D1086.tif" /><img file="US2022121884A1_D1087.tif" /><img file="US2022121884A1_D1088.tif" /><img file="US2022121884A1_D1089.tif" /><img file="US2022121884A1_D1090.tif" /><img file="US2022121884A1_D1091.tif" /><img file="US2022121884A1_D1092.tif" /><img file="US2022121884A1_D1093.tif" /><img file="US2022121884A1_D1094.tif" /><img file="US2022121884A1_D1095.tif" /><img file="US2022121884A1_D1096.tif" /><img file="US2022121884A1_D1097.tif" /><img file="US2022121884A1_D1098.tif" /><img file="US2022121884A1_D1099.tif" /><img file="US2022121884A1_D1100.tif" /><img file="US2022121884A1_D1101.tif" /><img file="US2022121884A1_D1102.tif" /><img file="US2022121884A1_D1103.tif" /><img file="US2022121884A1_D1104.tif" /><img file="US2022121884A1_D1105.tif" /><img file="US2022121884A1_D1106.tif" /><img file="US2022121884A1_D1107.tif" /><img file="US2022121884A1_D1108.tif" /><img file="US2022121884A1_D1109.tif" /><img file="US2022121884A1_D1110.tif" /><img file="US2022121884A1_D1111.tif" /><img file="US2022121884A1_D1112.tif" /><img file="US2022121884A1_D1113.tif" /><img file="US2022121884A1_D1114.tif" /><img file="US2022121884A1_D1115.tif" /><img file="US2022121884A1_D1116.tif" /><img file="US2022121884A1_D1117.tif" /><img file="US2022121884A1_D1118.tif" /><img file="US2022121884A1_D1119.tif" /><img file="US2022121884A1_D1120.tif" /><maths id="MATH-US-00007-2" num="00007.2"><math overflow="scroll"><mfrac><mrow><mrow><mi>R</mi><mo></mo><mrow><mo>(</mo><mi>X</mi><mo>)</mo></mrow></mrow><mo>:</mo><mrow><mi>X</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>is</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mrow><mo>(</mo><mrow><mrow><msub><mi>μ</mi><mn>1</mn></msub><mo>/</mo><msub><mrow><mi>u</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mrow><mn>1</mn></msub></mrow><mo>+</mo><mi>…</mi><mo>+</mo><mrow><msub><mi>μ</mi><mi>n</mi></msub><mo>/</mo><msub><mi>u</mi><mi>n</mi></msub></mrow></mrow><mo>)</mo></mrow></mrow></mrow><mrow><mrow><mrow><mi>R</mi><mo></mo><mrow><mo>(</mo><mi>Y</mi><mo>)</mo></mrow></mrow><mo>:</mo><mrow><msub><mi>μ</mi><mi>Y</mi></msub><mo></mo><mrow><mo>(</mo><mi>v</mi><mo>)</mo></mrow></mrow></mrow><mo>=</mo><mrow><msub><mi>sup</mi><mrow><msub><mi>u</mi><mn>1</mn></msub><mo></mo><msub><mi>…u</mi><mi>n</mi></msub></mrow></msub><mo></mo><msub><mi>μ</mi><mi>i</mi></msub></mrow></mrow></mfrac></math></maths><img file="US2022121884A1_D1121.tif" /><img file="US2022121884A1_D1122.tif" /><img file="US2022121884A1_D1123.tif" /><img file="US2022121884A1_D1124.tif" /><img file="US2022121884A1_D1125.tif" /><img file="US2022121884A1_D1126.tif" /><img file="US2022121884A1_D1127.tif" /><img file="US2022121884A1_D1128.tif" /><img file="US2022121884A1_D1129.tif" /><img file="US2022121884A1_D1130.tif" /><img file="US2022121884A1_D1131.tif" /><img file="US2022121884A1_D1132.tif" /><img file="US2022121884A1_D1133.tif" /><img file="US2022121884A1_D1134.tif" /><img file="US2022121884A1_D1135.tif" /><img file="US2022121884A1_D1136.tif" /><img file="US2022121884A1_D1137.tif" /><img file="US2022121884A1_D1138.tif" /><img file="US2022121884A1_D1139.tif" /><img file="US2022121884A1_D1140.tif" /><img file="US2022121884A1_D1141.tif" /><img file="US2022121884A1_D1142.tif" /><img file="US2022121884A1_D1143.tif" /><img file="US2022121884A1_D1144.tif" /><img file="US2022121884A1_D1145.tif" /><img file="US2022121884A1_D1146.tif" /><img file="US2022121884A1_D1147.tif" /><img file="US2022121884A1_D1148.tif" /><img file="US2022121884A1_D1149.tif" /><img file="US2022121884A1_D1150.tif" /><img file="US2022121884A1_D1151.tif" /><img file="US2022121884A1_D1152.tif" /><img file="US2022121884A1_D1153.tif" /><img file="US2022121884A1_D1154.tif" /><img file="US2022121884A1_D1155.tif" /><img file="US2022121884A1_D1156.tif" /><img file="US2022121884A1_D1157.tif" /><img file="US2022121884A1_D1158.tif" /><img file="US2022121884A1_D1159.tif" /><img file="US2022121884A1_D1160.tif" /><img file="US2022121884A1_D1161.tif" /><img file="US2022121884A1_D1162.tif" /><img file="US2022121884A1_D1163.tif" /><img file="US2022121884A1_D1164.tif" /><img file="US2022121884A1_D1165.tif" /><img file="US2022121884A1_D1166.tif" /><img file="US2022121884A1_D1167.tif" /><img file="US2022121884A1_D1168.tif" /><img file="US2022121884A1_D1169.tif" /><img file="US2022121884A1_D1170.tif" /><img file="US2022121884A1_D1171.tif" /><img file="US2022121884A1_D1172.tif" /><img file="US2022121884A1_D1173.tif" /><img file="US2022121884A1_D1174.tif" /><img file="US2022121884A1_D1175.tif" /><img file="US2022121884A1_D1176.tif" /><img file="US2022121884A1_D1177.tif" /><img file="US2022121884A1_D1178.tif" /><img file="US2022121884A1_D1179.tif" /><img file="US2022121884A1_D1180.tif" /><img file="US2022121884A1_D1181.tif" /><img file="US2022121884A1_D1182.tif" /><img file="US2022121884A1_D1183.tif" /><img file="US2022121884A1_D1184.tif" /><img file="US2022121884A1_D1185.tif" /><img file="US2022121884A1_D1186.tif" /><img file="US2022121884A1_D1187.tif" /><img file="US2022121884A1_D1188.tif" /><img file="US2022121884A1_D1189.tif" /><img file="US2022121884A1_D1190.tif" /><img file="US2022121884A1_D1191.tif" /><img file="US2022121884A1_D1192.tif" /><img file="US2022121884A1_D1193.tif" /><img file="US2022121884A1_D1194.tif" /><img file="US2022121884A1_D1195.tif" /><img file="US2022121884A1_D1196.tif" /><img file="US2022121884A1_D1197.tif" /><img file="US2022121884A1_D1198.tif" /><img file="US2022121884A1_D1199.tif" /><img file="US2022121884A1_D1200.tif" /><img file="US2022121884A1_D1201.tif" /><img file="US2022121884A1_D1202.tif" /><img file="US2022121884A1_D1203.tif" /><img file="US2022121884A1_D1204.tif" /><img file="US2022121884A1_D1205.tif" /><img file="US2022121884A1_D1206.tif" /><img file="US2022121884A1_D1207.tif" /><img file="US2022121884A1_D1208.tif" /><img file="US2022121884A1_D1209.tif" /><img file="US2022121884A1_D1210.tif" /><img file="US2022121884A1_D1211.tif" /><img file="US2022121884A1_D1212.tif" /><img file="US2022121884A1_D1213.tif" /><img file="US2022121884A1_D1214.tif" /><img file="US2022121884A1_D1215.tif" /><img file="US2022121884A1_D1216.tif" /><img file="US2022121884A1_D1217.tif" /><img file="US2022121884A1_D1218.tif" /><img file="US2022121884A1_D1219.tif" /><img file="US2022121884A1_D1220.tif" /><img file="US2022121884A1_D1221.tif" /><img file="US2022121884A1_D1222.tif" /><img file="US2022121884A1_D1223.tif" /><img file="US2022121884A1_D1224.tif" /><img file="US2022121884A1_D1225.tif" /><img file="US2022121884A1_D1226.tif" /><img file="US2022121884A1_D1227.tif" /><img file="US2022121884A1_D1228.tif" /><img file="US2022121884A1_D1229.tif" /><img file="US2022121884A1_D1230.tif" /><img file="US2022121884A1_D1231.tif" /><img file="US2022121884A1_D1232.tif" /><maths id="MATH-US-00007-3" num="00007.3"><math overflow="scroll"><mrow><mi>subject</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>to</mi></mrow></math></maths><img file="US2022121884A1_D1233.tif" /><img file="US2022121884A1_D1234.tif" /><img file="US2022121884A1_D1235.tif" /><img file="US2022121884A1_D1236.tif" /><img file="US2022121884A1_D1237.tif" /><img file="US2022121884A1_D1238.tif" /><img file="US2022121884A1_D1239.tif" /><img file="US2022121884A1_D1240.tif" /><img file="US2022121884A1_D1241.tif" /><img file="US2022121884A1_D1242.tif" /><img file="US2022121884A1_D1243.tif" /><img file="US2022121884A1_D1244.tif" /><img file="US2022121884A1_D1245.tif" /><img file="US2022121884A1_D1246.tif" /><img file="US2022121884A1_D1247.tif" /><img file="US2022121884A1_D1248.tif" /><img file="US2022121884A1_D1249.tif" /><img file="US2022121884A1_D1250.tif" /><img file="US2022121884A1_D1251.tif" /><img file="US2022121884A1_D1252.tif" /><img file="US2022121884A1_D1253.tif" /><img file="US2022121884A1_D1254.tif" /><img file="US2022121884A1_D1255.tif" /><img file="US2022121884A1_D1256.tif" /><img file="US2022121884A1_D1257.tif" /><img file="US2022121884A1_D1258.tif" /><img file="US2022121884A1_D1259.tif" /><img file="US2022121884A1_D1260.tif" /><img file="US2022121884A1_D1261.tif" /><img file="US2022121884A1_D1262.tif" /><img file="US2022121884A1_D1263.tif" /><img file="US2022121884A1_D1264.tif" /><img file="US2022121884A1_D1265.tif" /><img file="US2022121884A1_D1266.tif" /><img file="US2022121884A1_D1267.tif" /><img file="US2022121884A1_D1268.tif" /><img file="US2022121884A1_D1269.tif" /><img file="US2022121884A1_D1270.tif" /><img file="US2022121884A1_D1271.tif" /><img file="US2022121884A1_D1272.tif" /><img file="US2022121884A1_D1273.tif" /><img file="US2022121884A1_D1274.tif" /><img file="US2022121884A1_D1275.tif" /><img file="US2022121884A1_D1276.tif" /><img file="US2022121884A1_D1277.tif" /><img file="US2022121884A1_D1278.tif" /><img file="US2022121884A1_D1279.tif" /><img file="US2022121884A1_D1280.tif" /><img file="US2022121884A1_D1281.tif" /><img file="US2022121884A1_D1282.tif" /><img file="US2022121884A1_D1283.tif" /><img file="US2022121884A1_D1284.tif" /><img file="US2022121884A1_D1285.tif" /><img file="US2022121884A1_D1286.tif" /><img file="US2022121884A1_D1287.tif" /><img file="US2022121884A1_D1288.tif" /><img file="US2022121884A1_D1289.tif" /><img file="US2022121884A1_D1290.tif" /><img file="US2022121884A1_D1291.tif" /><img file="US2022121884A1_D1292.tif" /><img file="US2022121884A1_D1293.tif" /><img file="US2022121884A1_D1294.tif" /><img file="US2022121884A1_D1295.tif" /><img file="US2022121884A1_D1296.tif" /><img file="US2022121884A1_D1297.tif" /><img file="US2022121884A1_D1298.tif" /><img file="US2022121884A1_D1299.tif" /><img file="US2022121884A1_D1300.tif" /><img file="US2022121884A1_D1301.tif" /><img file="US2022121884A1_D1302.tif" /><img file="US2022121884A1_D1303.tif" /><img file="US2022121884A1_D1304.tif" /><img file="US2022121884A1_D1305.tif" /><img file="US2022121884A1_D1306.tif" /><img file="US2022121884A1_D1307.tif" /><img file="US2022121884A1_D1308.tif" /><img file="US2022121884A1_D1309.tif" /><img file="US2022121884A1_D1310.tif" /><img file="US2022121884A1_D1311.tif" /><img file="US2022121884A1_D1312.tif" /><img file="US2022121884A1_D1313.tif" /><img file="US2022121884A1_D1314.tif" /><img file="US2022121884A1_D1315.tif" /><img file="US2022121884A1_D1316.tif" /><img file="US2022121884A1_D1317.tif" /><img file="US2022121884A1_D1318.tif" /><img file="US2022121884A1_D1319.tif" /><img file="US2022121884A1_D1320.tif" /><img file="US2022121884A1_D1321.tif" /><img file="US2022121884A1_D1322.tif" /><img file="US2022121884A1_D1323.tif" /><img file="US2022121884A1_D1324.tif" /><img file="US2022121884A1_D1325.tif" /><img file="US2022121884A1_D1326.tif" /><img file="US2022121884A1_D1327.tif" /><img file="US2022121884A1_D1328.tif" /><img file="US2022121884A1_D1329.tif" /><img file="US2022121884A1_D1330.tif" /><img file="US2022121884A1_D1331.tif" /><img file="US2022121884A1_D1332.tif" /><img file="US2022121884A1_D1333.tif" /><img file="US2022121884A1_D1334.tif" /><img file="US2022121884A1_D1335.tif" /><img file="US2022121884A1_D1336.tif" /><img file="US2022121884A1_D1337.tif" /><img file="US2022121884A1_D1338.tif" /><img file="US2022121884A1_D1339.tif" /><img file="US2022121884A1_D1340.tif" /><img file="US2022121884A1_D1341.tif" /><img file="US2022121884A1_D1342.tif" /><img file="US2022121884A1_D1343.tif" /><img file="US2022121884A1_D1344.tif" /><maths id="MATH-US-00007-4" num="00007.4"><math overflow="scroll"><mrow><mi>v</mi><mo>=</mo><mrow><mi>f</mi><mo></mo><mrow><mo>(</mo><msub><mi>u</mi><mi>i</mi></msub><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D1345.tif" /><img file="US2022121884A1_D1346.tif" /><img file="US2022121884A1_D1347.tif" /><img file="US2022121884A1_D1348.tif" /><img file="US2022121884A1_D1349.tif" /><img file="US2022121884A1_D1350.tif" /><img file="US2022121884A1_D1351.tif" /><img file="US2022121884A1_D1352.tif" /><img file="US2022121884A1_D1353.tif" /><img file="US2022121884A1_D1354.tif" /><img file="US2022121884A1_D1355.tif" /><img file="US2022121884A1_D1356.tif" /><img file="US2022121884A1_D1357.tif" /><img file="US2022121884A1_D1358.tif" /><img file="US2022121884A1_D1359.tif" /><img file="US2022121884A1_D1360.tif" /><img file="US2022121884A1_D1361.tif" /><img file="US2022121884A1_D1362.tif" /><img file="US2022121884A1_D1363.tif" /><img file="US2022121884A1_D1364.tif" /><img file="US2022121884A1_D1365.tif" /><img file="US2022121884A1_D1366.tif" /><img file="US2022121884A1_D1367.tif" /><img file="US2022121884A1_D1368.tif" /><img file="US2022121884A1_D1369.tif" /><img file="US2022121884A1_D1370.tif" /><img file="US2022121884A1_D1371.tif" /><img file="US2022121884A1_D1372.tif" /><img file="US2022121884A1_D1373.tif" /><img file="US2022121884A1_D1374.tif" /><img file="US2022121884A1_D1375.tif" /><img file="US2022121884A1_D1376.tif" /><img file="US2022121884A1_D1377.tif" /><img file="US2022121884A1_D1378.tif" /><img file="US2022121884A1_D1379.tif" /><img file="US2022121884A1_D1380.tif" /><img file="US2022121884A1_D1381.tif" /><img file="US2022121884A1_D1382.tif" /><img file="US2022121884A1_D1383.tif" /><img file="US2022121884A1_D1384.tif" /><img file="US2022121884A1_D1385.tif" /><img file="US2022121884A1_D1386.tif" /><img file="US2022121884A1_D1387.tif" /><img file="US2022121884A1_D1388.tif" /><img file="US2022121884A1_D1389.tif" /><img file="US2022121884A1_D1390.tif" /><img file="US2022121884A1_D1391.tif" /><img file="US2022121884A1_D1392.tif" /><img file="US2022121884A1_D1393.tif" /><img file="US2022121884A1_D1394.tif" /><img file="US2022121884A1_D1395.tif" /><img file="US2022121884A1_D1396.tif" /><img file="US2022121884A1_D1397.tif" /><img file="US2022121884A1_D1398.tif" /><img file="US2022121884A1_D1399.tif" /><img file="US2022121884A1_D1400.tif" /><img file="US2022121884A1_D1401.tif" /><img file="US2022121884A1_D1402.tif" /><img file="US2022121884A1_D1403.tif" /><img file="US2022121884A1_D1404.tif" /><img file="US2022121884A1_D1405.tif" /><img file="US2022121884A1_D1406.tif" /><img file="US2022121884A1_D1407.tif" /><img file="US2022121884A1_D1408.tif" /><img file="US2022121884A1_D1409.tif" /><img file="US2022121884A1_D1410.tif" /><img file="US2022121884A1_D1411.tif" /><img file="US2022121884A1_D1412.tif" /><img file="US2022121884A1_D1413.tif" /><img file="US2022121884A1_D1414.tif" /><img file="US2022121884A1_D1415.tif" /><img file="US2022121884A1_D1416.tif" /><img file="US2022121884A1_D1417.tif" /><img file="US2022121884A1_D1418.tif" /><img file="US2022121884A1_D1419.tif" /><img file="US2022121884A1_D1420.tif" /><img file="US2022121884A1_D1421.tif" /><img file="US2022121884A1_D1422.tif" /><img file="US2022121884A1_D1423.tif" /><img file="US2022121884A1_D1424.tif" /><img file="US2022121884A1_D1425.tif" /><img file="US2022121884A1_D1426.tif" /><img file="US2022121884A1_D1427.tif" /><img file="US2022121884A1_D1428.tif" /><img file="US2022121884A1_D1429.tif" /><img file="US2022121884A1_D1430.tif" /><img file="US2022121884A1_D1431.tif" /><img file="US2022121884A1_D1432.tif" /><img file="US2022121884A1_D1433.tif" /><img file="US2022121884A1_D1434.tif" /><img file="US2022121884A1_D1435.tif" /><img file="US2022121884A1_D1436.tif" /><img file="US2022121884A1_D1437.tif" /><img file="US2022121884A1_D1438.tif" /><img file="US2022121884A1_D1439.tif" /><img file="US2022121884A1_D1440.tif" /><img file="US2022121884A1_D1441.tif" /><img file="US2022121884A1_D1442.tif" /><img file="US2022121884A1_D1443.tif" /><img file="US2022121884A1_D1444.tif" /><img file="US2022121884A1_D1445.tif" /><img file="US2022121884A1_D1446.tif" /><img file="US2022121884A1_D1447.tif" /><img file="US2022121884A1_D1448.tif" /><img file="US2022121884A1_D1449.tif" /><img file="US2022121884A1_D1450.tif" /><img file="US2022121884A1_D1451.tif" /><img file="US2022121884A1_D1452.tif" /><img file="US2022121884A1_D1453.tif" /><img file="US2022121884A1_D1454.tif" /><img file="US2022121884A1_D1455.tif" /><img file="US2022121884A1_D1456.tif" />
In a more general version, we have
<maths id="MATH-US-00008" num="00008"><math overflow="scroll"><mrow><mi>Y</mi><mo>=</mo><mrow><mi>f</mi><mo></mo><mrow><mo>(</mo><mi>X</mi><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D1457.tif" /><img file="US2022121884A1_D1458.tif" /><img file="US2022121884A1_D1459.tif" /><img file="US2022121884A1_D1460.tif" /><img file="US2022121884A1_D1461.tif" /><img file="US2022121884A1_D1462.tif" /><img file="US2022121884A1_D1463.tif" /><img file="US2022121884A1_D1464.tif" /><img file="US2022121884A1_D1465.tif" /><img file="US2022121884A1_D1466.tif" /><img file="US2022121884A1_D1467.tif" /><img file="US2022121884A1_D1468.tif" /><img file="US2022121884A1_D1469.tif" /><img file="US2022121884A1_D1470.tif" /><img file="US2022121884A1_D1471.tif" /><img file="US2022121884A1_D1472.tif" /><img file="US2022121884A1_D1473.tif" /><img file="US2022121884A1_D1474.tif" /><img file="US2022121884A1_D1475.tif" /><img file="US2022121884A1_D1476.tif" /><img file="US2022121884A1_D1477.tif" /><img file="US2022121884A1_D1478.tif" /><img file="US2022121884A1_D1479.tif" /><img file="US2022121884A1_D1480.tif" /><img file="US2022121884A1_D1481.tif" /><img file="US2022121884A1_D1482.tif" /><img file="US2022121884A1_D1483.tif" /><img file="US2022121884A1_D1484.tif" /><img file="US2022121884A1_D1485.tif" /><img file="US2022121884A1_D1486.tif" /><img file="US2022121884A1_D1487.tif" /><img file="US2022121884A1_D1488.tif" /><img file="US2022121884A1_D1489.tif" /><img file="US2022121884A1_D1490.tif" /><img file="US2022121884A1_D1491.tif" /><img file="US2022121884A1_D1492.tif" /><img file="US2022121884A1_D1493.tif" /><img file="US2022121884A1_D1494.tif" /><img file="US2022121884A1_D1495.tif" /><img file="US2022121884A1_D1496.tif" /><img file="US2022121884A1_D1497.tif" /><img file="US2022121884A1_D1498.tif" /><img file="US2022121884A1_D1499.tif" /><img file="US2022121884A1_D1500.tif" /><img file="US2022121884A1_D1501.tif" /><img file="US2022121884A1_D1502.tif" /><img file="US2022121884A1_D1503.tif" /><img file="US2022121884A1_D1504.tif" /><img file="US2022121884A1_D1505.tif" /><img file="US2022121884A1_D1506.tif" /><img file="US2022121884A1_D1507.tif" /><img file="US2022121884A1_D1508.tif" /><img file="US2022121884A1_D1509.tif" /><img file="US2022121884A1_D1510.tif" /><img file="US2022121884A1_D1511.tif" /><img file="US2022121884A1_D1512.tif" /><img file="US2022121884A1_D1513.tif" /><img file="US2022121884A1_D1514.tif" /><img file="US2022121884A1_D1515.tif" /><img file="US2022121884A1_D1516.tif" /><img file="US2022121884A1_D1517.tif" /><img file="US2022121884A1_D1518.tif" /><img file="US2022121884A1_D1519.tif" /><img file="US2022121884A1_D1520.tif" /><img file="US2022121884A1_D1521.tif" /><img file="US2022121884A1_D1522.tif" /><img file="US2022121884A1_D1523.tif" /><img file="US2022121884A1_D1524.tif" /><img file="US2022121884A1_D1525.tif" /><img file="US2022121884A1_D1526.tif" /><img file="US2022121884A1_D1527.tif" /><img file="US2022121884A1_D1528.tif" /><img file="US2022121884A1_D1529.tif" /><img file="US2022121884A1_D1530.tif" /><img file="US2022121884A1_D1531.tif" /><img file="US2022121884A1_D1532.tif" /><img file="US2022121884A1_D1533.tif" /><img file="US2022121884A1_D1534.tif" /><img file="US2022121884A1_D1535.tif" /><img file="US2022121884A1_D1536.tif" /><img file="US2022121884A1_D1537.tif" /><img file="US2022121884A1_D1538.tif" /><img file="US2022121884A1_D1539.tif" /><img file="US2022121884A1_D1540.tif" /><img file="US2022121884A1_D1541.tif" /><img file="US2022121884A1_D1542.tif" /><img file="US2022121884A1_D1543.tif" /><img file="US2022121884A1_D1544.tif" /><img file="US2022121884A1_D1545.tif" /><img file="US2022121884A1_D1546.tif" /><img file="US2022121884A1_D1547.tif" /><img file="US2022121884A1_D1548.tif" /><img file="US2022121884A1_D1549.tif" /><img file="US2022121884A1_D1550.tif" /><img file="US2022121884A1_D1551.tif" /><img file="US2022121884A1_D1552.tif" /><img file="US2022121884A1_D1553.tif" /><img file="US2022121884A1_D1554.tif" /><img file="US2022121884A1_D1555.tif" /><img file="US2022121884A1_D1556.tif" /><img file="US2022121884A1_D1557.tif" /><img file="US2022121884A1_D1558.tif" /><img file="US2022121884A1_D1559.tif" /><img file="US2022121884A1_D1560.tif" /><img file="US2022121884A1_D1561.tif" /><img file="US2022121884A1_D1562.tif" /><img file="US2022121884A1_D1563.tif" /><img file="US2022121884A1_D1564.tif" /><img file="US2022121884A1_D1565.tif" /><img file="US2022121884A1_D1566.tif" /><img file="US2022121884A1_D1567.tif" /><img file="US2022121884A1_D1568.tif" /><maths id="MATH-US-00008-2" num="00008.2"><math overflow="scroll"><mfrac><mrow><mrow><mrow><mi>R</mi><mo></mo><mrow><mo>(</mo><mi>X</mi><mo>)</mo></mrow></mrow><mo>:</mo><mrow><mrow><mi>g</mi><mo></mo><mrow><mo>(</mo><mi>X</mi><mo>)</mo></mrow></mrow><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>is</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mrow><mi>A</mi><mo></mo><mrow><mo>(</mo><mrow><mi>constraint</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>on</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>u</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>is</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><msub><mi>μ</mi><mi>A</mi></msub><mo></mo><mrow><mi>g</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow></mrow><mo>)</mo></mrow></mrow></mrow></mrow><mo>)</mo></mrow><mrow><mrow><mrow><mi>R</mi><mo></mo><mrow><mo>(</mo><mi>Y</mi><mo>)</mo></mrow></mrow><mo>:</mo><mrow><msub><mi>μ</mi><mi>Y</mi></msub><mo></mo><mrow><mo>(</mo><mi>v</mi><mo>)</mo></mrow></mrow></mrow><mo>=</mo><mrow><msub><mi>sup</mi><mi>u</mi></msub><mo></mo><mrow><msub><mi>μ</mi><mi>A</mi></msub><mo></mo><mrow><mo>(</mo><mrow><mi>g</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo>)</mo></mrow></mrow></mrow></mrow></mfrac></math></maths><img file="US2022121884A1_D1569.tif" /><img file="US2022121884A1_D1570.tif" /><img file="US2022121884A1_D1571.tif" /><img file="US2022121884A1_D1572.tif" /><img file="US2022121884A1_D1573.tif" /><img file="US2022121884A1_D1574.tif" /><img file="US2022121884A1_D1575.tif" /><img file="US2022121884A1_D1576.tif" /><img file="US2022121884A1_D1577.tif" /><img file="US2022121884A1_D1578.tif" /><img file="US2022121884A1_D1579.tif" /><img file="US2022121884A1_D1580.tif" /><img file="US2022121884A1_D1581.tif" /><img file="US2022121884A1_D1582.tif" /><img file="US2022121884A1_D1583.tif" /><img file="US2022121884A1_D1584.tif" /><img file="US2022121884A1_D1585.tif" /><img file="US2022121884A1_D1586.tif" /><img file="US2022121884A1_D1587.tif" /><img file="US2022121884A1_D1588.tif" /><img file="US2022121884A1_D1589.tif" /><img file="US2022121884A1_D1590.tif" /><img file="US2022121884A1_D1591.tif" /><img file="US2022121884A1_D1592.tif" /><img file="US2022121884A1_D1593.tif" /><img file="US2022121884A1_D1594.tif" /><img file="US2022121884A1_D1595.tif" /><img file="US2022121884A1_D1596.tif" /><img file="US2022121884A1_D1597.tif" /><img file="US2022121884A1_D1598.tif" /><img file="US2022121884A1_D1599.tif" /><img file="US2022121884A1_D1600.tif" /><img file="US2022121884A1_D1601.tif" /><img file="US2022121884A1_D1602.tif" /><img file="US2022121884A1_D1603.tif" /><img file="US2022121884A1_D1604.tif" /><img file="US2022121884A1_D1605.tif" /><img file="US2022121884A1_D1606.tif" /><img file="US2022121884A1_D1607.tif" /><img file="US2022121884A1_D1608.tif" /><img file="US2022121884A1_D1609.tif" /><img file="US2022121884A1_D1610.tif" /><img file="US2022121884A1_D1611.tif" /><img file="US2022121884A1_D1612.tif" /><img file="US2022121884A1_D1613.tif" /><img file="US2022121884A1_D1614.tif" /><img file="US2022121884A1_D1615.tif" /><img file="US2022121884A1_D1616.tif" /><img file="US2022121884A1_D1617.tif" /><img file="US2022121884A1_D1618.tif" /><img file="US2022121884A1_D1619.tif" /><img file="US2022121884A1_D1620.tif" /><img file="US2022121884A1_D1621.tif" /><img file="US2022121884A1_D1622.tif" /><img file="US2022121884A1_D1623.tif" /><img file="US2022121884A1_D1624.tif" /><img file="US2022121884A1_D1625.tif" /><img file="US2022121884A1_D1626.tif" /><img file="US2022121884A1_D1627.tif" /><img file="US2022121884A1_D1628.tif" /><img file="US2022121884A1_D1629.tif" /><img file="US2022121884A1_D1630.tif" /><img file="US2022121884A1_D1631.tif" /><img file="US2022121884A1_D1632.tif" /><img file="US2022121884A1_D1633.tif" /><img file="US2022121884A1_D1634.tif" /><img file="US2022121884A1_D1635.tif" /><img file="US2022121884A1_D1636.tif" /><img file="US2022121884A1_D1637.tif" /><img file="US2022121884A1_D1638.tif" /><img file="US2022121884A1_D1639.tif" /><img file="US2022121884A1_D1640.tif" /><img file="US2022121884A1_D1641.tif" /><img file="US2022121884A1_D1642.tif" /><img file="US2022121884A1_D1643.tif" /><img file="US2022121884A1_D1644.tif" /><img file="US2022121884A1_D1645.tif" /><img file="US2022121884A1_D1646.tif" /><img file="US2022121884A1_D1647.tif" /><img file="US2022121884A1_D1648.tif" /><img file="US2022121884A1_D1649.tif" /><img file="US2022121884A1_D1650.tif" /><img file="US2022121884A1_D1651.tif" /><img file="US2022121884A1_D1652.tif" /><img file="US2022121884A1_D1653.tif" /><img file="US2022121884A1_D1654.tif" /><img file="US2022121884A1_D1655.tif" /><img file="US2022121884A1_D1656.tif" /><img file="US2022121884A1_D1657.tif" /><img file="US2022121884A1_D1658.tif" /><img file="US2022121884A1_D1659.tif" /><img file="US2022121884A1_D1660.tif" /><img file="US2022121884A1_D1661.tif" /><img file="US2022121884A1_D1662.tif" /><img file="US2022121884A1_D1663.tif" /><img file="US2022121884A1_D1664.tif" /><img file="US2022121884A1_D1665.tif" /><img file="US2022121884A1_D1666.tif" /><img file="US2022121884A1_D1667.tif" /><img file="US2022121884A1_D1668.tif" /><img file="US2022121884A1_D1669.tif" /><img file="US2022121884A1_D1670.tif" /><img file="US2022121884A1_D1671.tif" /><img file="US2022121884A1_D1672.tif" /><img file="US2022121884A1_D1673.tif" /><img file="US2022121884A1_D1674.tif" /><img file="US2022121884A1_D1675.tif" /><img file="US2022121884A1_D1676.tif" /><img file="US2022121884A1_D1677.tif" /><img file="US2022121884A1_D1678.tif" /><img file="US2022121884A1_D1679.tif" /><img file="US2022121884A1_D1680.tif" /><maths id="MATH-US-00008-3" num="00008.3"><math overflow="scroll"><mrow><mi>subject</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>to</mi></mrow></math></maths><img file="US2022121884A1_D1681.tif" /><img file="US2022121884A1_D1682.tif" /><img file="US2022121884A1_D1683.tif" /><img file="US2022121884A1_D1684.tif" /><img file="US2022121884A1_D1685.tif" /><img file="US2022121884A1_D1686.tif" /><img file="US2022121884A1_D1687.tif" /><img file="US2022121884A1_D1688.tif" /><img file="US2022121884A1_D1689.tif" /><img file="US2022121884A1_D1690.tif" /><img file="US2022121884A1_D1691.tif" /><img file="US2022121884A1_D1692.tif" /><img file="US2022121884A1_D1693.tif" /><img file="US2022121884A1_D1694.tif" /><img file="US2022121884A1_D1695.tif" /><img file="US2022121884A1_D1696.tif" /><img file="US2022121884A1_D1697.tif" /><img file="US2022121884A1_D1698.tif" /><img file="US2022121884A1_D1699.tif" /><img file="US2022121884A1_D1700.tif" /><img file="US2022121884A1_D1701.tif" /><img file="US2022121884A1_D1702.tif" /><img file="US2022121884A1_D1703.tif" /><img file="US2022121884A1_D1704.tif" /><img file="US2022121884A1_D1705.tif" /><img file="US2022121884A1_D1706.tif" /><img file="US2022121884A1_D1707.tif" /><img file="US2022121884A1_D1708.tif" /><img file="US2022121884A1_D1709.tif" /><img file="US2022121884A1_D1710.tif" /><img file="US2022121884A1_D1711.tif" /><img file="US2022121884A1_D1712.tif" /><img file="US2022121884A1_D1713.tif" /><img file="US2022121884A1_D1714.tif" /><img file="US2022121884A1_D1715.tif" /><img file="US2022121884A1_D1716.tif" /><img file="US2022121884A1_D1717.tif" /><img file="US2022121884A1_D1718.tif" /><img file="US2022121884A1_D1719.tif" /><img file="US2022121884A1_D1720.tif" /><img file="US2022121884A1_D1721.tif" /><img file="US2022121884A1_D1722.tif" /><img file="US2022121884A1_D1723.tif" /><img file="US2022121884A1_D1724.tif" /><img file="US2022121884A1_D1725.tif" /><img file="US2022121884A1_D1726.tif" /><img file="US2022121884A1_D1727.tif" /><img file="US2022121884A1_D1728.tif" /><img file="US2022121884A1_D1729.tif" /><img file="US2022121884A1_D1730.tif" /><img file="US2022121884A1_D1731.tif" /><img file="US2022121884A1_D1732.tif" /><img file="US2022121884A1_D1733.tif" /><img file="US2022121884A1_D1734.tif" /><img file="US2022121884A1_D1735.tif" /><img file="US2022121884A1_D1736.tif" /><img file="US2022121884A1_D1737.tif" /><img file="US2022121884A1_D1738.tif" /><img file="US2022121884A1_D1739.tif" /><img file="US2022121884A1_D1740.tif" /><img file="US2022121884A1_D1741.tif" /><img file="US2022121884A1_D1742.tif" /><img file="US2022121884A1_D1743.tif" /><img file="US2022121884A1_D1744.tif" /><img file="US2022121884A1_D1745.tif" /><img file="US2022121884A1_D1746.tif" /><img file="US2022121884A1_D1747.tif" /><img file="US2022121884A1_D1748.tif" /><img file="US2022121884A1_D1749.tif" /><img file="US2022121884A1_D1750.tif" /><img file="US2022121884A1_D1751.tif" /><img file="US2022121884A1_D1752.tif" /><img file="US2022121884A1_D1753.tif" /><img file="US2022121884A1_D1754.tif" /><img file="US2022121884A1_D1755.tif" /><img file="US2022121884A1_D1756.tif" /><img file="US2022121884A1_D1757.tif" /><img file="US2022121884A1_D1758.tif" /><img file="US2022121884A1_D1759.tif" /><img file="US2022121884A1_D1760.tif" /><img file="US2022121884A1_D1761.tif" /><img file="US2022121884A1_D1762.tif" /><img file="US2022121884A1_D1763.tif" /><img file="US2022121884A1_D1764.tif" /><img file="US2022121884A1_D1765.tif" /><img file="US2022121884A1_D1766.tif" /><img file="US2022121884A1_D1767.tif" /><img file="US2022121884A1_D1768.tif" /><img file="US2022121884A1_D1769.tif" /><img file="US2022121884A1_D1770.tif" /><img file="US2022121884A1_D1771.tif" /><img file="US2022121884A1_D1772.tif" /><img file="US2022121884A1_D1773.tif" /><img file="US2022121884A1_D1774.tif" /><img file="US2022121884A1_D1775.tif" /><img file="US2022121884A1_D1776.tif" /><img file="US2022121884A1_D1777.tif" /><img file="US2022121884A1_D1778.tif" /><img file="US2022121884A1_D1779.tif" /><img file="US2022121884A1_D1780.tif" /><img file="US2022121884A1_D1781.tif" /><img file="US2022121884A1_D1782.tif" /><img file="US2022121884A1_D1783.tif" /><img file="US2022121884A1_D1784.tif" /><img file="US2022121884A1_D1785.tif" /><img file="US2022121884A1_D1786.tif" /><img file="US2022121884A1_D1787.tif" /><img file="US2022121884A1_D1788.tif" /><img file="US2022121884A1_D1789.tif" /><img file="US2022121884A1_D1790.tif" /><img file="US2022121884A1_D1791.tif" /><img file="US2022121884A1_D1792.tif" /><maths id="MATH-US-00008-4" num="00008.4"><math overflow="scroll"><mrow><mi>v</mi><mo>=</mo><mrow><mi>f</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D1793.tif" /><img file="US2022121884A1_D1794.tif" /><img file="US2022121884A1_D1795.tif" /><img file="US2022121884A1_D1796.tif" /><img file="US2022121884A1_D1797.tif" /><img file="US2022121884A1_D1798.tif" /><img file="US2022121884A1_D1799.tif" /><img file="US2022121884A1_D1800.tif" /><img file="US2022121884A1_D1801.tif" /><img file="US2022121884A1_D1802.tif" /><img file="US2022121884A1_D1803.tif" /><img file="US2022121884A1_D1804.tif" /><img file="US2022121884A1_D1805.tif" /><img file="US2022121884A1_D1806.tif" /><img file="US2022121884A1_D1807.tif" /><img file="US2022121884A1_D1808.tif" /><img file="US2022121884A1_D1809.tif" /><img file="US2022121884A1_D1810.tif" /><img file="US2022121884A1_D1811.tif" /><img file="US2022121884A1_D1812.tif" /><img file="US2022121884A1_D1813.tif" /><img file="US2022121884A1_D1814.tif" /><img file="US2022121884A1_D1815.tif" /><img file="US2022121884A1_D1816.tif" /><img file="US2022121884A1_D1817.tif" /><img file="US2022121884A1_D1818.tif" /><img file="US2022121884A1_D1819.tif" /><img file="US2022121884A1_D1820.tif" /><img file="US2022121884A1_D1821.tif" /><img file="US2022121884A1_D1822.tif" /><img file="US2022121884A1_D1823.tif" /><img file="US2022121884A1_D1824.tif" /><img file="US2022121884A1_D1825.tif" /><img file="US2022121884A1_D1826.tif" /><img file="US2022121884A1_D1827.tif" /><img file="US2022121884A1_D1828.tif" /><img file="US2022121884A1_D1829.tif" /><img file="US2022121884A1_D1830.tif" /><img file="US2022121884A1_D1831.tif" /><img file="US2022121884A1_D1832.tif" /><img file="US2022121884A1_D1833.tif" /><img file="US2022121884A1_D1834.tif" /><img file="US2022121884A1_D1835.tif" /><img file="US2022121884A1_D1836.tif" /><img file="US2022121884A1_D1837.tif" /><img file="US2022121884A1_D1838.tif" /><img file="US2022121884A1_D1839.tif" /><img file="US2022121884A1_D1840.tif" /><img file="US2022121884A1_D1841.tif" /><img file="US2022121884A1_D1842.tif" /><img file="US2022121884A1_D1843.tif" /><img file="US2022121884A1_D1844.tif" /><img file="US2022121884A1_D1845.tif" /><img file="US2022121884A1_D1846.tif" /><img file="US2022121884A1_D1847.tif" /><img file="US2022121884A1_D1848.tif" /><img file="US2022121884A1_D1849.tif" /><img file="US2022121884A1_D1850.tif" /><img file="US2022121884A1_D1851.tif" /><img file="US2022121884A1_D1852.tif" /><img file="US2022121884A1_D1853.tif" /><img file="US2022121884A1_D1854.tif" /><img file="US2022121884A1_D1855.tif" /><img file="US2022121884A1_D1856.tif" /><img file="US2022121884A1_D1857.tif" /><img file="US2022121884A1_D1858.tif" /><img file="US2022121884A1_D1859.tif" /><img file="US2022121884A1_D1860.tif" /><img file="US2022121884A1_D1861.tif" /><img file="US2022121884A1_D1862.tif" /><img file="US2022121884A1_D1863.tif" /><img file="US2022121884A1_D1864.tif" /><img file="US2022121884A1_D1865.tif" /><img file="US2022121884A1_D1866.tif" /><img file="US2022121884A1_D1867.tif" /><img file="US2022121884A1_D1868.tif" /><img file="US2022121884A1_D1869.tif" /><img file="US2022121884A1_D1870.tif" /><img file="US2022121884A1_D1871.tif" /><img file="US2022121884A1_D1872.tif" /><img file="US2022121884A1_D1873.tif" /><img file="US2022121884A1_D1874.tif" /><img file="US2022121884A1_D1875.tif" /><img file="US2022121884A1_D1876.tif" /><img file="US2022121884A1_D1877.tif" /><img file="US2022121884A1_D1878.tif" /><img file="US2022121884A1_D1879.tif" /><img file="US2022121884A1_D1880.tif" /><img file="US2022121884A1_D1881.tif" /><img file="US2022121884A1_D1882.tif" /><img file="US2022121884A1_D1883.tif" /><img file="US2022121884A1_D1884.tif" /><img file="US2022121884A1_D1885.tif" /><img file="US2022121884A1_D1886.tif" /><img file="US2022121884A1_D1887.tif" /><img file="US2022121884A1_D1888.tif" /><img file="US2022121884A1_D1889.tif" /><img file="US2022121884A1_D1890.tif" /><img file="US2022121884A1_D1891.tif" /><img file="US2022121884A1_D1892.tif" /><img file="US2022121884A1_D1893.tif" /><img file="US2022121884A1_D1894.tif" /><img file="US2022121884A1_D1895.tif" /><img file="US2022121884A1_D1896.tif" /><img file="US2022121884A1_D1897.tif" /><img file="US2022121884A1_D1898.tif" /><img file="US2022121884A1_D1899.tif" /><img file="US2022121884A1_D1900.tif" /><img file="US2022121884A1_D1901.tif" /><img file="US2022121884A1_D1902.tif" /><img file="US2022121884A1_D1903.tif" /><img file="US2022121884A1_D1904.tif" />
For a function with two arguments, the extension principle reads:
<maths id="MATH-US-00009" num="00009"><math overflow="scroll"><mrow><mi>Z</mi><mo>=</mo><mrow><mi>f</mi><mo></mo><mrow><mo>(</mo><mrow><mi>X</mi><mo>,</mo><mi>Y</mi></mrow><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D1905.tif" /><img file="US2022121884A1_D1906.tif" /><img file="US2022121884A1_D1907.tif" /><img file="US2022121884A1_D1908.tif" /><img file="US2022121884A1_D1909.tif" /><img file="US2022121884A1_D1910.tif" /><img file="US2022121884A1_D1911.tif" /><img file="US2022121884A1_D1912.tif" /><img file="US2022121884A1_D1913.tif" /><img file="US2022121884A1_D1914.tif" /><img file="US2022121884A1_D1915.tif" /><img file="US2022121884A1_D1916.tif" /><img file="US2022121884A1_D1917.tif" /><img file="US2022121884A1_D1918.tif" /><img file="US2022121884A1_D1919.tif" /><img file="US2022121884A1_D1920.tif" /><img file="US2022121884A1_D1921.tif" /><img file="US2022121884A1_D1922.tif" /><img file="US2022121884A1_D1923.tif" /><img file="US2022121884A1_D1924.tif" /><img file="US2022121884A1_D1925.tif" /><img file="US2022121884A1_D1926.tif" /><img file="US2022121884A1_D1927.tif" /><img file="US2022121884A1_D1928.tif" /><img file="US2022121884A1_D1929.tif" /><img file="US2022121884A1_D1930.tif" /><img file="US2022121884A1_D1931.tif" /><img file="US2022121884A1_D1932.tif" /><img file="US2022121884A1_D1933.tif" /><img file="US2022121884A1_D1934.tif" /><img file="US2022121884A1_D1935.tif" /><img file="US2022121884A1_D1936.tif" /><img file="US2022121884A1_D1937.tif" /><img file="US2022121884A1_D1938.tif" /><img file="US2022121884A1_D1939.tif" /><img file="US2022121884A1_D1940.tif" /><img file="US2022121884A1_D1941.tif" /><img file="US2022121884A1_D1942.tif" /><img file="US2022121884A1_D1943.tif" /><img file="US2022121884A1_D1944.tif" /><img file="US2022121884A1_D1945.tif" /><img file="US2022121884A1_D1946.tif" /><img file="US2022121884A1_D1947.tif" /><img file="US2022121884A1_D1948.tif" /><img file="US2022121884A1_D1949.tif" /><img file="US2022121884A1_D1950.tif" /><img file="US2022121884A1_D1951.tif" /><img file="US2022121884A1_D1952.tif" /><img file="US2022121884A1_D1953.tif" /><img file="US2022121884A1_D1954.tif" /><img file="US2022121884A1_D1955.tif" /><img file="US2022121884A1_D1956.tif" /><img file="US2022121884A1_D1957.tif" /><img file="US2022121884A1_D1958.tif" /><img file="US2022121884A1_D1959.tif" /><img file="US2022121884A1_D1960.tif" /><img file="US2022121884A1_D1961.tif" /><img file="US2022121884A1_D1962.tif" /><img file="US2022121884A1_D1963.tif" /><img file="US2022121884A1_D1964.tif" /><img file="US2022121884A1_D1965.tif" /><img file="US2022121884A1_D1966.tif" /><img file="US2022121884A1_D1967.tif" /><img file="US2022121884A1_D1968.tif" /><img file="US2022121884A1_D1969.tif" /><img file="US2022121884A1_D1970.tif" /><img file="US2022121884A1_D1971.tif" /><img file="US2022121884A1_D1972.tif" /><img file="US2022121884A1_D1973.tif" /><img file="US2022121884A1_D1974.tif" /><img file="US2022121884A1_D1975.tif" /><img file="US2022121884A1_D1976.tif" /><img file="US2022121884A1_D1977.tif" /><img file="US2022121884A1_D1978.tif" /><img file="US2022121884A1_D1979.tif" /><img file="US2022121884A1_D1980.tif" /><img file="US2022121884A1_D1981.tif" /><img file="US2022121884A1_D1982.tif" /><img file="US2022121884A1_D1983.tif" /><img file="US2022121884A1_D1984.tif" /><img file="US2022121884A1_D1985.tif" /><img file="US2022121884A1_D1986.tif" /><img file="US2022121884A1_D1987.tif" /><img file="US2022121884A1_D1988.tif" /><img file="US2022121884A1_D1989.tif" /><img file="US2022121884A1_D1990.tif" /><img file="US2022121884A1_D1991.tif" /><img file="US2022121884A1_D1992.tif" /><img file="US2022121884A1_D1993.tif" /><img file="US2022121884A1_D1994.tif" /><img file="US2022121884A1_D1995.tif" /><img file="US2022121884A1_D1996.tif" /><img file="US2022121884A1_D1997.tif" /><img file="US2022121884A1_D1998.tif" /><img file="US2022121884A1_D1999.tif" /><img file="US2022121884A1_D2000.tif" /><img file="US2022121884A1_D2001.tif" /><img file="US2022121884A1_D2002.tif" /><img file="US2022121884A1_D2003.tif" /><img file="US2022121884A1_D2004.tif" /><img file="US2022121884A1_D2005.tif" /><img file="US2022121884A1_D2006.tif" /><img file="US2022121884A1_D2007.tif" /><img file="US2022121884A1_D2008.tif" /><img file="US2022121884A1_D2009.tif" /><img file="US2022121884A1_D2010.tif" /><img file="US2022121884A1_D2011.tif" /><img file="US2022121884A1_D2012.tif" /><img file="US2022121884A1_D2013.tif" /><img file="US2022121884A1_D2014.tif" /><img file="US2022121884A1_D2015.tif" /><img file="US2022121884A1_D2016.tif" /><maths id="MATH-US-00009-2" num="00009.2"><math overflow="scroll"><mfrac><mtable><mtr><mtd><mrow><mrow><mi>R</mi><mo></mo><mrow><mo>(</mo><mi>X</mi><mo>)</mo></mrow></mrow><mo>:</mo><mrow><mrow><mi>g</mi><mo></mo><mrow><mo>(</mo><mi>X</mi><mo>)</mo></mrow></mrow><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>is</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mrow><mi>A</mi><mo></mo><mrow><mo>(</mo><mrow><mi>constraint</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>on</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>u</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>is</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mrow><msub><mi>μ</mi><mi>A</mi></msub><mo></mo><mrow><mo>(</mo><mrow><mi>g</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo>)</mo></mrow></mrow></mrow><mo>)</mo></mrow></mrow></mrow></mrow></mtd></mtr><mtr><mtd><mrow><mrow><mi>R</mi><mo></mo><mrow><mo>(</mo><mi>Y</mi><mo>)</mo></mrow></mrow><mo>:</mo><mrow><mrow><mi>h</mi><mo></mo><mrow><mo>(</mo><mi>Y</mi><mo>)</mo></mrow></mrow><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>is</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mrow><mi>B</mi><mo></mo><mrow><mo>(</mo><mrow><mi>constraint</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>on</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>u</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>is</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mrow><msub><mi>μ</mi><mi>B</mi></msub><mo></mo><mrow><mo>(</mo><mrow><mi>h</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo>)</mo></mrow></mrow></mrow><mo>)</mo></mrow></mrow></mrow></mrow></mtd></mtr></mtable><mrow><mrow><mrow><mrow><mi>R</mi><mo></mo><mrow><mo>(</mo><mi>Z</mi><mo>)</mo></mrow></mrow><mo>:</mo><mrow><msub><mi>μ</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>w</mi><mo>)</mo></mrow></mrow></mrow><mo>=</mo><mrow><msub><mi>sup</mi><mrow><mi>u</mi><mo>,</mo><mi>v</mi></mrow></msub><mo></mo><mrow><mo>(</mo><mrow><mrow><msub><mi>μ</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mrow><mi>g</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo>)</mo></mrow></mrow><mo>^</mo><mrow><msub><mi>μ</mi><mi>Y</mi></msub><mo></mo><mrow><mo>(</mo><mrow><mi>h</mi><mo></mo><mrow><mo>(</mo><mi>v</mi><mo>)</mo></mrow></mrow><mo>)</mo></mrow></mrow></mrow><mo>)</mo></mrow></mrow></mrow><mo>,</mo><mrow><mo>^=</mo><mi>min</mi></mrow></mrow></mfrac></math></maths><img file="US2022121884A1_D2017.tif" /><img file="US2022121884A1_D2018.tif" /><img file="US2022121884A1_D2019.tif" /><img file="US2022121884A1_D2020.tif" /><img file="US2022121884A1_D2021.tif" /><img file="US2022121884A1_D2022.tif" /><img file="US2022121884A1_D2023.tif" /><img file="US2022121884A1_D2024.tif" /><img file="US2022121884A1_D2025.tif" /><img file="US2022121884A1_D2026.tif" /><img file="US2022121884A1_D2027.tif" /><img file="US2022121884A1_D2028.tif" /><img file="US2022121884A1_D2029.tif" /><img file="US2022121884A1_D2030.tif" /><img file="US2022121884A1_D2031.tif" /><img file="US2022121884A1_D2032.tif" /><img file="US2022121884A1_D2033.tif" /><img file="US2022121884A1_D2034.tif" /><img file="US2022121884A1_D2035.tif" /><img file="US2022121884A1_D2036.tif" /><img file="US2022121884A1_D2037.tif" /><img file="US2022121884A1_D2038.tif" /><img file="US2022121884A1_D2039.tif" /><img file="US2022121884A1_D2040.tif" /><img file="US2022121884A1_D2041.tif" /><img file="US2022121884A1_D2042.tif" /><img file="US2022121884A1_D2043.tif" /><img file="US2022121884A1_D2044.tif" /><img file="US2022121884A1_D2045.tif" /><img file="US2022121884A1_D2046.tif" /><img file="US2022121884A1_D2047.tif" /><img file="US2022121884A1_D2048.tif" /><img file="US2022121884A1_D2049.tif" /><img file="US2022121884A1_D2050.tif" /><img file="US2022121884A1_D2051.tif" /><img file="US2022121884A1_D2052.tif" /><img file="US2022121884A1_D2053.tif" /><img file="US2022121884A1_D2054.tif" /><img file="US2022121884A1_D2055.tif" /><img file="US2022121884A1_D2056.tif" /><img file="US2022121884A1_D2057.tif" /><img file="US2022121884A1_D2058.tif" /><img file="US2022121884A1_D2059.tif" /><img file="US2022121884A1_D2060.tif" /><img file="US2022121884A1_D2061.tif" /><img file="US2022121884A1_D2062.tif" /><img file="US2022121884A1_D2063.tif" /><img file="US2022121884A1_D2064.tif" /><img file="US2022121884A1_D2065.tif" /><img file="US2022121884A1_D2066.tif" /><img file="US2022121884A1_D2067.tif" /><img file="US2022121884A1_D2068.tif" /><img file="US2022121884A1_D2069.tif" /><img file="US2022121884A1_D2070.tif" /><img file="US2022121884A1_D2071.tif" /><img file="US2022121884A1_D2072.tif" /><img file="US2022121884A1_D2073.tif" /><img file="US2022121884A1_D2074.tif" /><img file="US2022121884A1_D2075.tif" /><img file="US2022121884A1_D2076.tif" /><img file="US2022121884A1_D2077.tif" /><img file="US2022121884A1_D2078.tif" /><img file="US2022121884A1_D2079.tif" /><img file="US2022121884A1_D2080.tif" /><img file="US2022121884A1_D2081.tif" /><img file="US2022121884A1_D2082.tif" /><img file="US2022121884A1_D2083.tif" /><img file="US2022121884A1_D2084.tif" /><img file="US2022121884A1_D2085.tif" /><img file="US2022121884A1_D2086.tif" /><img file="US2022121884A1_D2087.tif" /><img file="US2022121884A1_D2088.tif" /><img file="US2022121884A1_D2089.tif" /><img file="US2022121884A1_D2090.tif" /><img file="US2022121884A1_D2091.tif" /><img file="US2022121884A1_D2092.tif" /><img file="US2022121884A1_D2093.tif" /><img file="US2022121884A1_D2094.tif" /><img file="US2022121884A1_D2095.tif" /><img file="US2022121884A1_D2096.tif" /><img file="US2022121884A1_D2097.tif" /><img file="US2022121884A1_D2098.tif" /><img file="US2022121884A1_D2099.tif" /><img file="US2022121884A1_D2100.tif" /><img file="US2022121884A1_D2101.tif" /><img file="US2022121884A1_D2102.tif" /><img file="US2022121884A1_D2103.tif" /><img file="US2022121884A1_D2104.tif" /><img file="US2022121884A1_D2105.tif" /><img file="US2022121884A1_D2106.tif" /><img file="US2022121884A1_D2107.tif" /><img file="US2022121884A1_D2108.tif" /><img file="US2022121884A1_D2109.tif" /><img file="US2022121884A1_D2110.tif" /><img file="US2022121884A1_D2111.tif" /><img file="US2022121884A1_D2112.tif" /><img file="US2022121884A1_D2113.tif" /><img file="US2022121884A1_D2114.tif" /><img file="US2022121884A1_D2115.tif" /><img file="US2022121884A1_D2116.tif" /><img file="US2022121884A1_D2117.tif" /><img file="US2022121884A1_D2118.tif" /><img file="US2022121884A1_D2119.tif" /><img file="US2022121884A1_D2120.tif" /><img file="US2022121884A1_D2121.tif" /><img file="US2022121884A1_D2122.tif" /><img file="US2022121884A1_D2123.tif" /><img file="US2022121884A1_D2124.tif" /><img file="US2022121884A1_D2125.tif" /><img file="US2022121884A1_D2126.tif" /><img file="US2022121884A1_D2127.tif" /><img file="US2022121884A1_D2128.tif" /><maths id="MATH-US-00009-3" num="00009.3"><math overflow="scroll"><mrow><mi>subject</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>to</mi></mrow></math></maths><img file="US2022121884A1_D2129.tif" /><img file="US2022121884A1_D2130.tif" /><img file="US2022121884A1_D2131.tif" /><img file="US2022121884A1_D2132.tif" /><img file="US2022121884A1_D2133.tif" /><img file="US2022121884A1_D2134.tif" /><img file="US2022121884A1_D2135.tif" /><img file="US2022121884A1_D2136.tif" /><img file="US2022121884A1_D2137.tif" /><img file="US2022121884A1_D2138.tif" /><img file="US2022121884A1_D2139.tif" /><img file="US2022121884A1_D2140.tif" /><img file="US2022121884A1_D2141.tif" /><img file="US2022121884A1_D2142.tif" /><img file="US2022121884A1_D2143.tif" /><img file="US2022121884A1_D2144.tif" /><img file="US2022121884A1_D2145.tif" /><img file="US2022121884A1_D2146.tif" /><img file="US2022121884A1_D2147.tif" /><img file="US2022121884A1_D2148.tif" /><img file="US2022121884A1_D2149.tif" /><img file="US2022121884A1_D2150.tif" /><img file="US2022121884A1_D2151.tif" /><img file="US2022121884A1_D2152.tif" /><img file="US2022121884A1_D2153.tif" /><img file="US2022121884A1_D2154.tif" /><img file="US2022121884A1_D2155.tif" /><img file="US2022121884A1_D2156.tif" /><img file="US2022121884A1_D2157.tif" /><img file="US2022121884A1_D2158.tif" /><img file="US2022121884A1_D2159.tif" /><img file="US2022121884A1_D2160.tif" /><img file="US2022121884A1_D2161.tif" /><img file="US2022121884A1_D2162.tif" /><img file="US2022121884A1_D2163.tif" /><img file="US2022121884A1_D2164.tif" /><img file="US2022121884A1_D2165.tif" /><img file="US2022121884A1_D2166.tif" /><img file="US2022121884A1_D2167.tif" /><img file="US2022121884A1_D2168.tif" /><img file="US2022121884A1_D2169.tif" /><img file="US2022121884A1_D2170.tif" /><img file="US2022121884A1_D2171.tif" /><img file="US2022121884A1_D2172.tif" /><img file="US2022121884A1_D2173.tif" /><img file="US2022121884A1_D2174.tif" /><img file="US2022121884A1_D2175.tif" /><img file="US2022121884A1_D2176.tif" /><img file="US2022121884A1_D2177.tif" /><img file="US2022121884A1_D2178.tif" /><img file="US2022121884A1_D2179.tif" /><img file="US2022121884A1_D2180.tif" /><img file="US2022121884A1_D2181.tif" /><img file="US2022121884A1_D2182.tif" /><img file="US2022121884A1_D2183.tif" /><img file="US2022121884A1_D2184.tif" /><img file="US2022121884A1_D2185.tif" /><img file="US2022121884A1_D2186.tif" /><img file="US2022121884A1_D2187.tif" /><img file="US2022121884A1_D2188.tif" /><img file="US2022121884A1_D2189.tif" /><img file="US2022121884A1_D2190.tif" /><img file="US2022121884A1_D2191.tif" /><img file="US2022121884A1_D2192.tif" /><img file="US2022121884A1_D2193.tif" /><img file="US2022121884A1_D2194.tif" /><img file="US2022121884A1_D2195.tif" /><img file="US2022121884A1_D2196.tif" /><img file="US2022121884A1_D2197.tif" /><img file="US2022121884A1_D2198.tif" /><img file="US2022121884A1_D2199.tif" /><img file="US2022121884A1_D2200.tif" /><img file="US2022121884A1_D2201.tif" /><img file="US2022121884A1_D2202.tif" /><img file="US2022121884A1_D2203.tif" /><img file="US2022121884A1_D2204.tif" /><img file="US2022121884A1_D2205.tif" /><img file="US2022121884A1_D2206.tif" /><img file="US2022121884A1_D2207.tif" /><img file="US2022121884A1_D2208.tif" /><img file="US2022121884A1_D2209.tif" /><img file="US2022121884A1_D2210.tif" /><img file="US2022121884A1_D2211.tif" /><img file="US2022121884A1_D2212.tif" /><img file="US2022121884A1_D2213.tif" /><img file="US2022121884A1_D2214.tif" /><img file="US2022121884A1_D2215.tif" /><img file="US2022121884A1_D2216.tif" /><img file="US2022121884A1_D2217.tif" /><img file="US2022121884A1_D2218.tif" /><img file="US2022121884A1_D2219.tif" /><img file="US2022121884A1_D2220.tif" /><img file="US2022121884A1_D2221.tif" /><img file="US2022121884A1_D2222.tif" /><img file="US2022121884A1_D2223.tif" /><img file="US2022121884A1_D2224.tif" /><img file="US2022121884A1_D2225.tif" /><img file="US2022121884A1_D2226.tif" /><img file="US2022121884A1_D2227.tif" /><img file="US2022121884A1_D2228.tif" /><img file="US2022121884A1_D2229.tif" /><img file="US2022121884A1_D2230.tif" /><img file="US2022121884A1_D2231.tif" /><img file="US2022121884A1_D2232.tif" /><img file="US2022121884A1_D2233.tif" /><img file="US2022121884A1_D2234.tif" /><img file="US2022121884A1_D2235.tif" /><img file="US2022121884A1_D2236.tif" /><img file="US2022121884A1_D2237.tif" /><img file="US2022121884A1_D2238.tif" /><img file="US2022121884A1_D2239.tif" /><img file="US2022121884A1_D2240.tif" /><maths id="MATH-US-00009-4" num="00009.4"><math overflow="scroll"><mrow><mi>w</mi><mo>=</mo><mrow><mi>f</mi><mo></mo><mrow><mo>(</mo><mrow><mi>u</mi><mo>,</mo><mi>v</mi></mrow><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D2241.tif" /><img file="US2022121884A1_D2242.tif" /><img file="US2022121884A1_D2243.tif" /><img file="US2022121884A1_D2244.tif" /><img file="US2022121884A1_D2245.tif" /><img file="US2022121884A1_D2246.tif" /><img file="US2022121884A1_D2247.tif" /><img file="US2022121884A1_D2248.tif" /><img file="US2022121884A1_D2249.tif" /><img file="US2022121884A1_D2250.tif" /><img file="US2022121884A1_D2251.tif" /><img file="US2022121884A1_D2252.tif" /><img file="US2022121884A1_D2253.tif" /><img file="US2022121884A1_D2254.tif" /><img file="US2022121884A1_D2255.tif" /><img file="US2022121884A1_D2256.tif" /><img file="US2022121884A1_D2257.tif" /><img file="US2022121884A1_D2258.tif" /><img file="US2022121884A1_D2259.tif" /><img file="US2022121884A1_D2260.tif" /><img file="US2022121884A1_D2261.tif" /><img file="US2022121884A1_D2262.tif" /><img file="US2022121884A1_D2263.tif" /><img file="US2022121884A1_D2264.tif" /><img file="US2022121884A1_D2265.tif" /><img file="US2022121884A1_D2266.tif" /><img file="US2022121884A1_D2267.tif" /><img file="US2022121884A1_D2268.tif" /><img file="US2022121884A1_D2269.tif" /><img file="US2022121884A1_D2270.tif" /><img file="US2022121884A1_D2271.tif" /><img file="US2022121884A1_D2272.tif" /><img file="US2022121884A1_D2273.tif" /><img file="US2022121884A1_D2274.tif" /><img file="US2022121884A1_D2275.tif" /><img file="US2022121884A1_D2276.tif" /><img file="US2022121884A1_D2277.tif" /><img file="US2022121884A1_D2278.tif" /><img file="US2022121884A1_D2279.tif" /><img file="US2022121884A1_D2280.tif" /><img file="US2022121884A1_D2281.tif" /><img file="US2022121884A1_D2282.tif" /><img file="US2022121884A1_D2283.tif" /><img file="US2022121884A1_D2284.tif" /><img file="US2022121884A1_D2285.tif" /><img file="US2022121884A1_D2286.tif" /><img file="US2022121884A1_D2287.tif" /><img file="US2022121884A1_D2288.tif" /><img file="US2022121884A1_D2289.tif" /><img file="US2022121884A1_D2290.tif" /><img file="US2022121884A1_D2291.tif" /><img file="US2022121884A1_D2292.tif" /><img file="US2022121884A1_D2293.tif" /><img file="US2022121884A1_D2294.tif" /><img file="US2022121884A1_D2295.tif" /><img file="US2022121884A1_D2296.tif" /><img file="US2022121884A1_D2297.tif" /><img file="US2022121884A1_D2298.tif" /><img file="US2022121884A1_D2299.tif" /><img file="US2022121884A1_D2300.tif" /><img file="US2022121884A1_D2301.tif" /><img file="US2022121884A1_D2302.tif" /><img file="US2022121884A1_D2303.tif" /><img file="US2022121884A1_D2304.tif" /><img file="US2022121884A1_D2305.tif" /><img file="US2022121884A1_D2306.tif" /><img file="US2022121884A1_D2307.tif" /><img file="US2022121884A1_D2308.tif" /><img file="US2022121884A1_D2309.tif" /><img file="US2022121884A1_D2310.tif" /><img file="US2022121884A1_D2311.tif" /><img file="US2022121884A1_D2312.tif" /><img file="US2022121884A1_D2313.tif" /><img file="US2022121884A1_D2314.tif" /><img file="US2022121884A1_D2315.tif" /><img file="US2022121884A1_D2316.tif" /><img file="US2022121884A1_D2317.tif" /><img file="US2022121884A1_D2318.tif" /><img file="US2022121884A1_D2319.tif" /><img file="US2022121884A1_D2320.tif" /><img file="US2022121884A1_D2321.tif" /><img file="US2022121884A1_D2322.tif" /><img file="US2022121884A1_D2323.tif" /><img file="US2022121884A1_D2324.tif" /><img file="US2022121884A1_D2325.tif" /><img file="US2022121884A1_D2326.tif" /><img file="US2022121884A1_D2327.tif" /><img file="US2022121884A1_D2328.tif" /><img file="US2022121884A1_D2329.tif" /><img file="US2022121884A1_D2330.tif" /><img file="US2022121884A1_D2331.tif" /><img file="US2022121884A1_D2332.tif" /><img file="US2022121884A1_D2333.tif" /><img file="US2022121884A1_D2334.tif" /><img file="US2022121884A1_D2335.tif" /><img file="US2022121884A1_D2336.tif" /><img file="US2022121884A1_D2337.tif" /><img file="US2022121884A1_D2338.tif" /><img file="US2022121884A1_D2339.tif" /><img file="US2022121884A1_D2340.tif" /><img file="US2022121884A1_D2341.tif" /><img file="US2022121884A1_D2342.tif" /><img file="US2022121884A1_D2343.tif" /><img file="US2022121884A1_D2344.tif" /><img file="US2022121884A1_D2345.tif" /><img file="US2022121884A1_D2346.tif" /><img file="US2022121884A1_D2347.tif" /><img file="US2022121884A1_D2348.tif" /><img file="US2022121884A1_D2349.tif" /><img file="US2022121884A1_D2350.tif" /><img file="US2022121884A1_D2351.tif" /><img file="US2022121884A1_D2352.tif" />
In application to probabilistic restrictions, the extension principle leads to results which coincide with standard results which relate to functions of probability distributions. Specifically, for discrete probability distributions, we have:
<maths id="MATH-US-00010" num="00010"><math overflow="scroll"><mrow><mi>Y</mi><mo>=</mo><mrow><mi>f</mi><mo></mo><mrow><mo>(</mo><mi>X</mi><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D2353.tif" /><img file="US2022121884A1_D2354.tif" /><img file="US2022121884A1_D2355.tif" /><img file="US2022121884A1_D2356.tif" /><img file="US2022121884A1_D2357.tif" /><img file="US2022121884A1_D2358.tif" /><img file="US2022121884A1_D2359.tif" /><img file="US2022121884A1_D2360.tif" /><img file="US2022121884A1_D2361.tif" /><img file="US2022121884A1_D2362.tif" /><img file="US2022121884A1_D2363.tif" /><img file="US2022121884A1_D2364.tif" /><img file="US2022121884A1_D2365.tif" /><img file="US2022121884A1_D2366.tif" /><img file="US2022121884A1_D2367.tif" /><img file="US2022121884A1_D2368.tif" /><img file="US2022121884A1_D2369.tif" /><img file="US2022121884A1_D2370.tif" /><img file="US2022121884A1_D2371.tif" /><img file="US2022121884A1_D2372.tif" /><img file="US2022121884A1_D2373.tif" /><img file="US2022121884A1_D2374.tif" /><img file="US2022121884A1_D2375.tif" /><img file="US2022121884A1_D2376.tif" /><img file="US2022121884A1_D2377.tif" /><img file="US2022121884A1_D2378.tif" /><img file="US2022121884A1_D2379.tif" /><img file="US2022121884A1_D2380.tif" /><img file="US2022121884A1_D2381.tif" /><img file="US2022121884A1_D2382.tif" /><img file="US2022121884A1_D2383.tif" /><img file="US2022121884A1_D2384.tif" /><img file="US2022121884A1_D2385.tif" /><img file="US2022121884A1_D2386.tif" /><img file="US2022121884A1_D2387.tif" /><img file="US2022121884A1_D2388.tif" /><img file="US2022121884A1_D2389.tif" /><img file="US2022121884A1_D2390.tif" /><img file="US2022121884A1_D2391.tif" /><img file="US2022121884A1_D2392.tif" /><img file="US2022121884A1_D2393.tif" /><img file="US2022121884A1_D2394.tif" /><img file="US2022121884A1_D2395.tif" /><img file="US2022121884A1_D2396.tif" /><img file="US2022121884A1_D2397.tif" /><img file="US2022121884A1_D2398.tif" /><img file="US2022121884A1_D2399.tif" /><img file="US2022121884A1_D2400.tif" /><img file="US2022121884A1_D2401.tif" /><img file="US2022121884A1_D2402.tif" /><img file="US2022121884A1_D2403.tif" /><img file="US2022121884A1_D2404.tif" /><img file="US2022121884A1_D2405.tif" /><img file="US2022121884A1_D2406.tif" /><img file="US2022121884A1_D2407.tif" /><img file="US2022121884A1_D2408.tif" /><img file="US2022121884A1_D2409.tif" /><img file="US2022121884A1_D2410.tif" /><img file="US2022121884A1_D2411.tif" /><img file="US2022121884A1_D2412.tif" /><img file="US2022121884A1_D2413.tif" /><img file="US2022121884A1_D2414.tif" /><img file="US2022121884A1_D2415.tif" /><img file="US2022121884A1_D2416.tif" /><img file="US2022121884A1_D2417.tif" /><img file="US2022121884A1_D2418.tif" /><img file="US2022121884A1_D2419.tif" /><img file="US2022121884A1_D2420.tif" /><img file="US2022121884A1_D2421.tif" /><img file="US2022121884A1_D2422.tif" /><img file="US2022121884A1_D2423.tif" /><img file="US2022121884A1_D2424.tif" /><img file="US2022121884A1_D2425.tif" /><img file="US2022121884A1_D2426.tif" /><img file="US2022121884A1_D2427.tif" /><img file="US2022121884A1_D2428.tif" /><img file="US2022121884A1_D2429.tif" /><img file="US2022121884A1_D2430.tif" /><img file="US2022121884A1_D2431.tif" /><img file="US2022121884A1_D2432.tif" /><img file="US2022121884A1_D2433.tif" /><img file="US2022121884A1_D2434.tif" /><img file="US2022121884A1_D2435.tif" /><img file="US2022121884A1_D2436.tif" /><img file="US2022121884A1_D2437.tif" /><img file="US2022121884A1_D2438.tif" /><img file="US2022121884A1_D2439.tif" /><img file="US2022121884A1_D2440.tif" /><img file="US2022121884A1_D2441.tif" /><img file="US2022121884A1_D2442.tif" /><img file="US2022121884A1_D2443.tif" /><img file="US2022121884A1_D2444.tif" /><img file="US2022121884A1_D2445.tif" /><img file="US2022121884A1_D2446.tif" /><img file="US2022121884A1_D2447.tif" /><img file="US2022121884A1_D2448.tif" /><img file="US2022121884A1_D2449.tif" /><img file="US2022121884A1_D2450.tif" /><img file="US2022121884A1_D2451.tif" /><img file="US2022121884A1_D2452.tif" /><img file="US2022121884A1_D2453.tif" /><img file="US2022121884A1_D2454.tif" /><img file="US2022121884A1_D2455.tif" /><img file="US2022121884A1_D2456.tif" /><img file="US2022121884A1_D2457.tif" /><img file="US2022121884A1_D2458.tif" /><img file="US2022121884A1_D2459.tif" /><img file="US2022121884A1_D2460.tif" /><img file="US2022121884A1_D2461.tif" /><img file="US2022121884A1_D2462.tif" /><img file="US2022121884A1_D2463.tif" /><img file="US2022121884A1_D2464.tif" /><maths id="MATH-US-00010-2" num="00010.2"><math overflow="scroll"><mfrac><mrow><mrow><mrow><mi>R</mi><mo></mo><mrow><mo>(</mo><mi>X</mi><mo>)</mo></mrow></mrow><mo>:</mo><mrow><mi>X</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>isp</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>p</mi></mrow></mrow><mo>,</mo><mrow><mi>p</mi><mo>=</mo><mrow><mrow><msub><mi>p</mi><mn>1</mn></msub><mo></mo><mi>\</mi><mo></mo><msub><mi>u</mi><mn>1</mn></msub></mrow><mo>+</mo><mrow><mi>…</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><msub><mi>p</mi><mi>n</mi></msub><mo></mo><mi>\</mi><mo></mo><msub><mi>u</mi><mi>n</mi></msub></mrow></mrow></mrow></mrow></mrow><mtable><mtr><mtd><mrow><mrow><mrow><mi>R</mi><mo></mo><mrow><mo>(</mo><mi>Y</mi><mo>)</mo></mrow></mrow><mo>:</mo><mrow><msub><mi>p</mi><mi>Y</mi></msub><mo></mo><mrow><mo>(</mo><mi>v</mi><mo>)</mo></mrow></mrow></mrow><mo>=</mo><mrow><msub><mo>∑</mo><mi>i</mi></msub><mo></mo><msub><mi>p</mi><mi>i</mi></msub></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mrow><mrow><mi>f</mi><mo></mo><mrow><mo>(</mo><mi>p</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mi>R</mi><mo></mo><mrow><mo>(</mo><mi>Y</mi><mo>)</mo></mrow></mrow></mrow><mo>)</mo></mrow></mtd></mtr></mtable></mfrac></math></maths><img file="US2022121884A1_D2465.tif" /><img file="US2022121884A1_D2466.tif" /><img file="US2022121884A1_D2467.tif" /><img file="US2022121884A1_D2468.tif" /><img file="US2022121884A1_D2469.tif" /><img file="US2022121884A1_D2470.tif" /><img file="US2022121884A1_D2471.tif" /><img file="US2022121884A1_D2472.tif" /><img file="US2022121884A1_D2473.tif" /><img file="US2022121884A1_D2474.tif" /><img file="US2022121884A1_D2475.tif" /><img file="US2022121884A1_D2476.tif" /><img file="US2022121884A1_D2477.tif" /><img file="US2022121884A1_D2478.tif" /><img file="US2022121884A1_D2479.tif" /><img file="US2022121884A1_D2480.tif" /><img file="US2022121884A1_D2481.tif" /><img file="US2022121884A1_D2482.tif" /><img file="US2022121884A1_D2483.tif" /><img file="US2022121884A1_D2484.tif" /><img file="US2022121884A1_D2485.tif" /><img file="US2022121884A1_D2486.tif" /><img file="US2022121884A1_D2487.tif" /><img file="US2022121884A1_D2488.tif" /><img file="US2022121884A1_D2489.tif" /><img file="US2022121884A1_D2490.tif" /><img file="US2022121884A1_D2491.tif" /><img file="US2022121884A1_D2492.tif" /><img file="US2022121884A1_D2493.tif" /><img file="US2022121884A1_D2494.tif" /><img file="US2022121884A1_D2495.tif" /><img file="US2022121884A1_D2496.tif" /><img file="US2022121884A1_D2497.tif" /><img file="US2022121884A1_D2498.tif" /><img file="US2022121884A1_D2499.tif" /><img file="US2022121884A1_D2500.tif" /><img file="US2022121884A1_D2501.tif" /><img file="US2022121884A1_D2502.tif" /><img file="US2022121884A1_D2503.tif" /><img file="US2022121884A1_D2504.tif" /><img file="US2022121884A1_D2505.tif" /><img file="US2022121884A1_D2506.tif" /><img file="US2022121884A1_D2507.tif" /><img file="US2022121884A1_D2508.tif" /><img file="US2022121884A1_D2509.tif" /><img file="US2022121884A1_D2510.tif" /><img file="US2022121884A1_D2511.tif" /><img file="US2022121884A1_D2512.tif" /><img file="US2022121884A1_D2513.tif" /><img file="US2022121884A1_D2514.tif" /><img file="US2022121884A1_D2515.tif" /><img file="US2022121884A1_D2516.tif" /><img file="US2022121884A1_D2517.tif" /><img file="US2022121884A1_D2518.tif" /><img file="US2022121884A1_D2519.tif" /><img file="US2022121884A1_D2520.tif" /><img file="US2022121884A1_D2521.tif" /><img file="US2022121884A1_D2522.tif" /><img file="US2022121884A1_D2523.tif" /><img file="US2022121884A1_D2524.tif" /><img file="US2022121884A1_D2525.tif" /><img file="US2022121884A1_D2526.tif" /><img file="US2022121884A1_D2527.tif" /><img file="US2022121884A1_D2528.tif" /><img file="US2022121884A1_D2529.tif" /><img file="US2022121884A1_D2530.tif" /><img file="US2022121884A1_D2531.tif" /><img file="US2022121884A1_D2532.tif" /><img file="US2022121884A1_D2533.tif" /><img file="US2022121884A1_D2534.tif" /><img file="US2022121884A1_D2535.tif" /><img file="US2022121884A1_D2536.tif" /><img file="US2022121884A1_D2537.tif" /><img file="US2022121884A1_D2538.tif" /><img file="US2022121884A1_D2539.tif" /><img file="US2022121884A1_D2540.tif" /><img file="US2022121884A1_D2541.tif" /><img file="US2022121884A1_D2542.tif" /><img file="US2022121884A1_D2543.tif" /><img file="US2022121884A1_D2544.tif" /><img file="US2022121884A1_D2545.tif" /><img file="US2022121884A1_D2546.tif" /><img file="US2022121884A1_D2547.tif" /><img file="US2022121884A1_D2548.tif" /><img file="US2022121884A1_D2549.tif" /><img file="US2022121884A1_D2550.tif" /><img file="US2022121884A1_D2551.tif" /><img file="US2022121884A1_D2552.tif" /><img file="US2022121884A1_D2553.tif" /><img file="US2022121884A1_D2554.tif" /><img file="US2022121884A1_D2555.tif" /><img file="US2022121884A1_D2556.tif" /><img file="US2022121884A1_D2557.tif" /><img file="US2022121884A1_D2558.tif" /><img file="US2022121884A1_D2559.tif" /><img file="US2022121884A1_D2560.tif" /><img file="US2022121884A1_D2561.tif" /><img file="US2022121884A1_D2562.tif" /><img file="US2022121884A1_D2563.tif" /><img file="US2022121884A1_D2564.tif" /><img file="US2022121884A1_D2565.tif" /><img file="US2022121884A1_D2566.tif" /><img file="US2022121884A1_D2567.tif" /><img file="US2022121884A1_D2568.tif" /><img file="US2022121884A1_D2569.tif" /><img file="US2022121884A1_D2570.tif" /><img file="US2022121884A1_D2571.tif" /><img file="US2022121884A1_D2572.tif" /><img file="US2022121884A1_D2573.tif" /><img file="US2022121884A1_D2574.tif" /><img file="US2022121884A1_D2575.tif" /><img file="US2022121884A1_D2576.tif" /><maths id="MATH-US-00010-3" num="00010.3"><math overflow="scroll"><mrow><mi>subject</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>to</mi></mrow></math></maths><img file="US2022121884A1_D2577.tif" /><img file="US2022121884A1_D2578.tif" /><img file="US2022121884A1_D2579.tif" /><img file="US2022121884A1_D2580.tif" /><img file="US2022121884A1_D2581.tif" /><img file="US2022121884A1_D2582.tif" /><img file="US2022121884A1_D2583.tif" /><img file="US2022121884A1_D2584.tif" /><img file="US2022121884A1_D2585.tif" /><img file="US2022121884A1_D2586.tif" /><img file="US2022121884A1_D2587.tif" /><img file="US2022121884A1_D2588.tif" /><img file="US2022121884A1_D2589.tif" /><img file="US2022121884A1_D2590.tif" /><img file="US2022121884A1_D2591.tif" /><img file="US2022121884A1_D2592.tif" /><img file="US2022121884A1_D2593.tif" /><img file="US2022121884A1_D2594.tif" /><img file="US2022121884A1_D2595.tif" /><img file="US2022121884A1_D2596.tif" /><img file="US2022121884A1_D2597.tif" /><img file="US2022121884A1_D2598.tif" /><img file="US2022121884A1_D2599.tif" /><img file="US2022121884A1_D2600.tif" /><img file="US2022121884A1_D2601.tif" /><img file="US2022121884A1_D2602.tif" /><img file="US2022121884A1_D2603.tif" /><img file="US2022121884A1_D2604.tif" /><img file="US2022121884A1_D2605.tif" /><img file="US2022121884A1_D2606.tif" /><img file="US2022121884A1_D2607.tif" /><img file="US2022121884A1_D2608.tif" /><img file="US2022121884A1_D2609.tif" /><img file="US2022121884A1_D2610.tif" /><img file="US2022121884A1_D2611.tif" /><img file="US2022121884A1_D2612.tif" /><img file="US2022121884A1_D2613.tif" /><img file="US2022121884A1_D2614.tif" /><img file="US2022121884A1_D2615.tif" /><img file="US2022121884A1_D2616.tif" /><img file="US2022121884A1_D2617.tif" /><img file="US2022121884A1_D2618.tif" /><img file="US2022121884A1_D2619.tif" /><img file="US2022121884A1_D2620.tif" /><img file="US2022121884A1_D2621.tif" /><img file="US2022121884A1_D2622.tif" /><img file="US2022121884A1_D2623.tif" /><img file="US2022121884A1_D2624.tif" /><img file="US2022121884A1_D2625.tif" /><img file="US2022121884A1_D2626.tif" /><img file="US2022121884A1_D2627.tif" /><img file="US2022121884A1_D2628.tif" /><img file="US2022121884A1_D2629.tif" /><img file="US2022121884A1_D2630.tif" /><img file="US2022121884A1_D2631.tif" /><img file="US2022121884A1_D2632.tif" /><img file="US2022121884A1_D2633.tif" /><img file="US2022121884A1_D2634.tif" /><img file="US2022121884A1_D2635.tif" /><img file="US2022121884A1_D2636.tif" /><img file="US2022121884A1_D2637.tif" /><img file="US2022121884A1_D2638.tif" /><img file="US2022121884A1_D2639.tif" /><img file="US2022121884A1_D2640.tif" /><img file="US2022121884A1_D2641.tif" /><img file="US2022121884A1_D2642.tif" /><img file="US2022121884A1_D2643.tif" /><img file="US2022121884A1_D2644.tif" /><img file="US2022121884A1_D2645.tif" /><img file="US2022121884A1_D2646.tif" /><img file="US2022121884A1_D2647.tif" /><img file="US2022121884A1_D2648.tif" /><img file="US2022121884A1_D2649.tif" /><img file="US2022121884A1_D2650.tif" /><img file="US2022121884A1_D2651.tif" /><img file="US2022121884A1_D2652.tif" /><img file="US2022121884A1_D2653.tif" /><img file="US2022121884A1_D2654.tif" /><img file="US2022121884A1_D2655.tif" /><img file="US2022121884A1_D2656.tif" /><img file="US2022121884A1_D2657.tif" /><img file="US2022121884A1_D2658.tif" /><img file="US2022121884A1_D2659.tif" /><img file="US2022121884A1_D2660.tif" /><img file="US2022121884A1_D2661.tif" /><img file="US2022121884A1_D2662.tif" /><img file="US2022121884A1_D2663.tif" /><img file="US2022121884A1_D2664.tif" /><img file="US2022121884A1_D2665.tif" /><img file="US2022121884A1_D2666.tif" /><img file="US2022121884A1_D2667.tif" /><img file="US2022121884A1_D2668.tif" /><img file="US2022121884A1_D2669.tif" /><img file="US2022121884A1_D2670.tif" /><img file="US2022121884A1_D2671.tif" /><img file="US2022121884A1_D2672.tif" /><img file="US2022121884A1_D2673.tif" /><img file="US2022121884A1_D2674.tif" /><img file="US2022121884A1_D2675.tif" /><img file="US2022121884A1_D2676.tif" /><img file="US2022121884A1_D2677.tif" /><img file="US2022121884A1_D2678.tif" /><img file="US2022121884A1_D2679.tif" /><img file="US2022121884A1_D2680.tif" /><img file="US2022121884A1_D2681.tif" /><img file="US2022121884A1_D2682.tif" /><img file="US2022121884A1_D2683.tif" /><img file="US2022121884A1_D2684.tif" /><img file="US2022121884A1_D2685.tif" /><img file="US2022121884A1_D2686.tif" /><img file="US2022121884A1_D2687.tif" /><img file="US2022121884A1_D2688.tif" /><maths id="MATH-US-00010-4" num="00010.4"><math overflow="scroll"><mrow><mi>v</mi><mo>=</mo><mrow><mi>f</mi><mo></mo><mrow><mo>(</mo><msub><mi>u</mi><mi>i</mi></msub><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D2689.tif" /><img file="US2022121884A1_D2690.tif" /><img file="US2022121884A1_D2691.tif" /><img file="US2022121884A1_D2692.tif" /><img file="US2022121884A1_D2693.tif" /><img file="US2022121884A1_D2694.tif" /><img file="US2022121884A1_D2695.tif" /><img file="US2022121884A1_D2696.tif" /><img file="US2022121884A1_D2697.tif" /><img file="US2022121884A1_D2698.tif" /><img file="US2022121884A1_D2699.tif" /><img file="US2022121884A1_D2700.tif" /><img file="US2022121884A1_D2701.tif" /><img file="US2022121884A1_D2702.tif" /><img file="US2022121884A1_D2703.tif" /><img file="US2022121884A1_D2704.tif" /><img file="US2022121884A1_D2705.tif" /><img file="US2022121884A1_D2706.tif" /><img file="US2022121884A1_D2707.tif" /><img file="US2022121884A1_D2708.tif" /><img file="US2022121884A1_D2709.tif" /><img file="US2022121884A1_D2710.tif" /><img file="US2022121884A1_D2711.tif" /><img file="US2022121884A1_D2712.tif" /><img file="US2022121884A1_D2713.tif" /><img file="US2022121884A1_D2714.tif" /><img file="US2022121884A1_D2715.tif" /><img file="US2022121884A1_D2716.tif" /><img file="US2022121884A1_D2717.tif" /><img file="US2022121884A1_D2718.tif" /><img file="US2022121884A1_D2719.tif" /><img file="US2022121884A1_D2720.tif" /><img file="US2022121884A1_D2721.tif" /><img file="US2022121884A1_D2722.tif" /><img file="US2022121884A1_D2723.tif" /><img file="US2022121884A1_D2724.tif" /><img file="US2022121884A1_D2725.tif" /><img file="US2022121884A1_D2726.tif" /><img file="US2022121884A1_D2727.tif" /><img file="US2022121884A1_D2728.tif" /><img file="US2022121884A1_D2729.tif" /><img file="US2022121884A1_D2730.tif" /><img file="US2022121884A1_D2731.tif" /><img file="US2022121884A1_D2732.tif" /><img file="US2022121884A1_D2733.tif" /><img file="US2022121884A1_D2734.tif" /><img file="US2022121884A1_D2735.tif" /><img file="US2022121884A1_D2736.tif" /><img file="US2022121884A1_D2737.tif" /><img file="US2022121884A1_D2738.tif" /><img file="US2022121884A1_D2739.tif" /><img file="US2022121884A1_D2740.tif" /><img file="US2022121884A1_D2741.tif" /><img file="US2022121884A1_D2742.tif" /><img file="US2022121884A1_D2743.tif" /><img file="US2022121884A1_D2744.tif" /><img file="US2022121884A1_D2745.tif" /><img file="US2022121884A1_D2746.tif" /><img file="US2022121884A1_D2747.tif" /><img file="US2022121884A1_D2748.tif" /><img file="US2022121884A1_D2749.tif" /><img file="US2022121884A1_D2750.tif" /><img file="US2022121884A1_D2751.tif" /><img file="US2022121884A1_D2752.tif" /><img file="US2022121884A1_D2753.tif" /><img file="US2022121884A1_D2754.tif" /><img file="US2022121884A1_D2755.tif" /><img file="US2022121884A1_D2756.tif" /><img file="US2022121884A1_D2757.tif" /><img file="US2022121884A1_D2758.tif" /><img file="US2022121884A1_D2759.tif" /><img file="US2022121884A1_D2760.tif" /><img file="US2022121884A1_D2761.tif" /><img file="US2022121884A1_D2762.tif" /><img file="US2022121884A1_D2763.tif" /><img file="US2022121884A1_D2764.tif" /><img file="US2022121884A1_D2765.tif" /><img file="US2022121884A1_D2766.tif" /><img file="US2022121884A1_D2767.tif" /><img file="US2022121884A1_D2768.tif" /><img file="US2022121884A1_D2769.tif" /><img file="US2022121884A1_D2770.tif" /><img file="US2022121884A1_D2771.tif" /><img file="US2022121884A1_D2772.tif" /><img file="US2022121884A1_D2773.tif" /><img file="US2022121884A1_D2774.tif" /><img file="US2022121884A1_D2775.tif" /><img file="US2022121884A1_D2776.tif" /><img file="US2022121884A1_D2777.tif" /><img file="US2022121884A1_D2778.tif" /><img file="US2022121884A1_D2779.tif" /><img file="US2022121884A1_D2780.tif" /><img file="US2022121884A1_D2781.tif" /><img file="US2022121884A1_D2782.tif" /><img file="US2022121884A1_D2783.tif" /><img file="US2022121884A1_D2784.tif" /><img file="US2022121884A1_D2785.tif" /><img file="US2022121884A1_D2786.tif" /><img file="US2022121884A1_D2787.tif" /><img file="US2022121884A1_D2788.tif" /><img file="US2022121884A1_D2789.tif" /><img file="US2022121884A1_D2790.tif" /><img file="US2022121884A1_D2791.tif" /><img file="US2022121884A1_D2792.tif" /><img file="US2022121884A1_D2793.tif" /><img file="US2022121884A1_D2794.tif" /><img file="US2022121884A1_D2795.tif" /><img file="US2022121884A1_D2796.tif" /><img file="US2022121884A1_D2797.tif" /><img file="US2022121884A1_D2798.tif" /><img file="US2022121884A1_D2799.tif" /><img file="US2022121884A1_D2800.tif" />
For functions with two arguments, we have:
<maths id="MATH-US-00011" num="00011"><math overflow="scroll"><mrow><mi>Z</mi><mo>=</mo><mrow><mi>f</mi><mo></mo><mrow><mo>(</mo><mrow><mi>X</mi><mo>,</mo><mi>Y</mi></mrow><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D2801.tif" /><img file="US2022121884A1_D2802.tif" /><img file="US2022121884A1_D2803.tif" /><img file="US2022121884A1_D2804.tif" /><img file="US2022121884A1_D2805.tif" /><img file="US2022121884A1_D2806.tif" /><img file="US2022121884A1_D2807.tif" /><img file="US2022121884A1_D2808.tif" /><img file="US2022121884A1_D2809.tif" /><img file="US2022121884A1_D2810.tif" /><img file="US2022121884A1_D2811.tif" /><img file="US2022121884A1_D2812.tif" /><img file="US2022121884A1_D2813.tif" /><img file="US2022121884A1_D2814.tif" /><img file="US2022121884A1_D2815.tif" /><img file="US2022121884A1_D2816.tif" /><img file="US2022121884A1_D2817.tif" /><img file="US2022121884A1_D2818.tif" /><img file="US2022121884A1_D2819.tif" /><img file="US2022121884A1_D2820.tif" /><img file="US2022121884A1_D2821.tif" /><img file="US2022121884A1_D2822.tif" /><img file="US2022121884A1_D2823.tif" /><img file="US2022121884A1_D2824.tif" /><img file="US2022121884A1_D2825.tif" /><img file="US2022121884A1_D2826.tif" /><img file="US2022121884A1_D2827.tif" /><img file="US2022121884A1_D2828.tif" /><img file="US2022121884A1_D2829.tif" /><img file="US2022121884A1_D2830.tif" /><img file="US2022121884A1_D2831.tif" /><img file="US2022121884A1_D2832.tif" /><img file="US2022121884A1_D2833.tif" /><img file="US2022121884A1_D2834.tif" /><img file="US2022121884A1_D2835.tif" /><img file="US2022121884A1_D2836.tif" /><img file="US2022121884A1_D2837.tif" /><img file="US2022121884A1_D2838.tif" /><img file="US2022121884A1_D2839.tif" /><img file="US2022121884A1_D2840.tif" /><img file="US2022121884A1_D2841.tif" /><img file="US2022121884A1_D2842.tif" /><img file="US2022121884A1_D2843.tif" /><img file="US2022121884A1_D2844.tif" /><img file="US2022121884A1_D2845.tif" /><img file="US2022121884A1_D2846.tif" /><img file="US2022121884A1_D2847.tif" /><img file="US2022121884A1_D2848.tif" /><img file="US2022121884A1_D2849.tif" /><img file="US2022121884A1_D2850.tif" /><img file="US2022121884A1_D2851.tif" /><img file="US2022121884A1_D2852.tif" /><img file="US2022121884A1_D2853.tif" /><img file="US2022121884A1_D2854.tif" /><img file="US2022121884A1_D2855.tif" /><img file="US2022121884A1_D2856.tif" /><img file="US2022121884A1_D2857.tif" /><img file="US2022121884A1_D2858.tif" /><img file="US2022121884A1_D2859.tif" /><img file="US2022121884A1_D2860.tif" /><img file="US2022121884A1_D2861.tif" /><img file="US2022121884A1_D2862.tif" /><img file="US2022121884A1_D2863.tif" /><img file="US2022121884A1_D2864.tif" /><img file="US2022121884A1_D2865.tif" /><img file="US2022121884A1_D2866.tif" /><img file="US2022121884A1_D2867.tif" /><img file="US2022121884A1_D2868.tif" /><img file="US2022121884A1_D2869.tif" /><img file="US2022121884A1_D2870.tif" /><img file="US2022121884A1_D2871.tif" /><img file="US2022121884A1_D2872.tif" /><img file="US2022121884A1_D2873.tif" /><img file="US2022121884A1_D2874.tif" /><img file="US2022121884A1_D2875.tif" /><img file="US2022121884A1_D2876.tif" /><img file="US2022121884A1_D2877.tif" /><img file="US2022121884A1_D2878.tif" /><img file="US2022121884A1_D2879.tif" /><img file="US2022121884A1_D2880.tif" /><img file="US2022121884A1_D2881.tif" /><img file="US2022121884A1_D2882.tif" /><img file="US2022121884A1_D2883.tif" /><img file="US2022121884A1_D2884.tif" /><img file="US2022121884A1_D2885.tif" /><img file="US2022121884A1_D2886.tif" /><img file="US2022121884A1_D2887.tif" /><img file="US2022121884A1_D2888.tif" /><img file="US2022121884A1_D2889.tif" /><img file="US2022121884A1_D2890.tif" /><img file="US2022121884A1_D2891.tif" /><img file="US2022121884A1_D2892.tif" /><img file="US2022121884A1_D2893.tif" /><img file="US2022121884A1_D2894.tif" /><img file="US2022121884A1_D2895.tif" /><img file="US2022121884A1_D2896.tif" /><img file="US2022121884A1_D2897.tif" /><img file="US2022121884A1_D2898.tif" /><img file="US2022121884A1_D2899.tif" /><img file="US2022121884A1_D2900.tif" /><img file="US2022121884A1_D2901.tif" /><img file="US2022121884A1_D2902.tif" /><img file="US2022121884A1_D2903.tif" /><img file="US2022121884A1_D2904.tif" /><img file="US2022121884A1_D2905.tif" /><img file="US2022121884A1_D2906.tif" /><img file="US2022121884A1_D2907.tif" /><img file="US2022121884A1_D2908.tif" /><img file="US2022121884A1_D2909.tif" /><img file="US2022121884A1_D2910.tif" /><img file="US2022121884A1_D2911.tif" /><img file="US2022121884A1_D2912.tif" /><maths id="MATH-US-00011-2" num="00011.2"><math overflow="scroll"><mfrac><mtable><mtr><mtd><mrow><mrow><mrow><mi>R</mi><mo></mo><mrow><mo>(</mo><mi>X</mi><mo>)</mo></mrow></mrow><mo>:</mo><mrow><mi>X</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>isp</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>p</mi></mrow></mrow><mo>,</mo><mrow><mi>p</mi><mo>=</mo><mrow><mrow><msub><mi>p</mi><mn>1</mn></msub><mo></mo><mi>\</mi><mo></mo><msub><mi>u</mi><mn>1</mn></msub></mrow><mo>+</mo><mrow><mi>…</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><msub><mi>p</mi><mi>m</mi></msub><mo></mo><mi>\</mi><mo></mo><msub><mi>u</mi><mi>m</mi></msub></mrow></mrow></mrow></mrow></mrow></mtd></mtr><mtr><mtd><mrow><mrow><mrow><mi>R</mi><mo></mo><mrow><mo>(</mo><mi>Y</mi><mo>)</mo></mrow></mrow><mo>:</mo><mrow><mi>Y</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>isp</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>q</mi></mrow></mrow><mo>=</mo><mrow><mrow><msub><mi>q</mi><mn>1</mn></msub><mo></mo><mi>\</mi><mo></mo><msub><mi>v</mi><mn>1</mn></msub></mrow><mo>+</mo><mrow><mi>…</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><msub><mi>q</mi><mi>n</mi></msub><mo></mo><mi>\</mi><mo></mo><msub><mi>v</mi><mi>n</mi></msub></mrow></mrow></mrow></mrow></mtd></mtr></mtable><mtable><mtr><mtd><mrow><mrow><mrow><mi>R</mi><mo></mo><mrow><mo>(</mo><mi>Z</mi><mo>)</mo></mrow></mrow><mo>:</mo><mrow><msub><mi>p</mi><mi>z</mi></msub><mo></mo><mrow><mo>(</mo><mi>w</mi><mo>)</mo></mrow></mrow></mrow><mo>=</mo><mrow><msub><mo>∑</mo><mi>i</mi></msub><mo></mo><mrow><msub><mi>p</mi><mi>i</mi></msub><mo></mo><msub><mi>q</mi><mi>j</mi></msub></mrow></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mrow><mrow><mi>f</mi><mo></mo><mrow><mo>(</mo><mrow><mi>p</mi><mo>,</mo><mi>q</mi></mrow><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mi>R</mi><mo></mo><mrow><mo>(</mo><mi>Z</mi><mo>)</mo></mrow></mrow></mrow><mo>)</mo></mrow></mtd></mtr></mtable></mfrac></math></maths><img file="US2022121884A1_D2913.tif" /><img file="US2022121884A1_D2914.tif" /><img file="US2022121884A1_D2915.tif" /><img file="US2022121884A1_D2916.tif" /><img file="US2022121884A1_D2917.tif" /><img file="US2022121884A1_D2918.tif" /><img file="US2022121884A1_D2919.tif" /><img file="US2022121884A1_D2920.tif" /><img file="US2022121884A1_D2921.tif" /><img file="US2022121884A1_D2922.tif" /><img file="US2022121884A1_D2923.tif" /><img file="US2022121884A1_D2924.tif" /><img file="US2022121884A1_D2925.tif" /><img file="US2022121884A1_D2926.tif" /><img file="US2022121884A1_D2927.tif" /><img file="US2022121884A1_D2928.tif" /><img file="US2022121884A1_D2929.tif" /><img file="US2022121884A1_D2930.tif" /><img file="US2022121884A1_D2931.tif" /><img file="US2022121884A1_D2932.tif" /><img file="US2022121884A1_D2933.tif" /><img file="US2022121884A1_D2934.tif" /><img file="US2022121884A1_D2935.tif" /><img file="US2022121884A1_D2936.tif" /><img file="US2022121884A1_D2937.tif" /><img file="US2022121884A1_D2938.tif" /><img file="US2022121884A1_D2939.tif" /><img file="US2022121884A1_D2940.tif" /><img file="US2022121884A1_D2941.tif" /><img file="US2022121884A1_D2942.tif" /><img file="US2022121884A1_D2943.tif" /><img file="US2022121884A1_D2944.tif" /><img file="US2022121884A1_D2945.tif" /><img file="US2022121884A1_D2946.tif" /><img file="US2022121884A1_D2947.tif" /><img file="US2022121884A1_D2948.tif" /><img file="US2022121884A1_D2949.tif" /><img file="US2022121884A1_D2950.tif" /><img file="US2022121884A1_D2951.tif" /><img file="US2022121884A1_D2952.tif" /><img file="US2022121884A1_D2953.tif" /><img file="US2022121884A1_D2954.tif" /><img file="US2022121884A1_D2955.tif" /><img file="US2022121884A1_D2956.tif" /><img file="US2022121884A1_D2957.tif" /><img file="US2022121884A1_D2958.tif" /><img file="US2022121884A1_D2959.tif" /><img file="US2022121884A1_D2960.tif" /><img file="US2022121884A1_D2961.tif" /><img file="US2022121884A1_D2962.tif" /><img file="US2022121884A1_D2963.tif" /><img file="US2022121884A1_D2964.tif" /><img file="US2022121884A1_D2965.tif" /><img file="US2022121884A1_D2966.tif" /><img file="US2022121884A1_D2967.tif" /><img file="US2022121884A1_D2968.tif" /><img file="US2022121884A1_D2969.tif" /><img file="US2022121884A1_D2970.tif" /><img file="US2022121884A1_D2971.tif" /><img file="US2022121884A1_D2972.tif" /><img file="US2022121884A1_D2973.tif" /><img file="US2022121884A1_D2974.tif" /><img file="US2022121884A1_D2975.tif" /><img file="US2022121884A1_D2976.tif" /><img file="US2022121884A1_D2977.tif" /><img file="US2022121884A1_D2978.tif" /><img file="US2022121884A1_D2979.tif" /><img file="US2022121884A1_D2980.tif" /><img file="US2022121884A1_D2981.tif" /><img file="US2022121884A1_D2982.tif" /><img file="US2022121884A1_D2983.tif" /><img file="US2022121884A1_D2984.tif" /><img file="US2022121884A1_D2985.tif" /><img file="US2022121884A1_D2986.tif" /><img file="US2022121884A1_D2987.tif" /><img file="US2022121884A1_D2988.tif" /><img file="US2022121884A1_D2989.tif" /><img file="US2022121884A1_D2990.tif" /><img file="US2022121884A1_D2991.tif" /><img file="US2022121884A1_D2992.tif" /><img file="US2022121884A1_D2993.tif" /><img file="US2022121884A1_D2994.tif" /><img file="US2022121884A1_D2995.tif" /><img file="US2022121884A1_D2996.tif" /><img file="US2022121884A1_D2997.tif" /><img file="US2022121884A1_D2998.tif" /><img file="US2022121884A1_D2999.tif" /><img file="US2022121884A1_D3000.tif" /><img file="US2022121884A1_D3001.tif" /><img file="US2022121884A1_D3002.tif" /><img file="US2022121884A1_D3003.tif" /><img file="US2022121884A1_D3004.tif" /><img file="US2022121884A1_D3005.tif" /><img file="US2022121884A1_D3006.tif" /><img file="US2022121884A1_D3007.tif" /><img file="US2022121884A1_D3008.tif" /><img file="US2022121884A1_D3009.tif" /><img file="US2022121884A1_D3010.tif" /><img file="US2022121884A1_D3011.tif" /><img file="US2022121884A1_D3012.tif" /><img file="US2022121884A1_D3013.tif" /><img file="US2022121884A1_D3014.tif" /><img file="US2022121884A1_D3015.tif" /><img file="US2022121884A1_D3016.tif" /><img file="US2022121884A1_D3017.tif" /><img file="US2022121884A1_D3018.tif" /><img file="US2022121884A1_D3019.tif" /><img file="US2022121884A1_D3020.tif" /><img file="US2022121884A1_D3021.tif" /><img file="US2022121884A1_D3022.tif" /><img file="US2022121884A1_D3023.tif" /><img file="US2022121884A1_D3024.tif" /><maths id="MATH-US-00011-3" num="00011.3"><math overflow="scroll"><mrow><mi>subject</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>to</mi></mrow></math></maths><img file="US2022121884A1_D3025.tif" /><img file="US2022121884A1_D3026.tif" /><img file="US2022121884A1_D3027.tif" /><img file="US2022121884A1_D3028.tif" /><img file="US2022121884A1_D3029.tif" /><img file="US2022121884A1_D3030.tif" /><img file="US2022121884A1_D3031.tif" /><img file="US2022121884A1_D3032.tif" /><img file="US2022121884A1_D3033.tif" /><img file="US2022121884A1_D3034.tif" /><img file="US2022121884A1_D3035.tif" /><img file="US2022121884A1_D3036.tif" /><img file="US2022121884A1_D3037.tif" /><img file="US2022121884A1_D3038.tif" /><img file="US2022121884A1_D3039.tif" /><img file="US2022121884A1_D3040.tif" /><img file="US2022121884A1_D3041.tif" /><img file="US2022121884A1_D3042.tif" /><img file="US2022121884A1_D3043.tif" /><img file="US2022121884A1_D3044.tif" /><img file="US2022121884A1_D3045.tif" /><img file="US2022121884A1_D3046.tif" /><img file="US2022121884A1_D3047.tif" /><img file="US2022121884A1_D3048.tif" /><img file="US2022121884A1_D3049.tif" /><img file="US2022121884A1_D3050.tif" /><img file="US2022121884A1_D3051.tif" /><img file="US2022121884A1_D3052.tif" /><img file="US2022121884A1_D3053.tif" /><img file="US2022121884A1_D3054.tif" /><img file="US2022121884A1_D3055.tif" /><img file="US2022121884A1_D3056.tif" /><img file="US2022121884A1_D3057.tif" /><img file="US2022121884A1_D3058.tif" /><img file="US2022121884A1_D3059.tif" /><img file="US2022121884A1_D3060.tif" /><img file="US2022121884A1_D3061.tif" /><img file="US2022121884A1_D3062.tif" /><img file="US2022121884A1_D3063.tif" /><img file="US2022121884A1_D3064.tif" /><img file="US2022121884A1_D3065.tif" /><img file="US2022121884A1_D3066.tif" /><img file="US2022121884A1_D3067.tif" /><img file="US2022121884A1_D3068.tif" /><img file="US2022121884A1_D3069.tif" /><img file="US2022121884A1_D3070.tif" /><img file="US2022121884A1_D3071.tif" /><img file="US2022121884A1_D3072.tif" /><img file="US2022121884A1_D3073.tif" /><img file="US2022121884A1_D3074.tif" /><img file="US2022121884A1_D3075.tif" /><img file="US2022121884A1_D3076.tif" /><img file="US2022121884A1_D3077.tif" /><img file="US2022121884A1_D3078.tif" /><img file="US2022121884A1_D3079.tif" /><img file="US2022121884A1_D3080.tif" /><img file="US2022121884A1_D3081.tif" /><img file="US2022121884A1_D3082.tif" /><img file="US2022121884A1_D3083.tif" /><img file="US2022121884A1_D3084.tif" /><img file="US2022121884A1_D3085.tif" /><img file="US2022121884A1_D3086.tif" /><img file="US2022121884A1_D3087.tif" /><img file="US2022121884A1_D3088.tif" /><img file="US2022121884A1_D3089.tif" /><img file="US2022121884A1_D3090.tif" /><img file="US2022121884A1_D3091.tif" /><img file="US2022121884A1_D3092.tif" /><img file="US2022121884A1_D3093.tif" /><img file="US2022121884A1_D3094.tif" /><img file="US2022121884A1_D3095.tif" /><img file="US2022121884A1_D3096.tif" /><img file="US2022121884A1_D3097.tif" /><img file="US2022121884A1_D3098.tif" /><img file="US2022121884A1_D3099.tif" /><img file="US2022121884A1_D3100.tif" /><img file="US2022121884A1_D3101.tif" /><img file="US2022121884A1_D3102.tif" /><img file="US2022121884A1_D3103.tif" /><img file="US2022121884A1_D3104.tif" /><img file="US2022121884A1_D3105.tif" /><img file="US2022121884A1_D3106.tif" /><img file="US2022121884A1_D3107.tif" /><img file="US2022121884A1_D3108.tif" /><img file="US2022121884A1_D3109.tif" /><img file="US2022121884A1_D3110.tif" /><img file="US2022121884A1_D3111.tif" /><img file="US2022121884A1_D3112.tif" /><img file="US2022121884A1_D3113.tif" /><img file="US2022121884A1_D3114.tif" /><img file="US2022121884A1_D3115.tif" /><img file="US2022121884A1_D3116.tif" /><img file="US2022121884A1_D3117.tif" /><img file="US2022121884A1_D3118.tif" /><img file="US2022121884A1_D3119.tif" /><img file="US2022121884A1_D3120.tif" /><img file="US2022121884A1_D3121.tif" /><img file="US2022121884A1_D3122.tif" /><img file="US2022121884A1_D3123.tif" /><img file="US2022121884A1_D3124.tif" /><img file="US2022121884A1_D3125.tif" /><img file="US2022121884A1_D3126.tif" /><img file="US2022121884A1_D3127.tif" /><img file="US2022121884A1_D3128.tif" /><img file="US2022121884A1_D3129.tif" /><img file="US2022121884A1_D3130.tif" /><img file="US2022121884A1_D3131.tif" /><img file="US2022121884A1_D3132.tif" /><img file="US2022121884A1_D3133.tif" /><img file="US2022121884A1_D3134.tif" /><img file="US2022121884A1_D3135.tif" /><img file="US2022121884A1_D3136.tif" /><maths id="MATH-US-00011-4" num="00011.4"><math overflow="scroll"><mrow><mi>w</mi><mo>=</mo><mrow><mi>f</mi><mo></mo><mrow><mo>(</mo><mrow><msub><mi>u</mi><mi>i</mi></msub><mo>,</mo><msub><mi>v</mi><mi>j</mi></msub></mrow><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D3137.tif" /><img file="US2022121884A1_D3138.tif" /><img file="US2022121884A1_D3139.tif" /><img file="US2022121884A1_D3140.tif" /><img file="US2022121884A1_D3141.tif" /><img file="US2022121884A1_D3142.tif" /><img file="US2022121884A1_D3143.tif" /><img file="US2022121884A1_D3144.tif" /><img file="US2022121884A1_D3145.tif" /><img file="US2022121884A1_D3146.tif" /><img file="US2022121884A1_D3147.tif" /><img file="US2022121884A1_D3148.tif" /><img file="US2022121884A1_D3149.tif" /><img file="US2022121884A1_D3150.tif" /><img file="US2022121884A1_D3151.tif" /><img file="US2022121884A1_D3152.tif" /><img file="US2022121884A1_D3153.tif" /><img file="US2022121884A1_D3154.tif" /><img file="US2022121884A1_D3155.tif" /><img file="US2022121884A1_D3156.tif" /><img file="US2022121884A1_D3157.tif" /><img file="US2022121884A1_D3158.tif" /><img file="US2022121884A1_D3159.tif" /><img file="US2022121884A1_D3160.tif" /><img file="US2022121884A1_D3161.tif" /><img file="US2022121884A1_D3162.tif" /><img file="US2022121884A1_D3163.tif" /><img file="US2022121884A1_D3164.tif" /><img file="US2022121884A1_D3165.tif" /><img file="US2022121884A1_D3166.tif" /><img file="US2022121884A1_D3167.tif" /><img file="US2022121884A1_D3168.tif" /><img file="US2022121884A1_D3169.tif" /><img file="US2022121884A1_D3170.tif" /><img file="US2022121884A1_D3171.tif" /><img file="US2022121884A1_D3172.tif" /><img file="US2022121884A1_D3173.tif" /><img file="US2022121884A1_D3174.tif" /><img file="US2022121884A1_D3175.tif" /><img file="US2022121884A1_D3176.tif" /><img file="US2022121884A1_D3177.tif" /><img file="US2022121884A1_D3178.tif" /><img file="US2022121884A1_D3179.tif" /><img file="US2022121884A1_D3180.tif" /><img file="US2022121884A1_D3181.tif" /><img file="US2022121884A1_D3182.tif" /><img file="US2022121884A1_D3183.tif" /><img file="US2022121884A1_D3184.tif" /><img file="US2022121884A1_D3185.tif" /><img file="US2022121884A1_D3186.tif" /><img file="US2022121884A1_D3187.tif" /><img file="US2022121884A1_D3188.tif" /><img file="US2022121884A1_D3189.tif" /><img file="US2022121884A1_D3190.tif" /><img file="US2022121884A1_D3191.tif" /><img file="US2022121884A1_D3192.tif" /><img file="US2022121884A1_D3193.tif" /><img file="US2022121884A1_D3194.tif" /><img file="US2022121884A1_D3195.tif" /><img file="US2022121884A1_D3196.tif" /><img file="US2022121884A1_D3197.tif" /><img file="US2022121884A1_D3198.tif" /><img file="US2022121884A1_D3199.tif" /><img file="US2022121884A1_D3200.tif" /><img file="US2022121884A1_D3201.tif" /><img file="US2022121884A1_D3202.tif" /><img file="US2022121884A1_D3203.tif" /><img file="US2022121884A1_D3204.tif" /><img file="US2022121884A1_D3205.tif" /><img file="US2022121884A1_D3206.tif" /><img file="US2022121884A1_D3207.tif" /><img file="US2022121884A1_D3208.tif" /><img file="US2022121884A1_D3209.tif" /><img file="US2022121884A1_D3210.tif" /><img file="US2022121884A1_D3211.tif" /><img file="US2022121884A1_D3212.tif" /><img file="US2022121884A1_D3213.tif" /><img file="US2022121884A1_D3214.tif" /><img file="US2022121884A1_D3215.tif" /><img file="US2022121884A1_D3216.tif" /><img file="US2022121884A1_D3217.tif" /><img file="US2022121884A1_D3218.tif" /><img file="US2022121884A1_D3219.tif" /><img file="US2022121884A1_D3220.tif" /><img file="US2022121884A1_D3221.tif" /><img file="US2022121884A1_D3222.tif" /><img file="US2022121884A1_D3223.tif" /><img file="US2022121884A1_D3224.tif" /><img file="US2022121884A1_D3225.tif" /><img file="US2022121884A1_D3226.tif" /><img file="US2022121884A1_D3227.tif" /><img file="US2022121884A1_D3228.tif" /><img file="US2022121884A1_D3229.tif" /><img file="US2022121884A1_D3230.tif" /><img file="US2022121884A1_D3231.tif" /><img file="US2022121884A1_D3232.tif" /><img file="US2022121884A1_D3233.tif" /><img file="US2022121884A1_D3234.tif" /><img file="US2022121884A1_D3235.tif" /><img file="US2022121884A1_D3236.tif" /><img file="US2022121884A1_D3237.tif" /><img file="US2022121884A1_D3238.tif" /><img file="US2022121884A1_D3239.tif" /><img file="US2022121884A1_D3240.tif" /><img file="US2022121884A1_D3241.tif" /><img file="US2022121884A1_D3242.tif" /><img file="US2022121884A1_D3243.tif" /><img file="US2022121884A1_D3244.tif" /><img file="US2022121884A1_D3245.tif" /><img file="US2022121884A1_D3246.tif" /><img file="US2022121884A1_D3247.tif" /><img file="US2022121884A1_D3248.tif" />
For the case where the restrictions are Z<sup>+</sup>-numbers, the extension principle reads:
<maths id="MATH-US-00012" num="00012"><math overflow="scroll"><mrow><mi>Z</mi><mo>=</mo><mrow><mi>f</mi><mo></mo><mrow><mo>(</mo><mrow><mi>X</mi><mo>,</mo><mi>Y</mi></mrow><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D3249.tif" /><img file="US2022121884A1_D3250.tif" /><img file="US2022121884A1_D3251.tif" /><img file="US2022121884A1_D3252.tif" /><img file="US2022121884A1_D3253.tif" /><img file="US2022121884A1_D3254.tif" /><img file="US2022121884A1_D3255.tif" /><img file="US2022121884A1_D3256.tif" /><img file="US2022121884A1_D3257.tif" /><img file="US2022121884A1_D3258.tif" /><img file="US2022121884A1_D3259.tif" /><img file="US2022121884A1_D3260.tif" /><img file="US2022121884A1_D3261.tif" /><img file="US2022121884A1_D3262.tif" /><img file="US2022121884A1_D3263.tif" /><img file="US2022121884A1_D3264.tif" /><img file="US2022121884A1_D3265.tif" /><img file="US2022121884A1_D3266.tif" /><img file="US2022121884A1_D3267.tif" /><img file="US2022121884A1_D3268.tif" /><img file="US2022121884A1_D3269.tif" /><img file="US2022121884A1_D3270.tif" /><img file="US2022121884A1_D3271.tif" /><img file="US2022121884A1_D3272.tif" /><img file="US2022121884A1_D3273.tif" /><img file="US2022121884A1_D3274.tif" /><img file="US2022121884A1_D3275.tif" /><img file="US2022121884A1_D3276.tif" /><img file="US2022121884A1_D3277.tif" /><img file="US2022121884A1_D3278.tif" /><img file="US2022121884A1_D3279.tif" /><img file="US2022121884A1_D3280.tif" /><img file="US2022121884A1_D3281.tif" /><img file="US2022121884A1_D3282.tif" /><img file="US2022121884A1_D3283.tif" /><img file="US2022121884A1_D3284.tif" /><img file="US2022121884A1_D3285.tif" /><img file="US2022121884A1_D3286.tif" /><img file="US2022121884A1_D3287.tif" /><img file="US2022121884A1_D3288.tif" /><img file="US2022121884A1_D3289.tif" /><img file="US2022121884A1_D3290.tif" /><img file="US2022121884A1_D3291.tif" /><img file="US2022121884A1_D3292.tif" /><img file="US2022121884A1_D3293.tif" /><img file="US2022121884A1_D3294.tif" /><img file="US2022121884A1_D3295.tif" /><img file="US2022121884A1_D3296.tif" /><img file="US2022121884A1_D3297.tif" /><img file="US2022121884A1_D3298.tif" /><img file="US2022121884A1_D3299.tif" /><img file="US2022121884A1_D3300.tif" /><img file="US2022121884A1_D3301.tif" /><img file="US2022121884A1_D3302.tif" /><img file="US2022121884A1_D3303.tif" /><img file="US2022121884A1_D3304.tif" /><img file="US2022121884A1_D3305.tif" /><img file="US2022121884A1_D3306.tif" /><img file="US2022121884A1_D3307.tif" /><img file="US2022121884A1_D3308.tif" /><img file="US2022121884A1_D3309.tif" /><img file="US2022121884A1_D3310.tif" /><img file="US2022121884A1_D3311.tif" /><img file="US2022121884A1_D3312.tif" /><img file="US2022121884A1_D3313.tif" /><img file="US2022121884A1_D3314.tif" /><img file="US2022121884A1_D3315.tif" /><img file="US2022121884A1_D3316.tif" /><img file="US2022121884A1_D3317.tif" /><img file="US2022121884A1_D3318.tif" /><img file="US2022121884A1_D3319.tif" /><img file="US2022121884A1_D3320.tif" /><img file="US2022121884A1_D3321.tif" /><img file="US2022121884A1_D3322.tif" /><img file="US2022121884A1_D3323.tif" /><img file="US2022121884A1_D3324.tif" /><img file="US2022121884A1_D3325.tif" /><img file="US2022121884A1_D3326.tif" /><img file="US2022121884A1_D3327.tif" /><img file="US2022121884A1_D3328.tif" /><img file="US2022121884A1_D3329.tif" /><img file="US2022121884A1_D3330.tif" /><img file="US2022121884A1_D3331.tif" /><img file="US2022121884A1_D3332.tif" /><img file="US2022121884A1_D3333.tif" /><img file="US2022121884A1_D3334.tif" /><img file="US2022121884A1_D3335.tif" /><img file="US2022121884A1_D3336.tif" /><img file="US2022121884A1_D3337.tif" /><img file="US2022121884A1_D3338.tif" /><img file="US2022121884A1_D3339.tif" /><img file="US2022121884A1_D3340.tif" /><img file="US2022121884A1_D3341.tif" /><img file="US2022121884A1_D3342.tif" /><img file="US2022121884A1_D3343.tif" /><img file="US2022121884A1_D3344.tif" /><img file="US2022121884A1_D3345.tif" /><img file="US2022121884A1_D3346.tif" /><img file="US2022121884A1_D3347.tif" /><img file="US2022121884A1_D3348.tif" /><img file="US2022121884A1_D3349.tif" /><img file="US2022121884A1_D3350.tif" /><img file="US2022121884A1_D3351.tif" /><img file="US2022121884A1_D3352.tif" /><img file="US2022121884A1_D3353.tif" /><img file="US2022121884A1_D3354.tif" /><img file="US2022121884A1_D3355.tif" /><img file="US2022121884A1_D3356.tif" /><img file="US2022121884A1_D3357.tif" /><img file="US2022121884A1_D3358.tif" /><img file="US2022121884A1_D3359.tif" /><img file="US2022121884A1_D3360.tif" /><maths id="MATH-US-00012-2" num="00012.2"><math overflow="scroll"><mfrac><mtable><mtr><mtd><mrow><mrow><mi>R</mi><mo></mo><mrow><mo>(</mo><mi>X</mi><mo>)</mo></mrow></mrow><mo>:</mo><mrow><mi>X</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>is</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mrow><mo>(</mo><mrow><msub><mi>A</mi><mi>X</mi></msub><mo>,</mo><msub><mi>p</mi><mi>X</mi></msub></mrow><mo>)</mo></mrow></mrow></mrow></mtd></mtr><mtr><mtd><mrow><mrow><mi>R</mi><mo></mo><mrow><mo>(</mo><mi>Y</mi><mo>)</mo></mrow></mrow><mo>:</mo><mrow><mi>Y</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>is</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mrow><mo>(</mo><mrow><msub><mi>A</mi><mi>Y</mi></msub><mo>,</mo><msub><mi>p</mi><mi>Y</mi></msub></mrow><mo>)</mo></mrow></mrow></mrow></mtd></mtr></mtable><mrow><mrow><mi>R</mi><mo></mo><mrow><mo>(</mo><mi>Z</mi><mo>)</mo></mrow></mrow><mo>:</mo><mrow><mi>Z</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>is</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mrow><mo>(</mo><mrow><mrow><mi>f</mi><mo></mo><mrow><mo>(</mo><mrow><msub><mi>A</mi><mi>X</mi></msub><mo>,</mo><msub><mi>A</mi><mi>Y</mi></msub></mrow><mo>)</mo></mrow></mrow><mo>,</mo><mrow><mi>f</mi><mo></mo><mrow><mo>(</mo><mrow><msub><mi>p</mi><mi>X</mi></msub><mo>,</mo><msub><mi>p</mi><mi>Y</mi></msub></mrow><mo>)</mo></mrow></mrow></mrow><mo>)</mo></mrow></mrow></mrow></mfrac></math></maths><img file="US2022121884A1_D3361.tif" /><img file="US2022121884A1_D3362.tif" /><img file="US2022121884A1_D3363.tif" /><img file="US2022121884A1_D3364.tif" /><img file="US2022121884A1_D3365.tif" /><img file="US2022121884A1_D3366.tif" /><img file="US2022121884A1_D3367.tif" /><img file="US2022121884A1_D3368.tif" /><img file="US2022121884A1_D3369.tif" /><img file="US2022121884A1_D3370.tif" /><img file="US2022121884A1_D3371.tif" /><img file="US2022121884A1_D3372.tif" /><img file="US2022121884A1_D3373.tif" /><img file="US2022121884A1_D3374.tif" /><img file="US2022121884A1_D3375.tif" /><img file="US2022121884A1_D3376.tif" /><img file="US2022121884A1_D3377.tif" /><img file="US2022121884A1_D3378.tif" /><img file="US2022121884A1_D3379.tif" /><img file="US2022121884A1_D3380.tif" /><img file="US2022121884A1_D3381.tif" /><img file="US2022121884A1_D3382.tif" /><img file="US2022121884A1_D3383.tif" /><img file="US2022121884A1_D3384.tif" /><img file="US2022121884A1_D3385.tif" /><img file="US2022121884A1_D3386.tif" /><img file="US2022121884A1_D3387.tif" /><img file="US2022121884A1_D3388.tif" /><img file="US2022121884A1_D3389.tif" /><img file="US2022121884A1_D3390.tif" /><img file="US2022121884A1_D3391.tif" /><img file="US2022121884A1_D3392.tif" /><img file="US2022121884A1_D3393.tif" /><img file="US2022121884A1_D3394.tif" /><img file="US2022121884A1_D3395.tif" /><img file="US2022121884A1_D3396.tif" /><img file="US2022121884A1_D3397.tif" /><img file="US2022121884A1_D3398.tif" /><img file="US2022121884A1_D3399.tif" /><img file="US2022121884A1_D3400.tif" /><img file="US2022121884A1_D3401.tif" /><img file="US2022121884A1_D3402.tif" /><img file="US2022121884A1_D3403.tif" /><img file="US2022121884A1_D3404.tif" /><img file="US2022121884A1_D3405.tif" /><img file="US2022121884A1_D3406.tif" /><img file="US2022121884A1_D3407.tif" /><img file="US2022121884A1_D3408.tif" /><img file="US2022121884A1_D3409.tif" /><img file="US2022121884A1_D3410.tif" /><img file="US2022121884A1_D3411.tif" /><img file="US2022121884A1_D3412.tif" /><img file="US2022121884A1_D3413.tif" /><img file="US2022121884A1_D3414.tif" /><img file="US2022121884A1_D3415.tif" /><img file="US2022121884A1_D3416.tif" /><img file="US2022121884A1_D3417.tif" /><img file="US2022121884A1_D3418.tif" /><img file="US2022121884A1_D3419.tif" /><img file="US2022121884A1_D3420.tif" /><img file="US2022121884A1_D3421.tif" /><img file="US2022121884A1_D3422.tif" /><img file="US2022121884A1_D3423.tif" /><img file="US2022121884A1_D3424.tif" /><img file="US2022121884A1_D3425.tif" /><img file="US2022121884A1_D3426.tif" /><img file="US2022121884A1_D3427.tif" /><img file="US2022121884A1_D3428.tif" /><img file="US2022121884A1_D3429.tif" /><img file="US2022121884A1_D3430.tif" /><img file="US2022121884A1_D3431.tif" /><img file="US2022121884A1_D3432.tif" /><img file="US2022121884A1_D3433.tif" /><img file="US2022121884A1_D3434.tif" /><img file="US2022121884A1_D3435.tif" /><img file="US2022121884A1_D3436.tif" /><img file="US2022121884A1_D3437.tif" /><img file="US2022121884A1_D3438.tif" /><img file="US2022121884A1_D3439.tif" /><img file="US2022121884A1_D3440.tif" /><img file="US2022121884A1_D3441.tif" /><img file="US2022121884A1_D3442.tif" /><img file="US2022121884A1_D3443.tif" /><img file="US2022121884A1_D3444.tif" /><img file="US2022121884A1_D3445.tif" /><img file="US2022121884A1_D3446.tif" /><img file="US2022121884A1_D3447.tif" /><img file="US2022121884A1_D3448.tif" /><img file="US2022121884A1_D3449.tif" /><img file="US2022121884A1_D3450.tif" /><img file="US2022121884A1_D3451.tif" /><img file="US2022121884A1_D3452.tif" /><img file="US2022121884A1_D3453.tif" /><img file="US2022121884A1_D3454.tif" /><img file="US2022121884A1_D3455.tif" /><img file="US2022121884A1_D3456.tif" /><img file="US2022121884A1_D3457.tif" /><img file="US2022121884A1_D3458.tif" /><img file="US2022121884A1_D3459.tif" /><img file="US2022121884A1_D3460.tif" /><img file="US2022121884A1_D3461.tif" /><img file="US2022121884A1_D3462.tif" /><img file="US2022121884A1_D3463.tif" /><img file="US2022121884A1_D3464.tif" /><img file="US2022121884A1_D3465.tif" /><img file="US2022121884A1_D3466.tif" /><img file="US2022121884A1_D3467.tif" /><img file="US2022121884A1_D3468.tif" /><img file="US2022121884A1_D3469.tif" /><img file="US2022121884A1_D3470.tif" /><img file="US2022121884A1_D3471.tif" /><img file="US2022121884A1_D3472.tif" />
It is this version of the extension principle that is the basis for computation with Z-numbers. Now, one may want to know if f(p<sub>X</sub>, p<sub>Y</sub>) is compatible with f(A<sub>X</sub>, A<sub>Y</sub>).
Turning to computation with Z-numbers, assume for simplicity that *=sum. Assume that Z<sub>X</sub>=(A<sub>X</sub>, B<sub>X</sub>) and Z<sub>Y</sub>=(A<sub>Y</sub>, B<sub>Y</sub>). Our problem is to compute the sum Z=X+Y. Assume that the associated Z-valuations are (X, A<sub>X</sub>, B<sub>X</sub>), (Y, A<sub>Y</sub>, B<sub>Y</sub>) and (Z, A<sub>Z</sub>, B<sub>Z</sub>).
The first step involves computation of p<sub>Z</sub>. To begin with, let us assume that p<sub>X </sub>and p<sub>Y </sub>are known, and let us proceed as we did in computing the sum of Z<sup>+</sup>-numbers. Then
<br />P<sub>Z</sub>=p<sub>X</sub>∘P<sub>Y </sub>
or more concretely,
<maths id="MATH-US-00013" num="00013"><math overflow="scroll"><mrow><mrow><msub><mi>p</mi><mi>Z</mi></msub><mo></mo><mrow><mo>(</mo><mi>v</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><munder><mo>∫</mo><mi>R</mi></munder><mo></mo><mrow><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>p</mi><mi>Y</mi></msub><mo></mo><mrow><mo>(</mo><mrow><mi>v</mi><mo>-</mo><mi>u</mi></mrow><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D3473.tif" /><img file="US2022121884A1_D3474.tif" /><img file="US2022121884A1_D3475.tif" /><img file="US2022121884A1_D3476.tif" /><img file="US2022121884A1_D3477.tif" /><img file="US2022121884A1_D3478.tif" /><img file="US2022121884A1_D3479.tif" /><img file="US2022121884A1_D3480.tif" /><img file="US2022121884A1_D3481.tif" /><img file="US2022121884A1_D3482.tif" /><img file="US2022121884A1_D3483.tif" /><img file="US2022121884A1_D3484.tif" /><img file="US2022121884A1_D3485.tif" /><img file="US2022121884A1_D3486.tif" /><img file="US2022121884A1_D3487.tif" /><img file="US2022121884A1_D3488.tif" /><img file="US2022121884A1_D3489.tif" /><img file="US2022121884A1_D3490.tif" /><img file="US2022121884A1_D3491.tif" /><img file="US2022121884A1_D3492.tif" /><img file="US2022121884A1_D3493.tif" /><img file="US2022121884A1_D3494.tif" /><img file="US2022121884A1_D3495.tif" /><img file="US2022121884A1_D3496.tif" /><img file="US2022121884A1_D3497.tif" /><img file="US2022121884A1_D3498.tif" /><img file="US2022121884A1_D3499.tif" /><img file="US2022121884A1_D3500.tif" /><img file="US2022121884A1_D3501.tif" /><img file="US2022121884A1_D3502.tif" /><img file="US2022121884A1_D3503.tif" /><img file="US2022121884A1_D3504.tif" /><img file="US2022121884A1_D3505.tif" /><img file="US2022121884A1_D3506.tif" /><img file="US2022121884A1_D3507.tif" /><img file="US2022121884A1_D3508.tif" /><img file="US2022121884A1_D3509.tif" /><img file="US2022121884A1_D3510.tif" /><img file="US2022121884A1_D3511.tif" /><img file="US2022121884A1_D3512.tif" /><img file="US2022121884A1_D3513.tif" /><img file="US2022121884A1_D3514.tif" /><img file="US2022121884A1_D3515.tif" /><img file="US2022121884A1_D3516.tif" /><img file="US2022121884A1_D3517.tif" /><img file="US2022121884A1_D3518.tif" /><img file="US2022121884A1_D3519.tif" /><img file="US2022121884A1_D3520.tif" /><img file="US2022121884A1_D3521.tif" /><img file="US2022121884A1_D3522.tif" /><img file="US2022121884A1_D3523.tif" /><img file="US2022121884A1_D3524.tif" /><img file="US2022121884A1_D3525.tif" /><img file="US2022121884A1_D3526.tif" /><img file="US2022121884A1_D3527.tif" /><img file="US2022121884A1_D3528.tif" /><img file="US2022121884A1_D3529.tif" /><img file="US2022121884A1_D3530.tif" /><img file="US2022121884A1_D3531.tif" /><img file="US2022121884A1_D3532.tif" /><img file="US2022121884A1_D3533.tif" /><img file="US2022121884A1_D3534.tif" /><img file="US2022121884A1_D3535.tif" /><img file="US2022121884A1_D3536.tif" /><img file="US2022121884A1_D3537.tif" /><img file="US2022121884A1_D3538.tif" /><img file="US2022121884A1_D3539.tif" /><img file="US2022121884A1_D3540.tif" /><img file="US2022121884A1_D3541.tif" /><img file="US2022121884A1_D3542.tif" /><img file="US2022121884A1_D3543.tif" /><img file="US2022121884A1_D3544.tif" /><img file="US2022121884A1_D3545.tif" /><img file="US2022121884A1_D3546.tif" /><img file="US2022121884A1_D3547.tif" /><img file="US2022121884A1_D3548.tif" /><img file="US2022121884A1_D3549.tif" /><img file="US2022121884A1_D3550.tif" /><img file="US2022121884A1_D3551.tif" /><img file="US2022121884A1_D3552.tif" /><img file="US2022121884A1_D3553.tif" /><img file="US2022121884A1_D3554.tif" /><img file="US2022121884A1_D3555.tif" /><img file="US2022121884A1_D3556.tif" /><img file="US2022121884A1_D3557.tif" /><img file="US2022121884A1_D3558.tif" /><img file="US2022121884A1_D3559.tif" /><img file="US2022121884A1_D3560.tif" /><img file="US2022121884A1_D3561.tif" /><img file="US2022121884A1_D3562.tif" /><img file="US2022121884A1_D3563.tif" /><img file="US2022121884A1_D3564.tif" /><img file="US2022121884A1_D3565.tif" /><img file="US2022121884A1_D3566.tif" /><img file="US2022121884A1_D3567.tif" /><img file="US2022121884A1_D3568.tif" /><img file="US2022121884A1_D3569.tif" /><img file="US2022121884A1_D3570.tif" /><img file="US2022121884A1_D3571.tif" /><img file="US2022121884A1_D3572.tif" /><img file="US2022121884A1_D3573.tif" /><img file="US2022121884A1_D3574.tif" /><img file="US2022121884A1_D3575.tif" /><img file="US2022121884A1_D3576.tif" /><img file="US2022121884A1_D3577.tif" /><img file="US2022121884A1_D3578.tif" /><img file="US2022121884A1_D3579.tif" /><img file="US2022121884A1_D3580.tif" /><img file="US2022121884A1_D3581.tif" /><img file="US2022121884A1_D3582.tif" /><img file="US2022121884A1_D3583.tif" /><img file="US2022121884A1_D3584.tif" />
In the case of Z-numbers what we know are not p<sub>X </sub>and p<sub>Y </sub>but restrictions on p<sub>X </sub>and p<sub>Y</sub>
<maths id="MATH-US-00014" num="00014"><math overflow="scroll"><mrow><munder><mo>∫</mo><mi>R</mi></munder><mo></mo><mrow><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>X</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>is</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>X</mi></mrow></mrow></math></maths><img file="US2022121884A1_D3585.tif" /><img file="US2022121884A1_D3586.tif" /><img file="US2022121884A1_D3587.tif" /><img file="US2022121884A1_D3588.tif" /><img file="US2022121884A1_D3589.tif" /><img file="US2022121884A1_D3590.tif" /><img file="US2022121884A1_D3591.tif" /><img file="US2022121884A1_D3592.tif" /><img file="US2022121884A1_D3593.tif" /><img file="US2022121884A1_D3594.tif" /><img file="US2022121884A1_D3595.tif" /><img file="US2022121884A1_D3596.tif" /><img file="US2022121884A1_D3597.tif" /><img file="US2022121884A1_D3598.tif" /><img file="US2022121884A1_D3599.tif" /><img file="US2022121884A1_D3600.tif" /><img file="US2022121884A1_D3601.tif" /><img file="US2022121884A1_D3602.tif" /><img file="US2022121884A1_D3603.tif" /><img file="US2022121884A1_D3604.tif" /><img file="US2022121884A1_D3605.tif" /><img file="US2022121884A1_D3606.tif" /><img file="US2022121884A1_D3607.tif" /><img file="US2022121884A1_D3608.tif" /><img file="US2022121884A1_D3609.tif" /><img file="US2022121884A1_D3610.tif" /><img file="US2022121884A1_D3611.tif" /><img file="US2022121884A1_D3612.tif" /><img file="US2022121884A1_D3613.tif" /><img file="US2022121884A1_D3614.tif" /><img file="US2022121884A1_D3615.tif" /><img file="US2022121884A1_D3616.tif" /><img file="US2022121884A1_D3617.tif" /><img file="US2022121884A1_D3618.tif" /><img file="US2022121884A1_D3619.tif" /><img file="US2022121884A1_D3620.tif" /><img file="US2022121884A1_D3621.tif" /><img file="US2022121884A1_D3622.tif" /><img file="US2022121884A1_D3623.tif" /><img file="US2022121884A1_D3624.tif" /><img file="US2022121884A1_D3625.tif" /><img file="US2022121884A1_D3626.tif" /><img file="US2022121884A1_D3627.tif" /><img file="US2022121884A1_D3628.tif" /><img file="US2022121884A1_D3629.tif" /><img file="US2022121884A1_D3630.tif" /><img file="US2022121884A1_D3631.tif" /><img file="US2022121884A1_D3632.tif" /><img file="US2022121884A1_D3633.tif" /><img file="US2022121884A1_D3634.tif" /><img file="US2022121884A1_D3635.tif" /><img file="US2022121884A1_D3636.tif" /><img file="US2022121884A1_D3637.tif" /><img file="US2022121884A1_D3638.tif" /><img file="US2022121884A1_D3639.tif" /><img file="US2022121884A1_D3640.tif" /><img file="US2022121884A1_D3641.tif" /><img file="US2022121884A1_D3642.tif" /><img file="US2022121884A1_D3643.tif" /><img file="US2022121884A1_D3644.tif" /><img file="US2022121884A1_D3645.tif" /><img file="US2022121884A1_D3646.tif" /><img file="US2022121884A1_D3647.tif" /><img file="US2022121884A1_D3648.tif" /><img file="US2022121884A1_D3649.tif" /><img file="US2022121884A1_D3650.tif" /><img file="US2022121884A1_D3651.tif" /><img file="US2022121884A1_D3652.tif" /><img file="US2022121884A1_D3653.tif" /><img file="US2022121884A1_D3654.tif" /><img file="US2022121884A1_D3655.tif" /><img file="US2022121884A1_D3656.tif" /><img file="US2022121884A1_D3657.tif" /><img file="US2022121884A1_D3658.tif" /><img file="US2022121884A1_D3659.tif" /><img file="US2022121884A1_D3660.tif" /><img file="US2022121884A1_D3661.tif" /><img file="US2022121884A1_D3662.tif" /><img file="US2022121884A1_D3663.tif" /><img file="US2022121884A1_D3664.tif" /><img file="US2022121884A1_D3665.tif" /><img file="US2022121884A1_D3666.tif" /><img file="US2022121884A1_D3667.tif" /><img file="US2022121884A1_D3668.tif" /><img file="US2022121884A1_D3669.tif" /><img file="US2022121884A1_D3670.tif" /><img file="US2022121884A1_D3671.tif" /><img file="US2022121884A1_D3672.tif" /><img file="US2022121884A1_D3673.tif" /><img file="US2022121884A1_D3674.tif" /><img file="US2022121884A1_D3675.tif" /><img file="US2022121884A1_D3676.tif" /><img file="US2022121884A1_D3677.tif" /><img file="US2022121884A1_D3678.tif" /><img file="US2022121884A1_D3679.tif" /><img file="US2022121884A1_D3680.tif" /><img file="US2022121884A1_D3681.tif" /><img file="US2022121884A1_D3682.tif" /><img file="US2022121884A1_D3683.tif" /><img file="US2022121884A1_D3684.tif" /><img file="US2022121884A1_D3685.tif" /><img file="US2022121884A1_D3686.tif" /><img file="US2022121884A1_D3687.tif" /><img file="US2022121884A1_D3688.tif" /><img file="US2022121884A1_D3689.tif" /><img file="US2022121884A1_D3690.tif" /><img file="US2022121884A1_D3691.tif" /><img file="US2022121884A1_D3692.tif" /><img file="US2022121884A1_D3693.tif" /><img file="US2022121884A1_D3694.tif" /><img file="US2022121884A1_D3695.tif" /><img file="US2022121884A1_D3696.tif" /><maths id="MATH-US-00014-2" num="00014.2"><math overflow="scroll"><mrow><munder><mo>∫</mo><mi>R</mi></munder><mo></mo><mrow><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>Y</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>p</mi><mi>Y</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>is</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><msub><mi>B</mi><mi>Y</mi></msub></mrow></mrow></math></maths><img file="US2022121884A1_D3697.tif" /><img file="US2022121884A1_D3698.tif" /><img file="US2022121884A1_D3699.tif" /><img file="US2022121884A1_D3700.tif" /><img file="US2022121884A1_D3701.tif" /><img file="US2022121884A1_D3702.tif" /><img file="US2022121884A1_D3703.tif" /><img file="US2022121884A1_D3704.tif" /><img file="US2022121884A1_D3705.tif" /><img file="US2022121884A1_D3706.tif" /><img file="US2022121884A1_D3707.tif" /><img file="US2022121884A1_D3708.tif" /><img file="US2022121884A1_D3709.tif" /><img file="US2022121884A1_D3710.tif" /><img file="US2022121884A1_D3711.tif" /><img file="US2022121884A1_D3712.tif" /><img file="US2022121884A1_D3713.tif" /><img file="US2022121884A1_D3714.tif" /><img file="US2022121884A1_D3715.tif" /><img file="US2022121884A1_D3716.tif" /><img file="US2022121884A1_D3717.tif" /><img file="US2022121884A1_D3718.tif" /><img file="US2022121884A1_D3719.tif" /><img file="US2022121884A1_D3720.tif" /><img file="US2022121884A1_D3721.tif" /><img file="US2022121884A1_D3722.tif" /><img file="US2022121884A1_D3723.tif" /><img file="US2022121884A1_D3724.tif" /><img file="US2022121884A1_D3725.tif" /><img file="US2022121884A1_D3726.tif" /><img file="US2022121884A1_D3727.tif" /><img file="US2022121884A1_D3728.tif" /><img file="US2022121884A1_D3729.tif" /><img file="US2022121884A1_D3730.tif" /><img file="US2022121884A1_D3731.tif" /><img file="US2022121884A1_D3732.tif" /><img file="US2022121884A1_D3733.tif" /><img file="US2022121884A1_D3734.tif" /><img file="US2022121884A1_D3735.tif" /><img file="US2022121884A1_D3736.tif" /><img file="US2022121884A1_D3737.tif" /><img file="US2022121884A1_D3738.tif" /><img file="US2022121884A1_D3739.tif" /><img file="US2022121884A1_D3740.tif" /><img file="US2022121884A1_D3741.tif" /><img file="US2022121884A1_D3742.tif" /><img file="US2022121884A1_D3743.tif" /><img file="US2022121884A1_D3744.tif" /><img file="US2022121884A1_D3745.tif" /><img file="US2022121884A1_D3746.tif" /><img file="US2022121884A1_D3747.tif" /><img file="US2022121884A1_D3748.tif" /><img file="US2022121884A1_D3749.tif" /><img file="US2022121884A1_D3750.tif" /><img file="US2022121884A1_D3751.tif" /><img file="US2022121884A1_D3752.tif" /><img file="US2022121884A1_D3753.tif" /><img file="US2022121884A1_D3754.tif" /><img file="US2022121884A1_D3755.tif" /><img file="US2022121884A1_D3756.tif" /><img file="US2022121884A1_D3757.tif" /><img file="US2022121884A1_D3758.tif" /><img file="US2022121884A1_D3759.tif" /><img file="US2022121884A1_D3760.tif" /><img file="US2022121884A1_D3761.tif" /><img file="US2022121884A1_D3762.tif" /><img file="US2022121884A1_D3763.tif" /><img file="US2022121884A1_D3764.tif" /><img file="US2022121884A1_D3765.tif" /><img file="US2022121884A1_D3766.tif" /><img file="US2022121884A1_D3767.tif" /><img file="US2022121884A1_D3768.tif" /><img file="US2022121884A1_D3769.tif" /><img file="US2022121884A1_D3770.tif" /><img file="US2022121884A1_D3771.tif" /><img file="US2022121884A1_D3772.tif" /><img file="US2022121884A1_D3773.tif" /><img file="US2022121884A1_D3774.tif" /><img file="US2022121884A1_D3775.tif" /><img file="US2022121884A1_D3776.tif" /><img file="US2022121884A1_D3777.tif" /><img file="US2022121884A1_D3778.tif" /><img file="US2022121884A1_D3779.tif" /><img file="US2022121884A1_D3780.tif" /><img file="US2022121884A1_D3781.tif" /><img file="US2022121884A1_D3782.tif" /><img file="US2022121884A1_D3783.tif" /><img file="US2022121884A1_D3784.tif" /><img file="US2022121884A1_D3785.tif" /><img file="US2022121884A1_D3786.tif" /><img file="US2022121884A1_D3787.tif" /><img file="US2022121884A1_D3788.tif" /><img file="US2022121884A1_D3789.tif" /><img file="US2022121884A1_D3790.tif" /><img file="US2022121884A1_D3791.tif" /><img file="US2022121884A1_D3792.tif" /><img file="US2022121884A1_D3793.tif" /><img file="US2022121884A1_D3794.tif" /><img file="US2022121884A1_D3795.tif" /><img file="US2022121884A1_D3796.tif" /><img file="US2022121884A1_D3797.tif" /><img file="US2022121884A1_D3798.tif" /><img file="US2022121884A1_D3799.tif" /><img file="US2022121884A1_D3800.tif" /><img file="US2022121884A1_D3801.tif" /><img file="US2022121884A1_D3802.tif" /><img file="US2022121884A1_D3803.tif" /><img file="US2022121884A1_D3804.tif" /><img file="US2022121884A1_D3805.tif" /><img file="US2022121884A1_D3806.tif" /><img file="US2022121884A1_D3807.tif" /><img file="US2022121884A1_D3808.tif" />
In terms of the membership functions of B<sub>X </sub>and B<sub>Y</sub>, these restrictions may be expressed as:
<maths id="MATH-US-00015" num="00015"><math overflow="scroll"><mrow><msub><mi>μ</mi><msub><mi>B</mi><mi>X</mi></msub></msub><mo></mo><mrow><mo>(</mo><mrow><msub><mo>∫</mo><mi>R</mi></msub><mo></mo><mrow><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>X</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>)</mo></mrow></mrow></math></maths><img file="US2022121884A1_D3809.tif" /><img file="US2022121884A1_D3810.tif" /><img file="US2022121884A1_D3811.tif" /><img file="US2022121884A1_D3812.tif" /><img file="US2022121884A1_D3813.tif" /><img file="US2022121884A1_D3814.tif" /><img file="US2022121884A1_D3815.tif" /><img file="US2022121884A1_D3816.tif" /><img file="US2022121884A1_D3817.tif" /><img file="US2022121884A1_D3818.tif" /><img file="US2022121884A1_D3819.tif" /><img file="US2022121884A1_D3820.tif" /><img file="US2022121884A1_D3821.tif" /><img file="US2022121884A1_D3822.tif" /><img file="US2022121884A1_D3823.tif" /><img file="US2022121884A1_D3824.tif" /><img file="US2022121884A1_D3825.tif" /><img file="US2022121884A1_D3826.tif" /><img file="US2022121884A1_D3827.tif" /><img file="US2022121884A1_D3828.tif" /><img file="US2022121884A1_D3829.tif" /><img file="US2022121884A1_D3830.tif" /><img file="US2022121884A1_D3831.tif" /><img file="US2022121884A1_D3832.tif" /><img file="US2022121884A1_D3833.tif" /><img file="US2022121884A1_D3834.tif" /><img file="US2022121884A1_D3835.tif" /><img file="US2022121884A1_D3836.tif" /><img file="US2022121884A1_D3837.tif" /><img file="US2022121884A1_D3838.tif" /><img file="US2022121884A1_D3839.tif" /><img file="US2022121884A1_D3840.tif" /><img file="US2022121884A1_D3841.tif" /><img file="US2022121884A1_D3842.tif" /><img file="US2022121884A1_D3843.tif" /><img file="US2022121884A1_D3844.tif" /><img file="US2022121884A1_D3845.tif" /><img file="US2022121884A1_D3846.tif" /><img file="US2022121884A1_D3847.tif" /><img file="US2022121884A1_D3848.tif" /><img file="US2022121884A1_D3849.tif" /><img file="US2022121884A1_D3850.tif" /><img file="US2022121884A1_D3851.tif" /><img file="US2022121884A1_D3852.tif" /><img file="US2022121884A1_D3853.tif" /><img file="US2022121884A1_D3854.tif" /><img file="US2022121884A1_D3855.tif" /><img file="US2022121884A1_D3856.tif" /><img file="US2022121884A1_D3857.tif" /><img file="US2022121884A1_D3858.tif" /><img file="US2022121884A1_D3859.tif" /><img file="US2022121884A1_D3860.tif" /><img file="US2022121884A1_D3861.tif" /><img file="US2022121884A1_D3862.tif" /><img file="US2022121884A1_D3863.tif" /><img file="US2022121884A1_D3864.tif" /><img file="US2022121884A1_D3865.tif" /><img file="US2022121884A1_D3866.tif" /><img file="US2022121884A1_D3867.tif" /><img file="US2022121884A1_D3868.tif" /><img file="US2022121884A1_D3869.tif" /><img file="US2022121884A1_D3870.tif" /><img file="US2022121884A1_D3871.tif" /><img file="US2022121884A1_D3872.tif" /><img file="US2022121884A1_D3873.tif" /><img file="US2022121884A1_D3874.tif" /><img file="US2022121884A1_D3875.tif" /><img file="US2022121884A1_D3876.tif" /><img file="US2022121884A1_D3877.tif" /><img file="US2022121884A1_D3878.tif" /><img file="US2022121884A1_D3879.tif" /><img file="US2022121884A1_D3880.tif" /><img file="US2022121884A1_D3881.tif" /><img file="US2022121884A1_D3882.tif" /><img file="US2022121884A1_D3883.tif" /><img file="US2022121884A1_D3884.tif" /><img file="US2022121884A1_D3885.tif" /><img file="US2022121884A1_D3886.tif" /><img file="US2022121884A1_D3887.tif" /><img file="US2022121884A1_D3888.tif" /><img file="US2022121884A1_D3889.tif" /><img file="US2022121884A1_D3890.tif" /><img file="US2022121884A1_D3891.tif" /><img file="US2022121884A1_D3892.tif" /><img file="US2022121884A1_D3893.tif" /><img file="US2022121884A1_D3894.tif" /><img file="US2022121884A1_D3895.tif" /><img file="US2022121884A1_D3896.tif" /><img file="US2022121884A1_D3897.tif" /><img file="US2022121884A1_D3898.tif" /><img file="US2022121884A1_D3899.tif" /><img file="US2022121884A1_D3900.tif" /><img file="US2022121884A1_D3901.tif" /><img file="US2022121884A1_D3902.tif" /><img file="US2022121884A1_D3903.tif" /><img file="US2022121884A1_D3904.tif" /><img file="US2022121884A1_D3905.tif" /><img file="US2022121884A1_D3906.tif" /><img file="US2022121884A1_D3907.tif" /><img file="US2022121884A1_D3908.tif" /><img file="US2022121884A1_D3909.tif" /><img file="US2022121884A1_D3910.tif" /><img file="US2022121884A1_D3911.tif" /><img file="US2022121884A1_D3912.tif" /><img file="US2022121884A1_D3913.tif" /><img file="US2022121884A1_D3914.tif" /><img file="US2022121884A1_D3915.tif" /><img file="US2022121884A1_D3916.tif" /><img file="US2022121884A1_D3917.tif" /><img file="US2022121884A1_D3918.tif" /><img file="US2022121884A1_D3919.tif" /><img file="US2022121884A1_D3920.tif" /><maths id="MATH-US-00015-2" num="00015.2"><math overflow="scroll"><mrow><msub><mi>μ</mi><msub><mi>B</mi><mi>Y</mi></msub></msub><mo></mo><mrow><mo>(</mo><mrow><msub><mo>∫</mo><mi>R</mi></msub><mo></mo><mrow><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>Y</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>p</mi><mi>Y</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>)</mo></mrow></mrow></math></maths><img file="US2022121884A1_D3921.tif" /><img file="US2022121884A1_D3922.tif" /><img file="US2022121884A1_D3923.tif" /><img file="US2022121884A1_D3924.tif" /><img file="US2022121884A1_D3925.tif" /><img file="US2022121884A1_D3926.tif" /><img file="US2022121884A1_D3927.tif" /><img file="US2022121884A1_D3928.tif" /><img file="US2022121884A1_D3929.tif" /><img file="US2022121884A1_D3930.tif" /><img file="US2022121884A1_D3931.tif" /><img file="US2022121884A1_D3932.tif" /><img file="US2022121884A1_D3933.tif" /><img file="US2022121884A1_D3934.tif" /><img file="US2022121884A1_D3935.tif" /><img file="US2022121884A1_D3936.tif" /><img file="US2022121884A1_D3937.tif" /><img file="US2022121884A1_D3938.tif" /><img file="US2022121884A1_D3939.tif" /><img file="US2022121884A1_D3940.tif" /><img file="US2022121884A1_D3941.tif" /><img file="US2022121884A1_D3942.tif" /><img file="US2022121884A1_D3943.tif" /><img file="US2022121884A1_D3944.tif" /><img file="US2022121884A1_D3945.tif" /><img file="US2022121884A1_D3946.tif" /><img file="US2022121884A1_D3947.tif" /><img file="US2022121884A1_D3948.tif" /><img file="US2022121884A1_D3949.tif" /><img file="US2022121884A1_D3950.tif" /><img file="US2022121884A1_D3951.tif" /><img file="US2022121884A1_D3952.tif" /><img file="US2022121884A1_D3953.tif" /><img file="US2022121884A1_D3954.tif" /><img file="US2022121884A1_D3955.tif" /><img file="US2022121884A1_D3956.tif" /><img file="US2022121884A1_D3957.tif" /><img file="US2022121884A1_D3958.tif" /><img file="US2022121884A1_D3959.tif" /><img file="US2022121884A1_D3960.tif" /><img file="US2022121884A1_D3961.tif" /><img file="US2022121884A1_D3962.tif" /><img file="US2022121884A1_D3963.tif" /><img file="US2022121884A1_D3964.tif" /><img file="US2022121884A1_D3965.tif" /><img file="US2022121884A1_D3966.tif" /><img file="US2022121884A1_D3967.tif" /><img file="US2022121884A1_D3968.tif" /><img file="US2022121884A1_D3969.tif" /><img file="US2022121884A1_D3970.tif" /><img file="US2022121884A1_D3971.tif" /><img file="US2022121884A1_D3972.tif" /><img file="US2022121884A1_D3973.tif" /><img file="US2022121884A1_D3974.tif" /><img file="US2022121884A1_D3975.tif" /><img file="US2022121884A1_D3976.tif" /><img file="US2022121884A1_D3977.tif" /><img file="US2022121884A1_D3978.tif" /><img file="US2022121884A1_D3979.tif" /><img file="US2022121884A1_D3980.tif" /><img file="US2022121884A1_D3981.tif" /><img file="US2022121884A1_D3982.tif" /><img file="US2022121884A1_D3983.tif" /><img file="US2022121884A1_D3984.tif" /><img file="US2022121884A1_D3985.tif" /><img file="US2022121884A1_D3986.tif" /><img file="US2022121884A1_D3987.tif" /><img file="US2022121884A1_D3988.tif" /><img file="US2022121884A1_D3989.tif" /><img file="US2022121884A1_D3990.tif" /><img file="US2022121884A1_D3991.tif" /><img file="US2022121884A1_D3992.tif" /><img file="US2022121884A1_D3993.tif" /><img file="US2022121884A1_D3994.tif" /><img file="US2022121884A1_D3995.tif" /><img file="US2022121884A1_D3996.tif" /><img file="US2022121884A1_D3997.tif" /><img file="US2022121884A1_D3998.tif" /><img file="US2022121884A1_D3999.tif" /><img file="US2022121884A1_D4000.tif" /><img file="US2022121884A1_D4001.tif" /><img file="US2022121884A1_D4002.tif" /><img file="US2022121884A1_D4003.tif" /><img file="US2022121884A1_D4004.tif" /><img file="US2022121884A1_D4005.tif" /><img file="US2022121884A1_D4006.tif" /><img file="US2022121884A1_D4007.tif" /><img file="US2022121884A1_D4008.tif" /><img file="US2022121884A1_D4009.tif" /><img file="US2022121884A1_D4010.tif" /><img file="US2022121884A1_D4011.tif" /><img file="US2022121884A1_D4012.tif" /><img file="US2022121884A1_D4013.tif" /><img file="US2022121884A1_D4014.tif" /><img file="US2022121884A1_D4015.tif" /><img file="US2022121884A1_D4016.tif" /><img file="US2022121884A1_D4017.tif" /><img file="US2022121884A1_D4018.tif" /><img file="US2022121884A1_D4019.tif" /><img file="US2022121884A1_D4020.tif" /><img file="US2022121884A1_D4021.tif" /><img file="US2022121884A1_D4022.tif" /><img file="US2022121884A1_D4023.tif" /><img file="US2022121884A1_D4024.tif" /><img file="US2022121884A1_D4025.tif" /><img file="US2022121884A1_D4026.tif" /><img file="US2022121884A1_D4027.tif" /><img file="US2022121884A1_D4028.tif" /><img file="US2022121884A1_D4029.tif" /><img file="US2022121884A1_D4030.tif" /><img file="US2022121884A1_D4031.tif" /><img file="US2022121884A1_D4032.tif" />
Additional restrictions on p<sub>X </sub>and p<sub>Y </sub>are:
<maths id="MATH-US-00016" num="00016"><math overflow="scroll"><mrow><mrow><msub><mo>∫</mo><mi>R</mi></msub><mo></mo><mrow><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>=</mo><mn>1</mn></mrow></math></maths><img file="US2022121884A1_D4033.tif" /><img file="US2022121884A1_D4034.tif" /><img file="US2022121884A1_D4035.tif" /><img file="US2022121884A1_D4036.tif" /><img file="US2022121884A1_D4037.tif" /><img file="US2022121884A1_D4038.tif" /><img file="US2022121884A1_D4039.tif" /><img file="US2022121884A1_D4040.tif" /><img file="US2022121884A1_D4041.tif" /><img file="US2022121884A1_D4042.tif" /><img file="US2022121884A1_D4043.tif" /><img file="US2022121884A1_D4044.tif" /><img file="US2022121884A1_D4045.tif" /><img file="US2022121884A1_D4046.tif" /><img file="US2022121884A1_D4047.tif" /><img file="US2022121884A1_D4048.tif" /><img file="US2022121884A1_D4049.tif" /><img file="US2022121884A1_D4050.tif" /><img file="US2022121884A1_D4051.tif" /><img file="US2022121884A1_D4052.tif" /><img file="US2022121884A1_D4053.tif" /><img file="US2022121884A1_D4054.tif" /><img file="US2022121884A1_D4055.tif" /><img file="US2022121884A1_D4056.tif" /><img file="US2022121884A1_D4057.tif" /><img file="US2022121884A1_D4058.tif" /><img file="US2022121884A1_D4059.tif" /><img file="US2022121884A1_D4060.tif" /><img file="US2022121884A1_D4061.tif" /><img file="US2022121884A1_D4062.tif" /><img file="US2022121884A1_D4063.tif" /><img file="US2022121884A1_D4064.tif" /><img file="US2022121884A1_D4065.tif" /><img file="US2022121884A1_D4066.tif" /><img file="US2022121884A1_D4067.tif" /><img file="US2022121884A1_D4068.tif" /><img file="US2022121884A1_D4069.tif" /><img file="US2022121884A1_D4070.tif" /><img file="US2022121884A1_D4071.tif" /><img file="US2022121884A1_D4072.tif" /><img file="US2022121884A1_D4073.tif" /><img file="US2022121884A1_D4074.tif" /><img file="US2022121884A1_D4075.tif" /><img file="US2022121884A1_D4076.tif" /><img file="US2022121884A1_D4077.tif" /><img file="US2022121884A1_D4078.tif" /><img file="US2022121884A1_D4079.tif" /><img file="US2022121884A1_D4080.tif" /><img file="US2022121884A1_D4081.tif" /><img file="US2022121884A1_D4082.tif" /><img file="US2022121884A1_D4083.tif" /><img file="US2022121884A1_D4084.tif" /><img file="US2022121884A1_D4085.tif" /><img file="US2022121884A1_D4086.tif" /><img file="US2022121884A1_D4087.tif" /><img file="US2022121884A1_D4088.tif" /><img file="US2022121884A1_D4089.tif" /><img file="US2022121884A1_D4090.tif" /><img file="US2022121884A1_D4091.tif" /><img file="US2022121884A1_D4092.tif" /><img file="US2022121884A1_D4093.tif" /><img file="US2022121884A1_D4094.tif" /><img file="US2022121884A1_D4095.tif" /><img file="US2022121884A1_D4096.tif" /><img file="US2022121884A1_D4097.tif" /><img file="US2022121884A1_D4098.tif" /><img file="US2022121884A1_D4099.tif" /><img file="US2022121884A1_D4100.tif" /><img file="US2022121884A1_D4101.tif" /><img file="US2022121884A1_D4102.tif" /><img file="US2022121884A1_D4103.tif" /><img file="US2022121884A1_D4104.tif" /><img file="US2022121884A1_D4105.tif" /><img file="US2022121884A1_D4106.tif" /><img file="US2022121884A1_D4107.tif" /><img file="US2022121884A1_D4108.tif" /><img file="US2022121884A1_D4109.tif" /><img file="US2022121884A1_D4110.tif" /><img file="US2022121884A1_D4111.tif" /><img file="US2022121884A1_D4112.tif" /><img file="US2022121884A1_D4113.tif" /><img file="US2022121884A1_D4114.tif" /><img file="US2022121884A1_D4115.tif" /><img file="US2022121884A1_D4116.tif" /><img file="US2022121884A1_D4117.tif" /><img file="US2022121884A1_D4118.tif" /><img file="US2022121884A1_D4119.tif" /><img file="US2022121884A1_D4120.tif" /><img file="US2022121884A1_D4121.tif" /><img file="US2022121884A1_D4122.tif" /><img file="US2022121884A1_D4123.tif" /><img file="US2022121884A1_D4124.tif" /><img file="US2022121884A1_D4125.tif" /><img file="US2022121884A1_D4126.tif" /><img file="US2022121884A1_D4127.tif" /><img file="US2022121884A1_D4128.tif" /><img file="US2022121884A1_D4129.tif" /><img file="US2022121884A1_D4130.tif" /><img file="US2022121884A1_D4131.tif" /><img file="US2022121884A1_D4132.tif" /><img file="US2022121884A1_D4133.tif" /><img file="US2022121884A1_D4134.tif" /><img file="US2022121884A1_D4135.tif" /><img file="US2022121884A1_D4136.tif" /><img file="US2022121884A1_D4137.tif" /><img file="US2022121884A1_D4138.tif" /><img file="US2022121884A1_D4139.tif" /><img file="US2022121884A1_D4140.tif" /><img file="US2022121884A1_D4141.tif" /><img file="US2022121884A1_D4142.tif" /><img file="US2022121884A1_D4143.tif" /><img file="US2022121884A1_D4144.tif" /><maths id="MATH-US-00016-2" num="00016.2"><math overflow="scroll"><mrow><mrow><msub><mo>∫</mo><mi>R</mi></msub><mo></mo><mrow><mrow><msub><mi>p</mi><mi>Y</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>=</mo><mn>1</mn></mrow></math></maths><img file="US2022121884A1_D4145.tif" /><img file="US2022121884A1_D4146.tif" /><img file="US2022121884A1_D4147.tif" /><img file="US2022121884A1_D4148.tif" /><img file="US2022121884A1_D4149.tif" /><img file="US2022121884A1_D4150.tif" /><img file="US2022121884A1_D4151.tif" /><img file="US2022121884A1_D4152.tif" /><img file="US2022121884A1_D4153.tif" /><img file="US2022121884A1_D4154.tif" /><img file="US2022121884A1_D4155.tif" /><img file="US2022121884A1_D4156.tif" /><img file="US2022121884A1_D4157.tif" /><img file="US2022121884A1_D4158.tif" /><img file="US2022121884A1_D4159.tif" /><img file="US2022121884A1_D4160.tif" /><img file="US2022121884A1_D4161.tif" /><img file="US2022121884A1_D4162.tif" /><img file="US2022121884A1_D4163.tif" /><img file="US2022121884A1_D4164.tif" /><img file="US2022121884A1_D4165.tif" /><img file="US2022121884A1_D4166.tif" /><img file="US2022121884A1_D4167.tif" /><img file="US2022121884A1_D4168.tif" /><img file="US2022121884A1_D4169.tif" /><img file="US2022121884A1_D4170.tif" /><img file="US2022121884A1_D4171.tif" /><img file="US2022121884A1_D4172.tif" /><img file="US2022121884A1_D4173.tif" /><img file="US2022121884A1_D4174.tif" /><img file="US2022121884A1_D4175.tif" /><img file="US2022121884A1_D4176.tif" /><img file="US2022121884A1_D4177.tif" /><img file="US2022121884A1_D4178.tif" /><img file="US2022121884A1_D4179.tif" /><img file="US2022121884A1_D4180.tif" /><img file="US2022121884A1_D4181.tif" /><img file="US2022121884A1_D4182.tif" /><img file="US2022121884A1_D4183.tif" /><img file="US2022121884A1_D4184.tif" /><img file="US2022121884A1_D4185.tif" /><img file="US2022121884A1_D4186.tif" /><img file="US2022121884A1_D4187.tif" /><img file="US2022121884A1_D4188.tif" /><img file="US2022121884A1_D4189.tif" /><img file="US2022121884A1_D4190.tif" /><img file="US2022121884A1_D4191.tif" /><img file="US2022121884A1_D4192.tif" /><img file="US2022121884A1_D4193.tif" /><img file="US2022121884A1_D4194.tif" /><img file="US2022121884A1_D4195.tif" /><img file="US2022121884A1_D4196.tif" /><img file="US2022121884A1_D4197.tif" /><img file="US2022121884A1_D4198.tif" /><img file="US2022121884A1_D4199.tif" /><img file="US2022121884A1_D4200.tif" /><img file="US2022121884A1_D4201.tif" /><img file="US2022121884A1_D4202.tif" /><img file="US2022121884A1_D4203.tif" /><img file="US2022121884A1_D4204.tif" /><img file="US2022121884A1_D4205.tif" /><img file="US2022121884A1_D4206.tif" /><img file="US2022121884A1_D4207.tif" /><img file="US2022121884A1_D4208.tif" /><img file="US2022121884A1_D4209.tif" /><img file="US2022121884A1_D4210.tif" /><img file="US2022121884A1_D4211.tif" /><img file="US2022121884A1_D4212.tif" /><img file="US2022121884A1_D4213.tif" /><img file="US2022121884A1_D4214.tif" /><img file="US2022121884A1_D4215.tif" /><img file="US2022121884A1_D4216.tif" /><img file="US2022121884A1_D4217.tif" /><img file="US2022121884A1_D4218.tif" /><img file="US2022121884A1_D4219.tif" /><img file="US2022121884A1_D4220.tif" /><img file="US2022121884A1_D4221.tif" /><img file="US2022121884A1_D4222.tif" /><img file="US2022121884A1_D4223.tif" /><img file="US2022121884A1_D4224.tif" /><img file="US2022121884A1_D4225.tif" /><img file="US2022121884A1_D4226.tif" /><img file="US2022121884A1_D4227.tif" /><img file="US2022121884A1_D4228.tif" /><img file="US2022121884A1_D4229.tif" /><img file="US2022121884A1_D4230.tif" /><img file="US2022121884A1_D4231.tif" /><img file="US2022121884A1_D4232.tif" /><img file="US2022121884A1_D4233.tif" /><img file="US2022121884A1_D4234.tif" /><img file="US2022121884A1_D4235.tif" /><img file="US2022121884A1_D4236.tif" /><img file="US2022121884A1_D4237.tif" /><img file="US2022121884A1_D4238.tif" /><img file="US2022121884A1_D4239.tif" /><img file="US2022121884A1_D4240.tif" /><img file="US2022121884A1_D4241.tif" /><img file="US2022121884A1_D4242.tif" /><img file="US2022121884A1_D4243.tif" /><img file="US2022121884A1_D4244.tif" /><img file="US2022121884A1_D4245.tif" /><img file="US2022121884A1_D4246.tif" /><img file="US2022121884A1_D4247.tif" /><img file="US2022121884A1_D4248.tif" /><img file="US2022121884A1_D4249.tif" /><img file="US2022121884A1_D4250.tif" /><img file="US2022121884A1_D4251.tif" /><img file="US2022121884A1_D4252.tif" /><img file="US2022121884A1_D4253.tif" /><img file="US2022121884A1_D4254.tif" /><img file="US2022121884A1_D4255.tif" /><img file="US2022121884A1_D4256.tif" /><maths id="MATH-US-00016-3" num="00016.3"><math overflow="scroll"><mrow><mrow><msub><mo>∫</mo><mi>R</mi></msub><mo></mo><mrow><mrow><msub><mi>up</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>=</mo><mrow><mfrac><mrow><msub><mo>∫</mo><mi>R</mi></msub><mo></mo><mrow><mi>u</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>X</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mrow><msub><mo>∫</mo><mi>R</mi></msub><mo></mo><mrow><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>X</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow></mfrac><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mrow><mo>(</mo><mi>compatibility</mi><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D4257.tif" /><img file="US2022121884A1_D4258.tif" /><img file="US2022121884A1_D4259.tif" /><img file="US2022121884A1_D4260.tif" /><img file="US2022121884A1_D4261.tif" /><img file="US2022121884A1_D4262.tif" /><img file="US2022121884A1_D4263.tif" /><img file="US2022121884A1_D4264.tif" /><img file="US2022121884A1_D4265.tif" /><img file="US2022121884A1_D4266.tif" /><img file="US2022121884A1_D4267.tif" /><img file="US2022121884A1_D4268.tif" /><img file="US2022121884A1_D4269.tif" /><img file="US2022121884A1_D4270.tif" /><img file="US2022121884A1_D4271.tif" /><img file="US2022121884A1_D4272.tif" /><img file="US2022121884A1_D4273.tif" /><img file="US2022121884A1_D4274.tif" /><img file="US2022121884A1_D4275.tif" /><img file="US2022121884A1_D4276.tif" /><img file="US2022121884A1_D4277.tif" /><img file="US2022121884A1_D4278.tif" /><img file="US2022121884A1_D4279.tif" /><img file="US2022121884A1_D4280.tif" /><img file="US2022121884A1_D4281.tif" /><img file="US2022121884A1_D4282.tif" /><img file="US2022121884A1_D4283.tif" /><img file="US2022121884A1_D4284.tif" /><img file="US2022121884A1_D4285.tif" /><img file="US2022121884A1_D4286.tif" /><img file="US2022121884A1_D4287.tif" /><img file="US2022121884A1_D4288.tif" /><img file="US2022121884A1_D4289.tif" /><img file="US2022121884A1_D4290.tif" /><img file="US2022121884A1_D4291.tif" /><img file="US2022121884A1_D4292.tif" /><img file="US2022121884A1_D4293.tif" /><img file="US2022121884A1_D4294.tif" /><img file="US2022121884A1_D4295.tif" /><img file="US2022121884A1_D4296.tif" /><img file="US2022121884A1_D4297.tif" /><img file="US2022121884A1_D4298.tif" /><img file="US2022121884A1_D4299.tif" /><img file="US2022121884A1_D4300.tif" /><img file="US2022121884A1_D4301.tif" /><img file="US2022121884A1_D4302.tif" /><img file="US2022121884A1_D4303.tif" /><img file="US2022121884A1_D4304.tif" /><img file="US2022121884A1_D4305.tif" /><img file="US2022121884A1_D4306.tif" /><img file="US2022121884A1_D4307.tif" /><img file="US2022121884A1_D4308.tif" /><img file="US2022121884A1_D4309.tif" /><img file="US2022121884A1_D4310.tif" /><img file="US2022121884A1_D4311.tif" /><img file="US2022121884A1_D4312.tif" /><img file="US2022121884A1_D4313.tif" /><img file="US2022121884A1_D4314.tif" /><img file="US2022121884A1_D4315.tif" /><img file="US2022121884A1_D4316.tif" /><img file="US2022121884A1_D4317.tif" /><img file="US2022121884A1_D4318.tif" /><img file="US2022121884A1_D4319.tif" /><img file="US2022121884A1_D4320.tif" /><img file="US2022121884A1_D4321.tif" /><img file="US2022121884A1_D4322.tif" /><img file="US2022121884A1_D4323.tif" /><img file="US2022121884A1_D4324.tif" /><img file="US2022121884A1_D4325.tif" /><img file="US2022121884A1_D4326.tif" /><img file="US2022121884A1_D4327.tif" /><img file="US2022121884A1_D4328.tif" /><img file="US2022121884A1_D4329.tif" /><img file="US2022121884A1_D4330.tif" /><img file="US2022121884A1_D4331.tif" /><img file="US2022121884A1_D4332.tif" /><img file="US2022121884A1_D4333.tif" /><img file="US2022121884A1_D4334.tif" /><img file="US2022121884A1_D4335.tif" /><img file="US2022121884A1_D4336.tif" /><img file="US2022121884A1_D4337.tif" /><img file="US2022121884A1_D4338.tif" /><img file="US2022121884A1_D4339.tif" /><img file="US2022121884A1_D4340.tif" /><img file="US2022121884A1_D4341.tif" /><img file="US2022121884A1_D4342.tif" /><img file="US2022121884A1_D4343.tif" /><img file="US2022121884A1_D4344.tif" /><img file="US2022121884A1_D4345.tif" /><img file="US2022121884A1_D4346.tif" /><img file="US2022121884A1_D4347.tif" /><img file="US2022121884A1_D4348.tif" /><img file="US2022121884A1_D4349.tif" /><img file="US2022121884A1_D4350.tif" /><img file="US2022121884A1_D4351.tif" /><img file="US2022121884A1_D4352.tif" /><img file="US2022121884A1_D4353.tif" /><img file="US2022121884A1_D4354.tif" /><img file="US2022121884A1_D4355.tif" /><img file="US2022121884A1_D4356.tif" /><img file="US2022121884A1_D4357.tif" /><img file="US2022121884A1_D4358.tif" /><img file="US2022121884A1_D4359.tif" /><img file="US2022121884A1_D4360.tif" /><img file="US2022121884A1_D4361.tif" /><img file="US2022121884A1_D4362.tif" /><img file="US2022121884A1_D4363.tif" /><img file="US2022121884A1_D4364.tif" /><img file="US2022121884A1_D4365.tif" /><img file="US2022121884A1_D4366.tif" /><img file="US2022121884A1_D4367.tif" /><img file="US2022121884A1_D4368.tif" /><maths id="MATH-US-00016-4" num="00016.4"><math overflow="scroll"><mrow><mrow><msub><mo>∫</mo><mi>R</mi></msub><mo></mo><mrow><mrow><msub><mi>up</mi><mi>Y</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>=</mo><mrow><mfrac><mrow><msub><mo>∫</mo><mi>R</mi></msub><mo></mo><mrow><mi>u</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>Y</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mrow><msub><mo>∫</mo><mi>R</mi></msub><mo></mo><mrow><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>Y</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow></mfrac><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mrow><mo>(</mo><mi>compatibility</mi><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D4369.tif" /><img file="US2022121884A1_D4370.tif" /><img file="US2022121884A1_D4371.tif" /><img file="US2022121884A1_D4372.tif" /><img file="US2022121884A1_D4373.tif" /><img file="US2022121884A1_D4374.tif" /><img file="US2022121884A1_D4375.tif" /><img file="US2022121884A1_D4376.tif" /><img file="US2022121884A1_D4377.tif" /><img file="US2022121884A1_D4378.tif" /><img file="US2022121884A1_D4379.tif" /><img file="US2022121884A1_D4380.tif" /><img file="US2022121884A1_D4381.tif" /><img file="US2022121884A1_D4382.tif" /><img file="US2022121884A1_D4383.tif" /><img file="US2022121884A1_D4384.tif" /><img file="US2022121884A1_D4385.tif" /><img file="US2022121884A1_D4386.tif" /><img file="US2022121884A1_D4387.tif" /><img file="US2022121884A1_D4388.tif" /><img file="US2022121884A1_D4389.tif" /><img file="US2022121884A1_D4390.tif" /><img file="US2022121884A1_D4391.tif" /><img file="US2022121884A1_D4392.tif" /><img file="US2022121884A1_D4393.tif" /><img file="US2022121884A1_D4394.tif" /><img file="US2022121884A1_D4395.tif" /><img file="US2022121884A1_D4396.tif" /><img file="US2022121884A1_D4397.tif" /><img file="US2022121884A1_D4398.tif" /><img file="US2022121884A1_D4399.tif" /><img file="US2022121884A1_D4400.tif" /><img file="US2022121884A1_D4401.tif" /><img file="US2022121884A1_D4402.tif" /><img file="US2022121884A1_D4403.tif" /><img file="US2022121884A1_D4404.tif" /><img file="US2022121884A1_D4405.tif" /><img file="US2022121884A1_D4406.tif" /><img file="US2022121884A1_D4407.tif" /><img file="US2022121884A1_D4408.tif" /><img file="US2022121884A1_D4409.tif" /><img file="US2022121884A1_D4410.tif" /><img file="US2022121884A1_D4411.tif" /><img file="US2022121884A1_D4412.tif" /><img file="US2022121884A1_D4413.tif" /><img file="US2022121884A1_D4414.tif" /><img file="US2022121884A1_D4415.tif" /><img file="US2022121884A1_D4416.tif" /><img file="US2022121884A1_D4417.tif" /><img file="US2022121884A1_D4418.tif" /><img file="US2022121884A1_D4419.tif" /><img file="US2022121884A1_D4420.tif" /><img file="US2022121884A1_D4421.tif" /><img file="US2022121884A1_D4422.tif" /><img file="US2022121884A1_D4423.tif" /><img file="US2022121884A1_D4424.tif" /><img file="US2022121884A1_D4425.tif" /><img file="US2022121884A1_D4426.tif" /><img file="US2022121884A1_D4427.tif" /><img file="US2022121884A1_D4428.tif" /><img file="US2022121884A1_D4429.tif" /><img file="US2022121884A1_D4430.tif" /><img file="US2022121884A1_D4431.tif" /><img file="US2022121884A1_D4432.tif" /><img file="US2022121884A1_D4433.tif" /><img file="US2022121884A1_D4434.tif" /><img file="US2022121884A1_D4435.tif" /><img file="US2022121884A1_D4436.tif" /><img file="US2022121884A1_D4437.tif" /><img file="US2022121884A1_D4438.tif" /><img file="US2022121884A1_D4439.tif" /><img file="US2022121884A1_D4440.tif" /><img file="US2022121884A1_D4441.tif" /><img file="US2022121884A1_D4442.tif" /><img file="US2022121884A1_D4443.tif" /><img file="US2022121884A1_D4444.tif" /><img file="US2022121884A1_D4445.tif" /><img file="US2022121884A1_D4446.tif" /><img file="US2022121884A1_D4447.tif" /><img file="US2022121884A1_D4448.tif" /><img file="US2022121884A1_D4449.tif" /><img file="US2022121884A1_D4450.tif" /><img file="US2022121884A1_D4451.tif" /><img file="US2022121884A1_D4452.tif" /><img file="US2022121884A1_D4453.tif" /><img file="US2022121884A1_D4454.tif" /><img file="US2022121884A1_D4455.tif" /><img file="US2022121884A1_D4456.tif" /><img file="US2022121884A1_D4457.tif" /><img file="US2022121884A1_D4458.tif" /><img file="US2022121884A1_D4459.tif" /><img file="US2022121884A1_D4460.tif" /><img file="US2022121884A1_D4461.tif" /><img file="US2022121884A1_D4462.tif" /><img file="US2022121884A1_D4463.tif" /><img file="US2022121884A1_D4464.tif" /><img file="US2022121884A1_D4465.tif" /><img file="US2022121884A1_D4466.tif" /><img file="US2022121884A1_D4467.tif" /><img file="US2022121884A1_D4468.tif" /><img file="US2022121884A1_D4469.tif" /><img file="US2022121884A1_D4470.tif" /><img file="US2022121884A1_D4471.tif" /><img file="US2022121884A1_D4472.tif" /><img file="US2022121884A1_D4473.tif" /><img file="US2022121884A1_D4474.tif" /><img file="US2022121884A1_D4475.tif" /><img file="US2022121884A1_D4476.tif" /><img file="US2022121884A1_D4477.tif" /><img file="US2022121884A1_D4478.tif" /><img file="US2022121884A1_D4479.tif" /><img file="US2022121884A1_D4480.tif" />
Applying the extension principle, the membership function of p<sub>Z </sub>may be expressed as:
<maths id="MATH-US-00017" num="00017"><math overflow="scroll"><mrow><mrow><msub><mi>μ</mi><msub><mi>p</mi><mi>Z</mi></msub></msub><mo></mo><mrow><mo>(</mo><msub><mi>p</mi><mi>Z</mi></msub><mo>)</mo></mrow></mrow><mo>=</mo><mrow><msub><mi>sup</mi><mrow><msub><mi>p</mi><mi>X</mi></msub><mo>,</mo><msub><mi>p</mi><mi>Y</mi></msub></mrow></msub><mo></mo><mrow><mo>(</mo><mrow><mrow><msub><mi>μ</mi><msub><mi>B</mi><mi>X</mi></msub></msub><mo></mo><mrow><mo>(</mo><mrow><msubsup><mo>∫</mo><mi>R</mi><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></msubsup><mo></mo><mrow><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>X</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>)</mo></mrow></mrow><mo>⋀</mo><mrow><msub><mi>μ</mi><msub><mi>B</mi><mi>Y</mi></msub></msub><mo></mo><mrow><mo>(</mo><mrow><msubsup><mo>∫</mo><mi>R</mi><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></msubsup><mo></mo><mrow><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>Y</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>p</mi><mi>Y</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>)</mo></mrow></mrow></mrow><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D4481.tif" /><img file="US2022121884A1_D4482.tif" /><img file="US2022121884A1_D4483.tif" /><img file="US2022121884A1_D4484.tif" /><img file="US2022121884A1_D4485.tif" /><img file="US2022121884A1_D4486.tif" /><img file="US2022121884A1_D4487.tif" /><img file="US2022121884A1_D4488.tif" /><img file="US2022121884A1_D4489.tif" /><img file="US2022121884A1_D4490.tif" /><img file="US2022121884A1_D4491.tif" /><img file="US2022121884A1_D4492.tif" /><img file="US2022121884A1_D4493.tif" /><img file="US2022121884A1_D4494.tif" /><img file="US2022121884A1_D4495.tif" /><img file="US2022121884A1_D4496.tif" /><img file="US2022121884A1_D4497.tif" /><img file="US2022121884A1_D4498.tif" /><img file="US2022121884A1_D4499.tif" /><img file="US2022121884A1_D4500.tif" /><img file="US2022121884A1_D4501.tif" /><img file="US2022121884A1_D4502.tif" /><img file="US2022121884A1_D4503.tif" /><img file="US2022121884A1_D4504.tif" /><img file="US2022121884A1_D4505.tif" /><img file="US2022121884A1_D4506.tif" /><img file="US2022121884A1_D4507.tif" /><img file="US2022121884A1_D4508.tif" /><img file="US2022121884A1_D4509.tif" /><img file="US2022121884A1_D4510.tif" /><img file="US2022121884A1_D4511.tif" /><img file="US2022121884A1_D4512.tif" /><img file="US2022121884A1_D4513.tif" /><img file="US2022121884A1_D4514.tif" /><img file="US2022121884A1_D4515.tif" /><img file="US2022121884A1_D4516.tif" /><img file="US2022121884A1_D4517.tif" /><img file="US2022121884A1_D4518.tif" /><img file="US2022121884A1_D4519.tif" /><img file="US2022121884A1_D4520.tif" /><img file="US2022121884A1_D4521.tif" /><img file="US2022121884A1_D4522.tif" /><img file="US2022121884A1_D4523.tif" /><img file="US2022121884A1_D4524.tif" /><img file="US2022121884A1_D4525.tif" /><img file="US2022121884A1_D4526.tif" /><img file="US2022121884A1_D4527.tif" /><img file="US2022121884A1_D4528.tif" /><img file="US2022121884A1_D4529.tif" /><img file="US2022121884A1_D4530.tif" /><img file="US2022121884A1_D4531.tif" /><img file="US2022121884A1_D4532.tif" /><img file="US2022121884A1_D4533.tif" /><img file="US2022121884A1_D4534.tif" /><img file="US2022121884A1_D4535.tif" /><img file="US2022121884A1_D4536.tif" /><img file="US2022121884A1_D4537.tif" /><img file="US2022121884A1_D4538.tif" /><img file="US2022121884A1_D4539.tif" /><img file="US2022121884A1_D4540.tif" /><img file="US2022121884A1_D4541.tif" /><img file="US2022121884A1_D4542.tif" /><img file="US2022121884A1_D4543.tif" /><img file="US2022121884A1_D4544.tif" /><img file="US2022121884A1_D4545.tif" /><img file="US2022121884A1_D4546.tif" /><img file="US2022121884A1_D4547.tif" /><img file="US2022121884A1_D4548.tif" /><img file="US2022121884A1_D4549.tif" /><img file="US2022121884A1_D4550.tif" /><img file="US2022121884A1_D4551.tif" /><img file="US2022121884A1_D4552.tif" /><img file="US2022121884A1_D4553.tif" /><img file="US2022121884A1_D4554.tif" /><img file="US2022121884A1_D4555.tif" /><img file="US2022121884A1_D4556.tif" /><img file="US2022121884A1_D4557.tif" /><img file="US2022121884A1_D4558.tif" /><img file="US2022121884A1_D4559.tif" /><img file="US2022121884A1_D4560.tif" /><img file="US2022121884A1_D4561.tif" /><img file="US2022121884A1_D4562.tif" /><img file="US2022121884A1_D4563.tif" /><img file="US2022121884A1_D4564.tif" /><img file="US2022121884A1_D4565.tif" /><img file="US2022121884A1_D4566.tif" /><img file="US2022121884A1_D4567.tif" /><img file="US2022121884A1_D4568.tif" /><img file="US2022121884A1_D4569.tif" /><img file="US2022121884A1_D4570.tif" /><img file="US2022121884A1_D4571.tif" /><img file="US2022121884A1_D4572.tif" /><img file="US2022121884A1_D4573.tif" /><img file="US2022121884A1_D4574.tif" /><img file="US2022121884A1_D4575.tif" /><img file="US2022121884A1_D4576.tif" /><img file="US2022121884A1_D4577.tif" /><img file="US2022121884A1_D4578.tif" /><img file="US2022121884A1_D4579.tif" /><img file="US2022121884A1_D4580.tif" /><img file="US2022121884A1_D4581.tif" /><img file="US2022121884A1_D4582.tif" /><img file="US2022121884A1_D4583.tif" /><img file="US2022121884A1_D4584.tif" /><img file="US2022121884A1_D4585.tif" /><img file="US2022121884A1_D4586.tif" /><img file="US2022121884A1_D4587.tif" /><img file="US2022121884A1_D4588.tif" /><img file="US2022121884A1_D4589.tif" /><img file="US2022121884A1_D4590.tif" /><img file="US2022121884A1_D4591.tif" /><img file="US2022121884A1_D4592.tif" /><maths id="MATH-US-00017-2" num="00017.2"><math overflow="scroll"><mrow><mstyle><mspace width="1.1em" height="1.1ex" /></mstyle><mo></mo><mrow><mi>subject</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>to</mi></mrow></mrow></math></maths><img file="US2022121884A1_D4593.tif" /><img file="US2022121884A1_D4594.tif" /><img file="US2022121884A1_D4595.tif" /><img file="US2022121884A1_D4596.tif" /><img file="US2022121884A1_D4597.tif" /><img file="US2022121884A1_D4598.tif" /><img file="US2022121884A1_D4599.tif" /><img file="US2022121884A1_D4600.tif" /><img file="US2022121884A1_D4601.tif" /><img file="US2022121884A1_D4602.tif" /><img file="US2022121884A1_D4603.tif" /><img file="US2022121884A1_D4604.tif" /><img file="US2022121884A1_D4605.tif" /><img file="US2022121884A1_D4606.tif" /><img file="US2022121884A1_D4607.tif" /><img file="US2022121884A1_D4608.tif" /><img file="US2022121884A1_D4609.tif" /><img file="US2022121884A1_D4610.tif" /><img file="US2022121884A1_D4611.tif" /><img file="US2022121884A1_D4612.tif" /><img file="US2022121884A1_D4613.tif" /><img file="US2022121884A1_D4614.tif" /><img file="US2022121884A1_D4615.tif" /><img file="US2022121884A1_D4616.tif" /><img file="US2022121884A1_D4617.tif" /><img file="US2022121884A1_D4618.tif" /><img file="US2022121884A1_D4619.tif" /><img file="US2022121884A1_D4620.tif" /><img file="US2022121884A1_D4621.tif" /><img file="US2022121884A1_D4622.tif" /><img file="US2022121884A1_D4623.tif" /><img file="US2022121884A1_D4624.tif" /><img file="US2022121884A1_D4625.tif" /><img file="US2022121884A1_D4626.tif" /><img file="US2022121884A1_D4627.tif" /><img file="US2022121884A1_D4628.tif" /><img file="US2022121884A1_D4629.tif" /><img file="US2022121884A1_D4630.tif" /><img file="US2022121884A1_D4631.tif" /><img file="US2022121884A1_D4632.tif" /><img file="US2022121884A1_D4633.tif" /><img file="US2022121884A1_D4634.tif" /><img file="US2022121884A1_D4635.tif" /><img file="US2022121884A1_D4636.tif" /><img file="US2022121884A1_D4637.tif" /><img file="US2022121884A1_D4638.tif" /><img file="US2022121884A1_D4639.tif" /><img file="US2022121884A1_D4640.tif" /><img file="US2022121884A1_D4641.tif" /><img file="US2022121884A1_D4642.tif" /><img file="US2022121884A1_D4643.tif" /><img file="US2022121884A1_D4644.tif" /><img file="US2022121884A1_D4645.tif" /><img file="US2022121884A1_D4646.tif" /><img file="US2022121884A1_D4647.tif" /><img file="US2022121884A1_D4648.tif" /><img file="US2022121884A1_D4649.tif" /><img file="US2022121884A1_D4650.tif" /><img file="US2022121884A1_D4651.tif" /><img file="US2022121884A1_D4652.tif" /><img file="US2022121884A1_D4653.tif" /><img file="US2022121884A1_D4654.tif" /><img file="US2022121884A1_D4655.tif" /><img file="US2022121884A1_D4656.tif" /><img file="US2022121884A1_D4657.tif" /><img file="US2022121884A1_D4658.tif" /><img file="US2022121884A1_D4659.tif" /><img file="US2022121884A1_D4660.tif" /><img file="US2022121884A1_D4661.tif" /><img file="US2022121884A1_D4662.tif" /><img file="US2022121884A1_D4663.tif" /><img file="US2022121884A1_D4664.tif" /><img file="US2022121884A1_D4665.tif" /><img file="US2022121884A1_D4666.tif" /><img file="US2022121884A1_D4667.tif" /><img file="US2022121884A1_D4668.tif" /><img file="US2022121884A1_D4669.tif" /><img file="US2022121884A1_D4670.tif" /><img file="US2022121884A1_D4671.tif" /><img file="US2022121884A1_D4672.tif" /><img file="US2022121884A1_D4673.tif" /><img file="US2022121884A1_D4674.tif" /><img file="US2022121884A1_D4675.tif" /><img file="US2022121884A1_D4676.tif" /><img file="US2022121884A1_D4677.tif" /><img file="US2022121884A1_D4678.tif" /><img file="US2022121884A1_D4679.tif" /><img file="US2022121884A1_D4680.tif" /><img file="US2022121884A1_D4681.tif" /><img file="US2022121884A1_D4682.tif" /><img file="US2022121884A1_D4683.tif" /><img file="US2022121884A1_D4684.tif" /><img file="US2022121884A1_D4685.tif" /><img file="US2022121884A1_D4686.tif" /><img file="US2022121884A1_D4687.tif" /><img file="US2022121884A1_D4688.tif" /><img file="US2022121884A1_D4689.tif" /><img file="US2022121884A1_D4690.tif" /><img file="US2022121884A1_D4691.tif" /><img file="US2022121884A1_D4692.tif" /><img file="US2022121884A1_D4693.tif" /><img file="US2022121884A1_D4694.tif" /><img file="US2022121884A1_D4695.tif" /><img file="US2022121884A1_D4696.tif" /><img file="US2022121884A1_D4697.tif" /><img file="US2022121884A1_D4698.tif" /><img file="US2022121884A1_D4699.tif" /><img file="US2022121884A1_D4700.tif" /><img file="US2022121884A1_D4701.tif" /><img file="US2022121884A1_D4702.tif" /><img file="US2022121884A1_D4703.tif" /><img file="US2022121884A1_D4704.tif" /><maths id="MATH-US-00017-3" num="00017.3"><math overflow="scroll"><mrow><mstyle><mspace width="1.1em" height="1.1ex" /></mstyle><mo></mo><mrow><msub><mi>p</mi><mi>Z</mi></msub><mo>=</mo><mrow><msub><mi>p</mi><mi>X</mi></msub><mo>∘</mo><msub><mi>p</mi><mi>Y</mi></msub></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D4705.tif" /><img file="US2022121884A1_D4706.tif" /><img file="US2022121884A1_D4707.tif" /><img file="US2022121884A1_D4708.tif" /><img file="US2022121884A1_D4709.tif" /><img file="US2022121884A1_D4710.tif" /><img file="US2022121884A1_D4711.tif" /><img file="US2022121884A1_D4712.tif" /><img file="US2022121884A1_D4713.tif" /><img file="US2022121884A1_D4714.tif" /><img file="US2022121884A1_D4715.tif" /><img file="US2022121884A1_D4716.tif" /><img file="US2022121884A1_D4717.tif" /><img file="US2022121884A1_D4718.tif" /><img file="US2022121884A1_D4719.tif" /><img file="US2022121884A1_D4720.tif" /><img file="US2022121884A1_D4721.tif" /><img file="US2022121884A1_D4722.tif" /><img file="US2022121884A1_D4723.tif" /><img file="US2022121884A1_D4724.tif" /><img file="US2022121884A1_D4725.tif" /><img file="US2022121884A1_D4726.tif" /><img file="US2022121884A1_D4727.tif" /><img file="US2022121884A1_D4728.tif" /><img file="US2022121884A1_D4729.tif" /><img file="US2022121884A1_D4730.tif" /><img file="US2022121884A1_D4731.tif" /><img file="US2022121884A1_D4732.tif" /><img file="US2022121884A1_D4733.tif" /><img file="US2022121884A1_D4734.tif" /><img file="US2022121884A1_D4735.tif" /><img file="US2022121884A1_D4736.tif" /><img file="US2022121884A1_D4737.tif" /><img file="US2022121884A1_D4738.tif" /><img file="US2022121884A1_D4739.tif" /><img file="US2022121884A1_D4740.tif" /><img file="US2022121884A1_D4741.tif" /><img file="US2022121884A1_D4742.tif" /><img file="US2022121884A1_D4743.tif" /><img file="US2022121884A1_D4744.tif" /><img file="US2022121884A1_D4745.tif" /><img file="US2022121884A1_D4746.tif" /><img file="US2022121884A1_D4747.tif" /><img file="US2022121884A1_D4748.tif" /><img file="US2022121884A1_D4749.tif" /><img file="US2022121884A1_D4750.tif" /><img file="US2022121884A1_D4751.tif" /><img file="US2022121884A1_D4752.tif" /><img file="US2022121884A1_D4753.tif" /><img file="US2022121884A1_D4754.tif" /><img file="US2022121884A1_D4755.tif" /><img file="US2022121884A1_D4756.tif" /><img file="US2022121884A1_D4757.tif" /><img file="US2022121884A1_D4758.tif" /><img file="US2022121884A1_D4759.tif" /><img file="US2022121884A1_D4760.tif" /><img file="US2022121884A1_D4761.tif" /><img file="US2022121884A1_D4762.tif" /><img file="US2022121884A1_D4763.tif" /><img file="US2022121884A1_D4764.tif" /><img file="US2022121884A1_D4765.tif" /><img file="US2022121884A1_D4766.tif" /><img file="US2022121884A1_D4767.tif" /><img file="US2022121884A1_D4768.tif" /><img file="US2022121884A1_D4769.tif" /><img file="US2022121884A1_D4770.tif" /><img file="US2022121884A1_D4771.tif" /><img file="US2022121884A1_D4772.tif" /><img file="US2022121884A1_D4773.tif" /><img file="US2022121884A1_D4774.tif" /><img file="US2022121884A1_D4775.tif" /><img file="US2022121884A1_D4776.tif" /><img file="US2022121884A1_D4777.tif" /><img file="US2022121884A1_D4778.tif" /><img file="US2022121884A1_D4779.tif" /><img file="US2022121884A1_D4780.tif" /><img file="US2022121884A1_D4781.tif" /><img file="US2022121884A1_D4782.tif" /><img file="US2022121884A1_D4783.tif" /><img file="US2022121884A1_D4784.tif" /><img file="US2022121884A1_D4785.tif" /><img file="US2022121884A1_D4786.tif" /><img file="US2022121884A1_D4787.tif" /><img file="US2022121884A1_D4788.tif" /><img file="US2022121884A1_D4789.tif" /><img file="US2022121884A1_D4790.tif" /><img file="US2022121884A1_D4791.tif" /><img file="US2022121884A1_D4792.tif" /><img file="US2022121884A1_D4793.tif" /><img file="US2022121884A1_D4794.tif" /><img file="US2022121884A1_D4795.tif" /><img file="US2022121884A1_D4796.tif" /><img file="US2022121884A1_D4797.tif" /><img file="US2022121884A1_D4798.tif" /><img file="US2022121884A1_D4799.tif" /><img file="US2022121884A1_D4800.tif" /><img file="US2022121884A1_D4801.tif" /><img file="US2022121884A1_D4802.tif" /><img file="US2022121884A1_D4803.tif" /><img file="US2022121884A1_D4804.tif" /><img file="US2022121884A1_D4805.tif" /><img file="US2022121884A1_D4806.tif" /><img file="US2022121884A1_D4807.tif" /><img file="US2022121884A1_D4808.tif" /><img file="US2022121884A1_D4809.tif" /><img file="US2022121884A1_D4810.tif" /><img file="US2022121884A1_D4811.tif" /><img file="US2022121884A1_D4812.tif" /><img file="US2022121884A1_D4813.tif" /><img file="US2022121884A1_D4814.tif" /><img file="US2022121884A1_D4815.tif" /><img file="US2022121884A1_D4816.tif" /><maths id="MATH-US-00017-4" num="00017.4"><math overflow="scroll"><mrow><mstyle><mspace width="1.1em" height="1.1ex" /></mstyle><mo></mo><mrow><mrow><msub><mo>∫</mo><mi>R</mi></msub><mo></mo><mrow><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>=</mo><mn>1</mn></mrow></mrow></math></maths><img file="US2022121884A1_D4817.tif" /><img file="US2022121884A1_D4818.tif" /><img file="US2022121884A1_D4819.tif" /><img file="US2022121884A1_D4820.tif" /><img file="US2022121884A1_D4821.tif" /><img file="US2022121884A1_D4822.tif" /><img file="US2022121884A1_D4823.tif" /><img file="US2022121884A1_D4824.tif" /><img file="US2022121884A1_D4825.tif" /><img file="US2022121884A1_D4826.tif" /><img file="US2022121884A1_D4827.tif" /><img file="US2022121884A1_D4828.tif" /><img file="US2022121884A1_D4829.tif" /><img file="US2022121884A1_D4830.tif" /><img file="US2022121884A1_D4831.tif" /><img file="US2022121884A1_D4832.tif" /><img file="US2022121884A1_D4833.tif" /><img file="US2022121884A1_D4834.tif" /><img file="US2022121884A1_D4835.tif" /><img file="US2022121884A1_D4836.tif" /><img file="US2022121884A1_D4837.tif" /><img file="US2022121884A1_D4838.tif" /><img file="US2022121884A1_D4839.tif" /><img file="US2022121884A1_D4840.tif" /><img file="US2022121884A1_D4841.tif" /><img file="US2022121884A1_D4842.tif" /><img file="US2022121884A1_D4843.tif" /><img file="US2022121884A1_D4844.tif" /><img file="US2022121884A1_D4845.tif" /><img file="US2022121884A1_D4846.tif" /><img file="US2022121884A1_D4847.tif" /><img file="US2022121884A1_D4848.tif" /><img file="US2022121884A1_D4849.tif" /><img file="US2022121884A1_D4850.tif" /><img file="US2022121884A1_D4851.tif" /><img file="US2022121884A1_D4852.tif" /><img file="US2022121884A1_D4853.tif" /><img file="US2022121884A1_D4854.tif" /><img file="US2022121884A1_D4855.tif" /><img file="US2022121884A1_D4856.tif" /><img file="US2022121884A1_D4857.tif" /><img file="US2022121884A1_D4858.tif" /><img file="US2022121884A1_D4859.tif" /><img file="US2022121884A1_D4860.tif" /><img file="US2022121884A1_D4861.tif" /><img file="US2022121884A1_D4862.tif" /><img file="US2022121884A1_D4863.tif" /><img file="US2022121884A1_D4864.tif" /><img file="US2022121884A1_D4865.tif" /><img file="US2022121884A1_D4866.tif" /><img file="US2022121884A1_D4867.tif" /><img file="US2022121884A1_D4868.tif" /><img file="US2022121884A1_D4869.tif" /><img file="US2022121884A1_D4870.tif" /><img file="US2022121884A1_D4871.tif" /><img file="US2022121884A1_D4872.tif" /><img file="US2022121884A1_D4873.tif" /><img file="US2022121884A1_D4874.tif" /><img file="US2022121884A1_D4875.tif" /><img file="US2022121884A1_D4876.tif" /><img file="US2022121884A1_D4877.tif" /><img file="US2022121884A1_D4878.tif" /><img file="US2022121884A1_D4879.tif" /><img file="US2022121884A1_D4880.tif" /><img file="US2022121884A1_D4881.tif" /><img file="US2022121884A1_D4882.tif" /><img file="US2022121884A1_D4883.tif" /><img file="US2022121884A1_D4884.tif" /><img file="US2022121884A1_D4885.tif" /><img file="US2022121884A1_D4886.tif" /><img file="US2022121884A1_D4887.tif" /><img file="US2022121884A1_D4888.tif" /><img file="US2022121884A1_D4889.tif" /><img file="US2022121884A1_D4890.tif" /><img file="US2022121884A1_D4891.tif" /><img file="US2022121884A1_D4892.tif" /><img file="US2022121884A1_D4893.tif" /><img file="US2022121884A1_D4894.tif" /><img file="US2022121884A1_D4895.tif" /><img file="US2022121884A1_D4896.tif" /><img file="US2022121884A1_D4897.tif" /><img file="US2022121884A1_D4898.tif" /><img file="US2022121884A1_D4899.tif" /><img file="US2022121884A1_D4900.tif" /><img file="US2022121884A1_D4901.tif" /><img file="US2022121884A1_D4902.tif" /><img file="US2022121884A1_D4903.tif" /><img file="US2022121884A1_D4904.tif" /><img file="US2022121884A1_D4905.tif" /><img file="US2022121884A1_D4906.tif" /><img file="US2022121884A1_D4907.tif" /><img file="US2022121884A1_D4908.tif" /><img file="US2022121884A1_D4909.tif" /><img file="US2022121884A1_D4910.tif" /><img file="US2022121884A1_D4911.tif" /><img file="US2022121884A1_D4912.tif" /><img file="US2022121884A1_D4913.tif" /><img file="US2022121884A1_D4914.tif" /><img file="US2022121884A1_D4915.tif" /><img file="US2022121884A1_D4916.tif" /><img file="US2022121884A1_D4917.tif" /><img file="US2022121884A1_D4918.tif" /><img file="US2022121884A1_D4919.tif" /><img file="US2022121884A1_D4920.tif" /><img file="US2022121884A1_D4921.tif" /><img file="US2022121884A1_D4922.tif" /><img file="US2022121884A1_D4923.tif" /><img file="US2022121884A1_D4924.tif" /><img file="US2022121884A1_D4925.tif" /><img file="US2022121884A1_D4926.tif" /><img file="US2022121884A1_D4927.tif" /><img file="US2022121884A1_D4928.tif" /><maths id="MATH-US-00017-5" num="00017.5"><math overflow="scroll"><mrow><mstyle><mspace width="1.1em" height="1.1ex" /></mstyle><mo></mo><mrow><mrow><msub><mo>∫</mo><mi>R</mi></msub><mo></mo><mrow><mrow><msub><mi>p</mi><mi>Y</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>=</mo><mn>1</mn></mrow></mrow></math></maths><img file="US2022121884A1_D4929.tif" /><img file="US2022121884A1_D4930.tif" /><img file="US2022121884A1_D4931.tif" /><img file="US2022121884A1_D4932.tif" /><img file="US2022121884A1_D4933.tif" /><img file="US2022121884A1_D4934.tif" /><img file="US2022121884A1_D4935.tif" /><img file="US2022121884A1_D4936.tif" /><img file="US2022121884A1_D4937.tif" /><img file="US2022121884A1_D4938.tif" /><img file="US2022121884A1_D4939.tif" /><img file="US2022121884A1_D4940.tif" /><img file="US2022121884A1_D4941.tif" /><img file="US2022121884A1_D4942.tif" /><img file="US2022121884A1_D4943.tif" /><img file="US2022121884A1_D4944.tif" /><img file="US2022121884A1_D4945.tif" /><img file="US2022121884A1_D4946.tif" /><img file="US2022121884A1_D4947.tif" /><img file="US2022121884A1_D4948.tif" /><img file="US2022121884A1_D4949.tif" /><img file="US2022121884A1_D4950.tif" /><img file="US2022121884A1_D4951.tif" /><img file="US2022121884A1_D4952.tif" /><img file="US2022121884A1_D4953.tif" /><img file="US2022121884A1_D4954.tif" /><img file="US2022121884A1_D4955.tif" /><img file="US2022121884A1_D4956.tif" /><img file="US2022121884A1_D4957.tif" /><img file="US2022121884A1_D4958.tif" /><img file="US2022121884A1_D4959.tif" /><img file="US2022121884A1_D4960.tif" /><img file="US2022121884A1_D4961.tif" /><img file="US2022121884A1_D4962.tif" /><img file="US2022121884A1_D4963.tif" /><img file="US2022121884A1_D4964.tif" /><img file="US2022121884A1_D4965.tif" /><img file="US2022121884A1_D4966.tif" /><img file="US2022121884A1_D4967.tif" /><img file="US2022121884A1_D4968.tif" /><img file="US2022121884A1_D4969.tif" /><img file="US2022121884A1_D4970.tif" /><img file="US2022121884A1_D4971.tif" /><img file="US2022121884A1_D4972.tif" /><img file="US2022121884A1_D4973.tif" /><img file="US2022121884A1_D4974.tif" /><img file="US2022121884A1_D4975.tif" /><img file="US2022121884A1_D4976.tif" /><img file="US2022121884A1_D4977.tif" /><img file="US2022121884A1_D4978.tif" /><img file="US2022121884A1_D4979.tif" /><img file="US2022121884A1_D4980.tif" /><img file="US2022121884A1_D4981.tif" /><img file="US2022121884A1_D4982.tif" /><img file="US2022121884A1_D4983.tif" /><img file="US2022121884A1_D4984.tif" /><img file="US2022121884A1_D4985.tif" /><img file="US2022121884A1_D4986.tif" /><img file="US2022121884A1_D4987.tif" /><img file="US2022121884A1_D4988.tif" /><img file="US2022121884A1_D4989.tif" /><img file="US2022121884A1_D4990.tif" /><img file="US2022121884A1_D4991.tif" /><img file="US2022121884A1_D4992.tif" /><img file="US2022121884A1_D4993.tif" /><img file="US2022121884A1_D4994.tif" /><img file="US2022121884A1_D4995.tif" /><img file="US2022121884A1_D4996.tif" /><img file="US2022121884A1_D4997.tif" /><img file="US2022121884A1_D4998.tif" /><img file="US2022121884A1_D4999.tif" /><img file="US2022121884A1_D5000.tif" /><img file="US2022121884A1_D5001.tif" /><img file="US2022121884A1_D5002.tif" /><img file="US2022121884A1_D5003.tif" /><img file="US2022121884A1_D5004.tif" /><img file="US2022121884A1_D5005.tif" /><img file="US2022121884A1_D5006.tif" /><img file="US2022121884A1_D5007.tif" /><img file="US2022121884A1_D5008.tif" /><img file="US2022121884A1_D5009.tif" /><img file="US2022121884A1_D5010.tif" /><img file="US2022121884A1_D5011.tif" /><img file="US2022121884A1_D5012.tif" /><img file="US2022121884A1_D5013.tif" /><img file="US2022121884A1_D5014.tif" /><img file="US2022121884A1_D5015.tif" /><img file="US2022121884A1_D5016.tif" /><img file="US2022121884A1_D5017.tif" /><img file="US2022121884A1_D5018.tif" /><img file="US2022121884A1_D5019.tif" /><img file="US2022121884A1_D5020.tif" /><img file="US2022121884A1_D5021.tif" /><img file="US2022121884A1_D5022.tif" /><img file="US2022121884A1_D5023.tif" /><img file="US2022121884A1_D5024.tif" /><img file="US2022121884A1_D5025.tif" /><img file="US2022121884A1_D5026.tif" /><img file="US2022121884A1_D5027.tif" /><img file="US2022121884A1_D5028.tif" /><img file="US2022121884A1_D5029.tif" /><img file="US2022121884A1_D5030.tif" /><img file="US2022121884A1_D5031.tif" /><img file="US2022121884A1_D5032.tif" /><img file="US2022121884A1_D5033.tif" /><img file="US2022121884A1_D5034.tif" /><img file="US2022121884A1_D5035.tif" /><img file="US2022121884A1_D5036.tif" /><img file="US2022121884A1_D5037.tif" /><img file="US2022121884A1_D5038.tif" /><img file="US2022121884A1_D5039.tif" /><img file="US2022121884A1_D5040.tif" /><maths id="MATH-US-00017-6" num="00017.6"><math overflow="scroll"><mrow><mstyle><mspace width="1.1em" height="1.1ex" /></mstyle><mo></mo><mrow><mrow><msub><mo>∫</mo><mi>R</mi></msub><mo></mo><mrow><mrow><msub><mi>up</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>=</mo><mfrac><mrow><msub><mo>∫</mo><mi>R</mi></msub><mo></mo><mrow><mi>u</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>X</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mrow><msub><mo>∫</mo><mi>R</mi></msub><mo></mo><mrow><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>X</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow></mfrac></mrow></mrow></math></maths><img file="US2022121884A1_D5041.tif" /><img file="US2022121884A1_D5042.tif" /><img file="US2022121884A1_D5043.tif" /><img file="US2022121884A1_D5044.tif" /><img file="US2022121884A1_D5045.tif" /><img file="US2022121884A1_D5046.tif" /><img file="US2022121884A1_D5047.tif" /><img file="US2022121884A1_D5048.tif" /><img file="US2022121884A1_D5049.tif" /><img file="US2022121884A1_D5050.tif" /><img file="US2022121884A1_D5051.tif" /><img file="US2022121884A1_D5052.tif" /><img file="US2022121884A1_D5053.tif" /><img file="US2022121884A1_D5054.tif" /><img file="US2022121884A1_D5055.tif" /><img file="US2022121884A1_D5056.tif" /><img file="US2022121884A1_D5057.tif" /><img file="US2022121884A1_D5058.tif" /><img file="US2022121884A1_D5059.tif" /><img file="US2022121884A1_D5060.tif" /><img file="US2022121884A1_D5061.tif" /><img file="US2022121884A1_D5062.tif" /><img file="US2022121884A1_D5063.tif" /><img file="US2022121884A1_D5064.tif" /><img file="US2022121884A1_D5065.tif" /><img file="US2022121884A1_D5066.tif" /><img file="US2022121884A1_D5067.tif" /><img file="US2022121884A1_D5068.tif" /><img file="US2022121884A1_D5069.tif" /><img file="US2022121884A1_D5070.tif" /><img file="US2022121884A1_D5071.tif" /><img file="US2022121884A1_D5072.tif" /><img file="US2022121884A1_D5073.tif" /><img file="US2022121884A1_D5074.tif" /><img file="US2022121884A1_D5075.tif" /><img file="US2022121884A1_D5076.tif" /><img file="US2022121884A1_D5077.tif" /><img file="US2022121884A1_D5078.tif" /><img file="US2022121884A1_D5079.tif" /><img file="US2022121884A1_D5080.tif" /><img file="US2022121884A1_D5081.tif" /><img file="US2022121884A1_D5082.tif" /><img file="US2022121884A1_D5083.tif" /><img file="US2022121884A1_D5084.tif" /><img file="US2022121884A1_D5085.tif" /><img file="US2022121884A1_D5086.tif" /><img file="US2022121884A1_D5087.tif" /><img file="US2022121884A1_D5088.tif" /><img file="US2022121884A1_D5089.tif" /><img file="US2022121884A1_D5090.tif" /><img file="US2022121884A1_D5091.tif" /><img file="US2022121884A1_D5092.tif" /><img file="US2022121884A1_D5093.tif" /><img file="US2022121884A1_D5094.tif" /><img file="US2022121884A1_D5095.tif" /><img file="US2022121884A1_D5096.tif" /><img file="US2022121884A1_D5097.tif" /><img file="US2022121884A1_D5098.tif" /><img file="US2022121884A1_D5099.tif" /><img file="US2022121884A1_D5100.tif" /><img file="US2022121884A1_D5101.tif" /><img file="US2022121884A1_D5102.tif" /><img file="US2022121884A1_D5103.tif" /><img file="US2022121884A1_D5104.tif" /><img file="US2022121884A1_D5105.tif" /><img file="US2022121884A1_D5106.tif" /><img file="US2022121884A1_D5107.tif" /><img file="US2022121884A1_D5108.tif" /><img file="US2022121884A1_D5109.tif" /><img file="US2022121884A1_D5110.tif" /><img file="US2022121884A1_D5111.tif" /><img file="US2022121884A1_D5112.tif" /><img file="US2022121884A1_D5113.tif" /><img file="US2022121884A1_D5114.tif" /><img file="US2022121884A1_D5115.tif" /><img file="US2022121884A1_D5116.tif" /><img file="US2022121884A1_D5117.tif" /><img file="US2022121884A1_D5118.tif" /><img file="US2022121884A1_D5119.tif" /><img file="US2022121884A1_D5120.tif" /><img file="US2022121884A1_D5121.tif" /><img file="US2022121884A1_D5122.tif" /><img file="US2022121884A1_D5123.tif" /><img file="US2022121884A1_D5124.tif" /><img file="US2022121884A1_D5125.tif" /><img file="US2022121884A1_D5126.tif" /><img file="US2022121884A1_D5127.tif" /><img file="US2022121884A1_D5128.tif" /><img file="US2022121884A1_D5129.tif" /><img file="US2022121884A1_D5130.tif" /><img file="US2022121884A1_D5131.tif" /><img file="US2022121884A1_D5132.tif" /><img file="US2022121884A1_D5133.tif" /><img file="US2022121884A1_D5134.tif" /><img file="US2022121884A1_D5135.tif" /><img file="US2022121884A1_D5136.tif" /><img file="US2022121884A1_D5137.tif" /><img file="US2022121884A1_D5138.tif" /><img file="US2022121884A1_D5139.tif" /><img file="US2022121884A1_D5140.tif" /><img file="US2022121884A1_D5141.tif" /><img file="US2022121884A1_D5142.tif" /><img file="US2022121884A1_D5143.tif" /><img file="US2022121884A1_D5144.tif" /><img file="US2022121884A1_D5145.tif" /><img file="US2022121884A1_D5146.tif" /><img file="US2022121884A1_D5147.tif" /><img file="US2022121884A1_D5148.tif" /><img file="US2022121884A1_D5149.tif" /><img file="US2022121884A1_D5150.tif" /><img file="US2022121884A1_D5151.tif" /><img file="US2022121884A1_D5152.tif" /><maths id="MATH-US-00017-7" num="00017.7"><math overflow="scroll"><mrow><mstyle><mspace width="1.1em" height="1.1ex" /></mstyle><mo></mo><mrow><mrow><msub><mo>∫</mo><mi>R</mi></msub><mo></mo><mrow><mrow><msub><mi>up</mi><mi>Y</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>=</mo><mfrac><mrow><msub><mo>∫</mo><mi>R</mi></msub><mo></mo><mrow><mi>u</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>Y</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mrow><msub><mo>∫</mo><mi>R</mi></msub><mo></mo><mrow><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>Y</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow></mfrac></mrow></mrow></math></maths><img file="US2022121884A1_D5153.tif" /><img file="US2022121884A1_D5154.tif" /><img file="US2022121884A1_D5155.tif" /><img file="US2022121884A1_D5156.tif" /><img file="US2022121884A1_D5157.tif" /><img file="US2022121884A1_D5158.tif" /><img file="US2022121884A1_D5159.tif" /><img file="US2022121884A1_D5160.tif" /><img file="US2022121884A1_D5161.tif" /><img file="US2022121884A1_D5162.tif" /><img file="US2022121884A1_D5163.tif" /><img file="US2022121884A1_D5164.tif" /><img file="US2022121884A1_D5165.tif" /><img file="US2022121884A1_D5166.tif" /><img file="US2022121884A1_D5167.tif" /><img file="US2022121884A1_D5168.tif" /><img file="US2022121884A1_D5169.tif" /><img file="US2022121884A1_D5170.tif" /><img file="US2022121884A1_D5171.tif" /><img file="US2022121884A1_D5172.tif" /><img file="US2022121884A1_D5173.tif" /><img file="US2022121884A1_D5174.tif" /><img file="US2022121884A1_D5175.tif" /><img file="US2022121884A1_D5176.tif" /><img file="US2022121884A1_D5177.tif" /><img file="US2022121884A1_D5178.tif" /><img file="US2022121884A1_D5179.tif" /><img file="US2022121884A1_D5180.tif" /><img file="US2022121884A1_D5181.tif" /><img file="US2022121884A1_D5182.tif" /><img file="US2022121884A1_D5183.tif" /><img file="US2022121884A1_D5184.tif" /><img file="US2022121884A1_D5185.tif" /><img file="US2022121884A1_D5186.tif" /><img file="US2022121884A1_D5187.tif" /><img file="US2022121884A1_D5188.tif" /><img file="US2022121884A1_D5189.tif" /><img file="US2022121884A1_D5190.tif" /><img file="US2022121884A1_D5191.tif" /><img file="US2022121884A1_D5192.tif" /><img file="US2022121884A1_D5193.tif" /><img file="US2022121884A1_D5194.tif" /><img file="US2022121884A1_D5195.tif" /><img file="US2022121884A1_D5196.tif" /><img file="US2022121884A1_D5197.tif" /><img file="US2022121884A1_D5198.tif" /><img file="US2022121884A1_D5199.tif" /><img file="US2022121884A1_D5200.tif" /><img file="US2022121884A1_D5201.tif" /><img file="US2022121884A1_D5202.tif" /><img file="US2022121884A1_D5203.tif" /><img file="US2022121884A1_D5204.tif" /><img file="US2022121884A1_D5205.tif" /><img file="US2022121884A1_D5206.tif" /><img file="US2022121884A1_D5207.tif" /><img file="US2022121884A1_D5208.tif" /><img file="US2022121884A1_D5209.tif" /><img file="US2022121884A1_D5210.tif" /><img file="US2022121884A1_D5211.tif" /><img file="US2022121884A1_D5212.tif" /><img file="US2022121884A1_D5213.tif" /><img file="US2022121884A1_D5214.tif" /><img file="US2022121884A1_D5215.tif" /><img file="US2022121884A1_D5216.tif" /><img file="US2022121884A1_D5217.tif" /><img file="US2022121884A1_D5218.tif" /><img file="US2022121884A1_D5219.tif" /><img file="US2022121884A1_D5220.tif" /><img file="US2022121884A1_D5221.tif" /><img file="US2022121884A1_D5222.tif" /><img file="US2022121884A1_D5223.tif" /><img file="US2022121884A1_D5224.tif" /><img file="US2022121884A1_D5225.tif" /><img file="US2022121884A1_D5226.tif" /><img file="US2022121884A1_D5227.tif" /><img file="US2022121884A1_D5228.tif" /><img file="US2022121884A1_D5229.tif" /><img file="US2022121884A1_D5230.tif" /><img file="US2022121884A1_D5231.tif" /><img file="US2022121884A1_D5232.tif" /><img file="US2022121884A1_D5233.tif" /><img file="US2022121884A1_D5234.tif" /><img file="US2022121884A1_D5235.tif" /><img file="US2022121884A1_D5236.tif" /><img file="US2022121884A1_D5237.tif" /><img file="US2022121884A1_D5238.tif" /><img file="US2022121884A1_D5239.tif" /><img file="US2022121884A1_D5240.tif" /><img file="US2022121884A1_D5241.tif" /><img file="US2022121884A1_D5242.tif" /><img file="US2022121884A1_D5243.tif" /><img file="US2022121884A1_D5244.tif" /><img file="US2022121884A1_D5245.tif" /><img file="US2022121884A1_D5246.tif" /><img file="US2022121884A1_D5247.tif" /><img file="US2022121884A1_D5248.tif" /><img file="US2022121884A1_D5249.tif" /><img file="US2022121884A1_D5250.tif" /><img file="US2022121884A1_D5251.tif" /><img file="US2022121884A1_D5252.tif" /><img file="US2022121884A1_D5253.tif" /><img file="US2022121884A1_D5254.tif" /><img file="US2022121884A1_D5255.tif" /><img file="US2022121884A1_D5256.tif" /><img file="US2022121884A1_D5257.tif" /><img file="US2022121884A1_D5258.tif" /><img file="US2022121884A1_D5259.tif" /><img file="US2022121884A1_D5260.tif" /><img file="US2022121884A1_D5261.tif" /><img file="US2022121884A1_D5262.tif" /><img file="US2022121884A1_D5263.tif" /><img file="US2022121884A1_D5264.tif" />
In this case, the combined restriction on the arguments is expressed as a conjunction of their restrictions, with {circumflex over ( )} interpreted as min. In effect, application of the extension principle reduces computation of p<sub>Z </sub>to a problem in functional optimization. What is important to note is that the solution is not a value of p<sub>Z </sub>but a restriction on the values of p<sub>Z</sub>, consistent with the restrictions on p<sub>X </sub>and p<sub>Y</sub>.
At this point it is helpful to pause and summarize where we stand. Proceeding as if we are dealing with Z<sup>+</sup>-numbers, we arrive at an expression for p<sub>Z </sub>as a function of p<sub>X </sub>and p<sub>Y</sub>. Using this expression and applying the extension principle we can compute the restriction on p<sub>Z </sub>which is induced by the restrictions on p<sub>X </sub>and p<sub>Y</sub>. The allowed values of p<sub>Z </sub>consist of those values of p<sub>Z </sub>which are consistent with the given information, with the understanding that consistency is a matter of degree.
The second step involves computation of the probability of the fuzzy event, Z is A<sub>Z</sub>, given p<sub>Z</sub>. As was noted earlier, in fuzzy logic the probability measure of the fuzzy event X is A, where A is a fuzzy set and X is a random variable with probability density p<sub>X</sub>, is defined as:
<maths id="MATH-US-00018" num="00018"><math overflow="scroll"><mrow><msubsup><mo>∫</mo><mi>R</mi><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></msubsup><mo></mo><mrow><mrow><msub><mi>μ</mi><mi>A</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow></math></maths><img file="US2022121884A1_D5265.tif" /><img file="US2022121884A1_D5266.tif" /><img file="US2022121884A1_D5267.tif" /><img file="US2022121884A1_D5268.tif" /><img file="US2022121884A1_D5269.tif" /><img file="US2022121884A1_D5270.tif" /><img file="US2022121884A1_D5271.tif" /><img file="US2022121884A1_D5272.tif" /><img file="US2022121884A1_D5273.tif" /><img file="US2022121884A1_D5274.tif" /><img file="US2022121884A1_D5275.tif" /><img file="US2022121884A1_D5276.tif" /><img file="US2022121884A1_D5277.tif" /><img file="US2022121884A1_D5278.tif" /><img file="US2022121884A1_D5279.tif" /><img file="US2022121884A1_D5280.tif" /><img file="US2022121884A1_D5281.tif" /><img file="US2022121884A1_D5282.tif" /><img file="US2022121884A1_D5283.tif" /><img file="US2022121884A1_D5284.tif" /><img file="US2022121884A1_D5285.tif" /><img file="US2022121884A1_D5286.tif" /><img file="US2022121884A1_D5287.tif" /><img file="US2022121884A1_D5288.tif" /><img file="US2022121884A1_D5289.tif" /><img file="US2022121884A1_D5290.tif" /><img file="US2022121884A1_D5291.tif" /><img file="US2022121884A1_D5292.tif" /><img file="US2022121884A1_D5293.tif" /><img file="US2022121884A1_D5294.tif" /><img file="US2022121884A1_D5295.tif" /><img file="US2022121884A1_D5296.tif" /><img file="US2022121884A1_D5297.tif" /><img file="US2022121884A1_D5298.tif" /><img file="US2022121884A1_D5299.tif" /><img file="US2022121884A1_D5300.tif" /><img file="US2022121884A1_D5301.tif" /><img file="US2022121884A1_D5302.tif" /><img file="US2022121884A1_D5303.tif" /><img file="US2022121884A1_D5304.tif" /><img file="US2022121884A1_D5305.tif" /><img file="US2022121884A1_D5306.tif" /><img file="US2022121884A1_D5307.tif" /><img file="US2022121884A1_D5308.tif" /><img file="US2022121884A1_D5309.tif" /><img file="US2022121884A1_D5310.tif" /><img file="US2022121884A1_D5311.tif" /><img file="US2022121884A1_D5312.tif" /><img file="US2022121884A1_D5313.tif" /><img file="US2022121884A1_D5314.tif" /><img file="US2022121884A1_D5315.tif" /><img file="US2022121884A1_D5316.tif" /><img file="US2022121884A1_D5317.tif" /><img file="US2022121884A1_D5318.tif" /><img file="US2022121884A1_D5319.tif" /><img file="US2022121884A1_D5320.tif" /><img file="US2022121884A1_D5321.tif" /><img file="US2022121884A1_D5322.tif" /><img file="US2022121884A1_D5323.tif" /><img file="US2022121884A1_D5324.tif" /><img file="US2022121884A1_D5325.tif" /><img file="US2022121884A1_D5326.tif" /><img file="US2022121884A1_D5327.tif" /><img file="US2022121884A1_D5328.tif" /><img file="US2022121884A1_D5329.tif" /><img file="US2022121884A1_D5330.tif" /><img file="US2022121884A1_D5331.tif" /><img file="US2022121884A1_D5332.tif" /><img file="US2022121884A1_D5333.tif" /><img file="US2022121884A1_D5334.tif" /><img file="US2022121884A1_D5335.tif" /><img file="US2022121884A1_D5336.tif" /><img file="US2022121884A1_D5337.tif" /><img file="US2022121884A1_D5338.tif" /><img file="US2022121884A1_D5339.tif" /><img file="US2022121884A1_D5340.tif" /><img file="US2022121884A1_D5341.tif" /><img file="US2022121884A1_D5342.tif" /><img file="US2022121884A1_D5343.tif" /><img file="US2022121884A1_D5344.tif" /><img file="US2022121884A1_D5345.tif" /><img file="US2022121884A1_D5346.tif" /><img file="US2022121884A1_D5347.tif" /><img file="US2022121884A1_D5348.tif" /><img file="US2022121884A1_D5349.tif" /><img file="US2022121884A1_D5350.tif" /><img file="US2022121884A1_D5351.tif" /><img file="US2022121884A1_D5352.tif" /><img file="US2022121884A1_D5353.tif" /><img file="US2022121884A1_D5354.tif" /><img file="US2022121884A1_D5355.tif" /><img file="US2022121884A1_D5356.tif" /><img file="US2022121884A1_D5357.tif" /><img file="US2022121884A1_D5358.tif" /><img file="US2022121884A1_D5359.tif" /><img file="US2022121884A1_D5360.tif" /><img file="US2022121884A1_D5361.tif" /><img file="US2022121884A1_D5362.tif" /><img file="US2022121884A1_D5363.tif" /><img file="US2022121884A1_D5364.tif" /><img file="US2022121884A1_D5365.tif" /><img file="US2022121884A1_D5366.tif" /><img file="US2022121884A1_D5367.tif" /><img file="US2022121884A1_D5368.tif" /><img file="US2022121884A1_D5369.tif" /><img file="US2022121884A1_D5370.tif" /><img file="US2022121884A1_D5371.tif" /><img file="US2022121884A1_D5372.tif" /><img file="US2022121884A1_D5373.tif" /><img file="US2022121884A1_D5374.tif" /><img file="US2022121884A1_D5375.tif" /><img file="US2022121884A1_D5376.tif" />
Using this expression, the probability measure of A<sub>Z </sub>may be expressed as:
<maths id="MATH-US-00019" num="00019"><math overflow="scroll"><mrow><mrow><msub><mi>B</mi><mi>Z</mi></msub><mo>=</mo><mrow><msubsup><mo>∫</mo><mi>R</mi><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></msubsup><mo></mo><mrow><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>Z</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>p</mi><mi>Z</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow></mrow><mo>,</mo><mstyle><mtext></mtext></mstyle><mo></mo><mi>where</mi></mrow></math></maths><img file="US2022121884A1_D5377.tif" /><img file="US2022121884A1_D5378.tif" /><img file="US2022121884A1_D5379.tif" /><img file="US2022121884A1_D5380.tif" /><img file="US2022121884A1_D5381.tif" /><img file="US2022121884A1_D5382.tif" /><img file="US2022121884A1_D5383.tif" /><img file="US2022121884A1_D5384.tif" /><img file="US2022121884A1_D5385.tif" /><img file="US2022121884A1_D5386.tif" /><img file="US2022121884A1_D5387.tif" /><img file="US2022121884A1_D5388.tif" /><img file="US2022121884A1_D5389.tif" /><img file="US2022121884A1_D5390.tif" /><img file="US2022121884A1_D5391.tif" /><img file="US2022121884A1_D5392.tif" /><img file="US2022121884A1_D5393.tif" /><img file="US2022121884A1_D5394.tif" /><img file="US2022121884A1_D5395.tif" /><img file="US2022121884A1_D5396.tif" /><img file="US2022121884A1_D5397.tif" /><img file="US2022121884A1_D5398.tif" /><img file="US2022121884A1_D5399.tif" /><img file="US2022121884A1_D5400.tif" /><img file="US2022121884A1_D5401.tif" /><img file="US2022121884A1_D5402.tif" /><img file="US2022121884A1_D5403.tif" /><img file="US2022121884A1_D5404.tif" /><img file="US2022121884A1_D5405.tif" /><img file="US2022121884A1_D5406.tif" /><img file="US2022121884A1_D5407.tif" /><img file="US2022121884A1_D5408.tif" /><img file="US2022121884A1_D5409.tif" /><img file="US2022121884A1_D5410.tif" /><img file="US2022121884A1_D5411.tif" /><img file="US2022121884A1_D5412.tif" /><img file="US2022121884A1_D5413.tif" /><img file="US2022121884A1_D5414.tif" /><img file="US2022121884A1_D5415.tif" /><img file="US2022121884A1_D5416.tif" /><img file="US2022121884A1_D5417.tif" /><img file="US2022121884A1_D5418.tif" /><img file="US2022121884A1_D5419.tif" /><img file="US2022121884A1_D5420.tif" /><img file="US2022121884A1_D5421.tif" /><img file="US2022121884A1_D5422.tif" /><img file="US2022121884A1_D5423.tif" /><img file="US2022121884A1_D5424.tif" /><img file="US2022121884A1_D5425.tif" /><img file="US2022121884A1_D5426.tif" /><img file="US2022121884A1_D5427.tif" /><img file="US2022121884A1_D5428.tif" /><img file="US2022121884A1_D5429.tif" /><img file="US2022121884A1_D5430.tif" /><img file="US2022121884A1_D5431.tif" /><img file="US2022121884A1_D5432.tif" /><img file="US2022121884A1_D5433.tif" /><img file="US2022121884A1_D5434.tif" /><img file="US2022121884A1_D5435.tif" /><img file="US2022121884A1_D5436.tif" /><img file="US2022121884A1_D5437.tif" /><img file="US2022121884A1_D5438.tif" /><img file="US2022121884A1_D5439.tif" /><img file="US2022121884A1_D5440.tif" /><img file="US2022121884A1_D5441.tif" /><img file="US2022121884A1_D5442.tif" /><img file="US2022121884A1_D5443.tif" /><img file="US2022121884A1_D5444.tif" /><img file="US2022121884A1_D5445.tif" /><img file="US2022121884A1_D5446.tif" /><img file="US2022121884A1_D5447.tif" /><img file="US2022121884A1_D5448.tif" /><img file="US2022121884A1_D5449.tif" /><img file="US2022121884A1_D5450.tif" /><img file="US2022121884A1_D5451.tif" /><img file="US2022121884A1_D5452.tif" /><img file="US2022121884A1_D5453.tif" /><img file="US2022121884A1_D5454.tif" /><img file="US2022121884A1_D5455.tif" /><img file="US2022121884A1_D5456.tif" /><img file="US2022121884A1_D5457.tif" /><img file="US2022121884A1_D5458.tif" /><img file="US2022121884A1_D5459.tif" /><img file="US2022121884A1_D5460.tif" /><img file="US2022121884A1_D5461.tif" /><img file="US2022121884A1_D5462.tif" /><img file="US2022121884A1_D5463.tif" /><img file="US2022121884A1_D5464.tif" /><img file="US2022121884A1_D5465.tif" /><img file="US2022121884A1_D5466.tif" /><img file="US2022121884A1_D5467.tif" /><img file="US2022121884A1_D5468.tif" /><img file="US2022121884A1_D5469.tif" /><img file="US2022121884A1_D5470.tif" /><img file="US2022121884A1_D5471.tif" /><img file="US2022121884A1_D5472.tif" /><img file="US2022121884A1_D5473.tif" /><img file="US2022121884A1_D5474.tif" /><img file="US2022121884A1_D5475.tif" /><img file="US2022121884A1_D5476.tif" /><img file="US2022121884A1_D5477.tif" /><img file="US2022121884A1_D5478.tif" /><img file="US2022121884A1_D5479.tif" /><img file="US2022121884A1_D5480.tif" /><img file="US2022121884A1_D5481.tif" /><img file="US2022121884A1_D5482.tif" /><img file="US2022121884A1_D5483.tif" /><img file="US2022121884A1_D5484.tif" /><img file="US2022121884A1_D5485.tif" /><img file="US2022121884A1_D5486.tif" /><img file="US2022121884A1_D5487.tif" /><img file="US2022121884A1_D5488.tif" /><maths id="MATH-US-00019-2" num="00019.2"><math overflow="scroll"><mrow><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>Z</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><msub><mi>sup</mi><mi>v</mi></msub><mo></mo><mrow><mo>(</mo><mrow><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>X</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>v</mi><mo>)</mo></mrow></mrow><mo>⋀</mo><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>Y</mi></msub></msub><mo></mo><mrow><mo>(</mo><mrow><mi>u</mi><mo>-</mo><mi>v</mi></mrow><mo>)</mo></mrow></mrow></mrow><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D5489.tif" /><img file="US2022121884A1_D5490.tif" /><img file="US2022121884A1_D5491.tif" /><img file="US2022121884A1_D5492.tif" /><img file="US2022121884A1_D5493.tif" /><img file="US2022121884A1_D5494.tif" /><img file="US2022121884A1_D5495.tif" /><img file="US2022121884A1_D5496.tif" /><img file="US2022121884A1_D5497.tif" /><img file="US2022121884A1_D5498.tif" /><img file="US2022121884A1_D5499.tif" /><img file="US2022121884A1_D5500.tif" /><img file="US2022121884A1_D5501.tif" /><img file="US2022121884A1_D5502.tif" /><img file="US2022121884A1_D5503.tif" /><img file="US2022121884A1_D5504.tif" /><img file="US2022121884A1_D5505.tif" /><img file="US2022121884A1_D5506.tif" /><img file="US2022121884A1_D5507.tif" /><img file="US2022121884A1_D5508.tif" /><img file="US2022121884A1_D5509.tif" /><img file="US2022121884A1_D5510.tif" /><img file="US2022121884A1_D5511.tif" /><img file="US2022121884A1_D5512.tif" /><img file="US2022121884A1_D5513.tif" /><img file="US2022121884A1_D5514.tif" /><img file="US2022121884A1_D5515.tif" /><img file="US2022121884A1_D5516.tif" /><img file="US2022121884A1_D5517.tif" /><img file="US2022121884A1_D5518.tif" /><img file="US2022121884A1_D5519.tif" /><img file="US2022121884A1_D5520.tif" /><img file="US2022121884A1_D5521.tif" /><img file="US2022121884A1_D5522.tif" /><img file="US2022121884A1_D5523.tif" /><img file="US2022121884A1_D5524.tif" /><img file="US2022121884A1_D5525.tif" /><img file="US2022121884A1_D5526.tif" /><img file="US2022121884A1_D5527.tif" /><img file="US2022121884A1_D5528.tif" /><img file="US2022121884A1_D5529.tif" /><img file="US2022121884A1_D5530.tif" /><img file="US2022121884A1_D5531.tif" /><img file="US2022121884A1_D5532.tif" /><img file="US2022121884A1_D5533.tif" /><img file="US2022121884A1_D5534.tif" /><img file="US2022121884A1_D5535.tif" /><img file="US2022121884A1_D5536.tif" /><img file="US2022121884A1_D5537.tif" /><img file="US2022121884A1_D5538.tif" /><img file="US2022121884A1_D5539.tif" /><img file="US2022121884A1_D5540.tif" /><img file="US2022121884A1_D5541.tif" /><img file="US2022121884A1_D5542.tif" /><img file="US2022121884A1_D5543.tif" /><img file="US2022121884A1_D5544.tif" /><img file="US2022121884A1_D5545.tif" /><img file="US2022121884A1_D5546.tif" /><img file="US2022121884A1_D5547.tif" /><img file="US2022121884A1_D5548.tif" /><img file="US2022121884A1_D5549.tif" /><img file="US2022121884A1_D5550.tif" /><img file="US2022121884A1_D5551.tif" /><img file="US2022121884A1_D5552.tif" /><img file="US2022121884A1_D5553.tif" /><img file="US2022121884A1_D5554.tif" /><img file="US2022121884A1_D5555.tif" /><img file="US2022121884A1_D5556.tif" /><img file="US2022121884A1_D5557.tif" /><img file="US2022121884A1_D5558.tif" /><img file="US2022121884A1_D5559.tif" /><img file="US2022121884A1_D5560.tif" /><img file="US2022121884A1_D5561.tif" /><img file="US2022121884A1_D5562.tif" /><img file="US2022121884A1_D5563.tif" /><img file="US2022121884A1_D5564.tif" /><img file="US2022121884A1_D5565.tif" /><img file="US2022121884A1_D5566.tif" /><img file="US2022121884A1_D5567.tif" /><img file="US2022121884A1_D5568.tif" /><img file="US2022121884A1_D5569.tif" /><img file="US2022121884A1_D5570.tif" /><img file="US2022121884A1_D5571.tif" /><img file="US2022121884A1_D5572.tif" /><img file="US2022121884A1_D5573.tif" /><img file="US2022121884A1_D5574.tif" /><img file="US2022121884A1_D5575.tif" /><img file="US2022121884A1_D5576.tif" /><img file="US2022121884A1_D5577.tif" /><img file="US2022121884A1_D5578.tif" /><img file="US2022121884A1_D5579.tif" /><img file="US2022121884A1_D5580.tif" /><img file="US2022121884A1_D5581.tif" /><img file="US2022121884A1_D5582.tif" /><img file="US2022121884A1_D5583.tif" /><img file="US2022121884A1_D5584.tif" /><img file="US2022121884A1_D5585.tif" /><img file="US2022121884A1_D5586.tif" /><img file="US2022121884A1_D5587.tif" /><img file="US2022121884A1_D5588.tif" /><img file="US2022121884A1_D5589.tif" /><img file="US2022121884A1_D5590.tif" /><img file="US2022121884A1_D5591.tif" /><img file="US2022121884A1_D5592.tif" /><img file="US2022121884A1_D5593.tif" /><img file="US2022121884A1_D5594.tif" /><img file="US2022121884A1_D5595.tif" /><img file="US2022121884A1_D5596.tif" /><img file="US2022121884A1_D5597.tif" /><img file="US2022121884A1_D5598.tif" /><img file="US2022121884A1_D5599.tif" /><img file="US2022121884A1_D5600.tif" />
It should be noted that B<sub>Z </sub>is a number when p<sub>Z </sub>is a known probability density function. Since <b>3</b>what we know about p<sub>Z </sub>is its possibility distribution, μ<sub>p</sub><sub><sub2>Z</sub2></sub>(pz), B<sub>Z </sub>is a fuzzy set with membership function μ<sub>B</sub><sub><sub2>Z</sub2></sub>. Applying the extension principle, we arrive at an expression for μ<sub>B</sub><sub><sub2>Z</sub2></sub>. More specifically,
<maths id="MATH-US-00020" num="00020"><math overflow="scroll"><mrow><mrow><msub><mi>μ</mi><msub><mi>B</mi><mi>Z</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>ω</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><msub><mi>sup</mi><msub><mi>p</mi><mi>Z</mi></msub></msub><mo></mo><mrow><msub><mi>μ</mi><msub><mi>p</mi><mi>Z</mi></msub></msub><mo></mo><mrow><mo>(</mo><msub><mi>p</mi><mi>Z</mi></msub><mo>)</mo></mrow></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D5601.tif" /><img file="US2022121884A1_D5602.tif" /><img file="US2022121884A1_D5603.tif" /><img file="US2022121884A1_D5604.tif" /><img file="US2022121884A1_D5605.tif" /><img file="US2022121884A1_D5606.tif" /><img file="US2022121884A1_D5607.tif" /><img file="US2022121884A1_D5608.tif" /><img file="US2022121884A1_D5609.tif" /><img file="US2022121884A1_D5610.tif" /><img file="US2022121884A1_D5611.tif" /><img file="US2022121884A1_D5612.tif" /><img file="US2022121884A1_D5613.tif" /><img file="US2022121884A1_D5614.tif" /><img file="US2022121884A1_D5615.tif" /><img file="US2022121884A1_D5616.tif" /><img file="US2022121884A1_D5617.tif" /><img file="US2022121884A1_D5618.tif" /><img file="US2022121884A1_D5619.tif" /><img file="US2022121884A1_D5620.tif" /><img file="US2022121884A1_D5621.tif" /><img file="US2022121884A1_D5622.tif" /><img file="US2022121884A1_D5623.tif" /><img file="US2022121884A1_D5624.tif" /><img file="US2022121884A1_D5625.tif" /><img file="US2022121884A1_D5626.tif" /><img file="US2022121884A1_D5627.tif" /><img file="US2022121884A1_D5628.tif" /><img file="US2022121884A1_D5629.tif" /><img file="US2022121884A1_D5630.tif" /><img file="US2022121884A1_D5631.tif" /><img file="US2022121884A1_D5632.tif" /><img file="US2022121884A1_D5633.tif" /><img file="US2022121884A1_D5634.tif" /><img file="US2022121884A1_D5635.tif" /><img file="US2022121884A1_D5636.tif" /><img file="US2022121884A1_D5637.tif" /><img file="US2022121884A1_D5638.tif" /><img file="US2022121884A1_D5639.tif" /><img file="US2022121884A1_D5640.tif" /><img file="US2022121884A1_D5641.tif" /><img file="US2022121884A1_D5642.tif" /><img file="US2022121884A1_D5643.tif" /><img file="US2022121884A1_D5644.tif" /><img file="US2022121884A1_D5645.tif" /><img file="US2022121884A1_D5646.tif" /><img file="US2022121884A1_D5647.tif" /><img file="US2022121884A1_D5648.tif" /><img file="US2022121884A1_D5649.tif" /><img file="US2022121884A1_D5650.tif" /><img file="US2022121884A1_D5651.tif" /><img file="US2022121884A1_D5652.tif" /><img file="US2022121884A1_D5653.tif" /><img file="US2022121884A1_D5654.tif" /><img file="US2022121884A1_D5655.tif" /><img file="US2022121884A1_D5656.tif" /><img file="US2022121884A1_D5657.tif" /><img file="US2022121884A1_D5658.tif" /><img file="US2022121884A1_D5659.tif" /><img file="US2022121884A1_D5660.tif" /><img file="US2022121884A1_D5661.tif" /><img file="US2022121884A1_D5662.tif" /><img file="US2022121884A1_D5663.tif" /><img file="US2022121884A1_D5664.tif" /><img file="US2022121884A1_D5665.tif" /><img file="US2022121884A1_D5666.tif" /><img file="US2022121884A1_D5667.tif" /><img file="US2022121884A1_D5668.tif" /><img file="US2022121884A1_D5669.tif" /><img file="US2022121884A1_D5670.tif" /><img file="US2022121884A1_D5671.tif" /><img file="US2022121884A1_D5672.tif" /><img file="US2022121884A1_D5673.tif" /><img file="US2022121884A1_D5674.tif" /><img file="US2022121884A1_D5675.tif" /><img file="US2022121884A1_D5676.tif" /><img file="US2022121884A1_D5677.tif" /><img file="US2022121884A1_D5678.tif" /><img file="US2022121884A1_D5679.tif" /><img file="US2022121884A1_D5680.tif" /><img file="US2022121884A1_D5681.tif" /><img file="US2022121884A1_D5682.tif" /><img file="US2022121884A1_D5683.tif" /><img file="US2022121884A1_D5684.tif" /><img file="US2022121884A1_D5685.tif" /><img file="US2022121884A1_D5686.tif" /><img file="US2022121884A1_D5687.tif" /><img file="US2022121884A1_D5688.tif" /><img file="US2022121884A1_D5689.tif" /><img file="US2022121884A1_D5690.tif" /><img file="US2022121884A1_D5691.tif" /><img file="US2022121884A1_D5692.tif" /><img file="US2022121884A1_D5693.tif" /><img file="US2022121884A1_D5694.tif" /><img file="US2022121884A1_D5695.tif" /><img file="US2022121884A1_D5696.tif" /><img file="US2022121884A1_D5697.tif" /><img file="US2022121884A1_D5698.tif" /><img file="US2022121884A1_D5699.tif" /><img file="US2022121884A1_D5700.tif" /><img file="US2022121884A1_D5701.tif" /><img file="US2022121884A1_D5702.tif" /><img file="US2022121884A1_D5703.tif" /><img file="US2022121884A1_D5704.tif" /><img file="US2022121884A1_D5705.tif" /><img file="US2022121884A1_D5706.tif" /><img file="US2022121884A1_D5707.tif" /><img file="US2022121884A1_D5708.tif" /><img file="US2022121884A1_D5709.tif" /><img file="US2022121884A1_D5710.tif" /><img file="US2022121884A1_D5711.tif" /><img file="US2022121884A1_D5712.tif" /><maths id="MATH-US-00020-2" num="00020.2"><math overflow="scroll"><mrow><mi>subject</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>to</mi></mrow></math></maths><img file="US2022121884A1_D5713.tif" /><img file="US2022121884A1_D5714.tif" /><img file="US2022121884A1_D5715.tif" /><img file="US2022121884A1_D5716.tif" /><img file="US2022121884A1_D5717.tif" /><img file="US2022121884A1_D5718.tif" /><img file="US2022121884A1_D5719.tif" /><img file="US2022121884A1_D5720.tif" /><img file="US2022121884A1_D5721.tif" /><img file="US2022121884A1_D5722.tif" /><img file="US2022121884A1_D5723.tif" /><img file="US2022121884A1_D5724.tif" /><img file="US2022121884A1_D5725.tif" /><img file="US2022121884A1_D5726.tif" /><img file="US2022121884A1_D5727.tif" /><img file="US2022121884A1_D5728.tif" /><img file="US2022121884A1_D5729.tif" /><img file="US2022121884A1_D5730.tif" /><img file="US2022121884A1_D5731.tif" /><img file="US2022121884A1_D5732.tif" /><img file="US2022121884A1_D5733.tif" /><img file="US2022121884A1_D5734.tif" /><img file="US2022121884A1_D5735.tif" /><img file="US2022121884A1_D5736.tif" /><img file="US2022121884A1_D5737.tif" /><img file="US2022121884A1_D5738.tif" /><img file="US2022121884A1_D5739.tif" /><img file="US2022121884A1_D5740.tif" /><img file="US2022121884A1_D5741.tif" /><img file="US2022121884A1_D5742.tif" /><img file="US2022121884A1_D5743.tif" /><img file="US2022121884A1_D5744.tif" /><img file="US2022121884A1_D5745.tif" /><img file="US2022121884A1_D5746.tif" /><img file="US2022121884A1_D5747.tif" /><img file="US2022121884A1_D5748.tif" /><img file="US2022121884A1_D5749.tif" /><img file="US2022121884A1_D5750.tif" /><img file="US2022121884A1_D5751.tif" /><img file="US2022121884A1_D5752.tif" /><img file="US2022121884A1_D5753.tif" /><img file="US2022121884A1_D5754.tif" /><img file="US2022121884A1_D5755.tif" /><img file="US2022121884A1_D5756.tif" /><img file="US2022121884A1_D5757.tif" /><img file="US2022121884A1_D5758.tif" /><img file="US2022121884A1_D5759.tif" /><img file="US2022121884A1_D5760.tif" /><img file="US2022121884A1_D5761.tif" /><img file="US2022121884A1_D5762.tif" /><img file="US2022121884A1_D5763.tif" /><img file="US2022121884A1_D5764.tif" /><img file="US2022121884A1_D5765.tif" /><img file="US2022121884A1_D5766.tif" /><img file="US2022121884A1_D5767.tif" /><img file="US2022121884A1_D5768.tif" /><img file="US2022121884A1_D5769.tif" /><img file="US2022121884A1_D5770.tif" /><img file="US2022121884A1_D5771.tif" /><img file="US2022121884A1_D5772.tif" /><img file="US2022121884A1_D5773.tif" /><img file="US2022121884A1_D5774.tif" /><img file="US2022121884A1_D5775.tif" /><img file="US2022121884A1_D5776.tif" /><img file="US2022121884A1_D5777.tif" /><img file="US2022121884A1_D5778.tif" /><img file="US2022121884A1_D5779.tif" /><img file="US2022121884A1_D5780.tif" /><img file="US2022121884A1_D5781.tif" /><img file="US2022121884A1_D5782.tif" /><img file="US2022121884A1_D5783.tif" /><img file="US2022121884A1_D5784.tif" /><img file="US2022121884A1_D5785.tif" /><img file="US2022121884A1_D5786.tif" /><img file="US2022121884A1_D5787.tif" /><img file="US2022121884A1_D5788.tif" /><img file="US2022121884A1_D5789.tif" /><img file="US2022121884A1_D5790.tif" /><img file="US2022121884A1_D5791.tif" /><img file="US2022121884A1_D5792.tif" /><img file="US2022121884A1_D5793.tif" /><img file="US2022121884A1_D5794.tif" /><img file="US2022121884A1_D5795.tif" /><img file="US2022121884A1_D5796.tif" /><img file="US2022121884A1_D5797.tif" /><img file="US2022121884A1_D5798.tif" /><img file="US2022121884A1_D5799.tif" /><img file="US2022121884A1_D5800.tif" /><img file="US2022121884A1_D5801.tif" /><img file="US2022121884A1_D5802.tif" /><img file="US2022121884A1_D5803.tif" /><img file="US2022121884A1_D5804.tif" /><img file="US2022121884A1_D5805.tif" /><img file="US2022121884A1_D5806.tif" /><img file="US2022121884A1_D5807.tif" /><img file="US2022121884A1_D5808.tif" /><img file="US2022121884A1_D5809.tif" /><img file="US2022121884A1_D5810.tif" /><img file="US2022121884A1_D5811.tif" /><img file="US2022121884A1_D5812.tif" /><img file="US2022121884A1_D5813.tif" /><img file="US2022121884A1_D5814.tif" /><img file="US2022121884A1_D5815.tif" /><img file="US2022121884A1_D5816.tif" /><img file="US2022121884A1_D5817.tif" /><img file="US2022121884A1_D5818.tif" /><img file="US2022121884A1_D5819.tif" /><img file="US2022121884A1_D5820.tif" /><img file="US2022121884A1_D5821.tif" /><img file="US2022121884A1_D5822.tif" /><img file="US2022121884A1_D5823.tif" /><img file="US2022121884A1_D5824.tif" /><maths id="MATH-US-00020-3" num="00020.3"><math overflow="scroll"><mrow><mi>w</mi><mo>=</mo><mrow><msubsup><mo>∫</mo><mi>R</mi><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></msubsup><mo></mo><mrow><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>Z</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>p</mi><mi>Z</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D5825.tif" /><img file="US2022121884A1_D5826.tif" /><img file="US2022121884A1_D5827.tif" /><img file="US2022121884A1_D5828.tif" /><img file="US2022121884A1_D5829.tif" /><img file="US2022121884A1_D5830.tif" /><img file="US2022121884A1_D5831.tif" /><img file="US2022121884A1_D5832.tif" /><img file="US2022121884A1_D5833.tif" /><img file="US2022121884A1_D5834.tif" /><img file="US2022121884A1_D5835.tif" /><img file="US2022121884A1_D5836.tif" /><img file="US2022121884A1_D5837.tif" /><img file="US2022121884A1_D5838.tif" /><img file="US2022121884A1_D5839.tif" /><img file="US2022121884A1_D5840.tif" /><img file="US2022121884A1_D5841.tif" /><img file="US2022121884A1_D5842.tif" /><img file="US2022121884A1_D5843.tif" /><img file="US2022121884A1_D5844.tif" /><img file="US2022121884A1_D5845.tif" /><img file="US2022121884A1_D5846.tif" /><img file="US2022121884A1_D5847.tif" /><img file="US2022121884A1_D5848.tif" /><img file="US2022121884A1_D5849.tif" /><img file="US2022121884A1_D5850.tif" /><img file="US2022121884A1_D5851.tif" /><img file="US2022121884A1_D5852.tif" /><img file="US2022121884A1_D5853.tif" /><img file="US2022121884A1_D5854.tif" /><img file="US2022121884A1_D5855.tif" /><img file="US2022121884A1_D5856.tif" /><img file="US2022121884A1_D5857.tif" /><img file="US2022121884A1_D5858.tif" /><img file="US2022121884A1_D5859.tif" /><img file="US2022121884A1_D5860.tif" /><img file="US2022121884A1_D5861.tif" /><img file="US2022121884A1_D5862.tif" /><img file="US2022121884A1_D5863.tif" /><img file="US2022121884A1_D5864.tif" /><img file="US2022121884A1_D5865.tif" /><img file="US2022121884A1_D5866.tif" /><img file="US2022121884A1_D5867.tif" /><img file="US2022121884A1_D5868.tif" /><img file="US2022121884A1_D5869.tif" /><img file="US2022121884A1_D5870.tif" /><img file="US2022121884A1_D5871.tif" /><img file="US2022121884A1_D5872.tif" /><img file="US2022121884A1_D5873.tif" /><img file="US2022121884A1_D5874.tif" /><img file="US2022121884A1_D5875.tif" /><img file="US2022121884A1_D5876.tif" /><img file="US2022121884A1_D5877.tif" /><img file="US2022121884A1_D5878.tif" /><img file="US2022121884A1_D5879.tif" /><img file="US2022121884A1_D5880.tif" /><img file="US2022121884A1_D5881.tif" /><img file="US2022121884A1_D5882.tif" /><img file="US2022121884A1_D5883.tif" /><img file="US2022121884A1_D5884.tif" /><img file="US2022121884A1_D5885.tif" /><img file="US2022121884A1_D5886.tif" /><img file="US2022121884A1_D5887.tif" /><img file="US2022121884A1_D5888.tif" /><img file="US2022121884A1_D5889.tif" /><img file="US2022121884A1_D5890.tif" /><img file="US2022121884A1_D5891.tif" /><img file="US2022121884A1_D5892.tif" /><img file="US2022121884A1_D5893.tif" /><img file="US2022121884A1_D5894.tif" /><img file="US2022121884A1_D5895.tif" /><img file="US2022121884A1_D5896.tif" /><img file="US2022121884A1_D5897.tif" /><img file="US2022121884A1_D5898.tif" /><img file="US2022121884A1_D5899.tif" /><img file="US2022121884A1_D5900.tif" /><img file="US2022121884A1_D5901.tif" /><img file="US2022121884A1_D5902.tif" /><img file="US2022121884A1_D5903.tif" /><img file="US2022121884A1_D5904.tif" /><img file="US2022121884A1_D5905.tif" /><img file="US2022121884A1_D5906.tif" /><img file="US2022121884A1_D5907.tif" /><img file="US2022121884A1_D5908.tif" /><img file="US2022121884A1_D5909.tif" /><img file="US2022121884A1_D5910.tif" /><img file="US2022121884A1_D5911.tif" /><img file="US2022121884A1_D5912.tif" /><img file="US2022121884A1_D5913.tif" /><img file="US2022121884A1_D5914.tif" /><img file="US2022121884A1_D5915.tif" /><img file="US2022121884A1_D5916.tif" /><img file="US2022121884A1_D5917.tif" /><img file="US2022121884A1_D5918.tif" /><img file="US2022121884A1_D5919.tif" /><img file="US2022121884A1_D5920.tif" /><img file="US2022121884A1_D5921.tif" /><img file="US2022121884A1_D5922.tif" /><img file="US2022121884A1_D5923.tif" /><img file="US2022121884A1_D5924.tif" /><img file="US2022121884A1_D5925.tif" /><img file="US2022121884A1_D5926.tif" /><img file="US2022121884A1_D5927.tif" /><img file="US2022121884A1_D5928.tif" /><img file="US2022121884A1_D5929.tif" /><img file="US2022121884A1_D5930.tif" /><img file="US2022121884A1_D5931.tif" /><img file="US2022121884A1_D5932.tif" /><img file="US2022121884A1_D5933.tif" /><img file="US2022121884A1_D5934.tif" /><img file="US2022121884A1_D5935.tif" /><img file="US2022121884A1_D5936.tif" />
where μ<sub>p</sub><sub><sub2>Z</sub2></sub>(pz) is the result of the first step. In principle, this completes computation of the sum of Z-numbers, Z<sub>X</sub>and Z<sub>Y</sub>.
In a similar way, we can compute various functions of Z-numbers. The basic idea which underlies these computations may be summarized as follows, Suppose that our problem is that of computing f(Z<sub>X</sub>, Z<sub>Y</sub>), where Z<sub>X</sub>and Z<sub>Y </sub>are Z-numbers, Z<sub>X</sub>=(A<sub>X</sub>, B<sub>X</sub>) and Z<sub>Y</sub>=(A<sub>Y</sub>, B<sub>Y</sub>), respectively, and f(Z<sub>X</sub>, Z<sub>Y</sub>)=(A<sub>Z</sub>, B<sub>Z</sub>). We begin by assuming that the underlying probability distributions p<sub>X </sub>and p<sub>Y </sub>are known. This assumption reduces the computation of f(Z<sub>X</sub>, Z<sub>Y</sub>) to computation of f(Z<sub>X</sub><sup>+</sup>, Z<sub>Y</sub><sup>+</sup>), which can be carried out through the use of the version of the extension principle which applies to restrictions which are Z<sup>+</sup>-numbers. At this point, we recognize that what we know are not p<sub>X </sub>and p<sub>Y </sub>but restrictions on p<sub>X </sub>and p<sub>Y</sub>. Applying the version of the extension principle which relates to probabilistic restrictions, we are led to f(Z<sub>X</sub>, Z<sub>Y</sub>). We can compute the restriction, B<sub>Z</sub>, of the scalar product of f(A<sub>X</sub>, A<sub>Y</sub>) and f(p<sub>X</sub>, p<sub>Y</sub>). Since A<sub>Z</sub>=f(A<sub>X</sub>, A<sub>Y</sub>), computation of B<sub>Z </sub>completes the computation of f(Z<sub>X</sub>, Z<sub>Y</sub>).
It is helpful to express the summary as a version of the extension principle. More concretely, we can write:
<maths id="MATH-US-00021" num="00021"><math overflow="scroll"><mrow><mstyle><mspace width="1.1em" height="1.1ex" /></mstyle><mo></mo><mrow><mi>Z</mi><mo>=</mo><mrow><mi>f</mi><mo></mo><mrow><mo>(</mo><mrow><mi>X</mi><mo>,</mo><mi>Y</mi></mrow><mo>)</mo></mrow></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D5937.tif" /><img file="US2022121884A1_D5938.tif" /><img file="US2022121884A1_D5939.tif" /><img file="US2022121884A1_D5940.tif" /><img file="US2022121884A1_D5941.tif" /><img file="US2022121884A1_D5942.tif" /><img file="US2022121884A1_D5943.tif" /><img file="US2022121884A1_D5944.tif" /><img file="US2022121884A1_D5945.tif" /><img file="US2022121884A1_D5946.tif" /><img file="US2022121884A1_D5947.tif" /><img file="US2022121884A1_D5948.tif" /><img file="US2022121884A1_D5949.tif" /><img file="US2022121884A1_D5950.tif" /><img file="US2022121884A1_D5951.tif" /><img file="US2022121884A1_D5952.tif" /><img file="US2022121884A1_D5953.tif" /><img file="US2022121884A1_D5954.tif" /><img file="US2022121884A1_D5955.tif" /><img file="US2022121884A1_D5956.tif" /><img file="US2022121884A1_D5957.tif" /><img file="US2022121884A1_D5958.tif" /><img file="US2022121884A1_D5959.tif" /><img file="US2022121884A1_D5960.tif" /><img file="US2022121884A1_D5961.tif" /><img file="US2022121884A1_D5962.tif" /><img file="US2022121884A1_D5963.tif" /><img file="US2022121884A1_D5964.tif" /><img file="US2022121884A1_D5965.tif" /><img file="US2022121884A1_D5966.tif" /><img file="US2022121884A1_D5967.tif" /><img file="US2022121884A1_D5968.tif" /><img file="US2022121884A1_D5969.tif" /><img file="US2022121884A1_D5970.tif" /><img file="US2022121884A1_D5971.tif" /><img file="US2022121884A1_D5972.tif" /><img file="US2022121884A1_D5973.tif" /><img file="US2022121884A1_D5974.tif" /><img file="US2022121884A1_D5975.tif" /><img file="US2022121884A1_D5976.tif" /><img file="US2022121884A1_D5977.tif" /><img file="US2022121884A1_D5978.tif" /><img file="US2022121884A1_D5979.tif" /><img file="US2022121884A1_D5980.tif" /><img file="US2022121884A1_D5981.tif" /><img file="US2022121884A1_D5982.tif" /><img file="US2022121884A1_D5983.tif" /><img file="US2022121884A1_D5984.tif" /><img file="US2022121884A1_D5985.tif" /><img file="US2022121884A1_D5986.tif" /><img file="US2022121884A1_D5987.tif" /><img file="US2022121884A1_D5988.tif" /><img file="US2022121884A1_D5989.tif" /><img file="US2022121884A1_D5990.tif" /><img file="US2022121884A1_D5991.tif" /><img file="US2022121884A1_D5992.tif" /><img file="US2022121884A1_D5993.tif" /><img file="US2022121884A1_D5994.tif" /><img file="US2022121884A1_D5995.tif" /><img file="US2022121884A1_D5996.tif" /><img file="US2022121884A1_D5997.tif" /><img file="US2022121884A1_D5998.tif" /><img file="US2022121884A1_D5999.tif" /><img file="US2022121884A1_D6000.tif" /><img file="US2022121884A1_D6001.tif" /><img file="US2022121884A1_D6002.tif" /><img file="US2022121884A1_D6003.tif" /><img file="US2022121884A1_D6004.tif" /><img file="US2022121884A1_D6005.tif" /><img file="US2022121884A1_D6006.tif" /><img file="US2022121884A1_D6007.tif" /><img file="US2022121884A1_D6008.tif" /><img file="US2022121884A1_D6009.tif" /><img file="US2022121884A1_D6010.tif" /><img file="US2022121884A1_D6011.tif" /><img file="US2022121884A1_D6012.tif" /><img file="US2022121884A1_D6013.tif" /><img file="US2022121884A1_D6014.tif" /><img file="US2022121884A1_D6015.tif" /><img file="US2022121884A1_D6016.tif" /><img file="US2022121884A1_D6017.tif" /><img file="US2022121884A1_D6018.tif" /><img file="US2022121884A1_D6019.tif" /><img file="US2022121884A1_D6020.tif" /><img file="US2022121884A1_D6021.tif" /><img file="US2022121884A1_D6022.tif" /><img file="US2022121884A1_D6023.tif" /><img file="US2022121884A1_D6024.tif" /><img file="US2022121884A1_D6025.tif" /><img file="US2022121884A1_D6026.tif" /><img file="US2022121884A1_D6027.tif" /><img file="US2022121884A1_D6028.tif" /><img file="US2022121884A1_D6029.tif" /><img file="US2022121884A1_D6030.tif" /><img file="US2022121884A1_D6031.tif" /><img file="US2022121884A1_D6032.tif" /><img file="US2022121884A1_D6033.tif" /><img file="US2022121884A1_D6034.tif" /><img file="US2022121884A1_D6035.tif" /><img file="US2022121884A1_D6036.tif" /><img file="US2022121884A1_D6037.tif" /><img file="US2022121884A1_D6038.tif" /><img file="US2022121884A1_D6039.tif" /><img file="US2022121884A1_D6040.tif" /><img file="US2022121884A1_D6041.tif" /><img file="US2022121884A1_D6042.tif" /><img file="US2022121884A1_D6043.tif" /><img file="US2022121884A1_D6044.tif" /><img file="US2022121884A1_D6045.tif" /><img file="US2022121884A1_D6046.tif" /><img file="US2022121884A1_D6047.tif" /><img file="US2022121884A1_D6048.tif" /><maths id="MATH-US-00021-2" num="00021.2"><math overflow="scroll"><mrow><mstyle><mspace width="1.1em" height="1.1ex" /></mstyle><mo></mo><mrow><mi>X</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>is</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mrow><mo>(</mo><mrow><msub><mi>A</mi><mi>X</mi></msub><mo>,</mo><msub><mi>B</mi><mi>X</mi></msub></mrow><mo>)</mo></mrow><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mrow><mo>(</mo><mrow><mi>restriction</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>on</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>X</mi></mrow><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D6049.tif" /><img file="US2022121884A1_D6050.tif" /><img file="US2022121884A1_D6051.tif" /><img file="US2022121884A1_D6052.tif" /><img file="US2022121884A1_D6053.tif" /><img file="US2022121884A1_D6054.tif" /><img file="US2022121884A1_D6055.tif" /><img file="US2022121884A1_D6056.tif" /><img file="US2022121884A1_D6057.tif" /><img file="US2022121884A1_D6058.tif" /><img file="US2022121884A1_D6059.tif" /><img file="US2022121884A1_D6060.tif" /><img file="US2022121884A1_D6061.tif" /><img file="US2022121884A1_D6062.tif" /><img file="US2022121884A1_D6063.tif" /><img file="US2022121884A1_D6064.tif" /><img file="US2022121884A1_D6065.tif" /><img file="US2022121884A1_D6066.tif" /><img file="US2022121884A1_D6067.tif" /><img file="US2022121884A1_D6068.tif" /><img file="US2022121884A1_D6069.tif" /><img file="US2022121884A1_D6070.tif" /><img file="US2022121884A1_D6071.tif" /><img file="US2022121884A1_D6072.tif" /><img file="US2022121884A1_D6073.tif" /><img file="US2022121884A1_D6074.tif" /><img file="US2022121884A1_D6075.tif" /><img file="US2022121884A1_D6076.tif" /><img file="US2022121884A1_D6077.tif" /><img file="US2022121884A1_D6078.tif" /><img file="US2022121884A1_D6079.tif" /><img file="US2022121884A1_D6080.tif" /><img file="US2022121884A1_D6081.tif" /><img file="US2022121884A1_D6082.tif" /><img file="US2022121884A1_D6083.tif" /><img file="US2022121884A1_D6084.tif" /><img file="US2022121884A1_D6085.tif" /><img file="US2022121884A1_D6086.tif" /><img file="US2022121884A1_D6087.tif" /><img file="US2022121884A1_D6088.tif" /><img file="US2022121884A1_D6089.tif" /><img file="US2022121884A1_D6090.tif" /><img file="US2022121884A1_D6091.tif" /><img file="US2022121884A1_D6092.tif" /><img file="US2022121884A1_D6093.tif" /><img file="US2022121884A1_D6094.tif" /><img file="US2022121884A1_D6095.tif" /><img file="US2022121884A1_D6096.tif" /><img file="US2022121884A1_D6097.tif" /><img file="US2022121884A1_D6098.tif" /><img file="US2022121884A1_D6099.tif" /><img file="US2022121884A1_D6100.tif" /><img file="US2022121884A1_D6101.tif" /><img file="US2022121884A1_D6102.tif" /><img file="US2022121884A1_D6103.tif" /><img file="US2022121884A1_D6104.tif" /><img file="US2022121884A1_D6105.tif" /><img file="US2022121884A1_D6106.tif" /><img file="US2022121884A1_D6107.tif" /><img file="US2022121884A1_D6108.tif" /><img file="US2022121884A1_D6109.tif" /><img file="US2022121884A1_D6110.tif" /><img file="US2022121884A1_D6111.tif" /><img file="US2022121884A1_D6112.tif" /><img file="US2022121884A1_D6113.tif" /><img file="US2022121884A1_D6114.tif" /><img file="US2022121884A1_D6115.tif" /><img file="US2022121884A1_D6116.tif" /><img file="US2022121884A1_D6117.tif" /><img file="US2022121884A1_D6118.tif" /><img file="US2022121884A1_D6119.tif" /><img file="US2022121884A1_D6120.tif" /><img file="US2022121884A1_D6121.tif" /><img file="US2022121884A1_D6122.tif" /><img file="US2022121884A1_D6123.tif" /><img file="US2022121884A1_D6124.tif" /><img file="US2022121884A1_D6125.tif" /><img file="US2022121884A1_D6126.tif" /><img file="US2022121884A1_D6127.tif" /><img file="US2022121884A1_D6128.tif" /><img file="US2022121884A1_D6129.tif" /><img file="US2022121884A1_D6130.tif" /><img file="US2022121884A1_D6131.tif" /><img file="US2022121884A1_D6132.tif" /><img file="US2022121884A1_D6133.tif" /><img file="US2022121884A1_D6134.tif" /><img file="US2022121884A1_D6135.tif" /><img file="US2022121884A1_D6136.tif" /><img file="US2022121884A1_D6137.tif" /><img file="US2022121884A1_D6138.tif" /><img file="US2022121884A1_D6139.tif" /><img file="US2022121884A1_D6140.tif" /><img file="US2022121884A1_D6141.tif" /><img file="US2022121884A1_D6142.tif" /><img file="US2022121884A1_D6143.tif" /><img file="US2022121884A1_D6144.tif" /><img file="US2022121884A1_D6145.tif" /><img file="US2022121884A1_D6146.tif" /><img file="US2022121884A1_D6147.tif" /><img file="US2022121884A1_D6148.tif" /><img file="US2022121884A1_D6149.tif" /><img file="US2022121884A1_D6150.tif" /><img file="US2022121884A1_D6151.tif" /><img file="US2022121884A1_D6152.tif" /><img file="US2022121884A1_D6153.tif" /><img file="US2022121884A1_D6154.tif" /><img file="US2022121884A1_D6155.tif" /><img file="US2022121884A1_D6156.tif" /><img file="US2022121884A1_D6157.tif" /><img file="US2022121884A1_D6158.tif" /><img file="US2022121884A1_D6159.tif" /><img file="US2022121884A1_D6160.tif" /><maths id="MATH-US-00021-3" num="00021.3"><math overflow="scroll"><mrow><mstyle><mspace width="1.1em" height="1.1ex" /></mstyle><mo></mo><mrow><mi>Y</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>is</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mrow><mo>(</mo><mrow><msub><mi>A</mi><mi>Y</mi></msub><mo>,</mo><msub><mi>B</mi><mi>Y</mi></msub></mrow><mo>)</mo></mrow><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mrow><mo>(</mo><mrow><mi>restriction</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>on</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>Y</mi></mrow><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D6161.tif" /><img file="US2022121884A1_D6162.tif" /><img file="US2022121884A1_D6163.tif" /><img file="US2022121884A1_D6164.tif" /><img file="US2022121884A1_D6165.tif" /><img file="US2022121884A1_D6166.tif" /><img file="US2022121884A1_D6167.tif" /><img file="US2022121884A1_D6168.tif" /><img file="US2022121884A1_D6169.tif" /><img file="US2022121884A1_D6170.tif" /><img file="US2022121884A1_D6171.tif" /><img file="US2022121884A1_D6172.tif" /><img file="US2022121884A1_D6173.tif" /><img file="US2022121884A1_D6174.tif" /><img file="US2022121884A1_D6175.tif" /><img file="US2022121884A1_D6176.tif" /><img file="US2022121884A1_D6177.tif" /><img file="US2022121884A1_D6178.tif" /><img file="US2022121884A1_D6179.tif" /><img file="US2022121884A1_D6180.tif" /><img file="US2022121884A1_D6181.tif" /><img file="US2022121884A1_D6182.tif" /><img file="US2022121884A1_D6183.tif" /><img file="US2022121884A1_D6184.tif" /><img file="US2022121884A1_D6185.tif" /><img file="US2022121884A1_D6186.tif" /><img file="US2022121884A1_D6187.tif" /><img file="US2022121884A1_D6188.tif" /><img file="US2022121884A1_D6189.tif" /><img file="US2022121884A1_D6190.tif" /><img file="US2022121884A1_D6191.tif" /><img file="US2022121884A1_D6192.tif" /><img file="US2022121884A1_D6193.tif" /><img file="US2022121884A1_D6194.tif" /><img file="US2022121884A1_D6195.tif" /><img file="US2022121884A1_D6196.tif" /><img file="US2022121884A1_D6197.tif" /><img file="US2022121884A1_D6198.tif" /><img file="US2022121884A1_D6199.tif" /><img file="US2022121884A1_D6200.tif" /><img file="US2022121884A1_D6201.tif" /><img file="US2022121884A1_D6202.tif" /><img file="US2022121884A1_D6203.tif" /><img file="US2022121884A1_D6204.tif" /><img file="US2022121884A1_D6205.tif" /><img file="US2022121884A1_D6206.tif" /><img file="US2022121884A1_D6207.tif" /><img file="US2022121884A1_D6208.tif" /><img file="US2022121884A1_D6209.tif" /><img file="US2022121884A1_D6210.tif" /><img file="US2022121884A1_D6211.tif" /><img file="US2022121884A1_D6212.tif" /><img file="US2022121884A1_D6213.tif" /><img file="US2022121884A1_D6214.tif" /><img file="US2022121884A1_D6215.tif" /><img file="US2022121884A1_D6216.tif" /><img file="US2022121884A1_D6217.tif" /><img file="US2022121884A1_D6218.tif" /><img file="US2022121884A1_D6219.tif" /><img file="US2022121884A1_D6220.tif" /><img file="US2022121884A1_D6221.tif" /><img file="US2022121884A1_D6222.tif" /><img file="US2022121884A1_D6223.tif" /><img file="US2022121884A1_D6224.tif" /><img file="US2022121884A1_D6225.tif" /><img file="US2022121884A1_D6226.tif" /><img file="US2022121884A1_D6227.tif" /><img file="US2022121884A1_D6228.tif" /><img file="US2022121884A1_D6229.tif" /><img file="US2022121884A1_D6230.tif" /><img file="US2022121884A1_D6231.tif" /><img file="US2022121884A1_D6232.tif" /><img file="US2022121884A1_D6233.tif" /><img file="US2022121884A1_D6234.tif" /><img file="US2022121884A1_D6235.tif" /><img file="US2022121884A1_D6236.tif" /><img file="US2022121884A1_D6237.tif" /><img file="US2022121884A1_D6238.tif" /><img file="US2022121884A1_D6239.tif" /><img file="US2022121884A1_D6240.tif" /><img file="US2022121884A1_D6241.tif" /><img file="US2022121884A1_D6242.tif" /><img file="US2022121884A1_D6243.tif" /><img file="US2022121884A1_D6244.tif" /><img file="US2022121884A1_D6245.tif" /><img file="US2022121884A1_D6246.tif" /><img file="US2022121884A1_D6247.tif" /><img file="US2022121884A1_D6248.tif" /><img file="US2022121884A1_D6249.tif" /><img file="US2022121884A1_D6250.tif" /><img file="US2022121884A1_D6251.tif" /><img file="US2022121884A1_D6252.tif" /><img file="US2022121884A1_D6253.tif" /><img file="US2022121884A1_D6254.tif" /><img file="US2022121884A1_D6255.tif" /><img file="US2022121884A1_D6256.tif" /><img file="US2022121884A1_D6257.tif" /><img file="US2022121884A1_D6258.tif" /><img file="US2022121884A1_D6259.tif" /><img file="US2022121884A1_D6260.tif" /><img file="US2022121884A1_D6261.tif" /><img file="US2022121884A1_D6262.tif" /><img file="US2022121884A1_D6263.tif" /><img file="US2022121884A1_D6264.tif" /><img file="US2022121884A1_D6265.tif" /><img file="US2022121884A1_D6266.tif" /><img file="US2022121884A1_D6267.tif" /><img file="US2022121884A1_D6268.tif" /><img file="US2022121884A1_D6269.tif" /><img file="US2022121884A1_D6270.tif" /><img file="US2022121884A1_D6271.tif" /><img file="US2022121884A1_D6272.tif" /><maths id="MATH-US-00021-4" num="00021.4"><math overflow="scroll"><mrow><mstyle><mspace width="1.1em" height="1.1ex" /></mstyle><mo></mo><mrow><mi>Z</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>is</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mrow><mo>(</mo><mrow><msub><mi>A</mi><mi>Z</mi></msub><mo>,</mo><msub><mi>B</mi><mi>Z</mi></msub></mrow><mo>)</mo></mrow><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mrow><mo>(</mo><mrow><mi>induced</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>restriction</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>on</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>Z</mi></mrow><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D6273.tif" /><img file="US2022121884A1_D6274.tif" /><img file="US2022121884A1_D6275.tif" /><img file="US2022121884A1_D6276.tif" /><img file="US2022121884A1_D6277.tif" /><img file="US2022121884A1_D6278.tif" /><img file="US2022121884A1_D6279.tif" /><img file="US2022121884A1_D6280.tif" /><img file="US2022121884A1_D6281.tif" /><img file="US2022121884A1_D6282.tif" /><img file="US2022121884A1_D6283.tif" /><img file="US2022121884A1_D6284.tif" /><img file="US2022121884A1_D6285.tif" /><img file="US2022121884A1_D6286.tif" /><img file="US2022121884A1_D6287.tif" /><img file="US2022121884A1_D6288.tif" /><img file="US2022121884A1_D6289.tif" /><img file="US2022121884A1_D6290.tif" /><img file="US2022121884A1_D6291.tif" /><img file="US2022121884A1_D6292.tif" /><img file="US2022121884A1_D6293.tif" /><img file="US2022121884A1_D6294.tif" /><img file="US2022121884A1_D6295.tif" /><img file="US2022121884A1_D6296.tif" /><img file="US2022121884A1_D6297.tif" /><img file="US2022121884A1_D6298.tif" /><img file="US2022121884A1_D6299.tif" /><img file="US2022121884A1_D6300.tif" /><img file="US2022121884A1_D6301.tif" /><img file="US2022121884A1_D6302.tif" /><img file="US2022121884A1_D6303.tif" /><img file="US2022121884A1_D6304.tif" /><img file="US2022121884A1_D6305.tif" /><img file="US2022121884A1_D6306.tif" /><img file="US2022121884A1_D6307.tif" /><img file="US2022121884A1_D6308.tif" /><img file="US2022121884A1_D6309.tif" /><img file="US2022121884A1_D6310.tif" /><img file="US2022121884A1_D6311.tif" /><img file="US2022121884A1_D6312.tif" /><img file="US2022121884A1_D6313.tif" /><img file="US2022121884A1_D6314.tif" /><img file="US2022121884A1_D6315.tif" /><img file="US2022121884A1_D6316.tif" /><img file="US2022121884A1_D6317.tif" /><img file="US2022121884A1_D6318.tif" /><img file="US2022121884A1_D6319.tif" /><img file="US2022121884A1_D6320.tif" /><img file="US2022121884A1_D6321.tif" /><img file="US2022121884A1_D6322.tif" /><img file="US2022121884A1_D6323.tif" /><img file="US2022121884A1_D6324.tif" /><img file="US2022121884A1_D6325.tif" /><img file="US2022121884A1_D6326.tif" /><img file="US2022121884A1_D6327.tif" /><img file="US2022121884A1_D6328.tif" /><img file="US2022121884A1_D6329.tif" /><img file="US2022121884A1_D6330.tif" /><img file="US2022121884A1_D6331.tif" /><img file="US2022121884A1_D6332.tif" /><img file="US2022121884A1_D6333.tif" /><img file="US2022121884A1_D6334.tif" /><img file="US2022121884A1_D6335.tif" /><img file="US2022121884A1_D6336.tif" /><img file="US2022121884A1_D6337.tif" /><img file="US2022121884A1_D6338.tif" /><img file="US2022121884A1_D6339.tif" /><img file="US2022121884A1_D6340.tif" /><img file="US2022121884A1_D6341.tif" /><img file="US2022121884A1_D6342.tif" /><img file="US2022121884A1_D6343.tif" /><img file="US2022121884A1_D6344.tif" /><img file="US2022121884A1_D6345.tif" /><img file="US2022121884A1_D6346.tif" /><img file="US2022121884A1_D6347.tif" /><img file="US2022121884A1_D6348.tif" /><img file="US2022121884A1_D6349.tif" /><img file="US2022121884A1_D6350.tif" /><img file="US2022121884A1_D6351.tif" /><img file="US2022121884A1_D6352.tif" /><img file="US2022121884A1_D6353.tif" /><img file="US2022121884A1_D6354.tif" /><img file="US2022121884A1_D6355.tif" /><img file="US2022121884A1_D6356.tif" /><img file="US2022121884A1_D6357.tif" /><img file="US2022121884A1_D6358.tif" /><img file="US2022121884A1_D6359.tif" /><img file="US2022121884A1_D6360.tif" /><img file="US2022121884A1_D6361.tif" /><img file="US2022121884A1_D6362.tif" /><img file="US2022121884A1_D6363.tif" /><img file="US2022121884A1_D6364.tif" /><img file="US2022121884A1_D6365.tif" /><img file="US2022121884A1_D6366.tif" /><img file="US2022121884A1_D6367.tif" /><img file="US2022121884A1_D6368.tif" /><img file="US2022121884A1_D6369.tif" /><img file="US2022121884A1_D6370.tif" /><img file="US2022121884A1_D6371.tif" /><img file="US2022121884A1_D6372.tif" /><img file="US2022121884A1_D6373.tif" /><img file="US2022121884A1_D6374.tif" /><img file="US2022121884A1_D6375.tif" /><img file="US2022121884A1_D6376.tif" /><img file="US2022121884A1_D6377.tif" /><img file="US2022121884A1_D6378.tif" /><img file="US2022121884A1_D6379.tif" /><img file="US2022121884A1_D6380.tif" /><img file="US2022121884A1_D6381.tif" /><img file="US2022121884A1_D6382.tif" /><img file="US2022121884A1_D6383.tif" /><img file="US2022121884A1_D6384.tif" /><maths id="MATH-US-00021-5" num="00021.5"><math overflow="scroll"><mover><mrow><msub><mi>A</mi><mi>Z</mi></msub><mo>=</mo><mrow><mrow><mi>f</mi><mo></mo><mrow><mo>(</mo><mrow><msub><mi>A</mi><mi>X</mi></msub><mo>,</mo><msub><mi>A</mi><mi>Y</mi></msub></mrow><mo>)</mo></mrow></mrow><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mrow><mo>(</mo><mrow><mi>application</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>of</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>extension</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>principle</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>for</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>fuzzy</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>numbers</mi></mrow><mo>)</mo></mrow></mrow></mrow><mi>_</mi></mover></math></maths><img file="US2022121884A1_D6385.tif" /><img file="US2022121884A1_D6386.tif" /><img file="US2022121884A1_D6387.tif" /><img file="US2022121884A1_D6388.tif" /><img file="US2022121884A1_D6389.tif" /><img file="US2022121884A1_D6390.tif" /><img file="US2022121884A1_D6391.tif" /><img file="US2022121884A1_D6392.tif" /><img file="US2022121884A1_D6393.tif" /><img file="US2022121884A1_D6394.tif" /><img file="US2022121884A1_D6395.tif" /><img file="US2022121884A1_D6396.tif" /><img file="US2022121884A1_D6397.tif" /><img file="US2022121884A1_D6398.tif" /><img file="US2022121884A1_D6399.tif" /><img file="US2022121884A1_D6400.tif" /><img file="US2022121884A1_D6401.tif" /><img file="US2022121884A1_D6402.tif" /><img file="US2022121884A1_D6403.tif" /><img file="US2022121884A1_D6404.tif" /><img file="US2022121884A1_D6405.tif" /><img file="US2022121884A1_D6406.tif" /><img file="US2022121884A1_D6407.tif" /><img file="US2022121884A1_D6408.tif" /><img file="US2022121884A1_D6409.tif" /><img file="US2022121884A1_D6410.tif" /><img file="US2022121884A1_D6411.tif" /><img file="US2022121884A1_D6412.tif" /><img file="US2022121884A1_D6413.tif" /><img file="US2022121884A1_D6414.tif" /><img file="US2022121884A1_D6415.tif" /><img file="US2022121884A1_D6416.tif" /><img file="US2022121884A1_D6417.tif" /><img file="US2022121884A1_D6418.tif" /><img file="US2022121884A1_D6419.tif" /><img file="US2022121884A1_D6420.tif" /><img file="US2022121884A1_D6421.tif" /><img file="US2022121884A1_D6422.tif" /><img file="US2022121884A1_D6423.tif" /><img file="US2022121884A1_D6424.tif" /><img file="US2022121884A1_D6425.tif" /><img file="US2022121884A1_D6426.tif" /><img file="US2022121884A1_D6427.tif" /><img file="US2022121884A1_D6428.tif" /><img file="US2022121884A1_D6429.tif" /><img file="US2022121884A1_D6430.tif" /><img file="US2022121884A1_D6431.tif" /><img file="US2022121884A1_D6432.tif" /><img file="US2022121884A1_D6433.tif" /><img file="US2022121884A1_D6434.tif" /><img file="US2022121884A1_D6435.tif" /><img file="US2022121884A1_D6436.tif" /><img file="US2022121884A1_D6437.tif" /><img file="US2022121884A1_D6438.tif" /><img file="US2022121884A1_D6439.tif" /><img file="US2022121884A1_D6440.tif" /><img file="US2022121884A1_D6441.tif" /><img file="US2022121884A1_D6442.tif" /><img file="US2022121884A1_D6443.tif" /><img file="US2022121884A1_D6444.tif" /><img file="US2022121884A1_D6445.tif" /><img file="US2022121884A1_D6446.tif" /><img file="US2022121884A1_D6447.tif" /><img file="US2022121884A1_D6448.tif" /><img file="US2022121884A1_D6449.tif" /><img file="US2022121884A1_D6450.tif" /><img file="US2022121884A1_D6451.tif" /><img file="US2022121884A1_D6452.tif" /><img file="US2022121884A1_D6453.tif" /><img file="US2022121884A1_D6454.tif" /><img file="US2022121884A1_D6455.tif" /><img file="US2022121884A1_D6456.tif" /><img file="US2022121884A1_D6457.tif" /><img file="US2022121884A1_D6458.tif" /><img file="US2022121884A1_D6459.tif" /><img file="US2022121884A1_D6460.tif" /><img file="US2022121884A1_D6461.tif" /><img file="US2022121884A1_D6462.tif" /><img file="US2022121884A1_D6463.tif" /><img file="US2022121884A1_D6464.tif" /><img file="US2022121884A1_D6465.tif" /><img file="US2022121884A1_D6466.tif" /><img file="US2022121884A1_D6467.tif" /><img file="US2022121884A1_D6468.tif" /><img file="US2022121884A1_D6469.tif" /><img file="US2022121884A1_D6470.tif" /><img file="US2022121884A1_D6471.tif" /><img file="US2022121884A1_D6472.tif" /><img file="US2022121884A1_D6473.tif" /><img file="US2022121884A1_D6474.tif" /><img file="US2022121884A1_D6475.tif" /><img file="US2022121884A1_D6476.tif" /><img file="US2022121884A1_D6477.tif" /><img file="US2022121884A1_D6478.tif" /><img file="US2022121884A1_D6479.tif" /><img file="US2022121884A1_D6480.tif" /><img file="US2022121884A1_D6481.tif" /><img file="US2022121884A1_D6482.tif" /><img file="US2022121884A1_D6483.tif" /><img file="US2022121884A1_D6484.tif" /><img file="US2022121884A1_D6485.tif" /><img file="US2022121884A1_D6486.tif" /><img file="US2022121884A1_D6487.tif" /><img file="US2022121884A1_D6488.tif" /><img file="US2022121884A1_D6489.tif" /><img file="US2022121884A1_D6490.tif" /><img file="US2022121884A1_D6491.tif" /><img file="US2022121884A1_D6492.tif" /><img file="US2022121884A1_D6493.tif" /><img file="US2022121884A1_D6494.tif" /><img file="US2022121884A1_D6495.tif" /><img file="US2022121884A1_D6496.tif" /><maths id="MATH-US-00021-6" num="00021.6"><math overflow="scroll"><mrow><mstyle><mspace width="1.1em" height="1.1ex" /></mstyle><mo></mo><mrow><msub><mi>B</mi><mi>Z</mi></msub><mo>=</mo><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>Z</mi></msub></msub><mo>·</mo><mrow><mi>f</mi><mo></mo><mrow><mo>(</mo><mrow><msub><mi>p</mi><mi>X</mi></msub><mo>,</mo><msub><mi>p</mi><mi>Y</mi></msub></mrow><mo>)</mo></mrow></mrow></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D6497.tif" /><img file="US2022121884A1_D6498.tif" /><img file="US2022121884A1_D6499.tif" /><img file="US2022121884A1_D6500.tif" /><img file="US2022121884A1_D6501.tif" /><img file="US2022121884A1_D6502.tif" /><img file="US2022121884A1_D6503.tif" /><img file="US2022121884A1_D6504.tif" /><img file="US2022121884A1_D6505.tif" /><img file="US2022121884A1_D6506.tif" /><img file="US2022121884A1_D6507.tif" /><img file="US2022121884A1_D6508.tif" /><img file="US2022121884A1_D6509.tif" /><img file="US2022121884A1_D6510.tif" /><img file="US2022121884A1_D6511.tif" /><img file="US2022121884A1_D6512.tif" /><img file="US2022121884A1_D6513.tif" /><img file="US2022121884A1_D6514.tif" /><img file="US2022121884A1_D6515.tif" /><img file="US2022121884A1_D6516.tif" /><img file="US2022121884A1_D6517.tif" /><img file="US2022121884A1_D6518.tif" /><img file="US2022121884A1_D6519.tif" /><img file="US2022121884A1_D6520.tif" /><img file="US2022121884A1_D6521.tif" /><img file="US2022121884A1_D6522.tif" /><img file="US2022121884A1_D6523.tif" /><img file="US2022121884A1_D6524.tif" /><img file="US2022121884A1_D6525.tif" /><img file="US2022121884A1_D6526.tif" /><img file="US2022121884A1_D6527.tif" /><img file="US2022121884A1_D6528.tif" /><img file="US2022121884A1_D6529.tif" /><img file="US2022121884A1_D6530.tif" /><img file="US2022121884A1_D6531.tif" /><img file="US2022121884A1_D6532.tif" /><img file="US2022121884A1_D6533.tif" /><img file="US2022121884A1_D6534.tif" /><img file="US2022121884A1_D6535.tif" /><img file="US2022121884A1_D6536.tif" /><img file="US2022121884A1_D6537.tif" /><img file="US2022121884A1_D6538.tif" /><img file="US2022121884A1_D6539.tif" /><img file="US2022121884A1_D6540.tif" /><img file="US2022121884A1_D6541.tif" /><img file="US2022121884A1_D6542.tif" /><img file="US2022121884A1_D6543.tif" /><img file="US2022121884A1_D6544.tif" /><img file="US2022121884A1_D6545.tif" /><img file="US2022121884A1_D6546.tif" /><img file="US2022121884A1_D6547.tif" /><img file="US2022121884A1_D6548.tif" /><img file="US2022121884A1_D6549.tif" /><img file="US2022121884A1_D6550.tif" /><img file="US2022121884A1_D6551.tif" /><img file="US2022121884A1_D6552.tif" /><img file="US2022121884A1_D6553.tif" /><img file="US2022121884A1_D6554.tif" /><img file="US2022121884A1_D6555.tif" /><img file="US2022121884A1_D6556.tif" /><img file="US2022121884A1_D6557.tif" /><img file="US2022121884A1_D6558.tif" /><img file="US2022121884A1_D6559.tif" /><img file="US2022121884A1_D6560.tif" /><img file="US2022121884A1_D6561.tif" /><img file="US2022121884A1_D6562.tif" /><img file="US2022121884A1_D6563.tif" /><img file="US2022121884A1_D6564.tif" /><img file="US2022121884A1_D6565.tif" /><img file="US2022121884A1_D6566.tif" /><img file="US2022121884A1_D6567.tif" /><img file="US2022121884A1_D6568.tif" /><img file="US2022121884A1_D6569.tif" /><img file="US2022121884A1_D6570.tif" /><img file="US2022121884A1_D6571.tif" /><img file="US2022121884A1_D6572.tif" /><img file="US2022121884A1_D6573.tif" /><img file="US2022121884A1_D6574.tif" /><img file="US2022121884A1_D6575.tif" /><img file="US2022121884A1_D6576.tif" /><img file="US2022121884A1_D6577.tif" /><img file="US2022121884A1_D6578.tif" /><img file="US2022121884A1_D6579.tif" /><img file="US2022121884A1_D6580.tif" /><img file="US2022121884A1_D6581.tif" /><img file="US2022121884A1_D6582.tif" /><img file="US2022121884A1_D6583.tif" /><img file="US2022121884A1_D6584.tif" /><img file="US2022121884A1_D6585.tif" /><img file="US2022121884A1_D6586.tif" /><img file="US2022121884A1_D6587.tif" /><img file="US2022121884A1_D6588.tif" /><img file="US2022121884A1_D6589.tif" /><img file="US2022121884A1_D6590.tif" /><img file="US2022121884A1_D6591.tif" /><img file="US2022121884A1_D6592.tif" /><img file="US2022121884A1_D6593.tif" /><img file="US2022121884A1_D6594.tif" /><img file="US2022121884A1_D6595.tif" /><img file="US2022121884A1_D6596.tif" /><img file="US2022121884A1_D6597.tif" /><img file="US2022121884A1_D6598.tif" /><img file="US2022121884A1_D6599.tif" /><img file="US2022121884A1_D6600.tif" /><img file="US2022121884A1_D6601.tif" /><img file="US2022121884A1_D6602.tif" /><img file="US2022121884A1_D6603.tif" /><img file="US2022121884A1_D6604.tif" /><img file="US2022121884A1_D6605.tif" /><img file="US2022121884A1_D6606.tif" /><img file="US2022121884A1_D6607.tif" /><img file="US2022121884A1_D6608.tif" />
where p<sub>X </sub>and p<sub>Y </sub>are constrained by:
<maths id="MATH-US-00022" num="00022"><math overflow="scroll"><mrow><msubsup><mo>∫</mo><mi>R</mi><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></msubsup><mo></mo><mrow><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>X</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>is</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><msub><mi>B</mi><mi>X</mi></msub></mrow></mrow></math></maths><img file="US2022121884A1_D6609.tif" /><img file="US2022121884A1_D6610.tif" /><img file="US2022121884A1_D6611.tif" /><img file="US2022121884A1_D6612.tif" /><img file="US2022121884A1_D6613.tif" /><img file="US2022121884A1_D6614.tif" /><img file="US2022121884A1_D6615.tif" /><img file="US2022121884A1_D6616.tif" /><img file="US2022121884A1_D6617.tif" /><img file="US2022121884A1_D6618.tif" /><img file="US2022121884A1_D6619.tif" /><img file="US2022121884A1_D6620.tif" /><img file="US2022121884A1_D6621.tif" /><img file="US2022121884A1_D6622.tif" /><img file="US2022121884A1_D6623.tif" /><img file="US2022121884A1_D6624.tif" /><img file="US2022121884A1_D6625.tif" /><img file="US2022121884A1_D6626.tif" /><img file="US2022121884A1_D6627.tif" /><img file="US2022121884A1_D6628.tif" /><img file="US2022121884A1_D6629.tif" /><img file="US2022121884A1_D6630.tif" /><img file="US2022121884A1_D6631.tif" /><img file="US2022121884A1_D6632.tif" /><img file="US2022121884A1_D6633.tif" /><img file="US2022121884A1_D6634.tif" /><img file="US2022121884A1_D6635.tif" /><img file="US2022121884A1_D6636.tif" /><img file="US2022121884A1_D6637.tif" /><img file="US2022121884A1_D6638.tif" /><img file="US2022121884A1_D6639.tif" /><img file="US2022121884A1_D6640.tif" /><img file="US2022121884A1_D6641.tif" /><img file="US2022121884A1_D6642.tif" /><img file="US2022121884A1_D6643.tif" /><img file="US2022121884A1_D6644.tif" /><img file="US2022121884A1_D6645.tif" /><img file="US2022121884A1_D6646.tif" /><img file="US2022121884A1_D6647.tif" /><img file="US2022121884A1_D6648.tif" /><img file="US2022121884A1_D6649.tif" /><img file="US2022121884A1_D6650.tif" /><img file="US2022121884A1_D6651.tif" /><img file="US2022121884A1_D6652.tif" /><img file="US2022121884A1_D6653.tif" /><img file="US2022121884A1_D6654.tif" /><img file="US2022121884A1_D6655.tif" /><img file="US2022121884A1_D6656.tif" /><img file="US2022121884A1_D6657.tif" /><img file="US2022121884A1_D6658.tif" /><img file="US2022121884A1_D6659.tif" /><img file="US2022121884A1_D6660.tif" /><img file="US2022121884A1_D6661.tif" /><img file="US2022121884A1_D6662.tif" /><img file="US2022121884A1_D6663.tif" /><img file="US2022121884A1_D6664.tif" /><img file="US2022121884A1_D6665.tif" /><img file="US2022121884A1_D6666.tif" /><img file="US2022121884A1_D6667.tif" /><img file="US2022121884A1_D6668.tif" /><img file="US2022121884A1_D6669.tif" /><img file="US2022121884A1_D6670.tif" /><img file="US2022121884A1_D6671.tif" /><img file="US2022121884A1_D6672.tif" /><img file="US2022121884A1_D6673.tif" /><img file="US2022121884A1_D6674.tif" /><img file="US2022121884A1_D6675.tif" /><img file="US2022121884A1_D6676.tif" /><img file="US2022121884A1_D6677.tif" /><img file="US2022121884A1_D6678.tif" /><img file="US2022121884A1_D6679.tif" /><img file="US2022121884A1_D6680.tif" /><img file="US2022121884A1_D6681.tif" /><img file="US2022121884A1_D6682.tif" /><img file="US2022121884A1_D6683.tif" /><img file="US2022121884A1_D6684.tif" /><img file="US2022121884A1_D6685.tif" /><img file="US2022121884A1_D6686.tif" /><img file="US2022121884A1_D6687.tif" /><img file="US2022121884A1_D6688.tif" /><img file="US2022121884A1_D6689.tif" /><img file="US2022121884A1_D6690.tif" /><img file="US2022121884A1_D6691.tif" /><img file="US2022121884A1_D6692.tif" /><img file="US2022121884A1_D6693.tif" /><img file="US2022121884A1_D6694.tif" /><img file="US2022121884A1_D6695.tif" /><img file="US2022121884A1_D6696.tif" /><img file="US2022121884A1_D6697.tif" /><img file="US2022121884A1_D6698.tif" /><img file="US2022121884A1_D6699.tif" /><img file="US2022121884A1_D6700.tif" /><img file="US2022121884A1_D6701.tif" /><img file="US2022121884A1_D6702.tif" /><img file="US2022121884A1_D6703.tif" /><img file="US2022121884A1_D6704.tif" /><img file="US2022121884A1_D6705.tif" /><img file="US2022121884A1_D6706.tif" /><img file="US2022121884A1_D6707.tif" /><img file="US2022121884A1_D6708.tif" /><img file="US2022121884A1_D6709.tif" /><img file="US2022121884A1_D6710.tif" /><img file="US2022121884A1_D6711.tif" /><img file="US2022121884A1_D6712.tif" /><img file="US2022121884A1_D6713.tif" /><img file="US2022121884A1_D6714.tif" /><img file="US2022121884A1_D6715.tif" /><img file="US2022121884A1_D6716.tif" /><img file="US2022121884A1_D6717.tif" /><img file="US2022121884A1_D6718.tif" /><img file="US2022121884A1_D6719.tif" /><img file="US2022121884A1_D6720.tif" /><maths id="MATH-US-00022-2" num="00022.2"><math overflow="scroll"><mrow><msubsup><mo>∫</mo><mi>R</mi><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></msubsup><mo></mo><mrow><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>Y</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>p</mi><mi>Y</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>is</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><msub><mi>B</mi><mi>Y</mi></msub></mrow></mrow></math></maths><img file="US2022121884A1_D6721.tif" /><img file="US2022121884A1_D6722.tif" /><img file="US2022121884A1_D6723.tif" /><img file="US2022121884A1_D6724.tif" /><img file="US2022121884A1_D6725.tif" /><img file="US2022121884A1_D6726.tif" /><img file="US2022121884A1_D6727.tif" /><img file="US2022121884A1_D6728.tif" /><img file="US2022121884A1_D6729.tif" /><img file="US2022121884A1_D6730.tif" /><img file="US2022121884A1_D6731.tif" /><img file="US2022121884A1_D6732.tif" /><img file="US2022121884A1_D6733.tif" /><img file="US2022121884A1_D6734.tif" /><img file="US2022121884A1_D6735.tif" /><img file="US2022121884A1_D6736.tif" /><img file="US2022121884A1_D6737.tif" /><img file="US2022121884A1_D6738.tif" /><img file="US2022121884A1_D6739.tif" /><img file="US2022121884A1_D6740.tif" /><img file="US2022121884A1_D6741.tif" /><img file="US2022121884A1_D6742.tif" /><img file="US2022121884A1_D6743.tif" /><img file="US2022121884A1_D6744.tif" /><img file="US2022121884A1_D6745.tif" /><img file="US2022121884A1_D6746.tif" /><img file="US2022121884A1_D6747.tif" /><img file="US2022121884A1_D6748.tif" /><img file="US2022121884A1_D6749.tif" /><img file="US2022121884A1_D6750.tif" /><img file="US2022121884A1_D6751.tif" /><img file="US2022121884A1_D6752.tif" /><img file="US2022121884A1_D6753.tif" /><img file="US2022121884A1_D6754.tif" /><img file="US2022121884A1_D6755.tif" /><img file="US2022121884A1_D6756.tif" /><img file="US2022121884A1_D6757.tif" /><img file="US2022121884A1_D6758.tif" /><img file="US2022121884A1_D6759.tif" /><img file="US2022121884A1_D6760.tif" /><img file="US2022121884A1_D6761.tif" /><img file="US2022121884A1_D6762.tif" /><img file="US2022121884A1_D6763.tif" /><img file="US2022121884A1_D6764.tif" /><img file="US2022121884A1_D6765.tif" /><img file="US2022121884A1_D6766.tif" /><img file="US2022121884A1_D6767.tif" /><img file="US2022121884A1_D6768.tif" /><img file="US2022121884A1_D6769.tif" /><img file="US2022121884A1_D6770.tif" /><img file="US2022121884A1_D6771.tif" /><img file="US2022121884A1_D6772.tif" /><img file="US2022121884A1_D6773.tif" /><img file="US2022121884A1_D6774.tif" /><img file="US2022121884A1_D6775.tif" /><img file="US2022121884A1_D6776.tif" /><img file="US2022121884A1_D6777.tif" /><img file="US2022121884A1_D6778.tif" /><img file="US2022121884A1_D6779.tif" /><img file="US2022121884A1_D6780.tif" /><img file="US2022121884A1_D6781.tif" /><img file="US2022121884A1_D6782.tif" /><img file="US2022121884A1_D6783.tif" /><img file="US2022121884A1_D6784.tif" /><img file="US2022121884A1_D6785.tif" /><img file="US2022121884A1_D6786.tif" /><img file="US2022121884A1_D6787.tif" /><img file="US2022121884A1_D6788.tif" /><img file="US2022121884A1_D6789.tif" /><img file="US2022121884A1_D6790.tif" /><img file="US2022121884A1_D6791.tif" /><img file="US2022121884A1_D6792.tif" /><img file="US2022121884A1_D6793.tif" /><img file="US2022121884A1_D6794.tif" /><img file="US2022121884A1_D6795.tif" /><img file="US2022121884A1_D6796.tif" /><img file="US2022121884A1_D6797.tif" /><img file="US2022121884A1_D6798.tif" /><img file="US2022121884A1_D6799.tif" /><img file="US2022121884A1_D6800.tif" /><img file="US2022121884A1_D6801.tif" /><img file="US2022121884A1_D6802.tif" /><img file="US2022121884A1_D6803.tif" /><img file="US2022121884A1_D6804.tif" /><img file="US2022121884A1_D6805.tif" /><img file="US2022121884A1_D6806.tif" /><img file="US2022121884A1_D6807.tif" /><img file="US2022121884A1_D6808.tif" /><img file="US2022121884A1_D6809.tif" /><img file="US2022121884A1_D6810.tif" /><img file="US2022121884A1_D6811.tif" /><img file="US2022121884A1_D6812.tif" /><img file="US2022121884A1_D6813.tif" /><img file="US2022121884A1_D6814.tif" /><img file="US2022121884A1_D6815.tif" /><img file="US2022121884A1_D6816.tif" /><img file="US2022121884A1_D6817.tif" /><img file="US2022121884A1_D6818.tif" /><img file="US2022121884A1_D6819.tif" /><img file="US2022121884A1_D6820.tif" /><img file="US2022121884A1_D6821.tif" /><img file="US2022121884A1_D6822.tif" /><img file="US2022121884A1_D6823.tif" /><img file="US2022121884A1_D6824.tif" /><img file="US2022121884A1_D6825.tif" /><img file="US2022121884A1_D6826.tif" /><img file="US2022121884A1_D6827.tif" /><img file="US2022121884A1_D6828.tif" /><img file="US2022121884A1_D6829.tif" /><img file="US2022121884A1_D6830.tif" /><img file="US2022121884A1_D6831.tif" /><img file="US2022121884A1_D6832.tif" />
In terms of the membership functions of B<sub>X </sub>and B<sub>Y</sub>, these restrictions may be expressed as:
<maths id="MATH-US-00023" num="00023"><math overflow="scroll"><mrow><msub><msub><mi>μ</mi><mi>B</mi></msub><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mrow><msubsup><mo>∫</mo><mi>R</mi><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></msubsup><mo></mo><mrow><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>X</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>)</mo></mrow></mrow></math></maths><img file="US2022121884A1_D6833.tif" /><img file="US2022121884A1_D6834.tif" /><img file="US2022121884A1_D6835.tif" /><img file="US2022121884A1_D6836.tif" /><img file="US2022121884A1_D6837.tif" /><img file="US2022121884A1_D6838.tif" /><img file="US2022121884A1_D6839.tif" /><img file="US2022121884A1_D6840.tif" /><img file="US2022121884A1_D6841.tif" /><img file="US2022121884A1_D6842.tif" /><img file="US2022121884A1_D6843.tif" /><img file="US2022121884A1_D6844.tif" /><img file="US2022121884A1_D6845.tif" /><img file="US2022121884A1_D6846.tif" /><img file="US2022121884A1_D6847.tif" /><img file="US2022121884A1_D6848.tif" /><img file="US2022121884A1_D6849.tif" /><img file="US2022121884A1_D6850.tif" /><img file="US2022121884A1_D6851.tif" /><img file="US2022121884A1_D6852.tif" /><img file="US2022121884A1_D6853.tif" /><img file="US2022121884A1_D6854.tif" /><img file="US2022121884A1_D6855.tif" /><img file="US2022121884A1_D6856.tif" /><img file="US2022121884A1_D6857.tif" /><img file="US2022121884A1_D6858.tif" /><img file="US2022121884A1_D6859.tif" /><img file="US2022121884A1_D6860.tif" /><img file="US2022121884A1_D6861.tif" /><img file="US2022121884A1_D6862.tif" /><img file="US2022121884A1_D6863.tif" /><img file="US2022121884A1_D6864.tif" /><img file="US2022121884A1_D6865.tif" /><img file="US2022121884A1_D6866.tif" /><img file="US2022121884A1_D6867.tif" /><img file="US2022121884A1_D6868.tif" /><img file="US2022121884A1_D6869.tif" /><img file="US2022121884A1_D6870.tif" /><img file="US2022121884A1_D6871.tif" /><img file="US2022121884A1_D6872.tif" /><img file="US2022121884A1_D6873.tif" /><img file="US2022121884A1_D6874.tif" /><img file="US2022121884A1_D6875.tif" /><img file="US2022121884A1_D6876.tif" /><img file="US2022121884A1_D6877.tif" /><img file="US2022121884A1_D6878.tif" /><img file="US2022121884A1_D6879.tif" /><img file="US2022121884A1_D6880.tif" /><img file="US2022121884A1_D6881.tif" /><img file="US2022121884A1_D6882.tif" /><img file="US2022121884A1_D6883.tif" /><img file="US2022121884A1_D6884.tif" /><img file="US2022121884A1_D6885.tif" /><img file="US2022121884A1_D6886.tif" /><img file="US2022121884A1_D6887.tif" /><img file="US2022121884A1_D6888.tif" /><img file="US2022121884A1_D6889.tif" /><img file="US2022121884A1_D6890.tif" /><img file="US2022121884A1_D6891.tif" /><img file="US2022121884A1_D6892.tif" /><img file="US2022121884A1_D6893.tif" /><img file="US2022121884A1_D6894.tif" /><img file="US2022121884A1_D6895.tif" /><img file="US2022121884A1_D6896.tif" /><img file="US2022121884A1_D6897.tif" /><img file="US2022121884A1_D6898.tif" /><img file="US2022121884A1_D6899.tif" /><img file="US2022121884A1_D6900.tif" /><img file="US2022121884A1_D6901.tif" /><img file="US2022121884A1_D6902.tif" /><img file="US2022121884A1_D6903.tif" /><img file="US2022121884A1_D6904.tif" /><img file="US2022121884A1_D6905.tif" /><img file="US2022121884A1_D6906.tif" /><img file="US2022121884A1_D6907.tif" /><img file="US2022121884A1_D6908.tif" /><img file="US2022121884A1_D6909.tif" /><img file="US2022121884A1_D6910.tif" /><img file="US2022121884A1_D6911.tif" /><img file="US2022121884A1_D6912.tif" /><img file="US2022121884A1_D6913.tif" /><img file="US2022121884A1_D6914.tif" /><img file="US2022121884A1_D6915.tif" /><img file="US2022121884A1_D6916.tif" /><img file="US2022121884A1_D6917.tif" /><img file="US2022121884A1_D6918.tif" /><img file="US2022121884A1_D6919.tif" /><img file="US2022121884A1_D6920.tif" /><img file="US2022121884A1_D6921.tif" /><img file="US2022121884A1_D6922.tif" /><img file="US2022121884A1_D6923.tif" /><img file="US2022121884A1_D6924.tif" /><img file="US2022121884A1_D6925.tif" /><img file="US2022121884A1_D6926.tif" /><img file="US2022121884A1_D6927.tif" /><img file="US2022121884A1_D6928.tif" /><img file="US2022121884A1_D6929.tif" /><img file="US2022121884A1_D6930.tif" /><img file="US2022121884A1_D6931.tif" /><img file="US2022121884A1_D6932.tif" /><img file="US2022121884A1_D6933.tif" /><img file="US2022121884A1_D6934.tif" /><img file="US2022121884A1_D6935.tif" /><img file="US2022121884A1_D6936.tif" /><img file="US2022121884A1_D6937.tif" /><img file="US2022121884A1_D6938.tif" /><img file="US2022121884A1_D6939.tif" /><img file="US2022121884A1_D6940.tif" /><img file="US2022121884A1_D6941.tif" /><img file="US2022121884A1_D6942.tif" /><img file="US2022121884A1_D6943.tif" /><img file="US2022121884A1_D6944.tif" /><maths id="MATH-US-00023-2" num="00023.2"><math overflow="scroll"><mrow><msub><msub><mi>μ</mi><mi>B</mi></msub><mi>Y</mi></msub><mo></mo><mrow><mo>(</mo><mrow><msubsup><mo>∫</mo><mi>R</mi><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></msubsup><mo></mo><mrow><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>Y</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>p</mi><mi>Y</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>)</mo></mrow></mrow></math></maths><img file="US2022121884A1_D6945.tif" /><img file="US2022121884A1_D6946.tif" /><img file="US2022121884A1_D6947.tif" /><img file="US2022121884A1_D6948.tif" /><img file="US2022121884A1_D6949.tif" /><img file="US2022121884A1_D6950.tif" /><img file="US2022121884A1_D6951.tif" /><img file="US2022121884A1_D6952.tif" /><img file="US2022121884A1_D6953.tif" /><img file="US2022121884A1_D6954.tif" /><img file="US2022121884A1_D6955.tif" /><img file="US2022121884A1_D6956.tif" /><img file="US2022121884A1_D6957.tif" /><img file="US2022121884A1_D6958.tif" /><img file="US2022121884A1_D6959.tif" /><img file="US2022121884A1_D6960.tif" /><img file="US2022121884A1_D6961.tif" /><img file="US2022121884A1_D6962.tif" /><img file="US2022121884A1_D6963.tif" /><img file="US2022121884A1_D6964.tif" /><img file="US2022121884A1_D6965.tif" /><img file="US2022121884A1_D6966.tif" /><img file="US2022121884A1_D6967.tif" /><img file="US2022121884A1_D6968.tif" /><img file="US2022121884A1_D6969.tif" /><img file="US2022121884A1_D6970.tif" /><img file="US2022121884A1_D6971.tif" /><img file="US2022121884A1_D6972.tif" /><img file="US2022121884A1_D6973.tif" /><img file="US2022121884A1_D6974.tif" /><img file="US2022121884A1_D6975.tif" /><img file="US2022121884A1_D6976.tif" /><img file="US2022121884A1_D6977.tif" /><img file="US2022121884A1_D6978.tif" /><img file="US2022121884A1_D6979.tif" /><img file="US2022121884A1_D6980.tif" /><img file="US2022121884A1_D6981.tif" /><img file="US2022121884A1_D6982.tif" /><img file="US2022121884A1_D6983.tif" /><img file="US2022121884A1_D6984.tif" /><img file="US2022121884A1_D6985.tif" /><img file="US2022121884A1_D6986.tif" /><img file="US2022121884A1_D6987.tif" /><img file="US2022121884A1_D6988.tif" /><img file="US2022121884A1_D6989.tif" /><img file="US2022121884A1_D6990.tif" /><img file="US2022121884A1_D6991.tif" /><img file="US2022121884A1_D6992.tif" /><img file="US2022121884A1_D6993.tif" /><img file="US2022121884A1_D6994.tif" /><img file="US2022121884A1_D6995.tif" /><img file="US2022121884A1_D6996.tif" /><img file="US2022121884A1_D6997.tif" /><img file="US2022121884A1_D6998.tif" /><img file="US2022121884A1_D6999.tif" /><img file="US2022121884A1_D7000.tif" /><img file="US2022121884A1_D7001.tif" /><img file="US2022121884A1_D7002.tif" /><img file="US2022121884A1_D7003.tif" /><img file="US2022121884A1_D7004.tif" /><img file="US2022121884A1_D7005.tif" /><img file="US2022121884A1_D7006.tif" /><img file="US2022121884A1_D7007.tif" /><img file="US2022121884A1_D7008.tif" /><img file="US2022121884A1_D7009.tif" /><img file="US2022121884A1_D7010.tif" /><img file="US2022121884A1_D7011.tif" /><img file="US2022121884A1_D7012.tif" /><img file="US2022121884A1_D7013.tif" /><img file="US2022121884A1_D7014.tif" /><img file="US2022121884A1_D7015.tif" /><img file="US2022121884A1_D7016.tif" /><img file="US2022121884A1_D7017.tif" /><img file="US2022121884A1_D7018.tif" /><img file="US2022121884A1_D7019.tif" /><img file="US2022121884A1_D7020.tif" /><img file="US2022121884A1_D7021.tif" /><img file="US2022121884A1_D7022.tif" /><img file="US2022121884A1_D7023.tif" /><img file="US2022121884A1_D7024.tif" /><img file="US2022121884A1_D7025.tif" /><img file="US2022121884A1_D7026.tif" /><img file="US2022121884A1_D7027.tif" /><img file="US2022121884A1_D7028.tif" /><img file="US2022121884A1_D7029.tif" /><img file="US2022121884A1_D7030.tif" /><img file="US2022121884A1_D7031.tif" /><img file="US2022121884A1_D7032.tif" /><img file="US2022121884A1_D7033.tif" /><img file="US2022121884A1_D7034.tif" /><img file="US2022121884A1_D7035.tif" /><img file="US2022121884A1_D7036.tif" /><img file="US2022121884A1_D7037.tif" /><img file="US2022121884A1_D7038.tif" /><img file="US2022121884A1_D7039.tif" /><img file="US2022121884A1_D7040.tif" /><img file="US2022121884A1_D7041.tif" /><img file="US2022121884A1_D7042.tif" /><img file="US2022121884A1_D7043.tif" /><img file="US2022121884A1_D7044.tif" /><img file="US2022121884A1_D7045.tif" /><img file="US2022121884A1_D7046.tif" /><img file="US2022121884A1_D7047.tif" /><img file="US2022121884A1_D7048.tif" /><img file="US2022121884A1_D7049.tif" /><img file="US2022121884A1_D7050.tif" /><img file="US2022121884A1_D7051.tif" /><img file="US2022121884A1_D7052.tif" /><img file="US2022121884A1_D7053.tif" /><img file="US2022121884A1_D7054.tif" /><img file="US2022121884A1_D7055.tif" /><img file="US2022121884A1_D7056.tif" />
Additional restrictions on p<sub>X </sub>and p<sub>Y </sub>are:
<maths id="MATH-US-00024" num="00024"><math overflow="scroll"><mrow><mrow><msub><mo>∫</mo><mi>R</mi></msub><mo></mo><mrow><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>=</mo><mn>1</mn></mrow></math></maths><img file="US2022121884A1_D7057.tif" /><img file="US2022121884A1_D7058.tif" /><img file="US2022121884A1_D7059.tif" /><img file="US2022121884A1_D7060.tif" /><img file="US2022121884A1_D7061.tif" /><img file="US2022121884A1_D7062.tif" /><img file="US2022121884A1_D7063.tif" /><img file="US2022121884A1_D7064.tif" /><img file="US2022121884A1_D7065.tif" /><img file="US2022121884A1_D7066.tif" /><img file="US2022121884A1_D7067.tif" /><img file="US2022121884A1_D7068.tif" /><img file="US2022121884A1_D7069.tif" /><img file="US2022121884A1_D7070.tif" /><img file="US2022121884A1_D7071.tif" /><img file="US2022121884A1_D7072.tif" /><img file="US2022121884A1_D7073.tif" /><img file="US2022121884A1_D7074.tif" /><img file="US2022121884A1_D7075.tif" /><img file="US2022121884A1_D7076.tif" /><img file="US2022121884A1_D7077.tif" /><img file="US2022121884A1_D7078.tif" /><img file="US2022121884A1_D7079.tif" /><img file="US2022121884A1_D7080.tif" /><img file="US2022121884A1_D7081.tif" /><img file="US2022121884A1_D7082.tif" /><img file="US2022121884A1_D7083.tif" /><img file="US2022121884A1_D7084.tif" /><img file="US2022121884A1_D7085.tif" /><img file="US2022121884A1_D7086.tif" /><img file="US2022121884A1_D7087.tif" /><img file="US2022121884A1_D7088.tif" /><img file="US2022121884A1_D7089.tif" /><img file="US2022121884A1_D7090.tif" /><img file="US2022121884A1_D7091.tif" /><img file="US2022121884A1_D7092.tif" /><img file="US2022121884A1_D7093.tif" /><img file="US2022121884A1_D7094.tif" /><img file="US2022121884A1_D7095.tif" /><img file="US2022121884A1_D7096.tif" /><img file="US2022121884A1_D7097.tif" /><img file="US2022121884A1_D7098.tif" /><img file="US2022121884A1_D7099.tif" /><img file="US2022121884A1_D7100.tif" /><img file="US2022121884A1_D7101.tif" /><img file="US2022121884A1_D7102.tif" /><img file="US2022121884A1_D7103.tif" /><img file="US2022121884A1_D7104.tif" /><img file="US2022121884A1_D7105.tif" /><img file="US2022121884A1_D7106.tif" /><img file="US2022121884A1_D7107.tif" /><img file="US2022121884A1_D7108.tif" /><img file="US2022121884A1_D7109.tif" /><img file="US2022121884A1_D7110.tif" /><img file="US2022121884A1_D7111.tif" /><img file="US2022121884A1_D7112.tif" /><img file="US2022121884A1_D7113.tif" /><img file="US2022121884A1_D7114.tif" /><img file="US2022121884A1_D7115.tif" /><img file="US2022121884A1_D7116.tif" /><img file="US2022121884A1_D7117.tif" /><img file="US2022121884A1_D7118.tif" /><img file="US2022121884A1_D7119.tif" /><img file="US2022121884A1_D7120.tif" /><img file="US2022121884A1_D7121.tif" /><img file="US2022121884A1_D7122.tif" /><img file="US2022121884A1_D7123.tif" /><img file="US2022121884A1_D7124.tif" /><img file="US2022121884A1_D7125.tif" /><img file="US2022121884A1_D7126.tif" /><img file="US2022121884A1_D7127.tif" /><img file="US2022121884A1_D7128.tif" /><img file="US2022121884A1_D7129.tif" /><img file="US2022121884A1_D7130.tif" /><img file="US2022121884A1_D7131.tif" /><img file="US2022121884A1_D7132.tif" /><img file="US2022121884A1_D7133.tif" /><img file="US2022121884A1_D7134.tif" /><img file="US2022121884A1_D7135.tif" /><img file="US2022121884A1_D7136.tif" /><img file="US2022121884A1_D7137.tif" /><img file="US2022121884A1_D7138.tif" /><img file="US2022121884A1_D7139.tif" /><img file="US2022121884A1_D7140.tif" /><img file="US2022121884A1_D7141.tif" /><img file="US2022121884A1_D7142.tif" /><img file="US2022121884A1_D7143.tif" /><img file="US2022121884A1_D7144.tif" /><img file="US2022121884A1_D7145.tif" /><img file="US2022121884A1_D7146.tif" /><img file="US2022121884A1_D7147.tif" /><img file="US2022121884A1_D7148.tif" /><img file="US2022121884A1_D7149.tif" /><img file="US2022121884A1_D7150.tif" /><img file="US2022121884A1_D7151.tif" /><img file="US2022121884A1_D7152.tif" /><img file="US2022121884A1_D7153.tif" /><img file="US2022121884A1_D7154.tif" /><img file="US2022121884A1_D7155.tif" /><img file="US2022121884A1_D7156.tif" /><img file="US2022121884A1_D7157.tif" /><img file="US2022121884A1_D7158.tif" /><img file="US2022121884A1_D7159.tif" /><img file="US2022121884A1_D7160.tif" /><img file="US2022121884A1_D7161.tif" /><img file="US2022121884A1_D7162.tif" /><img file="US2022121884A1_D7163.tif" /><img file="US2022121884A1_D7164.tif" /><img file="US2022121884A1_D7165.tif" /><img file="US2022121884A1_D7166.tif" /><img file="US2022121884A1_D7167.tif" /><img file="US2022121884A1_D7168.tif" /><maths id="MATH-US-00024-2" num="00024.2"><math overflow="scroll"><mrow><mrow><msub><mo>∫</mo><mi>R</mi></msub><mo></mo><mrow><mrow><msub><mi>p</mi><mi>Y</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>=</mo><mn>1</mn></mrow></math></maths><img file="US2022121884A1_D7169.tif" /><img file="US2022121884A1_D7170.tif" /><img file="US2022121884A1_D7171.tif" /><img file="US2022121884A1_D7172.tif" /><img file="US2022121884A1_D7173.tif" /><img file="US2022121884A1_D7174.tif" /><img file="US2022121884A1_D7175.tif" /><img file="US2022121884A1_D7176.tif" /><img file="US2022121884A1_D7177.tif" /><img file="US2022121884A1_D7178.tif" /><img file="US2022121884A1_D7179.tif" /><img file="US2022121884A1_D7180.tif" /><img file="US2022121884A1_D7181.tif" /><img file="US2022121884A1_D7182.tif" /><img file="US2022121884A1_D7183.tif" /><img file="US2022121884A1_D7184.tif" /><img file="US2022121884A1_D7185.tif" /><img file="US2022121884A1_D7186.tif" /><img file="US2022121884A1_D7187.tif" /><img file="US2022121884A1_D7188.tif" /><img file="US2022121884A1_D7189.tif" /><img file="US2022121884A1_D7190.tif" /><img file="US2022121884A1_D7191.tif" /><img file="US2022121884A1_D7192.tif" /><img file="US2022121884A1_D7193.tif" /><img file="US2022121884A1_D7194.tif" /><img file="US2022121884A1_D7195.tif" /><img file="US2022121884A1_D7196.tif" /><img file="US2022121884A1_D7197.tif" /><img file="US2022121884A1_D7198.tif" /><img file="US2022121884A1_D7199.tif" /><img file="US2022121884A1_D7200.tif" /><img file="US2022121884A1_D7201.tif" /><img file="US2022121884A1_D7202.tif" /><img file="US2022121884A1_D7203.tif" /><img file="US2022121884A1_D7204.tif" /><img file="US2022121884A1_D7205.tif" /><img file="US2022121884A1_D7206.tif" /><img file="US2022121884A1_D7207.tif" /><img file="US2022121884A1_D7208.tif" /><img file="US2022121884A1_D7209.tif" /><img file="US2022121884A1_D7210.tif" /><img file="US2022121884A1_D7211.tif" /><img file="US2022121884A1_D7212.tif" /><img file="US2022121884A1_D7213.tif" /><img file="US2022121884A1_D7214.tif" /><img file="US2022121884A1_D7215.tif" /><img file="US2022121884A1_D7216.tif" /><img file="US2022121884A1_D7217.tif" /><img file="US2022121884A1_D7218.tif" /><img file="US2022121884A1_D7219.tif" /><img file="US2022121884A1_D7220.tif" /><img file="US2022121884A1_D7221.tif" /><img file="US2022121884A1_D7222.tif" /><img file="US2022121884A1_D7223.tif" /><img file="US2022121884A1_D7224.tif" /><img file="US2022121884A1_D7225.tif" /><img file="US2022121884A1_D7226.tif" /><img file="US2022121884A1_D7227.tif" /><img file="US2022121884A1_D7228.tif" /><img file="US2022121884A1_D7229.tif" /><img file="US2022121884A1_D7230.tif" /><img file="US2022121884A1_D7231.tif" /><img file="US2022121884A1_D7232.tif" /><img file="US2022121884A1_D7233.tif" /><img file="US2022121884A1_D7234.tif" /><img file="US2022121884A1_D7235.tif" /><img file="US2022121884A1_D7236.tif" /><img file="US2022121884A1_D7237.tif" /><img file="US2022121884A1_D7238.tif" /><img file="US2022121884A1_D7239.tif" /><img file="US2022121884A1_D7240.tif" /><img file="US2022121884A1_D7241.tif" /><img file="US2022121884A1_D7242.tif" /><img file="US2022121884A1_D7243.tif" /><img file="US2022121884A1_D7244.tif" /><img file="US2022121884A1_D7245.tif" /><img file="US2022121884A1_D7246.tif" /><img file="US2022121884A1_D7247.tif" /><img file="US2022121884A1_D7248.tif" /><img file="US2022121884A1_D7249.tif" /><img file="US2022121884A1_D7250.tif" /><img file="US2022121884A1_D7251.tif" /><img file="US2022121884A1_D7252.tif" /><img file="US2022121884A1_D7253.tif" /><img file="US2022121884A1_D7254.tif" /><img file="US2022121884A1_D7255.tif" /><img file="US2022121884A1_D7256.tif" /><img file="US2022121884A1_D7257.tif" /><img file="US2022121884A1_D7258.tif" /><img file="US2022121884A1_D7259.tif" /><img file="US2022121884A1_D7260.tif" /><img file="US2022121884A1_D7261.tif" /><img file="US2022121884A1_D7262.tif" /><img file="US2022121884A1_D7263.tif" /><img file="US2022121884A1_D7264.tif" /><img file="US2022121884A1_D7265.tif" /><img file="US2022121884A1_D7266.tif" /><img file="US2022121884A1_D7267.tif" /><img file="US2022121884A1_D7268.tif" /><img file="US2022121884A1_D7269.tif" /><img file="US2022121884A1_D7270.tif" /><img file="US2022121884A1_D7271.tif" /><img file="US2022121884A1_D7272.tif" /><img file="US2022121884A1_D7273.tif" /><img file="US2022121884A1_D7274.tif" /><img file="US2022121884A1_D7275.tif" /><img file="US2022121884A1_D7276.tif" /><img file="US2022121884A1_D7277.tif" /><img file="US2022121884A1_D7278.tif" /><img file="US2022121884A1_D7279.tif" /><img file="US2022121884A1_D7280.tif" /><maths id="MATH-US-00024-3" num="00024.3"><math overflow="scroll"><mrow><mrow><msub><mo>∫</mo><mi>R</mi></msub><mo></mo><mrow><mrow><msub><mi>up</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>=</mo><mrow><mfrac><mrow><msub><mo>∫</mo><mi>R</mi></msub><mo></mo><mrow><mi>u</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>X</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mrow><msub><mo>∫</mo><mi>R</mi></msub><mo></mo><mrow><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>X</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow></mfrac><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mrow><mo>(</mo><mi>compatibility</mi><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D7281.tif" /><img file="US2022121884A1_D7282.tif" /><img file="US2022121884A1_D7283.tif" /><img file="US2022121884A1_D7284.tif" /><img file="US2022121884A1_D7285.tif" /><img file="US2022121884A1_D7286.tif" /><img file="US2022121884A1_D7287.tif" /><img file="US2022121884A1_D7288.tif" /><img file="US2022121884A1_D7289.tif" /><img file="US2022121884A1_D7290.tif" /><img file="US2022121884A1_D7291.tif" /><img file="US2022121884A1_D7292.tif" /><img file="US2022121884A1_D7293.tif" /><img file="US2022121884A1_D7294.tif" /><img file="US2022121884A1_D7295.tif" /><img file="US2022121884A1_D7296.tif" /><img file="US2022121884A1_D7297.tif" /><img file="US2022121884A1_D7298.tif" /><img file="US2022121884A1_D7299.tif" /><img file="US2022121884A1_D7300.tif" /><img file="US2022121884A1_D7301.tif" /><img file="US2022121884A1_D7302.tif" /><img file="US2022121884A1_D7303.tif" /><img file="US2022121884A1_D7304.tif" /><img file="US2022121884A1_D7305.tif" /><img file="US2022121884A1_D7306.tif" /><img file="US2022121884A1_D7307.tif" /><img file="US2022121884A1_D7308.tif" /><img file="US2022121884A1_D7309.tif" /><img file="US2022121884A1_D7310.tif" /><img file="US2022121884A1_D7311.tif" /><img file="US2022121884A1_D7312.tif" /><img file="US2022121884A1_D7313.tif" /><img file="US2022121884A1_D7314.tif" /><img file="US2022121884A1_D7315.tif" /><img file="US2022121884A1_D7316.tif" /><img file="US2022121884A1_D7317.tif" /><img file="US2022121884A1_D7318.tif" /><img file="US2022121884A1_D7319.tif" /><img file="US2022121884A1_D7320.tif" /><img file="US2022121884A1_D7321.tif" /><img file="US2022121884A1_D7322.tif" /><img file="US2022121884A1_D7323.tif" /><img file="US2022121884A1_D7324.tif" /><img file="US2022121884A1_D7325.tif" /><img file="US2022121884A1_D7326.tif" /><img file="US2022121884A1_D7327.tif" /><img file="US2022121884A1_D7328.tif" /><img file="US2022121884A1_D7329.tif" /><img file="US2022121884A1_D7330.tif" /><img file="US2022121884A1_D7331.tif" /><img file="US2022121884A1_D7332.tif" /><img file="US2022121884A1_D7333.tif" /><img file="US2022121884A1_D7334.tif" /><img file="US2022121884A1_D7335.tif" /><img file="US2022121884A1_D7336.tif" /><img file="US2022121884A1_D7337.tif" /><img file="US2022121884A1_D7338.tif" /><img file="US2022121884A1_D7339.tif" /><img file="US2022121884A1_D7340.tif" /><img file="US2022121884A1_D7341.tif" /><img file="US2022121884A1_D7342.tif" /><img file="US2022121884A1_D7343.tif" /><img file="US2022121884A1_D7344.tif" /><img file="US2022121884A1_D7345.tif" /><img file="US2022121884A1_D7346.tif" /><img file="US2022121884A1_D7347.tif" /><img file="US2022121884A1_D7348.tif" /><img file="US2022121884A1_D7349.tif" /><img file="US2022121884A1_D7350.tif" /><img file="US2022121884A1_D7351.tif" /><img file="US2022121884A1_D7352.tif" /><img file="US2022121884A1_D7353.tif" /><img file="US2022121884A1_D7354.tif" /><img file="US2022121884A1_D7355.tif" /><img file="US2022121884A1_D7356.tif" /><img file="US2022121884A1_D7357.tif" /><img file="US2022121884A1_D7358.tif" /><img file="US2022121884A1_D7359.tif" /><img file="US2022121884A1_D7360.tif" /><img file="US2022121884A1_D7361.tif" /><img file="US2022121884A1_D7362.tif" /><img file="US2022121884A1_D7363.tif" /><img file="US2022121884A1_D7364.tif" /><img file="US2022121884A1_D7365.tif" /><img file="US2022121884A1_D7366.tif" /><img file="US2022121884A1_D7367.tif" /><img file="US2022121884A1_D7368.tif" /><img file="US2022121884A1_D7369.tif" /><img file="US2022121884A1_D7370.tif" /><img file="US2022121884A1_D7371.tif" /><img file="US2022121884A1_D7372.tif" /><img file="US2022121884A1_D7373.tif" /><img file="US2022121884A1_D7374.tif" /><img file="US2022121884A1_D7375.tif" /><img file="US2022121884A1_D7376.tif" /><img file="US2022121884A1_D7377.tif" /><img file="US2022121884A1_D7378.tif" /><img file="US2022121884A1_D7379.tif" /><img file="US2022121884A1_D7380.tif" /><img file="US2022121884A1_D7381.tif" /><img file="US2022121884A1_D7382.tif" /><img file="US2022121884A1_D7383.tif" /><img file="US2022121884A1_D7384.tif" /><img file="US2022121884A1_D7385.tif" /><img file="US2022121884A1_D7386.tif" /><img file="US2022121884A1_D7387.tif" /><img file="US2022121884A1_D7388.tif" /><img file="US2022121884A1_D7389.tif" /><img file="US2022121884A1_D7390.tif" /><img file="US2022121884A1_D7391.tif" /><img file="US2022121884A1_D7392.tif" /><maths id="MATH-US-00024-4" num="00024.4"><math overflow="scroll"><mrow><mrow><msub><mo>∫</mo><mi>R</mi></msub><mo></mo><mrow><mrow><msub><mi>up</mi><mi>Y</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>=</mo><mrow><mfrac><mrow><msub><mo>∫</mo><mi>R</mi></msub><mo></mo><mrow><mi>u</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>Y</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mrow><msub><mo>∫</mo><mi>R</mi></msub><mo></mo><mrow><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>Y</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow></mfrac><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mrow><mo>(</mo><mi>compatibility</mi><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D7393.tif" /><img file="US2022121884A1_D7394.tif" /><img file="US2022121884A1_D7395.tif" /><img file="US2022121884A1_D7396.tif" /><img file="US2022121884A1_D7397.tif" /><img file="US2022121884A1_D7398.tif" /><img file="US2022121884A1_D7399.tif" /><img file="US2022121884A1_D7400.tif" /><img file="US2022121884A1_D7401.tif" /><img file="US2022121884A1_D7402.tif" /><img file="US2022121884A1_D7403.tif" /><img file="US2022121884A1_D7404.tif" /><img file="US2022121884A1_D7405.tif" /><img file="US2022121884A1_D7406.tif" /><img file="US2022121884A1_D7407.tif" /><img file="US2022121884A1_D7408.tif" /><img file="US2022121884A1_D7409.tif" /><img file="US2022121884A1_D7410.tif" /><img file="US2022121884A1_D7411.tif" /><img file="US2022121884A1_D7412.tif" /><img file="US2022121884A1_D7413.tif" /><img file="US2022121884A1_D7414.tif" /><img file="US2022121884A1_D7415.tif" /><img file="US2022121884A1_D7416.tif" /><img file="US2022121884A1_D7417.tif" /><img file="US2022121884A1_D7418.tif" /><img file="US2022121884A1_D7419.tif" /><img file="US2022121884A1_D7420.tif" /><img file="US2022121884A1_D7421.tif" /><img file="US2022121884A1_D7422.tif" /><img file="US2022121884A1_D7423.tif" /><img file="US2022121884A1_D7424.tif" /><img file="US2022121884A1_D7425.tif" /><img file="US2022121884A1_D7426.tif" /><img file="US2022121884A1_D7427.tif" /><img file="US2022121884A1_D7428.tif" /><img file="US2022121884A1_D7429.tif" /><img file="US2022121884A1_D7430.tif" /><img file="US2022121884A1_D7431.tif" /><img file="US2022121884A1_D7432.tif" /><img file="US2022121884A1_D7433.tif" /><img file="US2022121884A1_D7434.tif" /><img file="US2022121884A1_D7435.tif" /><img file="US2022121884A1_D7436.tif" /><img file="US2022121884A1_D7437.tif" /><img file="US2022121884A1_D7438.tif" /><img file="US2022121884A1_D7439.tif" /><img file="US2022121884A1_D7440.tif" /><img file="US2022121884A1_D7441.tif" /><img file="US2022121884A1_D7442.tif" /><img file="US2022121884A1_D7443.tif" /><img file="US2022121884A1_D7444.tif" /><img file="US2022121884A1_D7445.tif" /><img file="US2022121884A1_D7446.tif" /><img file="US2022121884A1_D7447.tif" /><img file="US2022121884A1_D7448.tif" /><img file="US2022121884A1_D7449.tif" /><img file="US2022121884A1_D7450.tif" /><img file="US2022121884A1_D7451.tif" /><img file="US2022121884A1_D7452.tif" /><img file="US2022121884A1_D7453.tif" /><img file="US2022121884A1_D7454.tif" /><img file="US2022121884A1_D7455.tif" /><img file="US2022121884A1_D7456.tif" /><img file="US2022121884A1_D7457.tif" /><img file="US2022121884A1_D7458.tif" /><img file="US2022121884A1_D7459.tif" /><img file="US2022121884A1_D7460.tif" /><img file="US2022121884A1_D7461.tif" /><img file="US2022121884A1_D7462.tif" /><img file="US2022121884A1_D7463.tif" /><img file="US2022121884A1_D7464.tif" /><img file="US2022121884A1_D7465.tif" /><img file="US2022121884A1_D7466.tif" /><img file="US2022121884A1_D7467.tif" /><img file="US2022121884A1_D7468.tif" /><img file="US2022121884A1_D7469.tif" /><img file="US2022121884A1_D7470.tif" /><img file="US2022121884A1_D7471.tif" /><img file="US2022121884A1_D7472.tif" /><img file="US2022121884A1_D7473.tif" /><img file="US2022121884A1_D7474.tif" /><img file="US2022121884A1_D7475.tif" /><img file="US2022121884A1_D7476.tif" /><img file="US2022121884A1_D7477.tif" /><img file="US2022121884A1_D7478.tif" /><img file="US2022121884A1_D7479.tif" /><img file="US2022121884A1_D7480.tif" /><img file="US2022121884A1_D7481.tif" /><img file="US2022121884A1_D7482.tif" /><img file="US2022121884A1_D7483.tif" /><img file="US2022121884A1_D7484.tif" /><img file="US2022121884A1_D7485.tif" /><img file="US2022121884A1_D7486.tif" /><img file="US2022121884A1_D7487.tif" /><img file="US2022121884A1_D7488.tif" /><img file="US2022121884A1_D7489.tif" /><img file="US2022121884A1_D7490.tif" /><img file="US2022121884A1_D7491.tif" /><img file="US2022121884A1_D7492.tif" /><img file="US2022121884A1_D7493.tif" /><img file="US2022121884A1_D7494.tif" /><img file="US2022121884A1_D7495.tif" /><img file="US2022121884A1_D7496.tif" /><img file="US2022121884A1_D7497.tif" /><img file="US2022121884A1_D7498.tif" /><img file="US2022121884A1_D7499.tif" /><img file="US2022121884A1_D7500.tif" /><img file="US2022121884A1_D7501.tif" /><img file="US2022121884A1_D7502.tif" /><img file="US2022121884A1_D7503.tif" /><img file="US2022121884A1_D7504.tif" />
Consequently, in agreement with earlier results we can write:
<maths id="MATH-US-00025" num="00025"><math overflow="scroll"><mrow><mrow><msub><mi>μ</mi><msub><mi>p</mi><mi>Z</mi></msub></msub><mo></mo><mrow><mo>(</mo><msub><mi>p</mi><mi>Z</mi></msub><mo>)</mo></mrow></mrow><mo>=</mo><mrow><msub><mi>sup</mi><mrow><msub><mi>p</mi><mi>X</mi></msub><mo>,</mo><msub><mi>p</mi><mi>Y</mi></msub></mrow></msub><mo></mo><mrow><mo>(</mo><mrow><mrow><msub><mi>μ</mi><msub><mi>B</mi><mi>X</mi></msub></msub><mo></mo><mrow><mo>(</mo><mrow><msubsup><mo>∫</mo><mi>R</mi><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></msubsup><mo></mo><mrow><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>X</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>)</mo></mrow></mrow><mo>⋀</mo><mrow><msub><mi>μ</mi><msub><mi>B</mi><mi>Y</mi></msub></msub><mo></mo><mrow><mo>(</mo><mrow><msubsup><mo>∫</mo><mi>R</mi><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></msubsup><mo></mo><mrow><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>Y</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>p</mi><mi>Y</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>)</mo></mrow></mrow></mrow><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D7505.tif" /><img file="US2022121884A1_D7506.tif" /><img file="US2022121884A1_D7507.tif" /><img file="US2022121884A1_D7508.tif" /><img file="US2022121884A1_D7509.tif" /><img file="US2022121884A1_D7510.tif" /><img file="US2022121884A1_D7511.tif" /><img file="US2022121884A1_D7512.tif" /><img file="US2022121884A1_D7513.tif" /><img file="US2022121884A1_D7514.tif" /><img file="US2022121884A1_D7515.tif" /><img file="US2022121884A1_D7516.tif" /><img file="US2022121884A1_D7517.tif" /><img file="US2022121884A1_D7518.tif" /><img file="US2022121884A1_D7519.tif" /><img file="US2022121884A1_D7520.tif" /><img file="US2022121884A1_D7521.tif" /><img file="US2022121884A1_D7522.tif" /><img file="US2022121884A1_D7523.tif" /><img file="US2022121884A1_D7524.tif" /><img file="US2022121884A1_D7525.tif" /><img file="US2022121884A1_D7526.tif" /><img file="US2022121884A1_D7527.tif" /><img file="US2022121884A1_D7528.tif" /><img file="US2022121884A1_D7529.tif" /><img file="US2022121884A1_D7530.tif" /><img file="US2022121884A1_D7531.tif" /><img file="US2022121884A1_D7532.tif" /><img file="US2022121884A1_D7533.tif" /><img file="US2022121884A1_D7534.tif" /><img file="US2022121884A1_D7535.tif" /><img file="US2022121884A1_D7536.tif" /><img file="US2022121884A1_D7537.tif" /><img file="US2022121884A1_D7538.tif" /><img file="US2022121884A1_D7539.tif" /><img file="US2022121884A1_D7540.tif" /><img file="US2022121884A1_D7541.tif" /><img file="US2022121884A1_D7542.tif" /><img file="US2022121884A1_D7543.tif" /><img file="US2022121884A1_D7544.tif" /><img file="US2022121884A1_D7545.tif" /><img file="US2022121884A1_D7546.tif" /><img file="US2022121884A1_D7547.tif" /><img file="US2022121884A1_D7548.tif" /><img file="US2022121884A1_D7549.tif" /><img file="US2022121884A1_D7550.tif" /><img file="US2022121884A1_D7551.tif" /><img file="US2022121884A1_D7552.tif" /><img file="US2022121884A1_D7553.tif" /><img file="US2022121884A1_D7554.tif" /><img file="US2022121884A1_D7555.tif" /><img file="US2022121884A1_D7556.tif" /><img file="US2022121884A1_D7557.tif" /><img file="US2022121884A1_D7558.tif" /><img file="US2022121884A1_D7559.tif" /><img file="US2022121884A1_D7560.tif" /><img file="US2022121884A1_D7561.tif" /><img file="US2022121884A1_D7562.tif" /><img file="US2022121884A1_D7563.tif" /><img file="US2022121884A1_D7564.tif" /><img file="US2022121884A1_D7565.tif" /><img file="US2022121884A1_D7566.tif" /><img file="US2022121884A1_D7567.tif" /><img file="US2022121884A1_D7568.tif" /><img file="US2022121884A1_D7569.tif" /><img file="US2022121884A1_D7570.tif" /><img file="US2022121884A1_D7571.tif" /><img file="US2022121884A1_D7572.tif" /><img file="US2022121884A1_D7573.tif" /><img file="US2022121884A1_D7574.tif" /><img file="US2022121884A1_D7575.tif" /><img file="US2022121884A1_D7576.tif" /><img file="US2022121884A1_D7577.tif" /><img file="US2022121884A1_D7578.tif" /><img file="US2022121884A1_D7579.tif" /><img file="US2022121884A1_D7580.tif" /><img file="US2022121884A1_D7581.tif" /><img file="US2022121884A1_D7582.tif" /><img file="US2022121884A1_D7583.tif" /><img file="US2022121884A1_D7584.tif" /><img file="US2022121884A1_D7585.tif" /><img file="US2022121884A1_D7586.tif" /><img file="US2022121884A1_D7587.tif" /><img file="US2022121884A1_D7588.tif" /><img file="US2022121884A1_D7589.tif" /><img file="US2022121884A1_D7590.tif" /><img file="US2022121884A1_D7591.tif" /><img file="US2022121884A1_D7592.tif" /><img file="US2022121884A1_D7593.tif" /><img file="US2022121884A1_D7594.tif" /><img file="US2022121884A1_D7595.tif" /><img file="US2022121884A1_D7596.tif" /><img file="US2022121884A1_D7597.tif" /><img file="US2022121884A1_D7598.tif" /><img file="US2022121884A1_D7599.tif" /><img file="US2022121884A1_D7600.tif" /><img file="US2022121884A1_D7601.tif" /><img file="US2022121884A1_D7602.tif" /><img file="US2022121884A1_D7603.tif" /><img file="US2022121884A1_D7604.tif" /><img file="US2022121884A1_D7605.tif" /><img file="US2022121884A1_D7606.tif" /><img file="US2022121884A1_D7607.tif" /><img file="US2022121884A1_D7608.tif" /><img file="US2022121884A1_D7609.tif" /><img file="US2022121884A1_D7610.tif" /><img file="US2022121884A1_D7611.tif" /><img file="US2022121884A1_D7612.tif" /><img file="US2022121884A1_D7613.tif" /><img file="US2022121884A1_D7614.tif" /><img file="US2022121884A1_D7615.tif" /><img file="US2022121884A1_D7616.tif" /><maths id="MATH-US-00025-2" num="00025.2"><math overflow="scroll"><mrow><mstyle><mspace width="1.1em" height="1.1ex" /></mstyle><mo></mo><mrow><mi>subject</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>to</mi></mrow></mrow></math></maths><img file="US2022121884A1_D7617.tif" /><img file="US2022121884A1_D7618.tif" /><img file="US2022121884A1_D7619.tif" /><img file="US2022121884A1_D7620.tif" /><img file="US2022121884A1_D7621.tif" /><img file="US2022121884A1_D7622.tif" /><img file="US2022121884A1_D7623.tif" /><img file="US2022121884A1_D7624.tif" /><img file="US2022121884A1_D7625.tif" /><img file="US2022121884A1_D7626.tif" /><img file="US2022121884A1_D7627.tif" /><img file="US2022121884A1_D7628.tif" /><img file="US2022121884A1_D7629.tif" /><img file="US2022121884A1_D7630.tif" /><img file="US2022121884A1_D7631.tif" /><img file="US2022121884A1_D7632.tif" /><img file="US2022121884A1_D7633.tif" /><img file="US2022121884A1_D7634.tif" /><img file="US2022121884A1_D7635.tif" /><img file="US2022121884A1_D7636.tif" /><img file="US2022121884A1_D7637.tif" /><img file="US2022121884A1_D7638.tif" /><img file="US2022121884A1_D7639.tif" /><img file="US2022121884A1_D7640.tif" /><img file="US2022121884A1_D7641.tif" /><img file="US2022121884A1_D7642.tif" /><img file="US2022121884A1_D7643.tif" /><img file="US2022121884A1_D7644.tif" /><img file="US2022121884A1_D7645.tif" /><img file="US2022121884A1_D7646.tif" /><img file="US2022121884A1_D7647.tif" /><img file="US2022121884A1_D7648.tif" /><img file="US2022121884A1_D7649.tif" /><img file="US2022121884A1_D7650.tif" /><img file="US2022121884A1_D7651.tif" /><img file="US2022121884A1_D7652.tif" /><img file="US2022121884A1_D7653.tif" /><img file="US2022121884A1_D7654.tif" /><img file="US2022121884A1_D7655.tif" /><img file="US2022121884A1_D7656.tif" /><img file="US2022121884A1_D7657.tif" /><img file="US2022121884A1_D7658.tif" /><img file="US2022121884A1_D7659.tif" /><img file="US2022121884A1_D7660.tif" /><img file="US2022121884A1_D7661.tif" /><img file="US2022121884A1_D7662.tif" /><img file="US2022121884A1_D7663.tif" /><img file="US2022121884A1_D7664.tif" /><img file="US2022121884A1_D7665.tif" /><img file="US2022121884A1_D7666.tif" /><img file="US2022121884A1_D7667.tif" /><img file="US2022121884A1_D7668.tif" /><img file="US2022121884A1_D7669.tif" /><img file="US2022121884A1_D7670.tif" /><img file="US2022121884A1_D7671.tif" /><img file="US2022121884A1_D7672.tif" /><img file="US2022121884A1_D7673.tif" /><img file="US2022121884A1_D7674.tif" /><img file="US2022121884A1_D7675.tif" /><img file="US2022121884A1_D7676.tif" /><img file="US2022121884A1_D7677.tif" /><img file="US2022121884A1_D7678.tif" /><img file="US2022121884A1_D7679.tif" /><img file="US2022121884A1_D7680.tif" /><img file="US2022121884A1_D7681.tif" /><img file="US2022121884A1_D7682.tif" /><img file="US2022121884A1_D7683.tif" /><img file="US2022121884A1_D7684.tif" /><img file="US2022121884A1_D7685.tif" /><img file="US2022121884A1_D7686.tif" /><img file="US2022121884A1_D7687.tif" /><img file="US2022121884A1_D7688.tif" /><img file="US2022121884A1_D7689.tif" /><img file="US2022121884A1_D7690.tif" /><img file="US2022121884A1_D7691.tif" /><img file="US2022121884A1_D7692.tif" /><img file="US2022121884A1_D7693.tif" /><img file="US2022121884A1_D7694.tif" /><img file="US2022121884A1_D7695.tif" /><img file="US2022121884A1_D7696.tif" /><img file="US2022121884A1_D7697.tif" /><img file="US2022121884A1_D7698.tif" /><img file="US2022121884A1_D7699.tif" /><img file="US2022121884A1_D7700.tif" /><img file="US2022121884A1_D7701.tif" /><img file="US2022121884A1_D7702.tif" /><img file="US2022121884A1_D7703.tif" /><img file="US2022121884A1_D7704.tif" /><img file="US2022121884A1_D7705.tif" /><img file="US2022121884A1_D7706.tif" /><img file="US2022121884A1_D7707.tif" /><img file="US2022121884A1_D7708.tif" /><img file="US2022121884A1_D7709.tif" /><img file="US2022121884A1_D7710.tif" /><img file="US2022121884A1_D7711.tif" /><img file="US2022121884A1_D7712.tif" /><img file="US2022121884A1_D7713.tif" /><img file="US2022121884A1_D7714.tif" /><img file="US2022121884A1_D7715.tif" /><img file="US2022121884A1_D7716.tif" /><img file="US2022121884A1_D7717.tif" /><img file="US2022121884A1_D7718.tif" /><img file="US2022121884A1_D7719.tif" /><img file="US2022121884A1_D7720.tif" /><img file="US2022121884A1_D7721.tif" /><img file="US2022121884A1_D7722.tif" /><img file="US2022121884A1_D7723.tif" /><img file="US2022121884A1_D7724.tif" /><img file="US2022121884A1_D7725.tif" /><img file="US2022121884A1_D7726.tif" /><img file="US2022121884A1_D7727.tif" /><img file="US2022121884A1_D7728.tif" /><maths id="MATH-US-00025-3" num="00025.3"><math overflow="scroll"><mrow><mstyle><mspace width="1.1em" height="1.1ex" /></mstyle><mo></mo><mrow><msub><mi>p</mi><mi>Z</mi></msub><mo>=</mo><mrow><msub><mi>p</mi><mi>X</mi></msub><mo>∘</mo><msub><mi>p</mi><mi>Y</mi></msub></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D7729.tif" /><img file="US2022121884A1_D7730.tif" /><img file="US2022121884A1_D7731.tif" /><img file="US2022121884A1_D7732.tif" /><img file="US2022121884A1_D7733.tif" /><img file="US2022121884A1_D7734.tif" /><img file="US2022121884A1_D7735.tif" /><img file="US2022121884A1_D7736.tif" /><img file="US2022121884A1_D7737.tif" /><img file="US2022121884A1_D7738.tif" /><img file="US2022121884A1_D7739.tif" /><img file="US2022121884A1_D7740.tif" /><img file="US2022121884A1_D7741.tif" /><img file="US2022121884A1_D7742.tif" /><img file="US2022121884A1_D7743.tif" /><img file="US2022121884A1_D7744.tif" /><img file="US2022121884A1_D7745.tif" /><img file="US2022121884A1_D7746.tif" /><img file="US2022121884A1_D7747.tif" /><img file="US2022121884A1_D7748.tif" /><img file="US2022121884A1_D7749.tif" /><img file="US2022121884A1_D7750.tif" /><img file="US2022121884A1_D7751.tif" /><img file="US2022121884A1_D7752.tif" /><img file="US2022121884A1_D7753.tif" /><img file="US2022121884A1_D7754.tif" /><img file="US2022121884A1_D7755.tif" /><img file="US2022121884A1_D7756.tif" /><img file="US2022121884A1_D7757.tif" /><img file="US2022121884A1_D7758.tif" /><img file="US2022121884A1_D7759.tif" /><img file="US2022121884A1_D7760.tif" /><img file="US2022121884A1_D7761.tif" /><img file="US2022121884A1_D7762.tif" /><img file="US2022121884A1_D7763.tif" /><img file="US2022121884A1_D7764.tif" /><img file="US2022121884A1_D7765.tif" /><img file="US2022121884A1_D7766.tif" /><img file="US2022121884A1_D7767.tif" /><img file="US2022121884A1_D7768.tif" /><img file="US2022121884A1_D7769.tif" /><img file="US2022121884A1_D7770.tif" /><img file="US2022121884A1_D7771.tif" /><img file="US2022121884A1_D7772.tif" /><img file="US2022121884A1_D7773.tif" /><img file="US2022121884A1_D7774.tif" /><img file="US2022121884A1_D7775.tif" /><img file="US2022121884A1_D7776.tif" /><img file="US2022121884A1_D7777.tif" /><img file="US2022121884A1_D7778.tif" /><img file="US2022121884A1_D7779.tif" /><img file="US2022121884A1_D7780.tif" /><img file="US2022121884A1_D7781.tif" /><img file="US2022121884A1_D7782.tif" /><img file="US2022121884A1_D7783.tif" /><img file="US2022121884A1_D7784.tif" /><img file="US2022121884A1_D7785.tif" /><img file="US2022121884A1_D7786.tif" /><img file="US2022121884A1_D7787.tif" /><img file="US2022121884A1_D7788.tif" /><img file="US2022121884A1_D7789.tif" /><img file="US2022121884A1_D7790.tif" /><img file="US2022121884A1_D7791.tif" /><img file="US2022121884A1_D7792.tif" /><img file="US2022121884A1_D7793.tif" /><img file="US2022121884A1_D7794.tif" /><img file="US2022121884A1_D7795.tif" /><img file="US2022121884A1_D7796.tif" /><img file="US2022121884A1_D7797.tif" /><img file="US2022121884A1_D7798.tif" /><img file="US2022121884A1_D7799.tif" /><img file="US2022121884A1_D7800.tif" /><img file="US2022121884A1_D7801.tif" /><img file="US2022121884A1_D7802.tif" /><img file="US2022121884A1_D7803.tif" /><img file="US2022121884A1_D7804.tif" /><img file="US2022121884A1_D7805.tif" /><img file="US2022121884A1_D7806.tif" /><img file="US2022121884A1_D7807.tif" /><img file="US2022121884A1_D7808.tif" /><img file="US2022121884A1_D7809.tif" /><img file="US2022121884A1_D7810.tif" /><img file="US2022121884A1_D7811.tif" /><img file="US2022121884A1_D7812.tif" /><img file="US2022121884A1_D7813.tif" /><img file="US2022121884A1_D7814.tif" /><img file="US2022121884A1_D7815.tif" /><img file="US2022121884A1_D7816.tif" /><img file="US2022121884A1_D7817.tif" /><img file="US2022121884A1_D7818.tif" /><img file="US2022121884A1_D7819.tif" /><img file="US2022121884A1_D7820.tif" /><img file="US2022121884A1_D7821.tif" /><img file="US2022121884A1_D7822.tif" /><img file="US2022121884A1_D7823.tif" /><img file="US2022121884A1_D7824.tif" /><img file="US2022121884A1_D7825.tif" /><img file="US2022121884A1_D7826.tif" /><img file="US2022121884A1_D7827.tif" /><img file="US2022121884A1_D7828.tif" /><img file="US2022121884A1_D7829.tif" /><img file="US2022121884A1_D7830.tif" /><img file="US2022121884A1_D7831.tif" /><img file="US2022121884A1_D7832.tif" /><img file="US2022121884A1_D7833.tif" /><img file="US2022121884A1_D7834.tif" /><img file="US2022121884A1_D7835.tif" /><img file="US2022121884A1_D7836.tif" /><img file="US2022121884A1_D7837.tif" /><img file="US2022121884A1_D7838.tif" /><img file="US2022121884A1_D7839.tif" /><img file="US2022121884A1_D7840.tif" /><maths id="MATH-US-00025-4" num="00025.4"><math overflow="scroll"><mrow><mstyle><mspace width="1.1em" height="1.1ex" /></mstyle><mo></mo><mrow><mrow><msub><mo>∫</mo><mi>R</mi></msub><mo></mo><mrow><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>=</mo><mn>1</mn></mrow></mrow></math></maths><img file="US2022121884A1_D7841.tif" /><img file="US2022121884A1_D7842.tif" /><img file="US2022121884A1_D7843.tif" /><img file="US2022121884A1_D7844.tif" /><img file="US2022121884A1_D7845.tif" /><img file="US2022121884A1_D7846.tif" /><img file="US2022121884A1_D7847.tif" /><img file="US2022121884A1_D7848.tif" /><img file="US2022121884A1_D7849.tif" /><img file="US2022121884A1_D7850.tif" /><img file="US2022121884A1_D7851.tif" /><img file="US2022121884A1_D7852.tif" /><img file="US2022121884A1_D7853.tif" /><img file="US2022121884A1_D7854.tif" /><img file="US2022121884A1_D7855.tif" /><img file="US2022121884A1_D7856.tif" /><img file="US2022121884A1_D7857.tif" /><img file="US2022121884A1_D7858.tif" /><img file="US2022121884A1_D7859.tif" /><img file="US2022121884A1_D7860.tif" /><img file="US2022121884A1_D7861.tif" /><img file="US2022121884A1_D7862.tif" /><img file="US2022121884A1_D7863.tif" /><img file="US2022121884A1_D7864.tif" /><img file="US2022121884A1_D7865.tif" /><img file="US2022121884A1_D7866.tif" /><img file="US2022121884A1_D7867.tif" /><img file="US2022121884A1_D7868.tif" /><img file="US2022121884A1_D7869.tif" /><img file="US2022121884A1_D7870.tif" /><img file="US2022121884A1_D7871.tif" /><img file="US2022121884A1_D7872.tif" /><img file="US2022121884A1_D7873.tif" /><img file="US2022121884A1_D7874.tif" /><img file="US2022121884A1_D7875.tif" /><img file="US2022121884A1_D7876.tif" /><img file="US2022121884A1_D7877.tif" /><img file="US2022121884A1_D7878.tif" /><img file="US2022121884A1_D7879.tif" /><img file="US2022121884A1_D7880.tif" /><img file="US2022121884A1_D7881.tif" /><img file="US2022121884A1_D7882.tif" /><img file="US2022121884A1_D7883.tif" /><img file="US2022121884A1_D7884.tif" /><img file="US2022121884A1_D7885.tif" /><img file="US2022121884A1_D7886.tif" /><img file="US2022121884A1_D7887.tif" /><img file="US2022121884A1_D7888.tif" /><img file="US2022121884A1_D7889.tif" /><img file="US2022121884A1_D7890.tif" /><img file="US2022121884A1_D7891.tif" /><img file="US2022121884A1_D7892.tif" /><img file="US2022121884A1_D7893.tif" /><img file="US2022121884A1_D7894.tif" /><img file="US2022121884A1_D7895.tif" /><img file="US2022121884A1_D7896.tif" /><img file="US2022121884A1_D7897.tif" /><img file="US2022121884A1_D7898.tif" /><img file="US2022121884A1_D7899.tif" /><img file="US2022121884A1_D7900.tif" /><img file="US2022121884A1_D7901.tif" /><img file="US2022121884A1_D7902.tif" /><img file="US2022121884A1_D7903.tif" /><img file="US2022121884A1_D7904.tif" /><img file="US2022121884A1_D7905.tif" /><img file="US2022121884A1_D7906.tif" /><img file="US2022121884A1_D7907.tif" /><img file="US2022121884A1_D7908.tif" /><img file="US2022121884A1_D7909.tif" /><img file="US2022121884A1_D7910.tif" /><img file="US2022121884A1_D7911.tif" /><img file="US2022121884A1_D7912.tif" /><img file="US2022121884A1_D7913.tif" /><img file="US2022121884A1_D7914.tif" /><img file="US2022121884A1_D7915.tif" /><img file="US2022121884A1_D7916.tif" /><img file="US2022121884A1_D7917.tif" /><img file="US2022121884A1_D7918.tif" /><img file="US2022121884A1_D7919.tif" /><img file="US2022121884A1_D7920.tif" /><img file="US2022121884A1_D7921.tif" /><img file="US2022121884A1_D7922.tif" /><img file="US2022121884A1_D7923.tif" /><img file="US2022121884A1_D7924.tif" /><img file="US2022121884A1_D7925.tif" /><img file="US2022121884A1_D7926.tif" /><img file="US2022121884A1_D7927.tif" /><img file="US2022121884A1_D7928.tif" /><img file="US2022121884A1_D7929.tif" /><img file="US2022121884A1_D7930.tif" /><img file="US2022121884A1_D7931.tif" /><img file="US2022121884A1_D7932.tif" /><img file="US2022121884A1_D7933.tif" /><img file="US2022121884A1_D7934.tif" /><img file="US2022121884A1_D7935.tif" /><img file="US2022121884A1_D7936.tif" /><img file="US2022121884A1_D7937.tif" /><img file="US2022121884A1_D7938.tif" /><img file="US2022121884A1_D7939.tif" /><img file="US2022121884A1_D7940.tif" /><img file="US2022121884A1_D7941.tif" /><img file="US2022121884A1_D7942.tif" /><img file="US2022121884A1_D7943.tif" /><img file="US2022121884A1_D7944.tif" /><img file="US2022121884A1_D7945.tif" /><img file="US2022121884A1_D7946.tif" /><img file="US2022121884A1_D7947.tif" /><img file="US2022121884A1_D7948.tif" /><img file="US2022121884A1_D7949.tif" /><img file="US2022121884A1_D7950.tif" /><img file="US2022121884A1_D7951.tif" /><img file="US2022121884A1_D7952.tif" /><maths id="MATH-US-00025-5" num="00025.5"><math overflow="scroll"><mrow><mstyle><mspace width="1.1em" height="1.1ex" /></mstyle><mo></mo><mrow><mrow><msub><mo>∫</mo><mi>R</mi></msub><mo></mo><mrow><mrow><msub><mi>p</mi><mi>Y</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>=</mo><mn>1</mn></mrow></mrow></math></maths><img file="US2022121884A1_D7953.tif" /><img file="US2022121884A1_D7954.tif" /><img file="US2022121884A1_D7955.tif" /><img file="US2022121884A1_D7956.tif" /><img file="US2022121884A1_D7957.tif" /><img file="US2022121884A1_D7958.tif" /><img file="US2022121884A1_D7959.tif" /><img file="US2022121884A1_D7960.tif" /><img file="US2022121884A1_D7961.tif" /><img file="US2022121884A1_D7962.tif" /><img file="US2022121884A1_D7963.tif" /><img file="US2022121884A1_D7964.tif" /><img file="US2022121884A1_D7965.tif" /><img file="US2022121884A1_D7966.tif" /><img file="US2022121884A1_D7967.tif" /><img file="US2022121884A1_D7968.tif" /><img file="US2022121884A1_D7969.tif" /><img file="US2022121884A1_D7970.tif" /><img file="US2022121884A1_D7971.tif" /><img file="US2022121884A1_D7972.tif" /><img file="US2022121884A1_D7973.tif" /><img file="US2022121884A1_D7974.tif" /><img file="US2022121884A1_D7975.tif" /><img file="US2022121884A1_D7976.tif" /><img file="US2022121884A1_D7977.tif" /><img file="US2022121884A1_D7978.tif" /><img file="US2022121884A1_D7979.tif" /><img file="US2022121884A1_D7980.tif" /><img file="US2022121884A1_D7981.tif" /><img file="US2022121884A1_D7982.tif" /><img file="US2022121884A1_D7983.tif" /><img file="US2022121884A1_D7984.tif" /><img file="US2022121884A1_D7985.tif" /><img file="US2022121884A1_D7986.tif" /><img file="US2022121884A1_D7987.tif" /><img file="US2022121884A1_D7988.tif" /><img file="US2022121884A1_D7989.tif" /><img file="US2022121884A1_D7990.tif" /><img file="US2022121884A1_D7991.tif" /><img file="US2022121884A1_D7992.tif" /><img file="US2022121884A1_D7993.tif" /><img file="US2022121884A1_D7994.tif" /><img file="US2022121884A1_D7995.tif" /><img file="US2022121884A1_D7996.tif" /><img file="US2022121884A1_D7997.tif" /><img file="US2022121884A1_D7998.tif" /><img file="US2022121884A1_D7999.tif" /><img file="US2022121884A1_D8000.tif" /><img file="US2022121884A1_D8001.tif" /><img file="US2022121884A1_D8002.tif" /><img file="US2022121884A1_D8003.tif" /><img file="US2022121884A1_D8004.tif" /><img file="US2022121884A1_D8005.tif" /><img file="US2022121884A1_D8006.tif" /><img file="US2022121884A1_D8007.tif" /><img file="US2022121884A1_D8008.tif" /><img file="US2022121884A1_D8009.tif" /><img file="US2022121884A1_D8010.tif" /><img file="US2022121884A1_D8011.tif" /><img file="US2022121884A1_D8012.tif" /><img file="US2022121884A1_D8013.tif" /><img file="US2022121884A1_D8014.tif" /><img file="US2022121884A1_D8015.tif" /><img file="US2022121884A1_D8016.tif" /><img file="US2022121884A1_D8017.tif" /><img file="US2022121884A1_D8018.tif" /><img file="US2022121884A1_D8019.tif" /><img file="US2022121884A1_D8020.tif" /><img file="US2022121884A1_D8021.tif" /><img file="US2022121884A1_D8022.tif" /><img file="US2022121884A1_D8023.tif" /><img file="US2022121884A1_D8024.tif" /><img file="US2022121884A1_D8025.tif" /><img file="US2022121884A1_D8026.tif" /><img file="US2022121884A1_D8027.tif" /><img file="US2022121884A1_D8028.tif" /><img file="US2022121884A1_D8029.tif" /><img file="US2022121884A1_D8030.tif" /><img file="US2022121884A1_D8031.tif" /><img file="US2022121884A1_D8032.tif" /><img file="US2022121884A1_D8033.tif" /><img file="US2022121884A1_D8034.tif" /><img file="US2022121884A1_D8035.tif" /><img file="US2022121884A1_D8036.tif" /><img file="US2022121884A1_D8037.tif" /><img file="US2022121884A1_D8038.tif" /><img file="US2022121884A1_D8039.tif" /><img file="US2022121884A1_D8040.tif" /><img file="US2022121884A1_D8041.tif" /><img file="US2022121884A1_D8042.tif" /><img file="US2022121884A1_D8043.tif" /><img file="US2022121884A1_D8044.tif" /><img file="US2022121884A1_D8045.tif" /><img file="US2022121884A1_D8046.tif" /><img file="US2022121884A1_D8047.tif" /><img file="US2022121884A1_D8048.tif" /><img file="US2022121884A1_D8049.tif" /><img file="US2022121884A1_D8050.tif" /><img file="US2022121884A1_D8051.tif" /><img file="US2022121884A1_D8052.tif" /><img file="US2022121884A1_D8053.tif" /><img file="US2022121884A1_D8054.tif" /><img file="US2022121884A1_D8055.tif" /><img file="US2022121884A1_D8056.tif" /><img file="US2022121884A1_D8057.tif" /><img file="US2022121884A1_D8058.tif" /><img file="US2022121884A1_D8059.tif" /><img file="US2022121884A1_D8060.tif" /><img file="US2022121884A1_D8061.tif" /><img file="US2022121884A1_D8062.tif" /><img file="US2022121884A1_D8063.tif" /><img file="US2022121884A1_D8064.tif" /><maths id="MATH-US-00025-6" num="00025.6"><math overflow="scroll"><mrow><mstyle><mspace width="1.1em" height="1.1ex" /></mstyle><mo></mo><mrow><mrow><msub><mo>∫</mo><mi>R</mi></msub><mo></mo><mrow><mrow><msub><mi>up</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>=</mo><mfrac><mrow><msub><mo>∫</mo><mi>R</mi></msub><mo></mo><mrow><mi>u</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>X</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mrow><msub><mo>∫</mo><mi>R</mi></msub><mo></mo><mrow><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>X</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow></mfrac></mrow></mrow></math></maths><img file="US2022121884A1_D8065.tif" /><img file="US2022121884A1_D8066.tif" /><img file="US2022121884A1_D8067.tif" /><img file="US2022121884A1_D8068.tif" /><img file="US2022121884A1_D8069.tif" /><img file="US2022121884A1_D8070.tif" /><img file="US2022121884A1_D8071.tif" /><img file="US2022121884A1_D8072.tif" /><img file="US2022121884A1_D8073.tif" /><img file="US2022121884A1_D8074.tif" /><img file="US2022121884A1_D8075.tif" /><img file="US2022121884A1_D8076.tif" /><img file="US2022121884A1_D8077.tif" /><img file="US2022121884A1_D8078.tif" /><img file="US2022121884A1_D8079.tif" /><img file="US2022121884A1_D8080.tif" /><img file="US2022121884A1_D8081.tif" /><img file="US2022121884A1_D8082.tif" /><img file="US2022121884A1_D8083.tif" /><img file="US2022121884A1_D8084.tif" /><img file="US2022121884A1_D8085.tif" /><img file="US2022121884A1_D8086.tif" /><img file="US2022121884A1_D8087.tif" /><img file="US2022121884A1_D8088.tif" /><img file="US2022121884A1_D8089.tif" /><img file="US2022121884A1_D8090.tif" /><img file="US2022121884A1_D8091.tif" /><img file="US2022121884A1_D8092.tif" /><img file="US2022121884A1_D8093.tif" /><img file="US2022121884A1_D8094.tif" /><img file="US2022121884A1_D8095.tif" /><img file="US2022121884A1_D8096.tif" /><img file="US2022121884A1_D8097.tif" /><img file="US2022121884A1_D8098.tif" /><img file="US2022121884A1_D8099.tif" /><img file="US2022121884A1_D8100.tif" /><img file="US2022121884A1_D8101.tif" /><img file="US2022121884A1_D8102.tif" /><img file="US2022121884A1_D8103.tif" /><img file="US2022121884A1_D8104.tif" /><img file="US2022121884A1_D8105.tif" /><img file="US2022121884A1_D8106.tif" /><img file="US2022121884A1_D8107.tif" /><img file="US2022121884A1_D8108.tif" /><img file="US2022121884A1_D8109.tif" /><img file="US2022121884A1_D8110.tif" /><img file="US2022121884A1_D8111.tif" /><img file="US2022121884A1_D8112.tif" /><img file="US2022121884A1_D8113.tif" /><img file="US2022121884A1_D8114.tif" /><img file="US2022121884A1_D8115.tif" /><img file="US2022121884A1_D8116.tif" /><img file="US2022121884A1_D8117.tif" /><img file="US2022121884A1_D8118.tif" /><img file="US2022121884A1_D8119.tif" /><img file="US2022121884A1_D8120.tif" /><img file="US2022121884A1_D8121.tif" /><img file="US2022121884A1_D8122.tif" /><img file="US2022121884A1_D8123.tif" /><img file="US2022121884A1_D8124.tif" /><img file="US2022121884A1_D8125.tif" /><img file="US2022121884A1_D8126.tif" /><img file="US2022121884A1_D8127.tif" /><img file="US2022121884A1_D8128.tif" /><img file="US2022121884A1_D8129.tif" /><img file="US2022121884A1_D8130.tif" /><img file="US2022121884A1_D8131.tif" /><img file="US2022121884A1_D8132.tif" /><img file="US2022121884A1_D8133.tif" /><img file="US2022121884A1_D8134.tif" /><img file="US2022121884A1_D8135.tif" /><img file="US2022121884A1_D8136.tif" /><img file="US2022121884A1_D8137.tif" /><img file="US2022121884A1_D8138.tif" /><img file="US2022121884A1_D8139.tif" /><img file="US2022121884A1_D8140.tif" /><img file="US2022121884A1_D8141.tif" /><img file="US2022121884A1_D8142.tif" /><img file="US2022121884A1_D8143.tif" /><img file="US2022121884A1_D8144.tif" /><img file="US2022121884A1_D8145.tif" /><img file="US2022121884A1_D8146.tif" /><img file="US2022121884A1_D8147.tif" /><img file="US2022121884A1_D8148.tif" /><img file="US2022121884A1_D8149.tif" /><img file="US2022121884A1_D8150.tif" /><img file="US2022121884A1_D8151.tif" /><img file="US2022121884A1_D8152.tif" /><img file="US2022121884A1_D8153.tif" /><img file="US2022121884A1_D8154.tif" /><img file="US2022121884A1_D8155.tif" /><img file="US2022121884A1_D8156.tif" /><img file="US2022121884A1_D8157.tif" /><img file="US2022121884A1_D8158.tif" /><img file="US2022121884A1_D8159.tif" /><img file="US2022121884A1_D8160.tif" /><img file="US2022121884A1_D8161.tif" /><img file="US2022121884A1_D8162.tif" /><img file="US2022121884A1_D8163.tif" /><img file="US2022121884A1_D8164.tif" /><img file="US2022121884A1_D8165.tif" /><img file="US2022121884A1_D8166.tif" /><img file="US2022121884A1_D8167.tif" /><img file="US2022121884A1_D8168.tif" /><img file="US2022121884A1_D8169.tif" /><img file="US2022121884A1_D8170.tif" /><img file="US2022121884A1_D8171.tif" /><img file="US2022121884A1_D8172.tif" /><img file="US2022121884A1_D8173.tif" /><img file="US2022121884A1_D8174.tif" /><img file="US2022121884A1_D8175.tif" /><img file="US2022121884A1_D8176.tif" /><maths id="MATH-US-00025-7" num="00025.7"><math overflow="scroll"><mrow><mstyle><mspace width="1.1em" height="1.1ex" /></mstyle><mo></mo><mrow><mrow><msub><mo>∫</mo><mi>R</mi></msub><mo></mo><mrow><mrow><msub><mi>up</mi><mi>Y</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>=</mo><mfrac><mrow><msub><mo>∫</mo><mi>R</mi></msub><mo></mo><mrow><mi>u</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>Y</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mrow><msub><mo>∫</mo><mi>R</mi></msub><mo></mo><mrow><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>Y</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow></mfrac></mrow></mrow></math></maths><img file="US2022121884A1_D8177.tif" /><img file="US2022121884A1_D8178.tif" /><img file="US2022121884A1_D8179.tif" /><img file="US2022121884A1_D8180.tif" /><img file="US2022121884A1_D8181.tif" /><img file="US2022121884A1_D8182.tif" /><img file="US2022121884A1_D8183.tif" /><img file="US2022121884A1_D8184.tif" /><img file="US2022121884A1_D8185.tif" /><img file="US2022121884A1_D8186.tif" /><img file="US2022121884A1_D8187.tif" /><img file="US2022121884A1_D8188.tif" /><img file="US2022121884A1_D8189.tif" /><img file="US2022121884A1_D8190.tif" /><img file="US2022121884A1_D8191.tif" /><img file="US2022121884A1_D8192.tif" /><img file="US2022121884A1_D8193.tif" /><img file="US2022121884A1_D8194.tif" /><img file="US2022121884A1_D8195.tif" /><img file="US2022121884A1_D8196.tif" /><img file="US2022121884A1_D8197.tif" /><img file="US2022121884A1_D8198.tif" /><img file="US2022121884A1_D8199.tif" /><img file="US2022121884A1_D8200.tif" /><img file="US2022121884A1_D8201.tif" /><img file="US2022121884A1_D8202.tif" /><img file="US2022121884A1_D8203.tif" /><img file="US2022121884A1_D8204.tif" /><img file="US2022121884A1_D8205.tif" /><img file="US2022121884A1_D8206.tif" /><img file="US2022121884A1_D8207.tif" /><img file="US2022121884A1_D8208.tif" /><img file="US2022121884A1_D8209.tif" /><img file="US2022121884A1_D8210.tif" /><img file="US2022121884A1_D8211.tif" /><img file="US2022121884A1_D8212.tif" /><img file="US2022121884A1_D8213.tif" /><img file="US2022121884A1_D8214.tif" /><img file="US2022121884A1_D8215.tif" /><img file="US2022121884A1_D8216.tif" /><img file="US2022121884A1_D8217.tif" /><img file="US2022121884A1_D8218.tif" /><img file="US2022121884A1_D8219.tif" /><img file="US2022121884A1_D8220.tif" /><img file="US2022121884A1_D8221.tif" /><img file="US2022121884A1_D8222.tif" /><img file="US2022121884A1_D8223.tif" /><img file="US2022121884A1_D8224.tif" /><img file="US2022121884A1_D8225.tif" /><img file="US2022121884A1_D8226.tif" /><img file="US2022121884A1_D8227.tif" /><img file="US2022121884A1_D8228.tif" /><img file="US2022121884A1_D8229.tif" /><img file="US2022121884A1_D8230.tif" /><img file="US2022121884A1_D8231.tif" /><img file="US2022121884A1_D8232.tif" /><img file="US2022121884A1_D8233.tif" /><img file="US2022121884A1_D8234.tif" /><img file="US2022121884A1_D8235.tif" /><img file="US2022121884A1_D8236.tif" /><img file="US2022121884A1_D8237.tif" /><img file="US2022121884A1_D8238.tif" /><img file="US2022121884A1_D8239.tif" /><img file="US2022121884A1_D8240.tif" /><img file="US2022121884A1_D8241.tif" /><img file="US2022121884A1_D8242.tif" /><img file="US2022121884A1_D8243.tif" /><img file="US2022121884A1_D8244.tif" /><img file="US2022121884A1_D8245.tif" /><img file="US2022121884A1_D8246.tif" /><img file="US2022121884A1_D8247.tif" /><img file="US2022121884A1_D8248.tif" /><img file="US2022121884A1_D8249.tif" /><img file="US2022121884A1_D8250.tif" /><img file="US2022121884A1_D8251.tif" /><img file="US2022121884A1_D8252.tif" /><img file="US2022121884A1_D8253.tif" /><img file="US2022121884A1_D8254.tif" /><img file="US2022121884A1_D8255.tif" /><img file="US2022121884A1_D8256.tif" /><img file="US2022121884A1_D8257.tif" /><img file="US2022121884A1_D8258.tif" /><img file="US2022121884A1_D8259.tif" /><img file="US2022121884A1_D8260.tif" /><img file="US2022121884A1_D8261.tif" /><img file="US2022121884A1_D8262.tif" /><img file="US2022121884A1_D8263.tif" /><img file="US2022121884A1_D8264.tif" /><img file="US2022121884A1_D8265.tif" /><img file="US2022121884A1_D8266.tif" /><img file="US2022121884A1_D8267.tif" /><img file="US2022121884A1_D8268.tif" /><img file="US2022121884A1_D8269.tif" /><img file="US2022121884A1_D8270.tif" /><img file="US2022121884A1_D8271.tif" /><img file="US2022121884A1_D8272.tif" /><img file="US2022121884A1_D8273.tif" /><img file="US2022121884A1_D8274.tif" /><img file="US2022121884A1_D8275.tif" /><img file="US2022121884A1_D8276.tif" /><img file="US2022121884A1_D8277.tif" /><img file="US2022121884A1_D8278.tif" /><img file="US2022121884A1_D8279.tif" /><img file="US2022121884A1_D8280.tif" /><img file="US2022121884A1_D8281.tif" /><img file="US2022121884A1_D8282.tif" /><img file="US2022121884A1_D8283.tif" /><img file="US2022121884A1_D8284.tif" /><img file="US2022121884A1_D8285.tif" /><img file="US2022121884A1_D8286.tif" /><img file="US2022121884A1_D8287.tif" /><img file="US2022121884A1_D8288.tif" />
What is important to keep in mind is that A and B are, for the most part, perception-based and hence intrinsically imprecise. Imprecision of A and B may be exploited by making simplifying assumptions about A and B—assumptions that are aimed at reduction of complexity of computation with Z-numbers and increasing the informativeness of results of computation. Two examples of such assumptions are sketched in the following.
Briefly, a realistic simplifying assumption is that p<sub>X </sub>and p<sub>Y </sub>are parametric distributions, in particular, Gaussian distributions with parameters m<sub>X</sub>, σ<sub>X</sub><sup>2 </sup>and m<sub>Y</sub>, σ<sub>Y</sub><sup>2</sup>, respectively. Compatibility conditions fix the values of m<sub>X </sub>and m<sub>Y</sub>. Consequently, if b<sub>X </sub>and by are numerical measures of certainty, then b<sub>X </sub>and by determine p<sub>X </sub>and p<sub>Y</sub>, respectively. Thus, the assumption that we know b<sub>X </sub>and b<sub>Y </sub>is equivalent to the assumption that we know p<sub>X </sub>and p<sub>Y</sub>. Employing the rules governing computation of functions of Z<sup>+</sup>-numbers, we can compute B<sub>Z </sub>as a function of b<sub>X </sub>and b<sub>Y</sub>. At this point, we recognize that B<sub>X </sub>and B<sub>Y </sub>are restrictions on b<sub>X </sub>and b<sub>Y</sub>, respectively. Employment of a general version of the extension principle leads to B<sub>Z </sub>and completes the process of computation. This may well be a very effective way of computing with Z-numbers. It should be noted that a Gaussian distribution may be viewed as a very special version of a Z-number.
Another effective way of exploiting the imprecision of A and B involves approximation of the trapezoidal membership function of A by an interval-valued membership function, A<sup>b</sup>, where A<sup>b </sup>is the bandwidth of A (<figref idref="DRAWINGS">FIG. 3</figref>). Since A is a crisp set, we can write:
<br />(<i>A</i><sub>X</sub><sup>b</sup><i>, B</i><sub>X</sub>)*(<i>A</i><sub>Y</sub><sup>b</sup><i>, B</i><sub>Y</sub>(=(<i>A</i><sub>X</sub><sup>b</sup><i>*A</i><sub>Y</sub><sup>b</sup><i>, B</i><sub>X</sub><i>×B</i><sub>Y</sub>)
where B<sub>X</sub>×B<sub>Y </sub>is the product of the fuzzy numbers B<sub>X </sub>and B<sub>Y</sub>. Validity of this expression depends on how well an interval-valued membership function approximates to a trapezoidal membership function.
Clearly, the issue of reliability of information is of pivotal importance in planning, decision-making, formulation of algorithms and management of information. There are many important directions which are explored, especially in the realm of calculi of Z-rules and their application to decision analysis and modeling of complex systems.
Computation with Z-numbers may be viewed as a generalization of computation with numbers, intervals, fuzzy numbers and random numbers. More concretely, the levels of generality are: computation with numbers (ground level 1); computation with intervals (level 1); computation with fuzzy numbers (level 2); computation with random numbers (level 2); and computation with Z-numbers (level 3). The higher the level of generality, the greater is the capability to construct realistic models of real-world systems, especially in the realms of economics, decision analysis, risk assessment, planning, analysis of causality and biomedicine.
It should be noted that many numbers, especially in fields such as economics and decision analysis are in reality Z-numbers, but they are not currently treated as such because it is much simpler to compute with numbers than with Z-numbers. Basically, the concept of a Z-number is a step toward formalization of the remarkable human capability to make rational decisions in an environment of imprecision and uncertainty. <figref idref="DRAWINGS">FIG. 108</figref> is an example of such a system described above.
Analysis Methods Using Probability Distributions with Z-Number:
We discussed the probability measure of a fuzzy set A in R<sub>X </sub>based on a hidden probability distribution p<sub>X</sub>, is determined as
<maths id="MATH-US-00026" num="00026"><math overflow="scroll"><mrow><mrow><msub><mi>p</mi><mi>X</mi></msub><mo>·</mo><msub><mi>μ</mi><mi>A</mi></msub></mrow><mo>=</mo><mrow><msubsup><mo>∫</mo><mi>R</mi><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></msubsup><mo></mo><mrow><mrow><msub><mi>μ</mi><mi>A</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><mi>du</mi><mo>.</mo></mrow></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D8289.tif" /><img file="US2022121884A1_D8290.tif" /><img file="US2022121884A1_D8291.tif" /><img file="US2022121884A1_D8292.tif" /><img file="US2022121884A1_D8293.tif" /><img file="US2022121884A1_D8294.tif" /><img file="US2022121884A1_D8295.tif" /><img file="US2022121884A1_D8296.tif" /><img file="US2022121884A1_D8297.tif" /><img file="US2022121884A1_D8298.tif" /><img file="US2022121884A1_D8299.tif" /><img file="US2022121884A1_D8300.tif" /><img file="US2022121884A1_D8301.tif" /><img file="US2022121884A1_D8302.tif" /><img file="US2022121884A1_D8303.tif" /><img file="US2022121884A1_D8304.tif" /><img file="US2022121884A1_D8305.tif" /><img file="US2022121884A1_D8306.tif" /><img file="US2022121884A1_D8307.tif" /><img file="US2022121884A1_D8308.tif" /><img file="US2022121884A1_D8309.tif" /><img file="US2022121884A1_D8310.tif" /><img file="US2022121884A1_D8311.tif" /><img file="US2022121884A1_D8312.tif" /><img file="US2022121884A1_D8313.tif" /><img file="US2022121884A1_D8314.tif" /><img file="US2022121884A1_D8315.tif" /><img file="US2022121884A1_D8316.tif" /><img file="US2022121884A1_D8317.tif" /><img file="US2022121884A1_D8318.tif" /><img file="US2022121884A1_D8319.tif" /><img file="US2022121884A1_D8320.tif" /><img file="US2022121884A1_D8321.tif" /><img file="US2022121884A1_D8322.tif" /><img file="US2022121884A1_D8323.tif" /><img file="US2022121884A1_D8324.tif" /><img file="US2022121884A1_D8325.tif" /><img file="US2022121884A1_D8326.tif" /><img file="US2022121884A1_D8327.tif" /><img file="US2022121884A1_D8328.tif" /><img file="US2022121884A1_D8329.tif" /><img file="US2022121884A1_D8330.tif" /><img file="US2022121884A1_D8331.tif" /><img file="US2022121884A1_D8332.tif" /><img file="US2022121884A1_D8333.tif" /><img file="US2022121884A1_D8334.tif" /><img file="US2022121884A1_D8335.tif" /><img file="US2022121884A1_D8336.tif" /><img file="US2022121884A1_D8337.tif" /><img file="US2022121884A1_D8338.tif" /><img file="US2022121884A1_D8339.tif" /><img file="US2022121884A1_D8340.tif" /><img file="US2022121884A1_D8341.tif" /><img file="US2022121884A1_D8342.tif" /><img file="US2022121884A1_D8343.tif" /><img file="US2022121884A1_D8344.tif" /><img file="US2022121884A1_D8345.tif" /><img file="US2022121884A1_D8346.tif" /><img file="US2022121884A1_D8347.tif" /><img file="US2022121884A1_D8348.tif" /><img file="US2022121884A1_D8349.tif" /><img file="US2022121884A1_D8350.tif" /><img file="US2022121884A1_D8351.tif" /><img file="US2022121884A1_D8352.tif" /><img file="US2022121884A1_D8353.tif" /><img file="US2022121884A1_D8354.tif" /><img file="US2022121884A1_D8355.tif" /><img file="US2022121884A1_D8356.tif" /><img file="US2022121884A1_D8357.tif" /><img file="US2022121884A1_D8358.tif" /><img file="US2022121884A1_D8359.tif" /><img file="US2022121884A1_D8360.tif" /><img file="US2022121884A1_D8361.tif" /><img file="US2022121884A1_D8362.tif" /><img file="US2022121884A1_D8363.tif" /><img file="US2022121884A1_D8364.tif" /><img file="US2022121884A1_D8365.tif" /><img file="US2022121884A1_D8366.tif" /><img file="US2022121884A1_D8367.tif" /><img file="US2022121884A1_D8368.tif" /><img file="US2022121884A1_D8369.tif" /><img file="US2022121884A1_D8370.tif" /><img file="US2022121884A1_D8371.tif" /><img file="US2022121884A1_D8372.tif" /><img file="US2022121884A1_D8373.tif" /><img file="US2022121884A1_D8374.tif" /><img file="US2022121884A1_D8375.tif" /><img file="US2022121884A1_D8376.tif" /><img file="US2022121884A1_D8377.tif" /><img file="US2022121884A1_D8378.tif" /><img file="US2022121884A1_D8379.tif" /><img file="US2022121884A1_D8380.tif" /><img file="US2022121884A1_D8381.tif" /><img file="US2022121884A1_D8382.tif" /><img file="US2022121884A1_D8383.tif" /><img file="US2022121884A1_D8384.tif" /><img file="US2022121884A1_D8385.tif" /><img file="US2022121884A1_D8386.tif" /><img file="US2022121884A1_D8387.tif" /><img file="US2022121884A1_D8388.tif" /><img file="US2022121884A1_D8389.tif" /><img file="US2022121884A1_D8390.tif" /><img file="US2022121884A1_D8391.tif" /><img file="US2022121884A1_D8392.tif" /><img file="US2022121884A1_D8393.tif" /><img file="US2022121884A1_D8394.tif" /><img file="US2022121884A1_D8395.tif" /><img file="US2022121884A1_D8396.tif" /><img file="US2022121884A1_D8397.tif" /><img file="US2022121884A1_D8398.tif" /><img file="US2022121884A1_D8399.tif" /><img file="US2022121884A1_D8400.tif" />
In an evaluation of Z number, this probability measure is restricted by a fuzzy set B, with the restriction determined by
<maths id="MATH-US-00027" num="00027"><math overflow="scroll"><mrow><mrow><msub><mi>μ</mi><mi>B</mi></msub><mo></mo><mrow><mo>(</mo><mrow><msubsup><mo>∫</mo><mi>R</mi><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></msubsup><mo></mo><mrow><mrow><msub><mi>μ</mi><mi>A</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>)</mo></mrow></mrow><mo>.</mo></mrow></math></maths><img file="US2022121884A1_D8401.tif" /><img file="US2022121884A1_D8402.tif" /><img file="US2022121884A1_D8403.tif" /><img file="US2022121884A1_D8404.tif" /><img file="US2022121884A1_D8405.tif" /><img file="US2022121884A1_D8406.tif" /><img file="US2022121884A1_D8407.tif" /><img file="US2022121884A1_D8408.tif" /><img file="US2022121884A1_D8409.tif" /><img file="US2022121884A1_D8410.tif" /><img file="US2022121884A1_D8411.tif" /><img file="US2022121884A1_D8412.tif" /><img file="US2022121884A1_D8413.tif" /><img file="US2022121884A1_D8414.tif" /><img file="US2022121884A1_D8415.tif" /><img file="US2022121884A1_D8416.tif" /><img file="US2022121884A1_D8417.tif" /><img file="US2022121884A1_D8418.tif" /><img file="US2022121884A1_D8419.tif" /><img file="US2022121884A1_D8420.tif" /><img file="US2022121884A1_D8421.tif" /><img file="US2022121884A1_D8422.tif" /><img file="US2022121884A1_D8423.tif" /><img file="US2022121884A1_D8424.tif" /><img file="US2022121884A1_D8425.tif" /><img file="US2022121884A1_D8426.tif" /><img file="US2022121884A1_D8427.tif" /><img file="US2022121884A1_D8428.tif" /><img file="US2022121884A1_D8429.tif" /><img file="US2022121884A1_D8430.tif" /><img file="US2022121884A1_D8431.tif" /><img file="US2022121884A1_D8432.tif" /><img file="US2022121884A1_D8433.tif" /><img file="US2022121884A1_D8434.tif" /><img file="US2022121884A1_D8435.tif" /><img file="US2022121884A1_D8436.tif" /><img file="US2022121884A1_D8437.tif" /><img file="US2022121884A1_D8438.tif" /><img file="US2022121884A1_D8439.tif" /><img file="US2022121884A1_D8440.tif" /><img file="US2022121884A1_D8441.tif" /><img file="US2022121884A1_D8442.tif" /><img file="US2022121884A1_D8443.tif" /><img file="US2022121884A1_D8444.tif" /><img file="US2022121884A1_D8445.tif" /><img file="US2022121884A1_D8446.tif" /><img file="US2022121884A1_D8447.tif" /><img file="US2022121884A1_D8448.tif" /><img file="US2022121884A1_D8449.tif" /><img file="US2022121884A1_D8450.tif" /><img file="US2022121884A1_D8451.tif" /><img file="US2022121884A1_D8452.tif" /><img file="US2022121884A1_D8453.tif" /><img file="US2022121884A1_D8454.tif" /><img file="US2022121884A1_D8455.tif" /><img file="US2022121884A1_D8456.tif" /><img file="US2022121884A1_D8457.tif" /><img file="US2022121884A1_D8458.tif" /><img file="US2022121884A1_D8459.tif" /><img file="US2022121884A1_D8460.tif" /><img file="US2022121884A1_D8461.tif" /><img file="US2022121884A1_D8462.tif" /><img file="US2022121884A1_D8463.tif" /><img file="US2022121884A1_D8464.tif" /><img file="US2022121884A1_D8465.tif" /><img file="US2022121884A1_D8466.tif" /><img file="US2022121884A1_D8467.tif" /><img file="US2022121884A1_D8468.tif" /><img file="US2022121884A1_D8469.tif" /><img file="US2022121884A1_D8470.tif" /><img file="US2022121884A1_D8471.tif" /><img file="US2022121884A1_D8472.tif" /><img file="US2022121884A1_D8473.tif" /><img file="US2022121884A1_D8474.tif" /><img file="US2022121884A1_D8475.tif" /><img file="US2022121884A1_D8476.tif" /><img file="US2022121884A1_D8477.tif" /><img file="US2022121884A1_D8478.tif" /><img file="US2022121884A1_D8479.tif" /><img file="US2022121884A1_D8480.tif" /><img file="US2022121884A1_D8481.tif" /><img file="US2022121884A1_D8482.tif" /><img file="US2022121884A1_D8483.tif" /><img file="US2022121884A1_D8484.tif" /><img file="US2022121884A1_D8485.tif" /><img file="US2022121884A1_D8486.tif" /><img file="US2022121884A1_D8487.tif" /><img file="US2022121884A1_D8488.tif" /><img file="US2022121884A1_D8489.tif" /><img file="US2022121884A1_D8490.tif" /><img file="US2022121884A1_D8491.tif" /><img file="US2022121884A1_D8492.tif" /><img file="US2022121884A1_D8493.tif" /><img file="US2022121884A1_D8494.tif" /><img file="US2022121884A1_D8495.tif" /><img file="US2022121884A1_D8496.tif" /><img file="US2022121884A1_D8497.tif" /><img file="US2022121884A1_D8498.tif" /><img file="US2022121884A1_D8499.tif" /><img file="US2022121884A1_D8500.tif" /><img file="US2022121884A1_D8501.tif" /><img file="US2022121884A1_D8502.tif" /><img file="US2022121884A1_D8503.tif" /><img file="US2022121884A1_D8504.tif" /><img file="US2022121884A1_D8505.tif" /><img file="US2022121884A1_D8506.tif" /><img file="US2022121884A1_D8507.tif" /><img file="US2022121884A1_D8508.tif" /><img file="US2022121884A1_D8509.tif" /><img file="US2022121884A1_D8510.tif" /><img file="US2022121884A1_D8511.tif" /><img file="US2022121884A1_D8512.tif" />
The restriction is then implied on the probability distribution. In an example shown in <figref idref="DRAWINGS">FIGS. 10(<i>a</i>)-(<i>b</i>)</figref>, of a trapezoid like membership function for A is depicted to several candidate probability distributions to illustrate the probability measure, in each case. Note that in this example, a Gaussian distribution is used for illustration purposes, but depending on the context, various types of distributions may be used. A category of distribution, e.g. p<sub>1</sub>(x) and p<sub>4</sub>(x), is concentric with A (or have same or similar center of mass). For a category such as p<sub>1</sub>(x), the confinement is at the core of A, and therefore, the corresponding probability measure of A, v<sub>p1</sub>, is 1, (see <figref idref="DRAWINGS">FIG. 10(<i>c</i>)</figref>). Conversely, a category of distribution with little or no overlap with A, e.g., p<sub>2</sub>(x) and p<sub>3</sub>(x), have a corresponding probability measure of 0 (i.e., v<sub>p2 </sub>and v<sub>p3</sub>). The other categories resulting in probability measure (0, 1), include those such as p<sub>4</sub>(x), p<sub>5</sub>(x), and p<sub>6</sub>(x). As mentioned above, p<sub>4</sub>(x) is concentric with A, but it has large enough variance to exceed core of A, resulting probability measure (V<sub>p4</sub>) of less than 1. p<sub>5</sub>(x) resembles a delta probability distribution (i.e., with sharply defined location), which essentially picks covered values of μ<sub>A</sub>(x) as the probability measure. When placed at the fuzzy edge of A, it results in probability measure, v<sub>p5</sub>, in (0, 1) range depending on μ<sub>A</sub>(x). Such a distribution, for example, is useful for testing purposes. p<sub>6</sub>(x) demonstrates a category that encompasses portions of support or core of A, resulting in a probability measure (V<sub>p4</sub>) in (0, 1). Unlike p<sub>5</sub>(x), p<sub>6</sub>(x) is not tied to A's core, providing a flexibility to adjust its variance and location to span various probability measures for A. Turning to <figref idref="DRAWINGS">FIG. 10(<i>c</i>)</figref>, category of distributions resulting in probability measures in (0, 1) are of particular interest, as they sample and span the restriction membership function μ<sub>B</sub>(v), where
<maths id="MATH-US-00028" num="00028"><math overflow="scroll"><mrow><mi>v</mi><mo></mo><mrow><msubsup><mo>∫</mo><mi>R</mi><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></msubsup><mo></mo><mrow><mrow><msub><mi>μ</mi><mi>A</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><mi>du</mi><mo>.</mo></mrow></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D8513.tif" /><img file="US2022121884A1_D8514.tif" /><img file="US2022121884A1_D8515.tif" /><img file="US2022121884A1_D8516.tif" /><img file="US2022121884A1_D8517.tif" /><img file="US2022121884A1_D8518.tif" /><img file="US2022121884A1_D8519.tif" /><img file="US2022121884A1_D8520.tif" /><img file="US2022121884A1_D8521.tif" /><img file="US2022121884A1_D8522.tif" /><img file="US2022121884A1_D8523.tif" /><img file="US2022121884A1_D8524.tif" /><img file="US2022121884A1_D8525.tif" /><img file="US2022121884A1_D8526.tif" /><img file="US2022121884A1_D8527.tif" /><img file="US2022121884A1_D8528.tif" /><img file="US2022121884A1_D8529.tif" /><img file="US2022121884A1_D8530.tif" /><img file="US2022121884A1_D8531.tif" /><img file="US2022121884A1_D8532.tif" /><img file="US2022121884A1_D8533.tif" /><img file="US2022121884A1_D8534.tif" /><img file="US2022121884A1_D8535.tif" /><img file="US2022121884A1_D8536.tif" /><img file="US2022121884A1_D8537.tif" /><img file="US2022121884A1_D8538.tif" /><img file="US2022121884A1_D8539.tif" /><img file="US2022121884A1_D8540.tif" /><img file="US2022121884A1_D8541.tif" /><img file="US2022121884A1_D8542.tif" /><img file="US2022121884A1_D8543.tif" /><img file="US2022121884A1_D8544.tif" /><img file="US2022121884A1_D8545.tif" /><img file="US2022121884A1_D8546.tif" /><img file="US2022121884A1_D8547.tif" /><img file="US2022121884A1_D8548.tif" /><img file="US2022121884A1_D8549.tif" /><img file="US2022121884A1_D8550.tif" /><img file="US2022121884A1_D8551.tif" /><img file="US2022121884A1_D8552.tif" /><img file="US2022121884A1_D8553.tif" /><img file="US2022121884A1_D8554.tif" /><img file="US2022121884A1_D8555.tif" /><img file="US2022121884A1_D8556.tif" /><img file="US2022121884A1_D8557.tif" /><img file="US2022121884A1_D8558.tif" /><img file="US2022121884A1_D8559.tif" /><img file="US2022121884A1_D8560.tif" /><img file="US2022121884A1_D8561.tif" /><img file="US2022121884A1_D8562.tif" /><img file="US2022121884A1_D8563.tif" /><img file="US2022121884A1_D8564.tif" /><img file="US2022121884A1_D8565.tif" /><img file="US2022121884A1_D8566.tif" /><img file="US2022121884A1_D8567.tif" /><img file="US2022121884A1_D8568.tif" /><img file="US2022121884A1_D8569.tif" /><img file="US2022121884A1_D8570.tif" /><img file="US2022121884A1_D8571.tif" /><img file="US2022121884A1_D8572.tif" /><img file="US2022121884A1_D8573.tif" /><img file="US2022121884A1_D8574.tif" /><img file="US2022121884A1_D8575.tif" /><img file="US2022121884A1_D8576.tif" /><img file="US2022121884A1_D8577.tif" /><img file="US2022121884A1_D8578.tif" /><img file="US2022121884A1_D8579.tif" /><img file="US2022121884A1_D8580.tif" /><img file="US2022121884A1_D8581.tif" /><img file="US2022121884A1_D8582.tif" /><img file="US2022121884A1_D8583.tif" /><img file="US2022121884A1_D8584.tif" /><img file="US2022121884A1_D8585.tif" /><img file="US2022121884A1_D8586.tif" /><img file="US2022121884A1_D8587.tif" /><img file="US2022121884A1_D8588.tif" /><img file="US2022121884A1_D8589.tif" /><img file="US2022121884A1_D8590.tif" /><img file="US2022121884A1_D8591.tif" /><img file="US2022121884A1_D8592.tif" /><img file="US2022121884A1_D8593.tif" /><img file="US2022121884A1_D8594.tif" /><img file="US2022121884A1_D8595.tif" /><img file="US2022121884A1_D8596.tif" /><img file="US2022121884A1_D8597.tif" /><img file="US2022121884A1_D8598.tif" /><img file="US2022121884A1_D8599.tif" /><img file="US2022121884A1_D8600.tif" /><img file="US2022121884A1_D8601.tif" /><img file="US2022121884A1_D8602.tif" /><img file="US2022121884A1_D8603.tif" /><img file="US2022121884A1_D8604.tif" /><img file="US2022121884A1_D8605.tif" /><img file="US2022121884A1_D8606.tif" /><img file="US2022121884A1_D8607.tif" /><img file="US2022121884A1_D8608.tif" /><img file="US2022121884A1_D8609.tif" /><img file="US2022121884A1_D8610.tif" /><img file="US2022121884A1_D8611.tif" /><img file="US2022121884A1_D8612.tif" /><img file="US2022121884A1_D8613.tif" /><img file="US2022121884A1_D8614.tif" /><img file="US2022121884A1_D8615.tif" /><img file="US2022121884A1_D8616.tif" /><img file="US2022121884A1_D8617.tif" /><img file="US2022121884A1_D8618.tif" /><img file="US2022121884A1_D8619.tif" /><img file="US2022121884A1_D8620.tif" /><img file="US2022121884A1_D8621.tif" /><img file="US2022121884A1_D8622.tif" /><img file="US2022121884A1_D8623.tif" /><img file="US2022121884A1_D8624.tif" />
<figref idref="DRAWINGS">FIG. 10(<i>c</i>)</figref>, also shows three types of restriction denoted by B, B′, and B″. Restriction B with high membership values for higher measures of probability of A, (e.g., for v<sub>p1 </sub>and V<sub>p4</sub>) demonstrates restrictions such as “very sure” or “very likely”. These in turn tend to restrict the probability distributions to those such as p<sub>1</sub>(x), p<sub>4</sub>(x), which present strong coverage of A, to relative exclusion of other categories such as p<sub>2</sub>(x), p<sub>3</sub>(x). In such a case, the informativeness of Z number (A, B), turns on the preciseness of both A and B, i.e., the more precise A and B are, the more restricted p<sub>X </sub>can be. On the other hand, restriction B′ with high membership values for low measures of probability of A, (e.g., for V<sub>p2 </sub>and v<sub>p3</sub>) demonstrates restrictions such as “very seldom” or “highly unlikely”. Such restrictions tend to reject distributions such as p<sub>1</sub>(x) or p<sub>4</sub>(x), in favor of those showing less or no overlap with A. Therefore, if A has a wide and imprecise nature, such a Z number would actually appear to be informative, as the possible distributions are restricted to cover those more precise regions in R corresponding to not A. Thus, in such a case, the informativeness of Z number (A, B), turns on the preciseness of both not A and B. Similarly, restriction B″ with high membership values for medium measures of probability of A, (e.g., for V<sub>p5 </sub>and v<sub>p6 </sub>or even V<sub>p4</sub>), demonstrates restrictions such as “often” and “possible”. These tend to restrict the distributions to those over-encompassing A (such as p<sub>4</sub>(x)) or those encompassing or located at the fuzzy edges of A (such as p<sub>6</sub>(x) and p<sub>5</sub>(x)).
In one embodiment, as depicted for example in <figref idref="DRAWINGS">FIG. 10(<i>d</i>)</figref>, the particular probability measures (e.g., v<sub>min</sub>, v<sub>mid </sub>and v<sub>max</sub>) defined by restriction B are determined, such as midpoint or corner points of membership function μ<sub>B</sub>(v). In one embodiment, probability measures (v) corresponding to multiple cuts of μ<sub>B</sub>(v) at (e.g., predefined levels) are determined. In one embodiment, these particular probability measures (v) for a fuzzy set (A<sub>x</sub>) of a given variable X are used to determine the corresponding probability measures (ω) for a fuzzy set (A<sub>y</sub>) on variable Y through a method such as extension principle. This targeted approach will reduce the amount of computation resources (memory and time) needed to determine restriction B<sub>y </sub>on probability measure of A<sub>y</sub>.
In one embodiment, a particular class/template/type; of probability distribution is selected to extend the restriction on p<sub>X </sub>onto restriction on p<sub>X</sub>'s parameters. For example, in one embodiment, a normal or Gaussian distribution is taken for p<sub>X </sub>(as shown in <figref idref="DRAWINGS">FIG. 11(<i>a</i>)</figref>) with two parameters, mean and standard deviation, (m<sub>x</sub>, σ<sub>x</sub>), representing the distribution. In one embodiment, the typical or standard-shape membership functions (e.g., triangular, trapezoid, one-sided sloped step-up, one-sided sloped step-down, etc.) are normalized or taken in their normalized form to determine the probability measure against various parameters of the probability distributions (used in the same normalized domain as the fuzzy set). For example, <figref idref="DRAWINGS">FIG. 11(<i>a</i>)</figref> depicts a symmetric trapezoid membership function μ<sub>A</sub>(x), normalized (and shifted) so that its support extends from −1 to 1 and its core at membership value of 1 (extending from −r to r, with respect to its support). In one embodiment, the normalization makes X a dimensionless quantity. The probability distribution, e.g., N(m<sub>x</sub>, σ<sub>x</sub>), is used in the same normalized scale as A. (Note that, to denormalize the distribution, the shift and scaling is used to determine denormalized m<sub>x </sub>while the scaling is used inversely to determine denormalized σ<sub>x</sub>.) In such normalized scale, the probability measure is determined, e.g., by:
<maths id="MATH-US-00029" num="00029"><math overflow="scroll"><mrow><mrow><msub><mi>p</mi><mi>X</mi></msub><mo>·</mo><msub><mi>μ</mi><mi>X</mi></msub></mrow><mo>=</mo><mrow><mrow><msubsup><mo>∫</mo><mi>R</mi><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></msubsup><mo></mo><mrow><mrow><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo>·</mo><mrow><msub><mi>μ</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>=</mo><mrow><mrow><mrow><msubsup><mo>∫</mo><mrow><mo>-</mo><mn>1</mn></mrow><mrow><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><mo>-</mo><mi>r</mi></mrow></mrow></msubsup><mo></mo><mrow><mrow><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo>·</mo><mrow><msub><mi>μ</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>+</mo><mrow><msubsup><mo>∫</mo><mrow><mo>-</mo><mi>r</mi></mrow><mrow><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>r</mi></mrow></msubsup><mo></mo><mrow><mrow><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo>·</mo><mrow><msub><mi>μ</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>+</mo><mrow><msubsup><mo>∫</mo><mi>r</mi><mrow><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>1</mn></mrow></msubsup><mo></mo><mrow><mrow><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo>·</mo><mrow><msub><mi>μ</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow></mrow><mo>=</mo><mrow><mrow><mfrac><mn>1</mn><mrow><mn>1</mn><mo>-</mo><mi>r</mi></mrow></mfrac><mo></mo><mrow><msubsup><mo>∫</mo><mrow><mo>-</mo><mn>1</mn></mrow><mrow><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>1</mn></mrow></msubsup><mo></mo><mrow><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow></mrow><mo>-</mo><mrow><mfrac><mi>r</mi><mrow><mn>1</mn><mo>-</mo><mi>r</mi></mrow></mfrac><mo></mo><mrow><msubsup><mo>∫</mo><mrow><mo>-</mo><mi>r</mi></mrow><mrow><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>r</mi></mrow></msubsup><mo></mo><mrow><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow></mrow><mo>+</mo><mrow><mfrac><mn>1</mn><mrow><mn>1</mn><mo>-</mo><mi>r</mi></mrow></mfrac><mo></mo><mrow><msubsup><mo>∫</mo><mrow><mo>-</mo><mn>1</mn></mrow><mrow><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>1</mn></mrow></msubsup><mo></mo><mrow><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow></mrow><mo>-</mo><mrow><mfrac><mi>r</mi><mrow><mn>1</mn><mo>-</mo><mi>r</mi></mrow></mfrac><mo></mo><mrow><msubsup><mo>∫</mo><mrow><mo>-</mo><mi>r</mi></mrow><mrow><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>r</mi></mrow></msubsup><mo></mo><mrow><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow></mrow></mrow></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D8625.tif" /><img file="US2022121884A1_D8626.tif" /><img file="US2022121884A1_D8627.tif" /><img file="US2022121884A1_D8628.tif" /><img file="US2022121884A1_D8629.tif" /><img file="US2022121884A1_D8630.tif" /><img file="US2022121884A1_D8631.tif" /><img file="US2022121884A1_D8632.tif" /><img file="US2022121884A1_D8633.tif" /><img file="US2022121884A1_D8634.tif" /><img file="US2022121884A1_D8635.tif" /><img file="US2022121884A1_D8636.tif" /><img file="US2022121884A1_D8637.tif" /><img file="US2022121884A1_D8638.tif" /><img file="US2022121884A1_D8639.tif" /><img file="US2022121884A1_D8640.tif" /><img file="US2022121884A1_D8641.tif" /><img file="US2022121884A1_D8642.tif" /><img file="US2022121884A1_D8643.tif" /><img file="US2022121884A1_D8644.tif" /><img file="US2022121884A1_D8645.tif" /><img file="US2022121884A1_D8646.tif" /><img file="US2022121884A1_D8647.tif" /><img file="US2022121884A1_D8648.tif" /><img file="US2022121884A1_D8649.tif" /><img file="US2022121884A1_D8650.tif" /><img file="US2022121884A1_D8651.tif" /><img file="US2022121884A1_D8652.tif" /><img file="US2022121884A1_D8653.tif" /><img file="US2022121884A1_D8654.tif" /><img file="US2022121884A1_D8655.tif" /><img file="US2022121884A1_D8656.tif" /><img file="US2022121884A1_D8657.tif" /><img file="US2022121884A1_D8658.tif" /><img file="US2022121884A1_D8659.tif" /><img file="US2022121884A1_D8660.tif" /><img file="US2022121884A1_D8661.tif" /><img file="US2022121884A1_D8662.tif" /><img file="US2022121884A1_D8663.tif" /><img file="US2022121884A1_D8664.tif" /><img file="US2022121884A1_D8665.tif" /><img file="US2022121884A1_D8666.tif" /><img file="US2022121884A1_D8667.tif" /><img file="US2022121884A1_D8668.tif" /><img file="US2022121884A1_D8669.tif" /><img file="US2022121884A1_D8670.tif" /><img file="US2022121884A1_D8671.tif" /><img file="US2022121884A1_D8672.tif" /><img file="US2022121884A1_D8673.tif" /><img file="US2022121884A1_D8674.tif" /><img file="US2022121884A1_D8675.tif" /><img file="US2022121884A1_D8676.tif" /><img file="US2022121884A1_D8677.tif" /><img file="US2022121884A1_D8678.tif" /><img file="US2022121884A1_D8679.tif" /><img file="US2022121884A1_D8680.tif" /><img file="US2022121884A1_D8681.tif" /><img file="US2022121884A1_D8682.tif" /><img file="US2022121884A1_D8683.tif" /><img file="US2022121884A1_D8684.tif" /><img file="US2022121884A1_D8685.tif" /><img file="US2022121884A1_D8686.tif" /><img file="US2022121884A1_D8687.tif" /><img file="US2022121884A1_D8688.tif" /><img file="US2022121884A1_D8689.tif" /><img file="US2022121884A1_D8690.tif" /><img file="US2022121884A1_D8691.tif" /><img file="US2022121884A1_D8692.tif" /><img file="US2022121884A1_D8693.tif" /><img file="US2022121884A1_D8694.tif" /><img file="US2022121884A1_D8695.tif" /><img file="US2022121884A1_D8696.tif" /><img file="US2022121884A1_D8697.tif" /><img file="US2022121884A1_D8698.tif" /><img file="US2022121884A1_D8699.tif" /><img file="US2022121884A1_D8700.tif" /><img file="US2022121884A1_D8701.tif" /><img file="US2022121884A1_D8702.tif" /><img file="US2022121884A1_D8703.tif" /><img file="US2022121884A1_D8704.tif" /><img file="US2022121884A1_D8705.tif" /><img file="US2022121884A1_D8706.tif" /><img file="US2022121884A1_D8707.tif" /><img file="US2022121884A1_D8708.tif" /><img file="US2022121884A1_D8709.tif" /><img file="US2022121884A1_D8710.tif" /><img file="US2022121884A1_D8711.tif" /><img file="US2022121884A1_D8712.tif" /><img file="US2022121884A1_D8713.tif" /><img file="US2022121884A1_D8714.tif" /><img file="US2022121884A1_D8715.tif" /><img file="US2022121884A1_D8716.tif" /><img file="US2022121884A1_D8717.tif" /><img file="US2022121884A1_D8718.tif" /><img file="US2022121884A1_D8719.tif" /><img file="US2022121884A1_D8720.tif" /><img file="US2022121884A1_D8721.tif" /><img file="US2022121884A1_D8722.tif" /><img file="US2022121884A1_D8723.tif" /><img file="US2022121884A1_D8724.tif" /><img file="US2022121884A1_D8725.tif" /><img file="US2022121884A1_D8726.tif" /><img file="US2022121884A1_D8727.tif" /><img file="US2022121884A1_D8728.tif" /><img file="US2022121884A1_D8729.tif" /><img file="US2022121884A1_D8730.tif" /><img file="US2022121884A1_D8731.tif" /><img file="US2022121884A1_D8732.tif" /><img file="US2022121884A1_D8733.tif" /><img file="US2022121884A1_D8734.tif" /><img file="US2022121884A1_D8735.tif" /><img file="US2022121884A1_D8736.tif" />
For p<sub>X </sub>as N(m<sub>x</sub>, σ<sub>x</sub>), the above probability measure of A, is reduced to expression with erf and exp terms with m<sub>x</sub>, σ<sub>x </sub>and r. In one embodiment, the probability measures are pre-determined/calculated/tabulated for various values of m<sub>x</sub>, σ<sub>x </sub>and r. Note that any denormalization on X does not affect the probability measure, while a denormalization in μ<sub>A</sub>(x) (i.e., maximum membership value) scales the probability measure.
In one embodiment, (p<sub>X</sub>·μ<sub>X</sub>) (here denoted as υ) is determined and/or stored in a model database, for various p<sub>X</sub>. For example, υ is depicted versus σ<sub>x</sub>, in <figref idref="DRAWINGS">FIG. 11(<i>b</i>)</figref>, for various m<sub>x </sub>(from 0, to 3), based on a trapezoid μ<sub>X </sub>with r=0.5. At low values of σ<sub>x</sub>, p<sub>X </sub>resembles a delta function picking up values of μ<sub>X </sub>evaluated at m<sub>x</sub>. For example, <figref idref="DRAWINGS">FIG. 11(<i>c</i>)</figref>, plot of υ depicts the trace of μ<sub>X </sub>(as dotted line) at low σ<sub>x</sub>. As shown on <figref idref="DRAWINGS">FIGS. 11(<i>b</i>)-(<i>c</i>)</figref>, at high values of σ<sub>x</sub>, υ drops is less sensitive to m<sub>x </sub>due to increased width of p<sub>X</sub>. In one embodiment, various p<sub>X </sub>may be determined for a target value of υ. For example, as depicted in <figref idref="DRAWINGS">FIG. 11(<i>d</i>)</figref>, the contour lines of υ are illustrated at ˜0, 0.2, 0.4, 0.6, 0.8, and ˜1. Similarly, <figref idref="DRAWINGS">FIG. 11(<i>e</i>)</figref> depicts various contour lines for υ. In one embodiment, involving Z-valuation (X, A<sub>x</sub>, B<sub>x</sub>), μ<sub>B</sub><sub><sub2>x </sub2></sub>is used to restrict the probability measure υ (=p<sub>X</sub>·μ<sub>A</sub><sub><sub2>X</sub2></sub>). For example, as depicted in <figref idref="DRAWINGS">FIG. 11(<i>f</i>)</figref>, μ<sub>B</sub><sub><sub2>X </sub2></sub>is a step up membership function with ramp from υ<sub>min </sub>and υ<sub>max </sub>(see <figref idref="DRAWINGS">FIGS. 10(<i>d</i>)</figref>) of 0.4 and 0.8. Applying the restriction to υ(p<sub>X</sub>) or υ(m<sub>x</sub>, σ<sub>x</sub>), the restriction, μ<sub>B</sub><sub><sub2>x</sub2></sub>(υ), may be extended to a candidate p<sub>X </sub>or (m<sub>x</sub>, σ<sub>x</sub>), as depicted in <figref idref="DRAWINGS">FIG. 11(<i>g</i>)</figref>. A contour map of μ<sub>B</sub><sub><sub2>x</sub2></sub>(m<sub>x</sub>, σ<sub>x</sub>) is for example depicted in <figref idref="DRAWINGS">FIG. 11(<i>h</i>)</figref>. In this example, the contour lines of μ<sub>B</sub><sub><sub2>x </sub2></sub>are shown for μ<sub>B</sub><sub><sub2>x </sub2></sub>of 1, 0.5, and 0, which based on membership function of μ<sub>B</sub><sub><sub2>x</sub2></sub>(υ) (see <figref idref="DRAWINGS">FIG. 11(<i>f</i>)</figref>), correspond to υ values of 0.8, 0.6, and 0.4, respectively. As illustrated, these contour lines coincide from <figref idref="DRAWINGS">FIGS. 11(<i>e</i>) and (<i>h</i>)</figref>.
In one embodiment, based on μ<sub>B</sub><sub><sub2>x</sub2></sub>(υ), for various υ's (e.g., υ<sub>min</sub>, υ<sub>mid</sub>, and/or υ<sub>max</sub>), close p<sub>X</sub>'s or (m<sub>x</sub>, σ<sub>x</sub>)'s candidate are determined, e.g., by tracking/determining the contour lines, via (mesh) interpolation using test (or random) p<sub>X</sub>'s or (m<sub>x</sub>, σ<sub>x</sub>) (e.g., by using a root finding method such as Secant method). In one embodiment, these subsets of p<sub>X</sub>'s or (m<sub>x</sub>, σ<sub>x</sub>) reduce the computation resources needed to apply the restriction on other variables or probability distributions.
For example, in a setting where Y=F(X), Z-valuation (X, A<sub>x</sub>, B<sub>y</sub>) may be extended to (Y, A<sub>y</sub>, B<sub>y</sub>) through restrictions on p<sub>X</sub>. In one embodiment, where A<sub>y </sub>is determined via extension principle using F(X) and A<sub>x</sub>, B<sub>y </sub>is determined by finding the restrictions on probability measure of A<sub>y</sub>. In one embodiment, F(X) is monotonic, i.e., X=F<sup>−1</sup>(Y) is unique.
<maths id="MATH-US-00030" num="00030"><math overflow="scroll"><mrow><mstyle><mspace width="4.4em" height="4.4ex" /></mstyle><mo></mo><mrow><mrow><mrow><msub><mi>p</mi><mi>Y</mi></msub><mo></mo><mrow><mo>(</mo><mi>y</mi><mo>)</mo></mrow></mrow><mo>·</mo><mi>dy</mi></mrow><mo>=</mo><mrow><mrow><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>x</mi><mo>)</mo></mrow></mrow><mo>·</mo><msub><mi>δ</mi><mi>XY</mi></msub><mo>·</mo><mrow><msub><mi>dxp</mi><mi>Y</mi></msub><mo></mo><mrow><mo>(</mo><mi>y</mi><mo>)</mo></mrow></mrow></mrow><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>or</mi></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D8737.tif" /><img file="US2022121884A1_D8738.tif" /><img file="US2022121884A1_D8739.tif" /><img file="US2022121884A1_D8740.tif" /><img file="US2022121884A1_D8741.tif" /><img file="US2022121884A1_D8742.tif" /><img file="US2022121884A1_D8743.tif" /><img file="US2022121884A1_D8744.tif" /><img file="US2022121884A1_D8745.tif" /><img file="US2022121884A1_D8746.tif" /><img file="US2022121884A1_D8747.tif" /><img file="US2022121884A1_D8748.tif" /><img file="US2022121884A1_D8749.tif" /><img file="US2022121884A1_D8750.tif" /><img file="US2022121884A1_D8751.tif" /><img file="US2022121884A1_D8752.tif" /><img file="US2022121884A1_D8753.tif" /><img file="US2022121884A1_D8754.tif" /><img file="US2022121884A1_D8755.tif" /><img file="US2022121884A1_D8756.tif" /><img file="US2022121884A1_D8757.tif" /><img file="US2022121884A1_D8758.tif" /><img file="US2022121884A1_D8759.tif" /><img file="US2022121884A1_D8760.tif" /><img file="US2022121884A1_D8761.tif" /><img file="US2022121884A1_D8762.tif" /><img file="US2022121884A1_D8763.tif" /><img file="US2022121884A1_D8764.tif" /><img file="US2022121884A1_D8765.tif" /><img file="US2022121884A1_D8766.tif" /><img file="US2022121884A1_D8767.tif" /><img file="US2022121884A1_D8768.tif" /><img file="US2022121884A1_D8769.tif" /><img file="US2022121884A1_D8770.tif" /><img file="US2022121884A1_D8771.tif" /><img file="US2022121884A1_D8772.tif" /><img file="US2022121884A1_D8773.tif" /><img file="US2022121884A1_D8774.tif" /><img file="US2022121884A1_D8775.tif" /><img file="US2022121884A1_D8776.tif" /><img file="US2022121884A1_D8777.tif" /><img file="US2022121884A1_D8778.tif" /><img file="US2022121884A1_D8779.tif" /><img file="US2022121884A1_D8780.tif" /><img file="US2022121884A1_D8781.tif" /><img file="US2022121884A1_D8782.tif" /><img file="US2022121884A1_D8783.tif" /><img file="US2022121884A1_D8784.tif" /><img file="US2022121884A1_D8785.tif" /><img file="US2022121884A1_D8786.tif" /><img file="US2022121884A1_D8787.tif" /><img file="US2022121884A1_D8788.tif" /><img file="US2022121884A1_D8789.tif" /><img file="US2022121884A1_D8790.tif" /><img file="US2022121884A1_D8791.tif" /><img file="US2022121884A1_D8792.tif" /><img file="US2022121884A1_D8793.tif" /><img file="US2022121884A1_D8794.tif" /><img file="US2022121884A1_D8795.tif" /><img file="US2022121884A1_D8796.tif" /><img file="US2022121884A1_D8797.tif" /><img file="US2022121884A1_D8798.tif" /><img file="US2022121884A1_D8799.tif" /><img file="US2022121884A1_D8800.tif" /><img file="US2022121884A1_D8801.tif" /><img file="US2022121884A1_D8802.tif" /><img file="US2022121884A1_D8803.tif" /><img file="US2022121884A1_D8804.tif" /><img file="US2022121884A1_D8805.tif" /><img file="US2022121884A1_D8806.tif" /><img file="US2022121884A1_D8807.tif" /><img file="US2022121884A1_D8808.tif" /><img file="US2022121884A1_D8809.tif" /><img file="US2022121884A1_D8810.tif" /><img file="US2022121884A1_D8811.tif" /><img file="US2022121884A1_D8812.tif" /><img file="US2022121884A1_D8813.tif" /><img file="US2022121884A1_D8814.tif" /><img file="US2022121884A1_D8815.tif" /><img file="US2022121884A1_D8816.tif" /><img file="US2022121884A1_D8817.tif" /><img file="US2022121884A1_D8818.tif" /><img file="US2022121884A1_D8819.tif" /><img file="US2022121884A1_D8820.tif" /><img file="US2022121884A1_D8821.tif" /><img file="US2022121884A1_D8822.tif" /><img file="US2022121884A1_D8823.tif" /><img file="US2022121884A1_D8824.tif" /><img file="US2022121884A1_D8825.tif" /><img file="US2022121884A1_D8826.tif" /><img file="US2022121884A1_D8827.tif" /><img file="US2022121884A1_D8828.tif" /><img file="US2022121884A1_D8829.tif" /><img file="US2022121884A1_D8830.tif" /><img file="US2022121884A1_D8831.tif" /><img file="US2022121884A1_D8832.tif" /><img file="US2022121884A1_D8833.tif" /><img file="US2022121884A1_D8834.tif" /><img file="US2022121884A1_D8835.tif" /><img file="US2022121884A1_D8836.tif" /><img file="US2022121884A1_D8837.tif" /><img file="US2022121884A1_D8838.tif" /><img file="US2022121884A1_D8839.tif" /><img file="US2022121884A1_D8840.tif" /><img file="US2022121884A1_D8841.tif" /><img file="US2022121884A1_D8842.tif" /><img file="US2022121884A1_D8843.tif" /><img file="US2022121884A1_D8844.tif" /><img file="US2022121884A1_D8845.tif" /><img file="US2022121884A1_D8846.tif" /><img file="US2022121884A1_D8847.tif" /><img file="US2022121884A1_D8848.tif" /><maths id="MATH-US-00030-2" num="00030.2"><math overflow="scroll"><mrow><mrow><msub><mi>p</mi><mi>Y</mi></msub><mo></mo><mrow><mo>(</mo><mi>y</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mrow><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>x</mi><mo>)</mo></mrow></mrow><mo>·</mo><msub><mi>δ</mi><mi>XY</mi></msub><mo>·</mo><msup><mrow><mo>(</mo><mfrac><mi>dy</mi><mi>dx</mi></mfrac><mo>)</mo></mrow><mrow><mo>-</mo><mn>1</mn></mrow></msup></mrow><mo>=</mo><mrow><mrow><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>x</mi><mo>)</mo></mrow></mrow><mo>·</mo><msub><mi>δ</mi><mi>XY</mi></msub><mo>·</mo><msup><mrow><mo>(</mo><mrow><msup><mi>F</mi><mi>′</mi></msup><mo></mo><mrow><mo>(</mo><mi>x</mi><mo>)</mo></mrow></mrow><mo>)</mo></mrow><mrow><mo>-</mo><mn>1</mn></mrow></msup></mrow><mo>=</mo><mrow><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>x</mi><mo>)</mo></mrow></mrow><mo>·</mo><msub><mi>δ</mi><mi>XY</mi></msub><mo>·</mo><msup><mrow><mi>abs</mi><mo></mo><mrow><mo>(</mo><mrow><msup><mi>F</mi><mi>′</mi></msup><mo></mo><mrow><mo>(</mo><mi>x</mi><mo>)</mo></mrow></mrow><mo>)</mo></mrow></mrow><mrow><mo>-</mo><mn>1</mn></mrow></msup></mrow></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D8849.tif" /><img file="US2022121884A1_D8850.tif" /><img file="US2022121884A1_D8851.tif" /><img file="US2022121884A1_D8852.tif" /><img file="US2022121884A1_D8853.tif" /><img file="US2022121884A1_D8854.tif" /><img file="US2022121884A1_D8855.tif" /><img file="US2022121884A1_D8856.tif" /><img file="US2022121884A1_D8857.tif" /><img file="US2022121884A1_D8858.tif" /><img file="US2022121884A1_D8859.tif" /><img file="US2022121884A1_D8860.tif" /><img file="US2022121884A1_D8861.tif" /><img file="US2022121884A1_D8862.tif" /><img file="US2022121884A1_D8863.tif" /><img file="US2022121884A1_D8864.tif" /><img file="US2022121884A1_D8865.tif" /><img file="US2022121884A1_D8866.tif" /><img file="US2022121884A1_D8867.tif" /><img file="US2022121884A1_D8868.tif" /><img file="US2022121884A1_D8869.tif" /><img file="US2022121884A1_D8870.tif" /><img file="US2022121884A1_D8871.tif" /><img file="US2022121884A1_D8872.tif" /><img file="US2022121884A1_D8873.tif" /><img file="US2022121884A1_D8874.tif" /><img file="US2022121884A1_D8875.tif" /><img file="US2022121884A1_D8876.tif" /><img file="US2022121884A1_D8877.tif" /><img file="US2022121884A1_D8878.tif" /><img file="US2022121884A1_D8879.tif" /><img file="US2022121884A1_D8880.tif" /><img file="US2022121884A1_D8881.tif" /><img file="US2022121884A1_D8882.tif" /><img file="US2022121884A1_D8883.tif" /><img file="US2022121884A1_D8884.tif" /><img file="US2022121884A1_D8885.tif" /><img file="US2022121884A1_D8886.tif" /><img file="US2022121884A1_D8887.tif" /><img file="US2022121884A1_D8888.tif" /><img file="US2022121884A1_D8889.tif" /><img file="US2022121884A1_D8890.tif" /><img file="US2022121884A1_D8891.tif" /><img file="US2022121884A1_D8892.tif" /><img file="US2022121884A1_D8893.tif" /><img file="US2022121884A1_D8894.tif" /><img file="US2022121884A1_D8895.tif" /><img file="US2022121884A1_D8896.tif" /><img file="US2022121884A1_D8897.tif" /><img file="US2022121884A1_D8898.tif" /><img file="US2022121884A1_D8899.tif" /><img file="US2022121884A1_D8900.tif" /><img file="US2022121884A1_D8901.tif" /><img file="US2022121884A1_D8902.tif" /><img file="US2022121884A1_D8903.tif" /><img file="US2022121884A1_D8904.tif" /><img file="US2022121884A1_D8905.tif" /><img file="US2022121884A1_D8906.tif" /><img file="US2022121884A1_D8907.tif" /><img file="US2022121884A1_D8908.tif" /><img file="US2022121884A1_D8909.tif" /><img file="US2022121884A1_D8910.tif" /><img file="US2022121884A1_D8911.tif" /><img file="US2022121884A1_D8912.tif" /><img file="US2022121884A1_D8913.tif" /><img file="US2022121884A1_D8914.tif" /><img file="US2022121884A1_D8915.tif" /><img file="US2022121884A1_D8916.tif" /><img file="US2022121884A1_D8917.tif" /><img file="US2022121884A1_D8918.tif" /><img file="US2022121884A1_D8919.tif" /><img file="US2022121884A1_D8920.tif" /><img file="US2022121884A1_D8921.tif" /><img file="US2022121884A1_D8922.tif" /><img file="US2022121884A1_D8923.tif" /><img file="US2022121884A1_D8924.tif" /><img file="US2022121884A1_D8925.tif" /><img file="US2022121884A1_D8926.tif" /><img file="US2022121884A1_D8927.tif" /><img file="US2022121884A1_D8928.tif" /><img file="US2022121884A1_D8929.tif" /><img file="US2022121884A1_D8930.tif" /><img file="US2022121884A1_D8931.tif" /><img file="US2022121884A1_D8932.tif" /><img file="US2022121884A1_D8933.tif" /><img file="US2022121884A1_D8934.tif" /><img file="US2022121884A1_D8935.tif" /><img file="US2022121884A1_D8936.tif" /><img file="US2022121884A1_D8937.tif" /><img file="US2022121884A1_D8938.tif" /><img file="US2022121884A1_D8939.tif" /><img file="US2022121884A1_D8940.tif" /><img file="US2022121884A1_D8941.tif" /><img file="US2022121884A1_D8942.tif" /><img file="US2022121884A1_D8943.tif" /><img file="US2022121884A1_D8944.tif" /><img file="US2022121884A1_D8945.tif" /><img file="US2022121884A1_D8946.tif" /><img file="US2022121884A1_D8947.tif" /><img file="US2022121884A1_D8948.tif" /><img file="US2022121884A1_D8949.tif" /><img file="US2022121884A1_D8950.tif" /><img file="US2022121884A1_D8951.tif" /><img file="US2022121884A1_D8952.tif" /><img file="US2022121884A1_D8953.tif" /><img file="US2022121884A1_D8954.tif" /><img file="US2022121884A1_D8955.tif" /><img file="US2022121884A1_D8956.tif" /><img file="US2022121884A1_D8957.tif" /><img file="US2022121884A1_D8958.tif" /><img file="US2022121884A1_D8959.tif" /><img file="US2022121884A1_D8960.tif" />
where δ<sub>xy </sub>is (+1) if F(X) is (monotonically) increasing and it is (−1) if F(X) is decreasing.
The extension principle also provides that, μ<sub>A</sub><sub><sub2>x</sub2></sub>(x) is μ<sub>A</sub><sub><sub2>y</sub2></sub>(y), where y=F(x). Therefore, the probability measure of A<sub>y</sub>, denoted as ω (=p<sub>Y</sub>·μ<sub>A</sub><sub><sub2>y</sub2></sub>), becomes the same as υ, for the same p<sub>X </sub>or (m<sub>x</sub>, σ<sub>x</sub>), as shown below:
<maths id="MATH-US-00031" num="00031"><math overflow="scroll"><mrow><mi>ω</mi><mo>=</mo><mrow><mrow><msub><mi>p</mi><mi>Y</mi></msub><mo>·</mo><msub><mi>μ</mi><msub><mi>A</mi><mi>y</mi></msub></msub></mrow><mo>=</mo><mrow><mrow><munder><mover><mo>∫</mo><msub><mi>y</mi><mi>max</mi></msub></mover><msub><mi>y</mi><mi>min</mi></msub></munder><mo></mo><mrow><mrow><msub><mi>p</mi><mi>Y</mi></msub><mo></mo><mrow><mo>(</mo><mi>y</mi><mo>)</mo></mrow></mrow><mo>·</mo><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>y</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>y</mi><mo>)</mo></mrow></mrow><mo>·</mo><mi>dy</mi></mrow></mrow><mo>=</mo><mrow><mrow><munder><mover><mo>∫</mo><mrow><msup><mi>F</mi><mrow><mo>-</mo><mn>1</mn></mrow></msup><mo></mo><mrow><mo>(</mo><msub><mi>y</mi><mi>max</mi></msub><mo>)</mo></mrow></mrow></mover><mrow><msup><mi>F</mi><mrow><mo>-</mo><mn>1</mn></mrow></msup><mo></mo><mrow><mo>(</mo><msub><mi>y</mi><mi>min</mi></msub><mo>)</mo></mrow></mrow></munder><mo></mo><mrow><mrow><msub><mi>p</mi><mi>Y</mi></msub><mo></mo><mrow><mo>(</mo><mi>y</mi><mo>)</mo></mrow></mrow><mo>·</mo><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>y</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>y</mi><mo>)</mo></mrow></mrow><mo>·</mo><mrow><mo>(</mo><mfrac><mi>dy</mi><mi>dx</mi></mfrac><mo>)</mo></mrow><mo>·</mo><mi>dx</mi></mrow></mrow><mo>=</mo><mrow><mrow><munder><mover><mo>∫</mo><mrow><msup><mi>F</mi><mrow><mo>-</mo><mn>1</mn></mrow></msup><mo></mo><mrow><mo>(</mo><msub><mi>y</mi><mi>max</mi></msub><mo>)</mo></mrow></mrow></mover><mrow><msup><mi>F</mi><mrow><mo>-</mo><mn>1</mn></mrow></msup><mo></mo><mrow><mo>(</mo><msub><mi>y</mi><mi>min</mi></msub><mo>)</mo></mrow></mrow></munder><mo></mo><mrow><mrow><msub><mi>p</mi><mi>Y</mi></msub><mo></mo><mrow><mo>(</mo><mi>y</mi><mo>)</mo></mrow></mrow><mo>·</mo><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>x</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>x</mi><mo>)</mo></mrow></mrow><mo>·</mo><mrow><mo>(</mo><mfrac><mi>dy</mi><mi>dx</mi></mfrac><mo>)</mo></mrow><mo>·</mo><mi>dx</mi></mrow></mrow><mo>=</mo><mrow><mrow><munder><mover><mo>∫</mo><mrow><msup><mi>F</mi><mrow><mo>-</mo><mn>1</mn></mrow></msup><mo></mo><mrow><mo>(</mo><msub><mi>y</mi><mi>max</mi></msub><mo>)</mo></mrow></mrow></mover><mrow><msup><mi>F</mi><mrow><mo>-</mo><mn>1</mn></mrow></msup><mo></mo><mrow><mo>(</mo><msub><mi>y</mi><mi>min</mi></msub><mo>)</mo></mrow></mrow></munder><mo></mo><mrow><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>x</mi><mo>)</mo></mrow></mrow><mo>·</mo><msub><mi>δ</mi><mi>XY</mi></msub><mo>·</mo><msup><mrow><mo>(</mo><mrow><msup><mi>F</mi><mi>′</mi></msup><mo></mo><mrow><mo>(</mo><mi>x</mi><mo>)</mo></mrow></mrow><mo>)</mo></mrow><mrow><mo>-</mo><mn>1</mn></mrow></msup><mo>·</mo><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>x</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>x</mi><mo>)</mo></mrow></mrow><mo>·</mo><mrow><mo>(</mo><mfrac><mi>dy</mi><mi>dx</mi></mfrac><mo>)</mo></mrow><mo>·</mo><mi>dx</mi></mrow></mrow><mo>=</mo><mrow><mrow><munder><mover><mo>∫</mo><msub><mi>x</mi><mi>max</mi></msub></mover><msub><mi>x</mi><mi>min</mi></msub></munder><mo></mo><mrow><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>x</mi><mo>)</mo></mrow></mrow><mo>·</mo><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>x</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>x</mi><mo>)</mo></mrow></mrow><mo>·</mo><mi>dx</mi></mrow></mrow><mo>=</mo><mi>v</mi></mrow></mrow></mrow></mrow></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D8961.tif" /><img file="US2022121884A1_D8962.tif" /><img file="US2022121884A1_D8963.tif" /><img file="US2022121884A1_D8964.tif" /><img file="US2022121884A1_D8965.tif" /><img file="US2022121884A1_D8966.tif" /><img file="US2022121884A1_D8967.tif" /><img file="US2022121884A1_D8968.tif" /><img file="US2022121884A1_D8969.tif" /><img file="US2022121884A1_D8970.tif" /><img file="US2022121884A1_D8971.tif" /><img file="US2022121884A1_D8972.tif" /><img file="US2022121884A1_D8973.tif" /><img file="US2022121884A1_D8974.tif" /><img file="US2022121884A1_D8975.tif" /><img file="US2022121884A1_D8976.tif" /><img file="US2022121884A1_D8977.tif" /><img file="US2022121884A1_D8978.tif" /><img file="US2022121884A1_D8979.tif" /><img file="US2022121884A1_D8980.tif" /><img file="US2022121884A1_D8981.tif" /><img file="US2022121884A1_D8982.tif" /><img file="US2022121884A1_D8983.tif" /><img file="US2022121884A1_D8984.tif" /><img file="US2022121884A1_D8985.tif" /><img file="US2022121884A1_D8986.tif" /><img file="US2022121884A1_D8987.tif" /><img file="US2022121884A1_D8988.tif" /><img file="US2022121884A1_D8989.tif" /><img file="US2022121884A1_D8990.tif" /><img file="US2022121884A1_D8991.tif" /><img file="US2022121884A1_D8992.tif" /><img file="US2022121884A1_D8993.tif" /><img file="US2022121884A1_D8994.tif" /><img file="US2022121884A1_D8995.tif" /><img file="US2022121884A1_D8996.tif" /><img file="US2022121884A1_D8997.tif" /><img file="US2022121884A1_D8998.tif" /><img file="US2022121884A1_D8999.tif" /><img file="US2022121884A1_D9000.tif" /><img file="US2022121884A1_D9001.tif" /><img file="US2022121884A1_D9002.tif" /><img file="US2022121884A1_D9003.tif" /><img file="US2022121884A1_D9004.tif" /><img file="US2022121884A1_D9005.tif" /><img file="US2022121884A1_D9006.tif" /><img file="US2022121884A1_D9007.tif" /><img file="US2022121884A1_D9008.tif" /><img file="US2022121884A1_D9009.tif" /><img file="US2022121884A1_D9010.tif" /><img file="US2022121884A1_D9011.tif" /><img file="US2022121884A1_D9012.tif" /><img file="US2022121884A1_D9013.tif" /><img file="US2022121884A1_D9014.tif" /><img file="US2022121884A1_D9015.tif" /><img file="US2022121884A1_D9016.tif" /><img file="US2022121884A1_D9017.tif" /><img file="US2022121884A1_D9018.tif" /><img file="US2022121884A1_D9019.tif" /><img file="US2022121884A1_D9020.tif" /><img file="US2022121884A1_D9021.tif" /><img file="US2022121884A1_D9022.tif" /><img file="US2022121884A1_D9023.tif" /><img file="US2022121884A1_D9024.tif" /><img file="US2022121884A1_D9025.tif" /><img file="US2022121884A1_D9026.tif" /><img file="US2022121884A1_D9027.tif" /><img file="US2022121884A1_D9028.tif" /><img file="US2022121884A1_D9029.tif" /><img file="US2022121884A1_D9030.tif" /><img file="US2022121884A1_D9031.tif" /><img file="US2022121884A1_D9032.tif" /><img file="US2022121884A1_D9033.tif" /><img file="US2022121884A1_D9034.tif" /><img file="US2022121884A1_D9035.tif" /><img file="US2022121884A1_D9036.tif" /><img file="US2022121884A1_D9037.tif" /><img file="US2022121884A1_D9038.tif" /><img file="US2022121884A1_D9039.tif" /><img file="US2022121884A1_D9040.tif" /><img file="US2022121884A1_D9041.tif" /><img file="US2022121884A1_D9042.tif" /><img file="US2022121884A1_D9043.tif" /><img file="US2022121884A1_D9044.tif" /><img file="US2022121884A1_D9045.tif" /><img file="US2022121884A1_D9046.tif" /><img file="US2022121884A1_D9047.tif" /><img file="US2022121884A1_D9048.tif" /><img file="US2022121884A1_D9049.tif" /><img file="US2022121884A1_D9050.tif" /><img file="US2022121884A1_D9051.tif" /><img file="US2022121884A1_D9052.tif" /><img file="US2022121884A1_D9053.tif" /><img file="US2022121884A1_D9054.tif" /><img file="US2022121884A1_D9055.tif" /><img file="US2022121884A1_D9056.tif" /><img file="US2022121884A1_D9057.tif" /><img file="US2022121884A1_D9058.tif" /><img file="US2022121884A1_D9059.tif" /><img file="US2022121884A1_D9060.tif" /><img file="US2022121884A1_D9061.tif" /><img file="US2022121884A1_D9062.tif" /><img file="US2022121884A1_D9063.tif" /><img file="US2022121884A1_D9064.tif" /><img file="US2022121884A1_D9065.tif" /><img file="US2022121884A1_D9066.tif" /><img file="US2022121884A1_D9067.tif" /><img file="US2022121884A1_D9068.tif" /><img file="US2022121884A1_D9069.tif" /><img file="US2022121884A1_D9070.tif" /><img file="US2022121884A1_D9071.tif" /><img file="US2022121884A1_D9072.tif" />
Therefore, μ<sub>B</sub><sub><sub2>y</sub2></sub>(ω) becomes identical to μ<sub>B</sub><sub><sub2>x</sub2></sub>(υ) (for any candidate p<sub>X</sub>), when F(X) is monotonic and A<sub>y </sub>is determined via extension principle from A<sub>x </sub>and F(X). This result does not hold when F(X) is not monotonic, but it may be used as first order approximation, in one embodiment. For example, for non-monotonic F(X), still assuming A<sub>y </sub>is determined via extension principle from A<sub>x </sub>and F(X):
<maths id="MATH-US-00032" num="00032"><math overflow="scroll"><mrow><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>y</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>y</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><munder><mi>sup</mi><mrow><mo>∀</mo><msup><mi>x</mi><mi>′</mi></msup></mrow></munder><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>x</mi></msub></msub><mo></mo><mrow><mo>(</mo><msup><mi>x</mi><mi>′</mi></msup><mo>)</mo></mrow></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D9073.tif" /><img file="US2022121884A1_D9074.tif" /><img file="US2022121884A1_D9075.tif" /><img file="US2022121884A1_D9076.tif" /><img file="US2022121884A1_D9077.tif" /><img file="US2022121884A1_D9078.tif" /><img file="US2022121884A1_D9079.tif" /><img file="US2022121884A1_D9080.tif" /><img file="US2022121884A1_D9081.tif" /><img file="US2022121884A1_D9082.tif" /><img file="US2022121884A1_D9083.tif" /><img file="US2022121884A1_D9084.tif" /><img file="US2022121884A1_D9085.tif" /><img file="US2022121884A1_D9086.tif" /><img file="US2022121884A1_D9087.tif" /><img file="US2022121884A1_D9088.tif" /><img file="US2022121884A1_D9089.tif" /><img file="US2022121884A1_D9090.tif" /><img file="US2022121884A1_D9091.tif" /><img file="US2022121884A1_D9092.tif" /><img file="US2022121884A1_D9093.tif" /><img file="US2022121884A1_D9094.tif" /><img file="US2022121884A1_D9095.tif" /><img file="US2022121884A1_D9096.tif" /><img file="US2022121884A1_D9097.tif" /><img file="US2022121884A1_D9098.tif" /><img file="US2022121884A1_D9099.tif" /><img file="US2022121884A1_D9100.tif" /><img file="US2022121884A1_D9101.tif" /><img file="US2022121884A1_D9102.tif" /><img file="US2022121884A1_D9103.tif" /><img file="US2022121884A1_D9104.tif" /><img file="US2022121884A1_D9105.tif" /><img file="US2022121884A1_D9106.tif" /><img file="US2022121884A1_D9107.tif" /><img file="US2022121884A1_D9108.tif" /><img file="US2022121884A1_D9109.tif" /><img file="US2022121884A1_D9110.tif" /><img file="US2022121884A1_D9111.tif" /><img file="US2022121884A1_D9112.tif" /><img file="US2022121884A1_D9113.tif" /><img file="US2022121884A1_D9114.tif" /><img file="US2022121884A1_D9115.tif" /><img file="US2022121884A1_D9116.tif" /><img file="US2022121884A1_D9117.tif" /><img file="US2022121884A1_D9118.tif" /><img file="US2022121884A1_D9119.tif" /><img file="US2022121884A1_D9120.tif" /><img file="US2022121884A1_D9121.tif" /><img file="US2022121884A1_D9122.tif" /><img file="US2022121884A1_D9123.tif" /><img file="US2022121884A1_D9124.tif" /><img file="US2022121884A1_D9125.tif" /><img file="US2022121884A1_D9126.tif" /><img file="US2022121884A1_D9127.tif" /><img file="US2022121884A1_D9128.tif" /><img file="US2022121884A1_D9129.tif" /><img file="US2022121884A1_D9130.tif" /><img file="US2022121884A1_D9131.tif" /><img file="US2022121884A1_D9132.tif" /><img file="US2022121884A1_D9133.tif" /><img file="US2022121884A1_D9134.tif" /><img file="US2022121884A1_D9135.tif" /><img file="US2022121884A1_D9136.tif" /><img file="US2022121884A1_D9137.tif" /><img file="US2022121884A1_D9138.tif" /><img file="US2022121884A1_D9139.tif" /><img file="US2022121884A1_D9140.tif" /><img file="US2022121884A1_D9141.tif" /><img file="US2022121884A1_D9142.tif" /><img file="US2022121884A1_D9143.tif" /><img file="US2022121884A1_D9144.tif" /><img file="US2022121884A1_D9145.tif" /><img file="US2022121884A1_D9146.tif" /><img file="US2022121884A1_D9147.tif" /><img file="US2022121884A1_D9148.tif" /><img file="US2022121884A1_D9149.tif" /><img file="US2022121884A1_D9150.tif" /><img file="US2022121884A1_D9151.tif" /><img file="US2022121884A1_D9152.tif" /><img file="US2022121884A1_D9153.tif" /><img file="US2022121884A1_D9154.tif" /><img file="US2022121884A1_D9155.tif" /><img file="US2022121884A1_D9156.tif" /><img file="US2022121884A1_D9157.tif" /><img file="US2022121884A1_D9158.tif" /><img file="US2022121884A1_D9159.tif" /><img file="US2022121884A1_D9160.tif" /><img file="US2022121884A1_D9161.tif" /><img file="US2022121884A1_D9162.tif" /><img file="US2022121884A1_D9163.tif" /><img file="US2022121884A1_D9164.tif" /><img file="US2022121884A1_D9165.tif" /><img file="US2022121884A1_D9166.tif" /><img file="US2022121884A1_D9167.tif" /><img file="US2022121884A1_D9168.tif" /><img file="US2022121884A1_D9169.tif" /><img file="US2022121884A1_D9170.tif" /><img file="US2022121884A1_D9171.tif" /><img file="US2022121884A1_D9172.tif" /><img file="US2022121884A1_D9173.tif" /><img file="US2022121884A1_D9174.tif" /><img file="US2022121884A1_D9175.tif" /><img file="US2022121884A1_D9176.tif" /><img file="US2022121884A1_D9177.tif" /><img file="US2022121884A1_D9178.tif" /><img file="US2022121884A1_D9179.tif" /><img file="US2022121884A1_D9180.tif" /><img file="US2022121884A1_D9181.tif" /><img file="US2022121884A1_D9182.tif" /><img file="US2022121884A1_D9183.tif" /><img file="US2022121884A1_D9184.tif" /><maths id="MATH-US-00032-2" num="00032.2"><math overflow="scroll"><mi>where</mi></math></maths><img file="US2022121884A1_D9185.tif" /><img file="US2022121884A1_D9186.tif" /><img file="US2022121884A1_D9187.tif" /><img file="US2022121884A1_D9188.tif" /><img file="US2022121884A1_D9189.tif" /><img file="US2022121884A1_D9190.tif" /><img file="US2022121884A1_D9191.tif" /><img file="US2022121884A1_D9192.tif" /><img file="US2022121884A1_D9193.tif" /><img file="US2022121884A1_D9194.tif" /><img file="US2022121884A1_D9195.tif" /><img file="US2022121884A1_D9196.tif" /><img file="US2022121884A1_D9197.tif" /><img file="US2022121884A1_D9198.tif" /><img file="US2022121884A1_D9199.tif" /><img file="US2022121884A1_D9200.tif" /><img file="US2022121884A1_D9201.tif" /><img file="US2022121884A1_D9202.tif" /><img file="US2022121884A1_D9203.tif" /><img file="US2022121884A1_D9204.tif" /><img file="US2022121884A1_D9205.tif" /><img file="US2022121884A1_D9206.tif" /><img file="US2022121884A1_D9207.tif" /><img file="US2022121884A1_D9208.tif" /><img file="US2022121884A1_D9209.tif" /><img file="US2022121884A1_D9210.tif" /><img file="US2022121884A1_D9211.tif" /><img file="US2022121884A1_D9212.tif" /><img file="US2022121884A1_D9213.tif" /><img file="US2022121884A1_D9214.tif" /><img file="US2022121884A1_D9215.tif" /><img file="US2022121884A1_D9216.tif" /><img file="US2022121884A1_D9217.tif" /><img file="US2022121884A1_D9218.tif" /><img file="US2022121884A1_D9219.tif" /><img file="US2022121884A1_D9220.tif" /><img file="US2022121884A1_D9221.tif" /><img file="US2022121884A1_D9222.tif" /><img file="US2022121884A1_D9223.tif" /><img file="US2022121884A1_D9224.tif" /><img file="US2022121884A1_D9225.tif" /><img file="US2022121884A1_D9226.tif" /><img file="US2022121884A1_D9227.tif" /><img file="US2022121884A1_D9228.tif" /><img file="US2022121884A1_D9229.tif" /><img file="US2022121884A1_D9230.tif" /><img file="US2022121884A1_D9231.tif" /><img file="US2022121884A1_D9232.tif" /><img file="US2022121884A1_D9233.tif" /><img file="US2022121884A1_D9234.tif" /><img file="US2022121884A1_D9235.tif" /><img file="US2022121884A1_D9236.tif" /><img file="US2022121884A1_D9237.tif" /><img file="US2022121884A1_D9238.tif" /><img file="US2022121884A1_D9239.tif" /><img file="US2022121884A1_D9240.tif" /><img file="US2022121884A1_D9241.tif" /><img file="US2022121884A1_D9242.tif" /><img file="US2022121884A1_D9243.tif" /><img file="US2022121884A1_D9244.tif" /><img file="US2022121884A1_D9245.tif" /><img file="US2022121884A1_D9246.tif" /><img file="US2022121884A1_D9247.tif" /><img file="US2022121884A1_D9248.tif" /><img file="US2022121884A1_D9249.tif" /><img file="US2022121884A1_D9250.tif" /><img file="US2022121884A1_D9251.tif" /><img file="US2022121884A1_D9252.tif" /><img file="US2022121884A1_D9253.tif" /><img file="US2022121884A1_D9254.tif" /><img file="US2022121884A1_D9255.tif" /><img file="US2022121884A1_D9256.tif" /><img file="US2022121884A1_D9257.tif" /><img file="US2022121884A1_D9258.tif" /><img file="US2022121884A1_D9259.tif" /><img file="US2022121884A1_D9260.tif" /><img file="US2022121884A1_D9261.tif" /><img file="US2022121884A1_D9262.tif" /><img file="US2022121884A1_D9263.tif" /><img file="US2022121884A1_D9264.tif" /><img file="US2022121884A1_D9265.tif" /><img file="US2022121884A1_D9266.tif" /><img file="US2022121884A1_D9267.tif" /><img file="US2022121884A1_D9268.tif" /><img file="US2022121884A1_D9269.tif" /><img file="US2022121884A1_D9270.tif" /><img file="US2022121884A1_D9271.tif" /><img file="US2022121884A1_D9272.tif" /><img file="US2022121884A1_D9273.tif" /><img file="US2022121884A1_D9274.tif" /><img file="US2022121884A1_D9275.tif" /><img file="US2022121884A1_D9276.tif" /><img file="US2022121884A1_D9277.tif" /><img file="US2022121884A1_D9278.tif" /><img file="US2022121884A1_D9279.tif" /><img file="US2022121884A1_D9280.tif" /><img file="US2022121884A1_D9281.tif" /><img file="US2022121884A1_D9282.tif" /><img file="US2022121884A1_D9283.tif" /><img file="US2022121884A1_D9284.tif" /><img file="US2022121884A1_D9285.tif" /><img file="US2022121884A1_D9286.tif" /><img file="US2022121884A1_D9287.tif" /><img file="US2022121884A1_D9288.tif" /><img file="US2022121884A1_D9289.tif" /><img file="US2022121884A1_D9290.tif" /><img file="US2022121884A1_D9291.tif" /><img file="US2022121884A1_D9292.tif" /><img file="US2022121884A1_D9293.tif" /><img file="US2022121884A1_D9294.tif" /><img file="US2022121884A1_D9295.tif" /><img file="US2022121884A1_D9296.tif" /><maths id="MATH-US-00032-3" num="00032.3"><math overflow="scroll"><mrow><msup><mi>x</mi><mi>′</mi></msup><mo>∈</mo><mrow><mo>{</mo><mrow><mi>solutions</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>of</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mrow><msup><mi>F</mi><mrow><mo>-</mo><mn>1</mn></mrow></msup><mo></mo><mrow><mo>(</mo><mi>y</mi><mo>)</mo></mrow></mrow></mrow><mo>}</mo></mrow></mrow></math></maths><img file="US2022121884A1_D9297.tif" /><img file="US2022121884A1_D9298.tif" /><img file="US2022121884A1_D9299.tif" /><img file="US2022121884A1_D9300.tif" /><img file="US2022121884A1_D9301.tif" /><img file="US2022121884A1_D9302.tif" /><img file="US2022121884A1_D9303.tif" /><img file="US2022121884A1_D9304.tif" /><img file="US2022121884A1_D9305.tif" /><img file="US2022121884A1_D9306.tif" /><img file="US2022121884A1_D9307.tif" /><img file="US2022121884A1_D9308.tif" /><img file="US2022121884A1_D9309.tif" /><img file="US2022121884A1_D9310.tif" /><img file="US2022121884A1_D9311.tif" /><img file="US2022121884A1_D9312.tif" /><img file="US2022121884A1_D9313.tif" /><img file="US2022121884A1_D9314.tif" /><img file="US2022121884A1_D9315.tif" /><img file="US2022121884A1_D9316.tif" /><img file="US2022121884A1_D9317.tif" /><img file="US2022121884A1_D9318.tif" /><img file="US2022121884A1_D9319.tif" /><img file="US2022121884A1_D9320.tif" /><img file="US2022121884A1_D9321.tif" /><img file="US2022121884A1_D9322.tif" /><img file="US2022121884A1_D9323.tif" /><img file="US2022121884A1_D9324.tif" /><img file="US2022121884A1_D9325.tif" /><img file="US2022121884A1_D9326.tif" /><img file="US2022121884A1_D9327.tif" /><img file="US2022121884A1_D9328.tif" /><img file="US2022121884A1_D9329.tif" /><img file="US2022121884A1_D9330.tif" /><img file="US2022121884A1_D9331.tif" /><img file="US2022121884A1_D9332.tif" /><img file="US2022121884A1_D9333.tif" /><img file="US2022121884A1_D9334.tif" /><img file="US2022121884A1_D9335.tif" /><img file="US2022121884A1_D9336.tif" /><img file="US2022121884A1_D9337.tif" /><img file="US2022121884A1_D9338.tif" /><img file="US2022121884A1_D9339.tif" /><img file="US2022121884A1_D9340.tif" /><img file="US2022121884A1_D9341.tif" /><img file="US2022121884A1_D9342.tif" /><img file="US2022121884A1_D9343.tif" /><img file="US2022121884A1_D9344.tif" /><img file="US2022121884A1_D9345.tif" /><img file="US2022121884A1_D9346.tif" /><img file="US2022121884A1_D9347.tif" /><img file="US2022121884A1_D9348.tif" /><img file="US2022121884A1_D9349.tif" /><img file="US2022121884A1_D9350.tif" /><img file="US2022121884A1_D9351.tif" /><img file="US2022121884A1_D9352.tif" /><img file="US2022121884A1_D9353.tif" /><img file="US2022121884A1_D9354.tif" /><img file="US2022121884A1_D9355.tif" /><img file="US2022121884A1_D9356.tif" /><img file="US2022121884A1_D9357.tif" /><img file="US2022121884A1_D9358.tif" /><img file="US2022121884A1_D9359.tif" /><img file="US2022121884A1_D9360.tif" /><img file="US2022121884A1_D9361.tif" /><img file="US2022121884A1_D9362.tif" /><img file="US2022121884A1_D9363.tif" /><img file="US2022121884A1_D9364.tif" /><img file="US2022121884A1_D9365.tif" /><img file="US2022121884A1_D9366.tif" /><img file="US2022121884A1_D9367.tif" /><img file="US2022121884A1_D9368.tif" /><img file="US2022121884A1_D9369.tif" /><img file="US2022121884A1_D9370.tif" /><img file="US2022121884A1_D9371.tif" /><img file="US2022121884A1_D9372.tif" /><img file="US2022121884A1_D9373.tif" /><img file="US2022121884A1_D9374.tif" /><img file="US2022121884A1_D9375.tif" /><img file="US2022121884A1_D9376.tif" /><img file="US2022121884A1_D9377.tif" /><img file="US2022121884A1_D9378.tif" /><img file="US2022121884A1_D9379.tif" /><img file="US2022121884A1_D9380.tif" /><img file="US2022121884A1_D9381.tif" /><img file="US2022121884A1_D9382.tif" /><img file="US2022121884A1_D9383.tif" /><img file="US2022121884A1_D9384.tif" /><img file="US2022121884A1_D9385.tif" /><img file="US2022121884A1_D9386.tif" /><img file="US2022121884A1_D9387.tif" /><img file="US2022121884A1_D9388.tif" /><img file="US2022121884A1_D9389.tif" /><img file="US2022121884A1_D9390.tif" /><img file="US2022121884A1_D9391.tif" /><img file="US2022121884A1_D9392.tif" /><img file="US2022121884A1_D9393.tif" /><img file="US2022121884A1_D9394.tif" /><img file="US2022121884A1_D9395.tif" /><img file="US2022121884A1_D9396.tif" /><img file="US2022121884A1_D9397.tif" /><img file="US2022121884A1_D9398.tif" /><img file="US2022121884A1_D9399.tif" /><img file="US2022121884A1_D9400.tif" /><img file="US2022121884A1_D9401.tif" /><img file="US2022121884A1_D9402.tif" /><img file="US2022121884A1_D9403.tif" /><img file="US2022121884A1_D9404.tif" /><img file="US2022121884A1_D9405.tif" /><img file="US2022121884A1_D9406.tif" /><img file="US2022121884A1_D9407.tif" /><img file="US2022121884A1_D9408.tif" />
Suppose in Y domain, there are N piecewise monotonic regions of F(X). Therefore, there are up to N number of x's as solutions to F<sup>−1</sup>(y), denoted by a set {x<sub>1</sub>, . . . , x<sub>i</sub>, . . . , x<sub>N</sub>}. An event occurring in Y domain, may occur at any of {x<sub>i</sub>}, therefore
<maths id="MATH-US-00033" num="00033"><math overflow="scroll"><mrow><mrow><msub><mi>p</mi><mi>Y</mi></msub><mo></mo><mrow><mo>(</mo><mi>y</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mrow><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>1</mn></mrow><mi>N</mi></munderover><mo></mo><mfrac><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><msub><mi>x</mi><mi>i</mi></msub><mo>)</mo></mrow></mrow><mrow><mrow><msup><mi>F</mi><mi>′</mi></msup><mo></mo><mrow><mo>(</mo><msub><mi>x</mi><mi>i</mi></msub><mo>)</mo></mrow></mrow><mo>·</mo><msub><mi>δ</mi><mrow><mi>XY</mi><mo>,</mo><mi>i</mi></mrow></msub></mrow></mfrac></mrow><mo>=</mo><mrow><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>1</mn></mrow><mi>N</mi></munderover><mo></mo><mfrac><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><msub><mi>x</mi><mi>i</mi></msub><mo>)</mo></mrow></mrow><mrow><mi>abs</mi><mo></mo><mrow><mo>(</mo><mrow><msup><mi>F</mi><mi>′</mi></msup><mo></mo><mrow><mo>(</mo><msub><mi>x</mi><mi>i</mi></msub><mo>)</mo></mrow></mrow><mo>)</mo></mrow></mrow></mfrac></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D9409.tif" /><img file="US2022121884A1_D9410.tif" /><img file="US2022121884A1_D9411.tif" /><img file="US2022121884A1_D9412.tif" /><img file="US2022121884A1_D9413.tif" /><img file="US2022121884A1_D9414.tif" /><img file="US2022121884A1_D9415.tif" /><img file="US2022121884A1_D9416.tif" /><img file="US2022121884A1_D9417.tif" /><img file="US2022121884A1_D9418.tif" /><img file="US2022121884A1_D9419.tif" /><img file="US2022121884A1_D9420.tif" /><img file="US2022121884A1_D9421.tif" /><img file="US2022121884A1_D9422.tif" /><img file="US2022121884A1_D9423.tif" /><img file="US2022121884A1_D9424.tif" /><img file="US2022121884A1_D9425.tif" /><img file="US2022121884A1_D9426.tif" /><img file="US2022121884A1_D9427.tif" /><img file="US2022121884A1_D9428.tif" /><img file="US2022121884A1_D9429.tif" /><img file="US2022121884A1_D9430.tif" /><img file="US2022121884A1_D9431.tif" /><img file="US2022121884A1_D9432.tif" /><img file="US2022121884A1_D9433.tif" /><img file="US2022121884A1_D9434.tif" /><img file="US2022121884A1_D9435.tif" /><img file="US2022121884A1_D9436.tif" /><img file="US2022121884A1_D9437.tif" /><img file="US2022121884A1_D9438.tif" /><img file="US2022121884A1_D9439.tif" /><img file="US2022121884A1_D9440.tif" /><img file="US2022121884A1_D9441.tif" /><img file="US2022121884A1_D9442.tif" /><img file="US2022121884A1_D9443.tif" /><img file="US2022121884A1_D9444.tif" /><img file="US2022121884A1_D9445.tif" /><img file="US2022121884A1_D9446.tif" /><img file="US2022121884A1_D9447.tif" /><img file="US2022121884A1_D9448.tif" /><img file="US2022121884A1_D9449.tif" /><img file="US2022121884A1_D9450.tif" /><img file="US2022121884A1_D9451.tif" /><img file="US2022121884A1_D9452.tif" /><img file="US2022121884A1_D9453.tif" /><img file="US2022121884A1_D9454.tif" /><img file="US2022121884A1_D9455.tif" /><img file="US2022121884A1_D9456.tif" /><img file="US2022121884A1_D9457.tif" /><img file="US2022121884A1_D9458.tif" /><img file="US2022121884A1_D9459.tif" /><img file="US2022121884A1_D9460.tif" /><img file="US2022121884A1_D9461.tif" /><img file="US2022121884A1_D9462.tif" /><img file="US2022121884A1_D9463.tif" /><img file="US2022121884A1_D9464.tif" /><img file="US2022121884A1_D9465.tif" /><img file="US2022121884A1_D9466.tif" /><img file="US2022121884A1_D9467.tif" /><img file="US2022121884A1_D9468.tif" /><img file="US2022121884A1_D9469.tif" /><img file="US2022121884A1_D9470.tif" /><img file="US2022121884A1_D9471.tif" /><img file="US2022121884A1_D9472.tif" /><img file="US2022121884A1_D9473.tif" /><img file="US2022121884A1_D9474.tif" /><img file="US2022121884A1_D9475.tif" /><img file="US2022121884A1_D9476.tif" /><img file="US2022121884A1_D9477.tif" /><img file="US2022121884A1_D9478.tif" /><img file="US2022121884A1_D9479.tif" /><img file="US2022121884A1_D9480.tif" /><img file="US2022121884A1_D9481.tif" /><img file="US2022121884A1_D9482.tif" /><img file="US2022121884A1_D9483.tif" /><img file="US2022121884A1_D9484.tif" /><img file="US2022121884A1_D9485.tif" /><img file="US2022121884A1_D9486.tif" /><img file="US2022121884A1_D9487.tif" /><img file="US2022121884A1_D9488.tif" /><img file="US2022121884A1_D9489.tif" /><img file="US2022121884A1_D9490.tif" /><img file="US2022121884A1_D9491.tif" /><img file="US2022121884A1_D9492.tif" /><img file="US2022121884A1_D9493.tif" /><img file="US2022121884A1_D9494.tif" /><img file="US2022121884A1_D9495.tif" /><img file="US2022121884A1_D9496.tif" /><img file="US2022121884A1_D9497.tif" /><img file="US2022121884A1_D9498.tif" /><img file="US2022121884A1_D9499.tif" /><img file="US2022121884A1_D9500.tif" /><img file="US2022121884A1_D9501.tif" /><img file="US2022121884A1_D9502.tif" /><img file="US2022121884A1_D9503.tif" /><img file="US2022121884A1_D9504.tif" /><img file="US2022121884A1_D9505.tif" /><img file="US2022121884A1_D9506.tif" /><img file="US2022121884A1_D9507.tif" /><img file="US2022121884A1_D9508.tif" /><img file="US2022121884A1_D9509.tif" /><img file="US2022121884A1_D9510.tif" /><img file="US2022121884A1_D9511.tif" /><img file="US2022121884A1_D9512.tif" /><img file="US2022121884A1_D9513.tif" /><img file="US2022121884A1_D9514.tif" /><img file="US2022121884A1_D9515.tif" /><img file="US2022121884A1_D9516.tif" /><img file="US2022121884A1_D9517.tif" /><img file="US2022121884A1_D9518.tif" /><img file="US2022121884A1_D9519.tif" /><img file="US2022121884A1_D9520.tif" />
where δ<sub>xy,i </sub>indicates, as before, whether i<sup>th </sup>monotonic region of F(X) is increasing or decreasing.
In an embodiment, ω is determined by:
<maths id="MATH-US-00034" num="00034"><math overflow="scroll"><mrow><mi>ω</mi><mo>=</mo><mrow><mrow><msub><mi>p</mi><mi>Y</mi></msub><mo>·</mo><msub><mi>μ</mi><msub><mi>A</mi><mi>y</mi></msub></msub></mrow><mo>=</mo><mrow><mrow><munder><mover><mo>∫</mo><msub><mi>y</mi><mi>max</mi></msub></mover><msub><mi>y</mi><mi>min</mi></msub></munder><mo></mo><mrow><mrow><msub><mi>p</mi><mi>Y</mi></msub><mo></mo><mrow><mo>(</mo><mi>y</mi><mo>)</mo></mrow></mrow><mo>·</mo><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>y</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>y</mi><mo>)</mo></mrow></mrow><mo>·</mo><mi>dy</mi></mrow></mrow><mo>=</mo><mrow><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>1</mn></mrow><mi>N</mi></munderover><mo></mo><mrow><munder><mover><mo>∫</mo><msub><mi>y</mi><mi>max</mi></msub></mover><msub><mi>y</mi><mi>min</mi></msub></munder><mo></mo><mrow><munder><mi>sup</mi><mrow><mo>∀</mo><msup><mi>x</mi><mi>′</mi></msup></mrow></munder><mo></mo><mrow><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>x</mi></msub></msub><mo></mo><mrow><mo>(</mo><msup><mi>x</mi><mi>′</mi></msup><mo>)</mo></mrow></mrow><mo>·</mo><mfrac><mrow><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><msub><mi>x</mi><mi>i</mi></msub><mo>)</mo></mrow></mrow><mo>·</mo><mi>dx</mi></mrow><mrow><mrow><msup><mi>F</mi><mi>′</mi></msup><mo></mo><mrow><mo>(</mo><msub><mi>x</mi><mi>i</mi></msub><mo>)</mo></mrow></mrow><mo>·</mo><msub><mi>δ</mi><mrow><mi>XY</mi><mo>,</mo><mi>i</mi></mrow></msub></mrow></mfrac><mo>·</mo><mfrac><mi>dy</mi><mi>dx</mi></mfrac></mrow></mrow></mrow></mrow></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D9521.tif" /><img file="US2022121884A1_D9522.tif" /><img file="US2022121884A1_D9523.tif" /><img file="US2022121884A1_D9524.tif" /><img file="US2022121884A1_D9525.tif" /><img file="US2022121884A1_D9526.tif" /><img file="US2022121884A1_D9527.tif" /><img file="US2022121884A1_D9528.tif" /><img file="US2022121884A1_D9529.tif" /><img file="US2022121884A1_D9530.tif" /><img file="US2022121884A1_D9531.tif" /><img file="US2022121884A1_D9532.tif" /><img file="US2022121884A1_D9533.tif" /><img file="US2022121884A1_D9534.tif" /><img file="US2022121884A1_D9535.tif" /><img file="US2022121884A1_D9536.tif" /><img file="US2022121884A1_D9537.tif" /><img file="US2022121884A1_D9538.tif" /><img file="US2022121884A1_D9539.tif" /><img file="US2022121884A1_D9540.tif" /><img file="US2022121884A1_D9541.tif" /><img file="US2022121884A1_D9542.tif" /><img file="US2022121884A1_D9543.tif" /><img file="US2022121884A1_D9544.tif" /><img file="US2022121884A1_D9545.tif" /><img file="US2022121884A1_D9546.tif" /><img file="US2022121884A1_D9547.tif" /><img file="US2022121884A1_D9548.tif" /><img file="US2022121884A1_D9549.tif" /><img file="US2022121884A1_D9550.tif" /><img file="US2022121884A1_D9551.tif" /><img file="US2022121884A1_D9552.tif" /><img file="US2022121884A1_D9553.tif" /><img file="US2022121884A1_D9554.tif" /><img file="US2022121884A1_D9555.tif" /><img file="US2022121884A1_D9556.tif" /><img file="US2022121884A1_D9557.tif" /><img file="US2022121884A1_D9558.tif" /><img file="US2022121884A1_D9559.tif" /><img file="US2022121884A1_D9560.tif" /><img file="US2022121884A1_D9561.tif" /><img file="US2022121884A1_D9562.tif" /><img file="US2022121884A1_D9563.tif" /><img file="US2022121884A1_D9564.tif" /><img file="US2022121884A1_D9565.tif" /><img file="US2022121884A1_D9566.tif" /><img file="US2022121884A1_D9567.tif" /><img file="US2022121884A1_D9568.tif" /><img file="US2022121884A1_D9569.tif" /><img file="US2022121884A1_D9570.tif" /><img file="US2022121884A1_D9571.tif" /><img file="US2022121884A1_D9572.tif" /><img file="US2022121884A1_D9573.tif" /><img file="US2022121884A1_D9574.tif" /><img file="US2022121884A1_D9575.tif" /><img file="US2022121884A1_D9576.tif" /><img file="US2022121884A1_D9577.tif" /><img file="US2022121884A1_D9578.tif" /><img file="US2022121884A1_D9579.tif" /><img file="US2022121884A1_D9580.tif" /><img file="US2022121884A1_D9581.tif" /><img file="US2022121884A1_D9582.tif" /><img file="US2022121884A1_D9583.tif" /><img file="US2022121884A1_D9584.tif" /><img file="US2022121884A1_D9585.tif" /><img file="US2022121884A1_D9586.tif" /><img file="US2022121884A1_D9587.tif" /><img file="US2022121884A1_D9588.tif" /><img file="US2022121884A1_D9589.tif" /><img file="US2022121884A1_D9590.tif" /><img file="US2022121884A1_D9591.tif" /><img file="US2022121884A1_D9592.tif" /><img file="US2022121884A1_D9593.tif" /><img file="US2022121884A1_D9594.tif" /><img file="US2022121884A1_D9595.tif" /><img file="US2022121884A1_D9596.tif" /><img file="US2022121884A1_D9597.tif" /><img file="US2022121884A1_D9598.tif" /><img file="US2022121884A1_D9599.tif" /><img file="US2022121884A1_D9600.tif" /><img file="US2022121884A1_D9601.tif" /><img file="US2022121884A1_D9602.tif" /><img file="US2022121884A1_D9603.tif" /><img file="US2022121884A1_D9604.tif" /><img file="US2022121884A1_D9605.tif" /><img file="US2022121884A1_D9606.tif" /><img file="US2022121884A1_D9607.tif" /><img file="US2022121884A1_D9608.tif" /><img file="US2022121884A1_D9609.tif" /><img file="US2022121884A1_D9610.tif" /><img file="US2022121884A1_D9611.tif" /><img file="US2022121884A1_D9612.tif" /><img file="US2022121884A1_D9613.tif" /><img file="US2022121884A1_D9614.tif" /><img file="US2022121884A1_D9615.tif" /><img file="US2022121884A1_D9616.tif" /><img file="US2022121884A1_D9617.tif" /><img file="US2022121884A1_D9618.tif" /><img file="US2022121884A1_D9619.tif" /><img file="US2022121884A1_D9620.tif" /><img file="US2022121884A1_D9621.tif" /><img file="US2022121884A1_D9622.tif" /><img file="US2022121884A1_D9623.tif" /><img file="US2022121884A1_D9624.tif" /><img file="US2022121884A1_D9625.tif" /><img file="US2022121884A1_D9626.tif" /><img file="US2022121884A1_D9627.tif" /><img file="US2022121884A1_D9628.tif" /><img file="US2022121884A1_D9629.tif" /><img file="US2022121884A1_D9630.tif" /><img file="US2022121884A1_D9631.tif" /><img file="US2022121884A1_D9632.tif" />
where x′ ∈ {x<sub>i</sub>}. Therefore,
<maths id="MATH-US-00035" num="00035"><math overflow="scroll"><mrow><mi>ω</mi><mo>=</mo><mrow><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>1</mn></mrow><mi>N</mi></munderover><mo></mo><mrow><munder><mover><mo>∫</mo><msub><mi>x</mi><mrow><mi>max</mi><mo>,</mo><mi>i</mi></mrow></msub></mover><msub><mi>x</mi><mrow><mi>min</mi><mo>,</mo><mi>i</mi></mrow></msub></munder><mo></mo><mrow><munder><mi>sup</mi><mrow><mo>∀</mo><msup><mi>x</mi><mi>′</mi></msup></mrow></munder><mo></mo><mrow><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>x</mi></msub></msub><mo></mo><mrow><mo>(</mo><msup><mi>x</mi><mi>′</mi></msup><mo>)</mo></mrow></mrow><mo>·</mo><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><msub><mi>x</mi><mi>i</mi></msub><mo>)</mo></mrow></mrow><mo>·</mo><mi>dx</mi></mrow></mrow></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D9633.tif" /><img file="US2022121884A1_D9634.tif" /><img file="US2022121884A1_D9635.tif" /><img file="US2022121884A1_D9636.tif" /><img file="US2022121884A1_D9637.tif" /><img file="US2022121884A1_D9638.tif" /><img file="US2022121884A1_D9639.tif" /><img file="US2022121884A1_D9640.tif" /><img file="US2022121884A1_D9641.tif" /><img file="US2022121884A1_D9642.tif" /><img file="US2022121884A1_D9643.tif" /><img file="US2022121884A1_D9644.tif" /><img file="US2022121884A1_D9645.tif" /><img file="US2022121884A1_D9646.tif" /><img file="US2022121884A1_D9647.tif" /><img file="US2022121884A1_D9648.tif" /><img file="US2022121884A1_D9649.tif" /><img file="US2022121884A1_D9650.tif" /><img file="US2022121884A1_D9651.tif" /><img file="US2022121884A1_D9652.tif" /><img file="US2022121884A1_D9653.tif" /><img file="US2022121884A1_D9654.tif" /><img file="US2022121884A1_D9655.tif" /><img file="US2022121884A1_D9656.tif" /><img file="US2022121884A1_D9657.tif" /><img file="US2022121884A1_D9658.tif" /><img file="US2022121884A1_D9659.tif" /><img file="US2022121884A1_D9660.tif" /><img file="US2022121884A1_D9661.tif" /><img file="US2022121884A1_D9662.tif" /><img file="US2022121884A1_D9663.tif" /><img file="US2022121884A1_D9664.tif" /><img file="US2022121884A1_D9665.tif" /><img file="US2022121884A1_D9666.tif" /><img file="US2022121884A1_D9667.tif" /><img file="US2022121884A1_D9668.tif" /><img file="US2022121884A1_D9669.tif" /><img file="US2022121884A1_D9670.tif" /><img file="US2022121884A1_D9671.tif" /><img file="US2022121884A1_D9672.tif" /><img file="US2022121884A1_D9673.tif" /><img file="US2022121884A1_D9674.tif" /><img file="US2022121884A1_D9675.tif" /><img file="US2022121884A1_D9676.tif" /><img file="US2022121884A1_D9677.tif" /><img file="US2022121884A1_D9678.tif" /><img file="US2022121884A1_D9679.tif" /><img file="US2022121884A1_D9680.tif" /><img file="US2022121884A1_D9681.tif" /><img file="US2022121884A1_D9682.tif" /><img file="US2022121884A1_D9683.tif" /><img file="US2022121884A1_D9684.tif" /><img file="US2022121884A1_D9685.tif" /><img file="US2022121884A1_D9686.tif" /><img file="US2022121884A1_D9687.tif" /><img file="US2022121884A1_D9688.tif" /><img file="US2022121884A1_D9689.tif" /><img file="US2022121884A1_D9690.tif" /><img file="US2022121884A1_D9691.tif" /><img file="US2022121884A1_D9692.tif" /><img file="US2022121884A1_D9693.tif" /><img file="US2022121884A1_D9694.tif" /><img file="US2022121884A1_D9695.tif" /><img file="US2022121884A1_D9696.tif" /><img file="US2022121884A1_D9697.tif" /><img file="US2022121884A1_D9698.tif" /><img file="US2022121884A1_D9699.tif" /><img file="US2022121884A1_D9700.tif" /><img file="US2022121884A1_D9701.tif" /><img file="US2022121884A1_D9702.tif" /><img file="US2022121884A1_D9703.tif" /><img file="US2022121884A1_D9704.tif" /><img file="US2022121884A1_D9705.tif" /><img file="US2022121884A1_D9706.tif" /><img file="US2022121884A1_D9707.tif" /><img file="US2022121884A1_D9708.tif" /><img file="US2022121884A1_D9709.tif" /><img file="US2022121884A1_D9710.tif" /><img file="US2022121884A1_D9711.tif" /><img file="US2022121884A1_D9712.tif" /><img file="US2022121884A1_D9713.tif" /><img file="US2022121884A1_D9714.tif" /><img file="US2022121884A1_D9715.tif" /><img file="US2022121884A1_D9716.tif" /><img file="US2022121884A1_D9717.tif" /><img file="US2022121884A1_D9718.tif" /><img file="US2022121884A1_D9719.tif" /><img file="US2022121884A1_D9720.tif" /><img file="US2022121884A1_D9721.tif" /><img file="US2022121884A1_D9722.tif" /><img file="US2022121884A1_D9723.tif" /><img file="US2022121884A1_D9724.tif" /><img file="US2022121884A1_D9725.tif" /><img file="US2022121884A1_D9726.tif" /><img file="US2022121884A1_D9727.tif" /><img file="US2022121884A1_D9728.tif" /><img file="US2022121884A1_D9729.tif" /><img file="US2022121884A1_D9730.tif" /><img file="US2022121884A1_D9731.tif" /><img file="US2022121884A1_D9732.tif" /><img file="US2022121884A1_D9733.tif" /><img file="US2022121884A1_D9734.tif" /><img file="US2022121884A1_D9735.tif" /><img file="US2022121884A1_D9736.tif" /><img file="US2022121884A1_D9737.tif" /><img file="US2022121884A1_D9738.tif" /><img file="US2022121884A1_D9739.tif" /><img file="US2022121884A1_D9740.tif" /><img file="US2022121884A1_D9741.tif" /><img file="US2022121884A1_D9742.tif" /><img file="US2022121884A1_D9743.tif" /><img file="US2022121884A1_D9744.tif" />
Thus, ω≥υ, for a given p<sub>X</sub>, because:
<maths id="MATH-US-00036" num="00036"><math overflow="scroll"><mrow><mi>ω</mi><mo>=</mo><mrow><mrow><mrow><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>1</mn></mrow><mi>N</mi></munderover><mo></mo><mrow><munder><mover><mo>∫</mo><msub><mi>x</mi><mrow><mi>max</mi><mo>,</mo><mi>i</mi></mrow></msub></mover><msub><mi>x</mi><mrow><mi>min</mi><mo>,</mo><mi>i</mi></mrow></msub></munder><mo></mo><mrow><munder><mi>sup</mi><mrow><mo>∀</mo><msup><mi>x</mi><mi>′</mi></msup></mrow></munder><mo></mo><mrow><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>x</mi></msub></msub><mo></mo><mrow><mo>(</mo><msup><mi>x</mi><mi>′</mi></msup><mo>)</mo></mrow></mrow><mo>·</mo><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><msub><mi>x</mi><mi>i</mi></msub><mo>)</mo></mrow></mrow><mo>·</mo><mi>dx</mi></mrow></mrow></mrow></mrow><mo>≥</mo><mrow><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>1</mn></mrow><mi>N</mi></munderover><mo></mo><mrow><munder><mover><mo>∫</mo><msub><mi>x</mi><mrow><mi>max</mi><mo>,</mo><mi>i</mi></mrow></msub></mover><msub><mi>x</mi><mrow><mi>min</mi><mo>,</mo><mi>i</mi></mrow></msub></munder><mo></mo><mrow><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>x</mi></msub></msub><mo></mo><mrow><mo>(</mo><msub><mi>x</mi><mi>i</mi></msub><mo>)</mo></mrow></mrow><mo>·</mo><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><msub><mi>x</mi><mi>i</mi></msub><mo>)</mo></mrow></mrow><mo>·</mo><mi>dx</mi></mrow></mrow></mrow></mrow><mo>=</mo><mrow><mrow><munder><mover><mo>∫</mo><msub><mi>x</mi><mi>max</mi></msub></mover><msub><mi>x</mi><mi>min</mi></msub></munder><mo></mo><mrow><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>x</mi></msub></msub><mo></mo><mrow><mo>(</mo><msub><mi>x</mi><mi>i</mi></msub><mo>)</mo></mrow></mrow><mo>·</mo><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><msub><mi>x</mi><mi>i</mi></msub><mo>)</mo></mrow></mrow><mo>·</mo><mi>dx</mi></mrow></mrow><mo>=</mo><mi>v</mi></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D9745.tif" /><img file="US2022121884A1_D9746.tif" /><img file="US2022121884A1_D9747.tif" /><img file="US2022121884A1_D9748.tif" /><img file="US2022121884A1_D9749.tif" /><img file="US2022121884A1_D9750.tif" /><img file="US2022121884A1_D9751.tif" /><img file="US2022121884A1_D9752.tif" /><img file="US2022121884A1_D9753.tif" /><img file="US2022121884A1_D9754.tif" /><img file="US2022121884A1_D9755.tif" /><img file="US2022121884A1_D9756.tif" /><img file="US2022121884A1_D9757.tif" /><img file="US2022121884A1_D9758.tif" /><img file="US2022121884A1_D9759.tif" /><img file="US2022121884A1_D9760.tif" /><img file="US2022121884A1_D9761.tif" /><img file="US2022121884A1_D9762.tif" /><img file="US2022121884A1_D9763.tif" /><img file="US2022121884A1_D9764.tif" /><img file="US2022121884A1_D9765.tif" /><img file="US2022121884A1_D9766.tif" /><img file="US2022121884A1_D9767.tif" /><img file="US2022121884A1_D9768.tif" /><img file="US2022121884A1_D9769.tif" /><img file="US2022121884A1_D9770.tif" /><img file="US2022121884A1_D9771.tif" /><img file="US2022121884A1_D9772.tif" /><img file="US2022121884A1_D9773.tif" /><img file="US2022121884A1_D9774.tif" /><img file="US2022121884A1_D9775.tif" /><img file="US2022121884A1_D9776.tif" /><img file="US2022121884A1_D9777.tif" /><img file="US2022121884A1_D9778.tif" /><img file="US2022121884A1_D9779.tif" /><img file="US2022121884A1_D9780.tif" /><img file="US2022121884A1_D9781.tif" /><img file="US2022121884A1_D9782.tif" /><img file="US2022121884A1_D9783.tif" /><img file="US2022121884A1_D9784.tif" /><img file="US2022121884A1_D9785.tif" /><img file="US2022121884A1_D9786.tif" /><img file="US2022121884A1_D9787.tif" /><img file="US2022121884A1_D9788.tif" /><img file="US2022121884A1_D9789.tif" /><img file="US2022121884A1_D9790.tif" /><img file="US2022121884A1_D9791.tif" /><img file="US2022121884A1_D9792.tif" /><img file="US2022121884A1_D9793.tif" /><img file="US2022121884A1_D9794.tif" /><img file="US2022121884A1_D9795.tif" /><img file="US2022121884A1_D9796.tif" /><img file="US2022121884A1_D9797.tif" /><img file="US2022121884A1_D9798.tif" /><img file="US2022121884A1_D9799.tif" /><img file="US2022121884A1_D9800.tif" /><img file="US2022121884A1_D9801.tif" /><img file="US2022121884A1_D9802.tif" /><img file="US2022121884A1_D9803.tif" /><img file="US2022121884A1_D9804.tif" /><img file="US2022121884A1_D9805.tif" /><img file="US2022121884A1_D9806.tif" /><img file="US2022121884A1_D9807.tif" /><img file="US2022121884A1_D9808.tif" /><img file="US2022121884A1_D9809.tif" /><img file="US2022121884A1_D9810.tif" /><img file="US2022121884A1_D9811.tif" /><img file="US2022121884A1_D9812.tif" /><img file="US2022121884A1_D9813.tif" /><img file="US2022121884A1_D9814.tif" /><img file="US2022121884A1_D9815.tif" /><img file="US2022121884A1_D9816.tif" /><img file="US2022121884A1_D9817.tif" /><img file="US2022121884A1_D9818.tif" /><img file="US2022121884A1_D9819.tif" /><img file="US2022121884A1_D9820.tif" /><img file="US2022121884A1_D9821.tif" /><img file="US2022121884A1_D9822.tif" /><img file="US2022121884A1_D9823.tif" /><img file="US2022121884A1_D9824.tif" /><img file="US2022121884A1_D9825.tif" /><img file="US2022121884A1_D9826.tif" /><img file="US2022121884A1_D9827.tif" /><img file="US2022121884A1_D9828.tif" /><img file="US2022121884A1_D9829.tif" /><img file="US2022121884A1_D9830.tif" /><img file="US2022121884A1_D9831.tif" /><img file="US2022121884A1_D9832.tif" /><img file="US2022121884A1_D9833.tif" /><img file="US2022121884A1_D9834.tif" /><img file="US2022121884A1_D9835.tif" /><img file="US2022121884A1_D9836.tif" /><img file="US2022121884A1_D9837.tif" /><img file="US2022121884A1_D9838.tif" /><img file="US2022121884A1_D9839.tif" /><img file="US2022121884A1_D9840.tif" /><img file="US2022121884A1_D9841.tif" /><img file="US2022121884A1_D9842.tif" /><img file="US2022121884A1_D9843.tif" /><img file="US2022121884A1_D9844.tif" /><img file="US2022121884A1_D9845.tif" /><img file="US2022121884A1_D9846.tif" /><img file="US2022121884A1_D9847.tif" /><img file="US2022121884A1_D9848.tif" /><img file="US2022121884A1_D9849.tif" /><img file="US2022121884A1_D9850.tif" /><img file="US2022121884A1_D9851.tif" /><img file="US2022121884A1_D9852.tif" /><img file="US2022121884A1_D9853.tif" /><img file="US2022121884A1_D9854.tif" /><img file="US2022121884A1_D9855.tif" /><img file="US2022121884A1_D9856.tif" />
In one embodiment, where, e.g., due to relative symmetry in F(X) and μ<sub>A</sub><sub><sub2>x</sub2></sub>(x), μ<sub>A</sub><sub><sub2>x</sub2></sub>(x) is the same for ∀x′ ∈ {x<sub>i</sub>}, then ω=υ, because
<maths id="MATH-US-00037" num="00037"><math overflow="scroll"><mrow><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>y</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>y</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mrow><munder><mi>sup</mi><mrow><mo>∀</mo><msup><mi>x</mi><mi>′</mi></msup></mrow></munder><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>x</mi></msub></msub><mo></mo><mrow><mo>(</mo><msup><mi>x</mi><mi>′</mi></msup><mo>)</mo></mrow></mrow></mrow><mo>=</mo><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>x</mi></msub></msub><mo></mo><mrow><mo>(</mo><msub><mi>x</mi><mi>i</mi></msub><mo>)</mo></mrow></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D9857.tif" /><img file="US2022121884A1_D9858.tif" /><img file="US2022121884A1_D9859.tif" /><img file="US2022121884A1_D9860.tif" /><img file="US2022121884A1_D9861.tif" /><img file="US2022121884A1_D9862.tif" /><img file="US2022121884A1_D9863.tif" /><img file="US2022121884A1_D9864.tif" /><img file="US2022121884A1_D9865.tif" /><img file="US2022121884A1_D9866.tif" /><img file="US2022121884A1_D9867.tif" /><img file="US2022121884A1_D9868.tif" /><img file="US2022121884A1_D9869.tif" /><img file="US2022121884A1_D9870.tif" /><img file="US2022121884A1_D9871.tif" /><img file="US2022121884A1_D9872.tif" /><img file="US2022121884A1_D9873.tif" /><img file="US2022121884A1_D9874.tif" /><img file="US2022121884A1_D9875.tif" /><img file="US2022121884A1_D9876.tif" /><img file="US2022121884A1_D9877.tif" /><img file="US2022121884A1_D9878.tif" /><img file="US2022121884A1_D9879.tif" /><img file="US2022121884A1_D9880.tif" /><img file="US2022121884A1_D9881.tif" /><img file="US2022121884A1_D9882.tif" /><img file="US2022121884A1_D9883.tif" /><img file="US2022121884A1_D9884.tif" /><img file="US2022121884A1_D9885.tif" /><img file="US2022121884A1_D9886.tif" /><img file="US2022121884A1_D9887.tif" /><img file="US2022121884A1_D9888.tif" /><img file="US2022121884A1_D9889.tif" /><img file="US2022121884A1_D9890.tif" /><img file="US2022121884A1_D9891.tif" /><img file="US2022121884A1_D9892.tif" /><img file="US2022121884A1_D9893.tif" /><img file="US2022121884A1_D9894.tif" /><img file="US2022121884A1_D9895.tif" /><img file="US2022121884A1_D9896.tif" /><img file="US2022121884A1_D9897.tif" /><img file="US2022121884A1_D9898.tif" /><img file="US2022121884A1_D9899.tif" /><img file="US2022121884A1_D9900.tif" /><img file="US2022121884A1_D9901.tif" /><img file="US2022121884A1_D9902.tif" /><img file="US2022121884A1_D9903.tif" /><img file="US2022121884A1_D9904.tif" /><img file="US2022121884A1_D9905.tif" /><img file="US2022121884A1_D9906.tif" /><img file="US2022121884A1_D9907.tif" /><img file="US2022121884A1_D9908.tif" /><img file="US2022121884A1_D9909.tif" /><img file="US2022121884A1_D9910.tif" /><img file="US2022121884A1_D9911.tif" /><img file="US2022121884A1_D9912.tif" /><img file="US2022121884A1_D9913.tif" /><img file="US2022121884A1_D9914.tif" /><img file="US2022121884A1_D9915.tif" /><img file="US2022121884A1_D9916.tif" /><img file="US2022121884A1_D9917.tif" /><img file="US2022121884A1_D9918.tif" /><img file="US2022121884A1_D9919.tif" /><img file="US2022121884A1_D9920.tif" /><img file="US2022121884A1_D9921.tif" /><img file="US2022121884A1_D9922.tif" /><img file="US2022121884A1_D9923.tif" /><img file="US2022121884A1_D9924.tif" /><img file="US2022121884A1_D9925.tif" /><img file="US2022121884A1_D9926.tif" /><img file="US2022121884A1_D9927.tif" /><img file="US2022121884A1_D9928.tif" /><img file="US2022121884A1_D9929.tif" /><img file="US2022121884A1_D9930.tif" /><img file="US2022121884A1_D9931.tif" /><img file="US2022121884A1_D9932.tif" /><img file="US2022121884A1_D9933.tif" /><img file="US2022121884A1_D9934.tif" /><img file="US2022121884A1_D9935.tif" /><img file="US2022121884A1_D9936.tif" /><img file="US2022121884A1_D9937.tif" /><img file="US2022121884A1_D9938.tif" /><img file="US2022121884A1_D9939.tif" /><img file="US2022121884A1_D9940.tif" /><img file="US2022121884A1_D9941.tif" /><img file="US2022121884A1_D9942.tif" /><img file="US2022121884A1_D9943.tif" /><img file="US2022121884A1_D9944.tif" /><img file="US2022121884A1_D9945.tif" /><img file="US2022121884A1_D9946.tif" /><img file="US2022121884A1_D9947.tif" /><img file="US2022121884A1_D9948.tif" /><img file="US2022121884A1_D9949.tif" /><img file="US2022121884A1_D9950.tif" /><img file="US2022121884A1_D9951.tif" /><img file="US2022121884A1_D9952.tif" /><img file="US2022121884A1_D9953.tif" /><img file="US2022121884A1_D9954.tif" /><img file="US2022121884A1_D9955.tif" /><img file="US2022121884A1_D9956.tif" /><img file="US2022121884A1_D9957.tif" /><img file="US2022121884A1_D9958.tif" /><img file="US2022121884A1_D9959.tif" /><img file="US2022121884A1_D9960.tif" /><img file="US2022121884A1_D9961.tif" /><img file="US2022121884A1_D9962.tif" /><img file="US2022121884A1_D9963.tif" /><img file="US2022121884A1_D9964.tif" /><img file="US2022121884A1_D9965.tif" /><img file="US2022121884A1_D9966.tif" /><img file="US2022121884A1_D9967.tif" /><img file="US2022121884A1_D9968.tif" />
for any x<sub>i</sub>.
Likewise, in one embodiment, where μ<sub>A</sub><sub><sub2>x</sub2></sub>(x) is zero or negligible in a region (e.g., for N=2) then ω=υ, as the contribution to o comes from the dominant monotonic region of F(X).
In one embodiment, deviation of ω from υ is estimated/determined by determining difference between
<maths id="MATH-US-00038" num="00038"><math overflow="scroll"><mrow><munder><mi>sup</mi><mrow><mo>∀</mo><msup><mi>x</mi><mi>′</mi></msup></mrow></munder><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>x</mi></msub></msub><mo></mo><mrow><mo>(</mo><msup><mi>x</mi><mi>′</mi></msup><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D9969.tif" /><img file="US2022121884A1_D9970.tif" /><img file="US2022121884A1_D9971.tif" /><img file="US2022121884A1_D9972.tif" /><img file="US2022121884A1_D9973.tif" /><img file="US2022121884A1_D9974.tif" /><img file="US2022121884A1_D9975.tif" /><img file="US2022121884A1_D9976.tif" /><img file="US2022121884A1_D9977.tif" /><img file="US2022121884A1_D9978.tif" /><img file="US2022121884A1_D9979.tif" /><img file="US2022121884A1_D9980.tif" /><img file="US2022121884A1_D9981.tif" /><img file="US2022121884A1_D9982.tif" /><img file="US2022121884A1_D9983.tif" /><img file="US2022121884A1_D9984.tif" /><img file="US2022121884A1_D9985.tif" /><img file="US2022121884A1_D9986.tif" /><img file="US2022121884A1_D9987.tif" /><img file="US2022121884A1_D9988.tif" /><img file="US2022121884A1_D9989.tif" /><img file="US2022121884A1_D9990.tif" /><img file="US2022121884A1_D9991.tif" /><img file="US2022121884A1_D9992.tif" /><img file="US2022121884A1_D9993.tif" /><img file="US2022121884A1_D9994.tif" /><img file="US2022121884A1_D9995.tif" /><img file="US2022121884A1_D9996.tif" /><img file="US2022121884A1_D9997.tif" /><img file="US2022121884A1_D9998.tif" /><img file="US2022121884A1_D9999.tif" /><img file="US2022121884A1_D10000.tif" /><img file="US2022121884A1_D10001.tif" /><img file="US2022121884A1_D10002.tif" /><img file="US2022121884A1_D10003.tif" /><img file="US2022121884A1_D10004.tif" /><img file="US2022121884A1_D10005.tif" /><img file="US2022121884A1_D10006.tif" /><img file="US2022121884A1_D10007.tif" /><img file="US2022121884A1_D10008.tif" /><img file="US2022121884A1_D10009.tif" /><img file="US2022121884A1_D10010.tif" /><img file="US2022121884A1_D10011.tif" /><img file="US2022121884A1_D10012.tif" /><img file="US2022121884A1_D10013.tif" /><img file="US2022121884A1_D10014.tif" /><img file="US2022121884A1_D10015.tif" /><img file="US2022121884A1_D10016.tif" /><img file="US2022121884A1_D10017.tif" /><img file="US2022121884A1_D10018.tif" /><img file="US2022121884A1_D10019.tif" /><img file="US2022121884A1_D10020.tif" /><img file="US2022121884A1_D10021.tif" /><img file="US2022121884A1_D10022.tif" /><img file="US2022121884A1_D10023.tif" /><img file="US2022121884A1_D10024.tif" /><img file="US2022121884A1_D10025.tif" /><img file="US2022121884A1_D10026.tif" /><img file="US2022121884A1_D10027.tif" /><img file="US2022121884A1_D10028.tif" /><img file="US2022121884A1_D10029.tif" /><img file="US2022121884A1_D10030.tif" /><img file="US2022121884A1_D10031.tif" /><img file="US2022121884A1_D10032.tif" /><img file="US2022121884A1_D10033.tif" /><img file="US2022121884A1_D10034.tif" /><img file="US2022121884A1_D10035.tif" /><img file="US2022121884A1_D10036.tif" /><img file="US2022121884A1_D10037.tif" /><img file="US2022121884A1_D10038.tif" /><img file="US2022121884A1_D10039.tif" /><img file="US2022121884A1_D10040.tif" /><img file="US2022121884A1_D10041.tif" /><img file="US2022121884A1_D10042.tif" /><img file="US2022121884A1_D10043.tif" /><img file="US2022121884A1_D10044.tif" /><img file="US2022121884A1_D10045.tif" /><img file="US2022121884A1_D10046.tif" /><img file="US2022121884A1_D10047.tif" /><img file="US2022121884A1_D10048.tif" /><img file="US2022121884A1_D10049.tif" /><img file="US2022121884A1_D10050.tif" /><img file="US2022121884A1_D10051.tif" /><img file="US2022121884A1_D10052.tif" /><img file="US2022121884A1_D10053.tif" /><img file="US2022121884A1_D10054.tif" /><img file="US2022121884A1_D10055.tif" /><img file="US2022121884A1_D10056.tif" /><img file="US2022121884A1_D10057.tif" /><img file="US2022121884A1_D10058.tif" /><img file="US2022121884A1_D10059.tif" /><img file="US2022121884A1_D10060.tif" /><img file="US2022121884A1_D10061.tif" /><img file="US2022121884A1_D10062.tif" /><img file="US2022121884A1_D10063.tif" /><img file="US2022121884A1_D10064.tif" /><img file="US2022121884A1_D10065.tif" /><img file="US2022121884A1_D10066.tif" /><img file="US2022121884A1_D10067.tif" /><img file="US2022121884A1_D10068.tif" /><img file="US2022121884A1_D10069.tif" /><img file="US2022121884A1_D10070.tif" /><img file="US2022121884A1_D10071.tif" /><img file="US2022121884A1_D10072.tif" /><img file="US2022121884A1_D10073.tif" /><img file="US2022121884A1_D10074.tif" /><img file="US2022121884A1_D10075.tif" /><img file="US2022121884A1_D10076.tif" /><img file="US2022121884A1_D10077.tif" /><img file="US2022121884A1_D10078.tif" /><img file="US2022121884A1_D10079.tif" /><img file="US2022121884A1_D10080.tif" />
and various μ<sub>A</sub><sub><sub2>x</sub2></sub>(x<sub>i</sub>)'s.
In one embodiment, where μ<sub>A</sub><sub><sub2>x</sub2></sub>(y) is provided via a proposition (instead of being determined via extension principle through F(X) and A<sub>x</sub>), μ<sub>A′</sub><sub><sub2>y</sub2></sub>(y) is determined (via extension principle) and compared to μ<sub>A</sub><sub><sub2>y</sub2></sub>(y). If there is a match, then ω is estimated using υ, e.g., as described above.
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 11(<i>i</i>)</figref>, μ<sub>B</sub><sub><sub2>y</sub2></sub>(ω) is determined by a series of mapping, aggregation and maximization between p<sub>X</sub>, υ, and ω domains.
One embodiment, for example, uses the concepts above for prediction of stock market, parameters related to economy, or other applications. Consider the following example:
Example 1
We are given this information (for anticipation and prediction): There probability that the price of oil next month is significantly over 100 dollars/barrel is not small.
Assume that the ticket price for an airline from Washington D.C. to New York is in the form of (Y=F(X)=a<sub>1</sub>. X+a<sub>2</sub>), where X is the next month's estimated price of oil (in dollars/barrel) and Y is the ticket price (in dollars). For this example, further assume that a<sub>1</sub>=1.5 and a<sub>2</sub>=150, i.e., Y=1.5X+150. Then, we have the following questions:
q1: What is the Price of the Ticket from Washington D.C. to New York?
X represents (the price of oil the next month), A is (significantly over 100 dollars barrel) and B<sub>x </sub>is (not small). Then, (X, A<sub>x</sub>, B<sub>x</sub>) is a Z-valuation restricting the probability of (X) the price of oil the next month. In this example, as depicted in <figref idref="DRAWINGS">FIG. 12(<i>a</i>)</figref>, significantly over is represented by a step-up membership function membership function, μ<sub>A</sub><sub><sub2>x</sub2></sub>, with a fuzzy edge from 100 to 130. Also, as depicted in <figref idref="DRAWINGS">FIG. 12(<i>b</i>)</figref>, not small is represented by a ramp-up membership function membership function, μ<sub>B</sub><sub><sub2>x</sub2></sub>(υ), with the ramp edge at a from 0 to 50%. Note that υ is the probability measure of A<sub>x</sub>. The answer to q<sub>1</sub>, also represented in a Z-valuation, is (Y, A<sub>y</sub>, B<sub>y</sub>), where Y represents the price of the ticket, A<sub>y </sub>represents a fuzzy set in Y, and B<sub>y </sub>represents the certainty of Z-valuation for the answer. Here both A<sub>y </sub>and B<sub>y </sub>are being sought by q<sub>1</sub>. In one embodiment, an X domain is created from [0, 250], a form of Normal Distribution, N(m<sub>x</sub>, σ<sub>x</sub>), is assumed for p<sub>X</sub>(u) (where u is a value in X domain). A set of candidate p<sub>X </sub>are setup by setting a range for m<sub>x</sub>, e.g., [40, 200], and a range for σ<sub>x</sub>, e.g., [0, 30]. Note that value of zero for σ<sub>x</sub>, signifies delta function which is estimated by a very small value, such as 0.01 (in this case). In one embodiment, the range of (m<sub>x</sub>, σ<sub>x</sub>) is chosen so that they cover various categories of distributions with respect to μ<sub>A</sub><sub><sub2>x</sub2></sub>, as discussed previously. For example, maximum σ<sub>x </sub>is determined, in one embodiment, as a factor (e.g., between 1 to 3) times the maximum ramp width of μ<sub>A</sub><sub><sub2>x</sub2></sub>. In this example, maximum ox is taken as (1 times) ramp width of μ<sub>a</sub><sub><sub2>x </sub2></sub>of 30 (=130−100). In one embodiment, m<sub>x </sub>range is determined with respect to μ<sub>A</sub><sub><sub2>x </sub2></sub>(e.g., beginning of the ramp, at 100) and maximum σ<sub>x </sub>(e.g., 30). For example, m<sub>x </sub>range is taken to cover a factor of σ<sub>x </sub>(e.g., 2 to 3) from ramp (e.g., bottom at 100 and top at 130). In one embodiment, the range of X domain is also taken to encompass m<sub>x </sub>range by a factor of σ<sub>x </sub>(e.g., 2 to 3) at either extreme (e.g., if valid in the context of X). In one embodiment, as shown in <figref idref="DRAWINGS">FIG. 12(<i>c</i>)</figref>, X range/values are used to find the corresponding Y values based on F(X). Given that q<sub>1 </sub>looks for A<sub>y </sub>as part of the answer, one embodiment uses extension principle determine the membership function of A<sub>y </sub>in Y, μ<sub>A</sub><sub><sub2>y</sub2></sub>. In one embodiment, μ<sub>A</sub><sub><sub2>y </sub2></sub>is determined by determining the corresponding Y values for X values which identify μ<sub>A</sub><sub><sub2>x </sub2></sub>(e.g., X values of ramp location or trapezoid corners). In such an embodiment, when F(X) is monotonic in the range of X domain, for X=x<sub>0</sub>, the corresponding y<sub>0 </sub>are μ<sub>A</sub><sub><sub2>y </sub2></sub>are determined as: y<sub>0</sub>=F(x<sub>0</sub>) and μ<sub>A</sub><sub><sub2>y</sub2></sub>(y<sub>0</sub>)=μ<sub>A</sub><sub><sub2>x</sub2></sub>(x<sub>0</sub>). In one embodiment, where multiple values of X exist for F<sup>−1</sup>(y), μ<sub>A</sub><sub><sub2>y</sub2></sub>(y)=sup (μ<sub>A</sub><sub><sub2>x</sub2></sub>(x′)) for all x′ in X domain where y<sub>0</sub>=F(x′). In one embodiment, μ<sub>A</sub><sub><sub2>y</sub2></sub>(y) is determined at every y corresponding to every x in X domain. In one embodiment, the range of resulting Y values is determined (e.g., min and max of values). For example, the range of Y is [150, ç]. In one embodiment,μ<sub>A</sub><sub><sub2>y </sub2></sub>(y) is determined as an envelope in Y domain covering points (F(x′), μ<sub>A</sub><sub><sub2>x</sub2></sub>(x′)) for all x′ in X domain. The envelope then represents sup (μ<sub>A</sub><sub><sub2>x</sub2></sub>(x′)). In one embodiment, Y domain is divided in bins (for example of equal size). For various x values, e.g., x<sub>1 </sub>and x<sub>2</sub>, where values of F(x) fall in the same bin, maximum μ<sub>A</sub><sub><sub2>x</sub2></sub>(x) for those x's are attributed to the bin. In one embodiment, y values signifying the bins are used for determining the probability measures of A<sub>y</sub>. In one embodiment, the original y values corresponding to the set of x values used in X domain are used to determine probability measures of A<sub>y</sub>. In such an embodiment, for example, the maximum corresponding μ<sub>A</sub><sub><sub2>x </sub2></sub>attributed to the bin is also attributed to such y values. For example, as depicted in <figref idref="DRAWINGS">FIG. 12(<i>d</i>)</figref>, μ<sub>A</sub><sub><sub2>y </sub2></sub>is calculated for corresponding y values.
In one embodiment, the probability measure of A<sub>x</sub>, (i.e., υ), is determined by dot product of p<sub>X </sub>and μ<sub>A</sub><sub><sub2>x</sub2></sub>. In one embodiment, μ<sub>A</sub><sub><sub2>x </sub2></sub>is evaluated at x values in X domain (e.g., against a set of points between x<sub>min </sub>and x<sub>max</sub>). Similarly, μ<sub>A</sub><sub><sub2>x </sub2></sub>is determined at the data set {x<sub>i</sub>} in X domain (or at significant, e.g., corner points of μ<sub>A</sub><sub><sub2>x</sub2></sub>). In one embodiment, the dot product is determined by evaluating
<br />υ<sub>p</sub><sub><sub2>x</sub2></sub>=Σ<sub>i</sub><i>p</i><sub>x</sub>(<i>x</i><sub>i</sub>)·μ<sub>A</sub><sub><sub2>x</sub2></sub>(<i>x</i><sub>i</sub>)
In one embodiment, υ is determined via piecewise evaluation (e.g., using exp and erf functions when p<sub>X </sub>is Gaussian). In one embodiment, υ is determined for various candidates for p<sub>X</sub>. For example, taking p<sub>X</sub>, as N(m<sub>x</sub>, σ<sub>x</sub>) as described above, υ is determined for various (m<sub>x</sub>, σ<sub>x</sub>) combination, as depicted in <figref idref="DRAWINGS">FIGS. 12(<i>e</i>)-(<i>f</i>)</figref>. The contour maps of u versus (m<sub>x</sub>, σ<sub>x</sub>) is depicted in <figref idref="DRAWINGS">FIGS. 12(<i>g</i>)-(<i>h</i>)</figref>. As depicted in these figures, at low σ<sub>x </sub>(delta function limit of p<sub>X</sub>), υ(m<sub>x</sub>, σ<sub>x</sub>) becomes μ<sub>A</sub><sub><sub2>x</sub2></sub>(m<sub>x</sub>). At higher, σ<sub>x </sub>smoothing effect takes over for intermediate values of υ.
Given restriction not small, B<sub>x</sub>, in one embodiment, the test score for each candidate p<sub>X </sub>is evaluated, by evaluating the truth value of its corresponding probability measure of A<sub>x</sub>, υ, in μ<sub>B</sub><sub><sub2>x</sub2></sub>(υ). In one embodiment, the assignment of test score is used for p<sub>X </sub>candidates corresponding to a particular set of υ values (e.g., those used to define μ<sub>B</sub><sub><sub2>x</sub2></sub>(υ) such as the ramp location or trapezoid corners). In such an embodiment, bins are associated with such particular υ's to determine p<sub>X </sub>candidates with corresponding υ values within a bin. Those candidates, are for example, identified by those (m<sub>x</sub>, σ<sub>x</sub>) at or near particular contour lines of interest (e.g., marked as υ<sub>1</sub>, σ<sub>2</sub>, and υ<sub>3 </sub>at υ values of 0, 0.25 and 0.5, on <figref idref="DRAWINGS">FIG. 12(<i>h</i>)</figref>, indicating the beginning, middle, and end of the ramp for B<sub>x </sub>as shown in <figref idref="DRAWINGS">FIG. 12(<i>b</i>)</figref>). <figref idref="DRAWINGS">FIG. 12(<i>i</i>)</figref> depicts, for example, the test score for a given (m<sub>x</sub>, σ<sub>x</sub>) by evaluating the corresponding υ(m<sub>x</sub>, σ<sub>x</sub>) against μ<sub>B</sub><sub><sub2>x</sub2></sub>(υ). <figref idref="DRAWINGS">FIG. 12(<i>j</i>)</figref> depicts, for example, depicts a contour map of μ<sub>B</sub><sub><sub2>x</sub2></sub>(υ(m<sub>x</sub>, σ<sub>x</sub>)) on (m<sub>x</sub>, σ<sub>x</sub>) domain. For example, μ<sub>1</sub>, μ<sub>2</sub>, and μ<sub>3 </sub>at μ values of 0, 0.5, and 1 marked on the contour map correspond to υ contours for υ<sub>1</sub>, υ<sub>2</sub>, and υ<sub>3</sub>.
In one embodiment, the probability measure of A<sub>y</sub>, (i.e., ω), is determined by dot product of p<sub>Y </sub>and μ<sub>A</sub><sub><sub2>y</sub2></sub>. In one embodiment, p<sub>Y </sub>is determined via application of extension principal. In one embodiment, px's for points in {x<sub>i</sub>} in X domain are attributed to their corresponding points {y<sub>i</sub>} in Y domain. Such an embodiment accommodates having multiple y<sub>i</sub>'s have the same value (or belong to the same bin in Y domain). Alternatively, or additionally, in one embodiment, bins are setup in Y domain to determine p<sub>Y </sub>for each bin by summing over corresponding p<sub>i</sub>'s (from X domain) where F(x<sub>i</sub>) is within the Y-bin. In such an embodiment, ω, for example, is determined by taking p<sub>Y </sub>and μ<sub>A</sub><sub><sub2>y </sub2></sub>dot product in Y domain over Y bins. However, in one embodiment, p<sub>Y </sub>and μ<sub>A</sub><sub><sub2>y </sub2></sub>dot product is essentially determined in X domain, for example by:
<br />ω<sub>p</sub><sub><sub2>x</sub2></sub>=Σ<sub>i</sub><i>p</i><sub>x</sub>(<i>x</i><sub>i</sub>)·μ<sub>A</sub><sub><sub2>y</sub2></sub>(<i>y</i><sub>i</sub>)
In one embodiment, ω is determined via piecewise evaluation. In one embodiment, ω is determined for various candidates for p<sub>X</sub>. For example, taking p<sub>X</sub>, as N(m<sub>x</sub>, σ<sub>x</sub>) as described above, ω is determined for various (m<sub>x</sub>, σ<sub>x</sub>) combination, as depicted in <figref idref="DRAWINGS">FIGS. 12(<i>k</i>)-(<i>l</i>)</figref>. These contour maps of ω are identical to those of υ versus (m<sub>x</sub>, σ<sub>x</sub>) (depicted in <figref idref="DRAWINGS">FIGS. 12(<i>e</i>) and (<i>g</i>)</figref>), as expected. since F(X), in this example, is monotonic (as explained previously).
In one embodiment, to obtain the relationship between ω and restriction test scores from B<sub>x</sub>, to determine B<sub>y</sub>, bins are setup in ω domain (e.g., between ω<sub>min </sub>and ω<sub>max</sub>, or in [0, 1] range). In one embodiment, the size/number of bin(s) in ω is adjustable or adaptive to accommodate regions in ω domain where (m<sub>x</sub>, σ<sub>x</sub>) mapping is scarce, sparse or absent. In one embodiment, for each (m<sub>x</sub>, σ<sub>x</sub>), the calculated ω (m<sub>x</sub>, σ<sub>x</sub>), is mapped to a bin in o domain. In such an embodiment, each (m<sub>x</sub>, σ<sub>x</sub>) becomes associated to a e bin (e.g., identified by an ID or index). Multiple (m<sub>g</sub>, σ<sub>x</sub>) may map to the same ω bin. In one embodiment, through this association with the same ω bin, the maximum μ<sub>B</sub><sub><sub2>x</sub2></sub>(υ(m<sub>x</sub>, σ<sub>x</sub>)) for (m<sub>x</sub>, σ<sub>x</sub>)'s associated with the same ω bin is determined. For example, <figref idref="DRAWINGS">FIG. 12(<i>m</i>)-(<i>n</i>)</figref> depict the contour maps of Max μ<sub>B</sub><sub><sub2>x</sub2></sub>(υ(m<sub>x</sub>, σ<sub>x</sub>)) for various (m<sub>x</sub>, σ<sub>x</sub>). In one embodiment, maximum μ<sub>B</sub><sub><sub2>x</sub2></sub>(υ(m<sub>x</sub>, σ<sub>x</sub>)) is associated to the ω bin of the corresponding (m<sub>x</sub>, σ<sub>x</sub>)'s. In one embodiment, unique set of ω bins is determined that are associated with at least one (m<sub>x</sub>, σ<sub>x</sub>). Associated maximum μ<sub>B</sub><sub><sub2>x</sub2></sub>(υ(m<sub>x</sub>, σ<sub>x</sub>) is determined per o value representing the corresponding o bin. In one embodiment, this maximum μ<sub>B</sub><sub><sub2>x</sub2></sub>(υ(m<sub>x</sub>, σ<sub>x</sub>) per ω is provided as the result for μ<sub>B</sub><sub><sub2>x</sub2></sub>(υ). For example, <figref idref="DRAWINGS">FIG. 12(<i>o</i>)</figref> depicts μ<sub>B</sub><sub><sub2>y</sub2></sub>(ω) for this example, which very closely resembles μ<sub>B</sub><sub><sub2>x</sub2></sub>(υ), as expected, because F(X) is a monotonic, as explained previously.
Therefore, in this example, assuming that μ<sub>A</sub><sub><sub2>y</sub2></sub>(y) (ramping up from 300 to 345) indicates somewhat higher than 300, and that μ<sub>B</sub><sub><sub2>y</sub2></sub>(ω) maps to more than medium (i.e., not small) (in this context), then the answer to q<sub>1 </sub>becomes: The probability of the price of the ticket being somewhat higher than 300 is more than medium.
q2: What is the Probability that the Price of the Ticket (from Washington D.C. to New York) is not Low?
In this question, Y still presents the price of the ticket; however, A<sub>y </sub>is already specified by q<sub>2 </sub>as not low in this context. Parsing the question, Prob(Y is A<sub>y</sub>) or B<sub>y </sub>in Z-valuation of (Y, A<sub>y</sub>, B<sub>y</sub>) is the output. In one embodiment, the knowledge database is searched to precisiate the meaning of not low in the context of Y. In one embodiment, in parsing q<sub>2</sub>, not is recognized as the modifier of a fuzzy set low in context of Y. In one embodiment, the knowledgebase is used to determined, for example low is a step down fuzzy set with its ramp located between 250 and 300. In one embodiment, the modifiers are used to convert the membership functions per truth system(s) used by the module. For example, <figref idref="DRAWINGS">FIG. 13(<i>a</i>)</figref> depicts μ<sub>A</sub><sub><sub2>y</sub2></sub>(y) for not low. In one embodiment, μ<sub>A</sub><sub><sub2>y </sub2></sub>is determined for every y in {y<sub>i</sub>} where y<sub>i</sub>=F(x<sub>i</sub>). In one embodiment μ<sub>A</sub><sub><sub2>y </sub2></sub>is determined via a piecewise evaluation/lookup from μ<sub>A</sub><sub><sub2>y</sub2></sub>.
In one embodiment, the association of (xi, yi) is used to attribute p<sub>X </sub>values to (xi, yi). Comparing with q<sub>1</sub>, in one embodiment, υ and μ<sub>A</sub><sub><sub2>x </sub2></sub>are reused or determined similarly. For example, <figref idref="DRAWINGS">FIGS. 12(<i>a</i>)-(<i>c</i>) and 12(<i>e</i>)-(<i>j</i>)</figref> are applicable to q<sub>2</sub>, as in this example, μ<sub>A</sub><sub><sub2>x</sub2></sub>(<figref idref="DRAWINGS">FIG. 14(<i>a</i>)</figref>), μ<sub>B</sub><sub><sub2>x</sub2></sub>(<figref idref="DRAWINGS">FIG. 12(<i>b</i>)</figref>), and F(X) (<figref idref="DRAWINGS">FIG. 12(<i>c</i>)</figref>) are still the same; υ determination/calculation (<figref idref="DRAWINGS">FIGS. 12(<i>e</i>)-(<i>h</i>)</figref>) is still applied the same; and μ<sub>B</sub><sub><sub2>x </sub2></sub>is applied similarly to υ, in order to map μ<sub>B</sub><sub><sub2>x </sub2></sub>to candidate p<sub>X</sub>'s (<figref idref="DRAWINGS">FIGS. 12(<i>i</i>)-(<i>j</i>)</figref>). However, given μ<sub>A</sub><sub><sub2>y </sub2></sub>is provided via by q<sub>2 </sub>(instead of, e.g., an extension principle via μ<sub>A</sub><sub><sub2>x</sub2></sub>), the corresponding probability measures, ω, is expected to be different. For example, <figref idref="DRAWINGS">FIGS. 13(<i>b</i>)-(<i>c</i>)</figref> depict ω (as dot product of μ<sub>A</sub><sub><sub2>y </sub2></sub>and p<sub>Y</sub>) per various candidate distribution, i.e., (m<sub>x</sub>, σ<sub>x</sub>) . Compared to ω in q<sub>1 </sub>(<figref idref="DRAWINGS">FIGS. 12(<i>k</i>)-(<i>l</i>)</figref>), the contours appear to be shifted to lower values of m<sub>x</sub>, because the shift in the fuzzy edge of μ<sub>A</sub><sub><sub2>y</sub2></sub>(from q<sub>1 </sub>to q<sub>2</sub>) toward lower ticket prices, causes similar shift in ω contours in this example, as F(X) is monotonic and increasing. At any rate, contours of ω and υ are no longer collocated on (m<sub>x</sub>, σ<sub>x</sub>) given A<sub>y </sub>was not obtained through application of the extension principle to F(X) and A<sub>x</sub>. The maximum μ<sub>B</sub><sub><sub2>x</sub2></sub>(υ(m<sub>x</sub>, σ<sub>x</sub>)), for example obtained via application of ω bins, is depicted in <figref idref="DRAWINGS">FIGS. 13(<i>d</i>)-(<i>e</i>)</figref>. In one embodiment, through association with ω bins, the corresponding B<sub>y </sub>is determined obtaining μ<sub>B</sub><sub><sub2>x</sub2></sub>(υ(m<sub>x</sub>, σ<sub>x</sub>)) per ω, as shown for example in <figref idref="DRAWINGS">FIG. 13(<i>f</i>)</figref>. One embodiment, varies the number/size of ω bins to compensate the scarcity of distribution candidate to provide the maximum μ<sub>B</sub><sub><sub2>x</sub2></sub>(υ(m<sub>x</sub>, σ<sub>x</sub>)) at a particular ω bin. For example, ω bin factor of 5 was applied to obtain the results depicted in <figref idref="DRAWINGS">FIGS. 13(<i>d</i>)-(<i>f</i>)</figref>, i.e., the number of bins was reduced from 101 to 20, while the bin size was increased from 0.01 to 0.0526. With ω bin factor of 1, the result for μ<sub>B</sub><sub><sub2>x</sub2></sub>(ω) are depicted in <figref idref="DRAWINGS">FIG. 13(<i>g</i>)</figref>. In one embodiment, the ω bin factor is varied within a range (e.g., 1 to 20) to reduce the number of quick changes (or high frequency content) in the resulting B<sub>y </sub>membership function, beyond a threshold. In one embodiment, ω bins are determined for which there appear to be inadequate candidate distribution (e.g., based on quick drops in the membership function of B<sub>y</sub>). For such ω values, a set of probability distributions, i.e., (m<sub>x</sub>, σ<sub>x</sub>)'s, are determined (e.g., those at or close to the corresponding o contours). Then, more finely distributed parameters/distributions are used to increase the varied candidates contributing to maximum levels of μ<sub>B</sub><sub><sub2>y</sub2></sub>(ω). In one embodiment, an adaptive process is used to select various size ω bins for various ω values. In one embodiment, an envelope-forming or fitting process or module, e.g., with an adjustable smoothing parameter or minimum-piece-length parameter, is used to determine one or more envelopes (e.g., having a convex shape) connecting/covering the maximum points of resulting μ<sub>B</sub><sub><sub2>y</sub2></sub>(ω), as for example depicted as dotted line in <figref idref="DRAWINGS">FIG. 13(<i>g</i>)</figref>.
In one embodiment, the resulting μ<sub>B</sub><sub><sub2>y</sub2></sub>(ω) is provided to other modules that take membership function as input (e.g., a fuzzy rule engine) or store in a knowledge data store. In one embodiment, the resulting μ<sub>B</sub><sub><sub2>y</sub2></sub>(ω) (e.g. in <figref idref="DRAWINGS">FIG. 13(<i>f</i>)</figref>) is compared with templates or knowledge base to determine the natural language counterpart for B<sub>y</sub>. In one embodiment, the knowledge base, for example, includes various models of membership function (e.g., in [0, 1] vs. [0, 1] range or a subset of it) to find the best fit. In one embodiment, fuzzy logic rules (including rules for and, or, not, etc.) are used to generate more models. In one embodiment, fuzzy modifiers (e.g., very, somewhat, more or less, more than, less than, sort of; slightly, etc.) are used to construct modified models. In one embodiment, the best fit is determined by a combination of models from the knowledge base. One embodiment uses adjustable parameter to indicate and control the complexity of combinations of models for fitting B<sub>y</sub>.
In one embodiment, μ<sub>B</sub><sub><sub2>y</sub2></sub>(ω) (e.g., in <figref idref="DRAWINGS">FIG. 13(<i>f</i>)</figref>) is determined to map to very probable. Therefore, the answer to q<sub>2 </sub>becomes: The price of the ticket is very probably not low.
q3: What is the Probability that the Price of the Ticket (from Washington D.C. to New York) is High?
As in q<sub>2</sub>, q<sub>3 </sub>presents A<sub>y </sub>as high. In one embodiment, within the context, μ<sub>A</sub><sub><sub2>y </sub2></sub>is given, for example, as ramp located at 350 (with a width of 50), as depicted in <figref idref="DRAWINGS">FIG. 14(<i>a</i>)</figref>. Probability measure of μ<sub>A</sub><sub><sub2>y</sub2></sub>(i.e., ω) is determined as above. 14(b)-(c) depict ω contour maps, and indicate the shifting of the contour lines to higher m<sub>x </sub>values (in the reverse direction compared to the scenario of q<sub>2</sub>). However, comparing with the contour map of μ<sub>B</sub><sub><sub2>x </sub2></sub>in <figref idref="DRAWINGS">FIG. 12(<i>j</i>)</figref>, it is evident that at σ<sub>x </sub>of 120 (contour marked as μ<sub>3</sub>), μ<sub>B</sub><sub><sub2>x </sub2></sub>is 1, while in such a region, all potential values of ω are covered (from 0 to 1) as shown in 14(c). Therefore, all values of ω's are definitely possible (i.e., not restricted by application of A<sub>y</sub>). The resulting μ<sub>B</sub><sub><sub2>y </sub2></sub>is depicted in 14(d), indicating 1 for all possible values with the counterpart natural language term anything. Therefore, in this example, the answer to q<sub>3 </sub>is: The probability of the price of the ticket being high can be anything.
<figref idref="DRAWINGS">FIG. 109</figref> is an example of a system described above.
Fuzzy Control with Z-Number:
As mentioned previously, an extension of a fuzzy control system that uses fuzzy rules can employ Z-numbers a either or both antecedent and consequent portion of IF THEN fuzzy rule. Regularly, in executing a fuzzy rule, such as (IF X is A 7211N Y is B), the value of variable X used in antecedent, is determined (e.g., from an Input or from defuzzification result of other relevant rules) to be x<sub>0</sub>. In one embodiment, the truth value of the antecedent is evaluated given the knowledge base (e.g., X=x<sub>0</sub>) as the truth value of how (X is A) is satisfied, i.e., μ<sub>A</sub>(x<sub>0</sub>). The truth value of the antecedent (assuming more than a threshold to trigger the consequent) is then applied to the truth value of the consequent, e.g., by clipping or scaling the membership function of B by μ<sub>A</sub>(x0). Firing of fuzzy rules involving the same variable at the consequent yields a superimposed membership function for Y. Then, a crisp value for Y is determined by defuzzification of Y's resulting membership function, e.g., via taking a center of mass or based on maximum membership value (e.g., in Mamdani's inference method), or a defuzzied value for Y is determined by a weighted average of the centroids from consequents of the fuzzy rules based on their corresponding truth values of their antecedents (e.g., in Sugeno fuzzy inference method).
In one embodiment, where the antecedent involves a Z-number, e.g., as in the following fuzzy rule:
IF (X is Z) THEN (Y is C), where Z=(A<sub>X</sub>, B<sub>X</sub>) and X is a random variable,
the truth value of the antecedent (X is Z) is determined by how well its imposed restriction is satisfied based on the knowledge base. For example, if the probability or statistical distribution of X is p<sub>X</sub>, the antecedent is imposing a restriction on this probability distribution as illustrated earlier as:
<maths id="MATH-US-00039" num="00039"><math overflow="scroll"><mrow><msub><mi>μ</mi><msub><mi>B</mi><mi>X</mi></msub></msub><mo></mo><mrow><mo>(</mo><mrow><munder><mo>∫</mo><mi>R</mi></munder><mo></mo><mrow><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>X</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>)</mo></mrow></mrow></math></maths><img file="US2022121884A1_D10081.tif" /><img file="US2022121884A1_D10082.tif" /><img file="US2022121884A1_D10083.tif" /><img file="US2022121884A1_D10084.tif" /><img file="US2022121884A1_D10085.tif" /><img file="US2022121884A1_D10086.tif" /><img file="US2022121884A1_D10087.tif" /><img file="US2022121884A1_D10088.tif" /><img file="US2022121884A1_D10089.tif" /><img file="US2022121884A1_D10090.tif" /><img file="US2022121884A1_D10091.tif" /><img file="US2022121884A1_D10092.tif" /><img file="US2022121884A1_D10093.tif" /><img file="US2022121884A1_D10094.tif" /><img file="US2022121884A1_D10095.tif" /><img file="US2022121884A1_D10096.tif" /><img file="US2022121884A1_D10097.tif" /><img file="US2022121884A1_D10098.tif" /><img file="US2022121884A1_D10099.tif" /><img file="US2022121884A1_D10100.tif" /><img file="US2022121884A1_D10101.tif" /><img file="US2022121884A1_D10102.tif" /><img file="US2022121884A1_D10103.tif" /><img file="US2022121884A1_D10104.tif" /><img file="US2022121884A1_D10105.tif" /><img file="US2022121884A1_D10106.tif" /><img file="US2022121884A1_D10107.tif" /><img file="US2022121884A1_D10108.tif" /><img file="US2022121884A1_D10109.tif" /><img file="US2022121884A1_D10110.tif" /><img file="US2022121884A1_D10111.tif" /><img file="US2022121884A1_D10112.tif" /><img file="US2022121884A1_D10113.tif" /><img file="US2022121884A1_D10114.tif" /><img file="US2022121884A1_D10115.tif" /><img file="US2022121884A1_D10116.tif" /><img file="US2022121884A1_D10117.tif" /><img file="US2022121884A1_D10118.tif" /><img file="US2022121884A1_D10119.tif" /><img file="US2022121884A1_D10120.tif" /><img file="US2022121884A1_D10121.tif" /><img file="US2022121884A1_D10122.tif" /><img file="US2022121884A1_D10123.tif" /><img file="US2022121884A1_D10124.tif" /><img file="US2022121884A1_D10125.tif" /><img file="US2022121884A1_D10126.tif" /><img file="US2022121884A1_D10127.tif" /><img file="US2022121884A1_D10128.tif" /><img file="US2022121884A1_D10129.tif" /><img file="US2022121884A1_D10130.tif" /><img file="US2022121884A1_D10131.tif" /><img file="US2022121884A1_D10132.tif" /><img file="US2022121884A1_D10133.tif" /><img file="US2022121884A1_D10134.tif" /><img file="US2022121884A1_D10135.tif" /><img file="US2022121884A1_D10136.tif" /><img file="US2022121884A1_D10137.tif" /><img file="US2022121884A1_D10138.tif" /><img file="US2022121884A1_D10139.tif" /><img file="US2022121884A1_D10140.tif" /><img file="US2022121884A1_D10141.tif" /><img file="US2022121884A1_D10142.tif" /><img file="US2022121884A1_D10143.tif" /><img file="US2022121884A1_D10144.tif" /><img file="US2022121884A1_D10145.tif" /><img file="US2022121884A1_D10146.tif" /><img file="US2022121884A1_D10147.tif" /><img file="US2022121884A1_D10148.tif" /><img file="US2022121884A1_D10149.tif" /><img file="US2022121884A1_D10150.tif" /><img file="US2022121884A1_D10151.tif" /><img file="US2022121884A1_D10152.tif" /><img file="US2022121884A1_D10153.tif" /><img file="US2022121884A1_D10154.tif" /><img file="US2022121884A1_D10155.tif" /><img file="US2022121884A1_D10156.tif" /><img file="US2022121884A1_D10157.tif" /><img file="US2022121884A1_D10158.tif" /><img file="US2022121884A1_D10159.tif" /><img file="US2022121884A1_D10160.tif" /><img file="US2022121884A1_D10161.tif" /><img file="US2022121884A1_D10162.tif" /><img file="US2022121884A1_D10163.tif" /><img file="US2022121884A1_D10164.tif" /><img file="US2022121884A1_D10165.tif" /><img file="US2022121884A1_D10166.tif" /><img file="US2022121884A1_D10167.tif" /><img file="US2022121884A1_D10168.tif" /><img file="US2022121884A1_D10169.tif" /><img file="US2022121884A1_D10170.tif" /><img file="US2022121884A1_D10171.tif" /><img file="US2022121884A1_D10172.tif" /><img file="US2022121884A1_D10173.tif" /><img file="US2022121884A1_D10174.tif" /><img file="US2022121884A1_D10175.tif" /><img file="US2022121884A1_D10176.tif" /><img file="US2022121884A1_D10177.tif" /><img file="US2022121884A1_D10178.tif" /><img file="US2022121884A1_D10179.tif" /><img file="US2022121884A1_D10180.tif" /><img file="US2022121884A1_D10181.tif" /><img file="US2022121884A1_D10182.tif" /><img file="US2022121884A1_D10183.tif" /><img file="US2022121884A1_D10184.tif" /><img file="US2022121884A1_D10185.tif" /><img file="US2022121884A1_D10186.tif" /><img file="US2022121884A1_D10187.tif" /><img file="US2022121884A1_D10188.tif" /><img file="US2022121884A1_D10189.tif" /><img file="US2022121884A1_D10190.tif" /><img file="US2022121884A1_D10191.tif" /><img file="US2022121884A1_D10192.tif" />
where u is a real value parameter in X domain, one embodiment, the probability distribution of X, p<sub>X</sub>, is used to evaluate the truth value of the antecedent, by evaluating how well the restriction on the probability distribution is met. In one embodiment, an approximation for p<sub>X </sub>is used to determine the antecedent's truth value. Denoting p<sub>xi </sub>as an estimate or an input probability distribution for X, the antecedent truth value is determined as:
<maths id="MATH-US-00040" num="00040"><math overflow="scroll"><mrow><msub><mi>μ</mi><msub><mi>B</mi><mi>X</mi></msub></msub><mo></mo><mrow><mo>(</mo><mrow><munder><mo>∫</mo><mi>R</mi></munder><mo></mo><mrow><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>X</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>p</mi><mi>Xi</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>)</mo></mrow></mrow></math></maths><img file="US2022121884A1_D10193.tif" /><img file="US2022121884A1_D10194.tif" /><img file="US2022121884A1_D10195.tif" /><img file="US2022121884A1_D10196.tif" /><img file="US2022121884A1_D10197.tif" /><img file="US2022121884A1_D10198.tif" /><img file="US2022121884A1_D10199.tif" /><img file="US2022121884A1_D10200.tif" /><img file="US2022121884A1_D10201.tif" /><img file="US2022121884A1_D10202.tif" /><img file="US2022121884A1_D10203.tif" /><img file="US2022121884A1_D10204.tif" /><img file="US2022121884A1_D10205.tif" /><img file="US2022121884A1_D10206.tif" /><img file="US2022121884A1_D10207.tif" /><img file="US2022121884A1_D10208.tif" /><img file="US2022121884A1_D10209.tif" /><img file="US2022121884A1_D10210.tif" /><img file="US2022121884A1_D10211.tif" /><img file="US2022121884A1_D10212.tif" /><img file="US2022121884A1_D10213.tif" /><img file="US2022121884A1_D10214.tif" /><img file="US2022121884A1_D10215.tif" /><img file="US2022121884A1_D10216.tif" /><img file="US2022121884A1_D10217.tif" /><img file="US2022121884A1_D10218.tif" /><img file="US2022121884A1_D10219.tif" /><img file="US2022121884A1_D10220.tif" /><img file="US2022121884A1_D10221.tif" /><img file="US2022121884A1_D10222.tif" /><img file="US2022121884A1_D10223.tif" /><img file="US2022121884A1_D10224.tif" /><img file="US2022121884A1_D10225.tif" /><img file="US2022121884A1_D10226.tif" /><img file="US2022121884A1_D10227.tif" /><img file="US2022121884A1_D10228.tif" /><img file="US2022121884A1_D10229.tif" /><img file="US2022121884A1_D10230.tif" /><img file="US2022121884A1_D10231.tif" /><img file="US2022121884A1_D10232.tif" /><img file="US2022121884A1_D10233.tif" /><img file="US2022121884A1_D10234.tif" /><img file="US2022121884A1_D10235.tif" /><img file="US2022121884A1_D10236.tif" /><img file="US2022121884A1_D10237.tif" /><img file="US2022121884A1_D10238.tif" /><img file="US2022121884A1_D10239.tif" /><img file="US2022121884A1_D10240.tif" /><img file="US2022121884A1_D10241.tif" /><img file="US2022121884A1_D10242.tif" /><img file="US2022121884A1_D10243.tif" /><img file="US2022121884A1_D10244.tif" /><img file="US2022121884A1_D10245.tif" /><img file="US2022121884A1_D10246.tif" /><img file="US2022121884A1_D10247.tif" /><img file="US2022121884A1_D10248.tif" /><img file="US2022121884A1_D10249.tif" /><img file="US2022121884A1_D10250.tif" /><img file="US2022121884A1_D10251.tif" /><img file="US2022121884A1_D10252.tif" /><img file="US2022121884A1_D10253.tif" /><img file="US2022121884A1_D10254.tif" /><img file="US2022121884A1_D10255.tif" /><img file="US2022121884A1_D10256.tif" /><img file="US2022121884A1_D10257.tif" /><img file="US2022121884A1_D10258.tif" /><img file="US2022121884A1_D10259.tif" /><img file="US2022121884A1_D10260.tif" /><img file="US2022121884A1_D10261.tif" /><img file="US2022121884A1_D10262.tif" /><img file="US2022121884A1_D10263.tif" /><img file="US2022121884A1_D10264.tif" /><img file="US2022121884A1_D10265.tif" /><img file="US2022121884A1_D10266.tif" /><img file="US2022121884A1_D10267.tif" /><img file="US2022121884A1_D10268.tif" /><img file="US2022121884A1_D10269.tif" /><img file="US2022121884A1_D10270.tif" /><img file="US2022121884A1_D10271.tif" /><img file="US2022121884A1_D10272.tif" /><img file="US2022121884A1_D10273.tif" /><img file="US2022121884A1_D10274.tif" /><img file="US2022121884A1_D10275.tif" /><img file="US2022121884A1_D10276.tif" /><img file="US2022121884A1_D10277.tif" /><img file="US2022121884A1_D10278.tif" /><img file="US2022121884A1_D10279.tif" /><img file="US2022121884A1_D10280.tif" /><img file="US2022121884A1_D10281.tif" /><img file="US2022121884A1_D10282.tif" /><img file="US2022121884A1_D10283.tif" /><img file="US2022121884A1_D10284.tif" /><img file="US2022121884A1_D10285.tif" /><img file="US2022121884A1_D10286.tif" /><img file="US2022121884A1_D10287.tif" /><img file="US2022121884A1_D10288.tif" /><img file="US2022121884A1_D10289.tif" /><img file="US2022121884A1_D10290.tif" /><img file="US2022121884A1_D10291.tif" /><img file="US2022121884A1_D10292.tif" /><img file="US2022121884A1_D10293.tif" /><img file="US2022121884A1_D10294.tif" /><img file="US2022121884A1_D10295.tif" /><img file="US2022121884A1_D10296.tif" /><img file="US2022121884A1_D10297.tif" /><img file="US2022121884A1_D10298.tif" /><img file="US2022121884A1_D10299.tif" /><img file="US2022121884A1_D10300.tif" /><img file="US2022121884A1_D10301.tif" /><img file="US2022121884A1_D10302.tif" /><img file="US2022121884A1_D10303.tif" /><img file="US2022121884A1_D10304.tif" />
An embodiment, e.g., in a fuzzy control system or module, uses multiple values of u to estimate p<sub>X</sub>. In one embodiment, the values of u are discrete or made to be discrete through bins representing ranges of u, in order to count or track the bin population representing the probability distribution of X. For example, at bin<sub>i</sub>, p<sub>X </sub>is estimated as:
<maths id="MATH-US-00041" num="00041"><math overflow="scroll"><mrow><msub><mi>p</mi><mi>X</mi></msub><mo>❘</mo><mrow><msub><mi>bin</mi><mi>i</mi></msub><mo>≈</mo><mrow><mfrac><mn>1</mn><mrow><mi>Δ</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><msub><mi>u</mi><mi>i</mi></msub></mrow></mfrac><mo>·</mo><mfrac><msub><mi>Count</mi><mi>i</mi></msub><mrow><msub><mo>∑</mo><mi>j</mi></msub><mo></mo><msub><mi>Count</mi><mi>j</mi></msub></mrow></mfrac></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D10305.tif" /><img file="US2022121884A1_D10306.tif" /><img file="US2022121884A1_D10307.tif" /><img file="US2022121884A1_D10308.tif" /><img file="US2022121884A1_D10309.tif" /><img file="US2022121884A1_D10310.tif" /><img file="US2022121884A1_D10311.tif" /><img file="US2022121884A1_D10312.tif" /><img file="US2022121884A1_D10313.tif" /><img file="US2022121884A1_D10314.tif" /><img file="US2022121884A1_D10315.tif" /><img file="US2022121884A1_D10316.tif" /><img file="US2022121884A1_D10317.tif" /><img file="US2022121884A1_D10318.tif" /><img file="US2022121884A1_D10319.tif" /><img file="US2022121884A1_D10320.tif" /><img file="US2022121884A1_D10321.tif" /><img file="US2022121884A1_D10322.tif" /><img file="US2022121884A1_D10323.tif" /><img file="US2022121884A1_D10324.tif" /><img file="US2022121884A1_D10325.tif" /><img file="US2022121884A1_D10326.tif" /><img file="US2022121884A1_D10327.tif" /><img file="US2022121884A1_D10328.tif" /><img file="US2022121884A1_D10329.tif" /><img file="US2022121884A1_D10330.tif" /><img file="US2022121884A1_D10331.tif" /><img file="US2022121884A1_D10332.tif" /><img file="US2022121884A1_D10333.tif" /><img file="US2022121884A1_D10334.tif" /><img file="US2022121884A1_D10335.tif" /><img file="US2022121884A1_D10336.tif" /><img file="US2022121884A1_D10337.tif" /><img file="US2022121884A1_D10338.tif" /><img file="US2022121884A1_D10339.tif" /><img file="US2022121884A1_D10340.tif" /><img file="US2022121884A1_D10341.tif" /><img file="US2022121884A1_D10342.tif" /><img file="US2022121884A1_D10343.tif" /><img file="US2022121884A1_D10344.tif" /><img file="US2022121884A1_D10345.tif" /><img file="US2022121884A1_D10346.tif" /><img file="US2022121884A1_D10347.tif" /><img file="US2022121884A1_D10348.tif" /><img file="US2022121884A1_D10349.tif" /><img file="US2022121884A1_D10350.tif" /><img file="US2022121884A1_D10351.tif" /><img file="US2022121884A1_D10352.tif" /><img file="US2022121884A1_D10353.tif" /><img file="US2022121884A1_D10354.tif" /><img file="US2022121884A1_D10355.tif" /><img file="US2022121884A1_D10356.tif" /><img file="US2022121884A1_D10357.tif" /><img file="US2022121884A1_D10358.tif" /><img file="US2022121884A1_D10359.tif" /><img file="US2022121884A1_D10360.tif" /><img file="US2022121884A1_D10361.tif" /><img file="US2022121884A1_D10362.tif" /><img file="US2022121884A1_D10363.tif" /><img file="US2022121884A1_D10364.tif" /><img file="US2022121884A1_D10365.tif" /><img file="US2022121884A1_D10366.tif" /><img file="US2022121884A1_D10367.tif" /><img file="US2022121884A1_D10368.tif" /><img file="US2022121884A1_D10369.tif" /><img file="US2022121884A1_D10370.tif" /><img file="US2022121884A1_D10371.tif" /><img file="US2022121884A1_D10372.tif" /><img file="US2022121884A1_D10373.tif" /><img file="US2022121884A1_D10374.tif" /><img file="US2022121884A1_D10375.tif" /><img file="US2022121884A1_D10376.tif" /><img file="US2022121884A1_D10377.tif" /><img file="US2022121884A1_D10378.tif" /><img file="US2022121884A1_D10379.tif" /><img file="US2022121884A1_D10380.tif" /><img file="US2022121884A1_D10381.tif" /><img file="US2022121884A1_D10382.tif" /><img file="US2022121884A1_D10383.tif" /><img file="US2022121884A1_D10384.tif" /><img file="US2022121884A1_D10385.tif" /><img file="US2022121884A1_D10386.tif" /><img file="US2022121884A1_D10387.tif" /><img file="US2022121884A1_D10388.tif" /><img file="US2022121884A1_D10389.tif" /><img file="US2022121884A1_D10390.tif" /><img file="US2022121884A1_D10391.tif" /><img file="US2022121884A1_D10392.tif" /><img file="US2022121884A1_D10393.tif" /><img file="US2022121884A1_D10394.tif" /><img file="US2022121884A1_D10395.tif" /><img file="US2022121884A1_D10396.tif" /><img file="US2022121884A1_D10397.tif" /><img file="US2022121884A1_D10398.tif" /><img file="US2022121884A1_D10399.tif" /><img file="US2022121884A1_D10400.tif" /><img file="US2022121884A1_D10401.tif" /><img file="US2022121884A1_D10402.tif" /><img file="US2022121884A1_D10403.tif" /><img file="US2022121884A1_D10404.tif" /><img file="US2022121884A1_D10405.tif" /><img file="US2022121884A1_D10406.tif" /><img file="US2022121884A1_D10407.tif" /><img file="US2022121884A1_D10408.tif" /><img file="US2022121884A1_D10409.tif" /><img file="US2022121884A1_D10410.tif" /><img file="US2022121884A1_D10411.tif" /><img file="US2022121884A1_D10412.tif" /><img file="US2022121884A1_D10413.tif" /><img file="US2022121884A1_D10414.tif" /><img file="US2022121884A1_D10415.tif" /><img file="US2022121884A1_D10416.tif" />
where Δu<sub>i </sub>and Count<sub>i </sub>are the width and population of i<sup>th </sup>bin. This way, a running count of population of bins is tracked as more sample data is received.
In one embodiment, Z-number appears as the consequent of a fuzzy rule, e.g.,
IF (Y is C) THEN (X is Z), where Z=(A<sub>X</sub>, B<sub>X</sub>) and X is a random variable.
As other fuzzy rules, when the rule is executed, the truth value of the antecedent (i.e., μ<sub>C</sub>(y<sub>0</sub>), where y<sub>0 </sub>is a value for Y, that is input to the rule) is applied to the restriction imposed by the consequent. The restriction imposed by the consequent is, e.g., on the probability distribution of X, which is the variable used in the consequent. Given the antecedent's truth value of T<sub>ant </sub>(between 0 and 1), in one embodiment, the contribution of the rule on the restriction of p<sub>X </sub>is represented by
<br />μ<sub>B</sub><sub><sub2>x</sub2></sub>(∫<sub>R</sub>μ<sub>A</sub><sub><sub2>x</sub2></sub>(<i>u</i>)·p<sub>x</sub>(u)·du) dipped or scaled by T<sub>ant </sub>
In one embodiment, Z-number appears in an antecedent of a fuzzy rule, but instead of the quantity restricted (e.g., px), other indirect knowledge base information may be available. For example, in the following fuzzy rule:
IF (X is Z) THEN (Y is C), where Z=(A<sub>X</sub>, B<sub>X</sub>) and X is a random variable,
suppose from input or other rules, it is given that (X is D) where D is a fuzzy set in X domain. In one approach, the hidden candidates of p<sub>X </sub>(denoted by index i) are given test scores based on the knowledge base, and such test scores are used to evaluate the truth value of the antecedent. For example, the truth value of the antecedent is determined by:
<maths id="MATH-US-00042" num="00042"><math overflow="scroll"><mrow><msub><mi>T</mi><mi>ant</mi></msub><mo>=</mo><mrow><munder><mi>sup</mi><mrow><mo>∀</mo><mi>i</mi></mrow></munder><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><mo>(</mo><mrow><msub><mi>ts</mi><mi>i</mi></msub><mo>⋀</mo><msubsup><mi>ts</mi><mi>i</mi><mi>′</mi></msubsup></mrow><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D10417.tif" /><img file="US2022121884A1_D10418.tif" /><img file="US2022121884A1_D10419.tif" /><img file="US2022121884A1_D10420.tif" /><img file="US2022121884A1_D10421.tif" /><img file="US2022121884A1_D10422.tif" /><img file="US2022121884A1_D10423.tif" /><img file="US2022121884A1_D10424.tif" /><img file="US2022121884A1_D10425.tif" /><img file="US2022121884A1_D10426.tif" /><img file="US2022121884A1_D10427.tif" /><img file="US2022121884A1_D10428.tif" /><img file="US2022121884A1_D10429.tif" /><img file="US2022121884A1_D10430.tif" /><img file="US2022121884A1_D10431.tif" /><img file="US2022121884A1_D10432.tif" /><img file="US2022121884A1_D10433.tif" /><img file="US2022121884A1_D10434.tif" /><img file="US2022121884A1_D10435.tif" /><img file="US2022121884A1_D10436.tif" /><img file="US2022121884A1_D10437.tif" /><img file="US2022121884A1_D10438.tif" /><img file="US2022121884A1_D10439.tif" /><img file="US2022121884A1_D10440.tif" /><img file="US2022121884A1_D10441.tif" /><img file="US2022121884A1_D10442.tif" /><img file="US2022121884A1_D10443.tif" /><img file="US2022121884A1_D10444.tif" /><img file="US2022121884A1_D10445.tif" /><img file="US2022121884A1_D10446.tif" /><img file="US2022121884A1_D10447.tif" /><img file="US2022121884A1_D10448.tif" /><img file="US2022121884A1_D10449.tif" /><img file="US2022121884A1_D10450.tif" /><img file="US2022121884A1_D10451.tif" /><img file="US2022121884A1_D10452.tif" /><img file="US2022121884A1_D10453.tif" /><img file="US2022121884A1_D10454.tif" /><img file="US2022121884A1_D10455.tif" /><img file="US2022121884A1_D10456.tif" /><img file="US2022121884A1_D10457.tif" /><img file="US2022121884A1_D10458.tif" /><img file="US2022121884A1_D10459.tif" /><img file="US2022121884A1_D10460.tif" /><img file="US2022121884A1_D10461.tif" /><img file="US2022121884A1_D10462.tif" /><img file="US2022121884A1_D10463.tif" /><img file="US2022121884A1_D10464.tif" /><img file="US2022121884A1_D10465.tif" /><img file="US2022121884A1_D10466.tif" /><img file="US2022121884A1_D10467.tif" /><img file="US2022121884A1_D10468.tif" /><img file="US2022121884A1_D10469.tif" /><img file="US2022121884A1_D10470.tif" /><img file="US2022121884A1_D10471.tif" /><img file="US2022121884A1_D10472.tif" /><img file="US2022121884A1_D10473.tif" /><img file="US2022121884A1_D10474.tif" /><img file="US2022121884A1_D10475.tif" /><img file="US2022121884A1_D10476.tif" /><img file="US2022121884A1_D10477.tif" /><img file="US2022121884A1_D10478.tif" /><img file="US2022121884A1_D10479.tif" /><img file="US2022121884A1_D10480.tif" /><img file="US2022121884A1_D10481.tif" /><img file="US2022121884A1_D10482.tif" /><img file="US2022121884A1_D10483.tif" /><img file="US2022121884A1_D10484.tif" /><img file="US2022121884A1_D10485.tif" /><img file="US2022121884A1_D10486.tif" /><img file="US2022121884A1_D10487.tif" /><img file="US2022121884A1_D10488.tif" /><img file="US2022121884A1_D10489.tif" /><img file="US2022121884A1_D10490.tif" /><img file="US2022121884A1_D10491.tif" /><img file="US2022121884A1_D10492.tif" /><img file="US2022121884A1_D10493.tif" /><img file="US2022121884A1_D10494.tif" /><img file="US2022121884A1_D10495.tif" /><img file="US2022121884A1_D10496.tif" /><img file="US2022121884A1_D10497.tif" /><img file="US2022121884A1_D10498.tif" /><img file="US2022121884A1_D10499.tif" /><img file="US2022121884A1_D10500.tif" /><img file="US2022121884A1_D10501.tif" /><img file="US2022121884A1_D10502.tif" /><img file="US2022121884A1_D10503.tif" /><img file="US2022121884A1_D10504.tif" /><img file="US2022121884A1_D10505.tif" /><img file="US2022121884A1_D10506.tif" /><img file="US2022121884A1_D10507.tif" /><img file="US2022121884A1_D10508.tif" /><img file="US2022121884A1_D10509.tif" /><img file="US2022121884A1_D10510.tif" /><img file="US2022121884A1_D10511.tif" /><img file="US2022121884A1_D10512.tif" /><img file="US2022121884A1_D10513.tif" /><img file="US2022121884A1_D10514.tif" /><img file="US2022121884A1_D10515.tif" /><img file="US2022121884A1_D10516.tif" /><img file="US2022121884A1_D10517.tif" /><img file="US2022121884A1_D10518.tif" /><img file="US2022121884A1_D10519.tif" /><img file="US2022121884A1_D10520.tif" /><img file="US2022121884A1_D10521.tif" /><img file="US2022121884A1_D10522.tif" /><img file="US2022121884A1_D10523.tif" /><img file="US2022121884A1_D10524.tif" /><img file="US2022121884A1_D10525.tif" /><img file="US2022121884A1_D10526.tif" /><img file="US2022121884A1_D10527.tif" /><img file="US2022121884A1_D10528.tif" /><maths id="MATH-US-00042-2" num="00042.2"><math overflow="scroll"><mi>where</mi></math></maths><img file="US2022121884A1_D10529.tif" /><img file="US2022121884A1_D10530.tif" /><img file="US2022121884A1_D10531.tif" /><img file="US2022121884A1_D10532.tif" /><img file="US2022121884A1_D10533.tif" /><img file="US2022121884A1_D10534.tif" /><img file="US2022121884A1_D10535.tif" /><img file="US2022121884A1_D10536.tif" /><img file="US2022121884A1_D10537.tif" /><img file="US2022121884A1_D10538.tif" /><img file="US2022121884A1_D10539.tif" /><img file="US2022121884A1_D10540.tif" /><img file="US2022121884A1_D10541.tif" /><img file="US2022121884A1_D10542.tif" /><img file="US2022121884A1_D10543.tif" /><img file="US2022121884A1_D10544.tif" /><img file="US2022121884A1_D10545.tif" /><img file="US2022121884A1_D10546.tif" /><img file="US2022121884A1_D10547.tif" /><img file="US2022121884A1_D10548.tif" /><img file="US2022121884A1_D10549.tif" /><img file="US2022121884A1_D10550.tif" /><img file="US2022121884A1_D10551.tif" /><img file="US2022121884A1_D10552.tif" /><img file="US2022121884A1_D10553.tif" /><img file="US2022121884A1_D10554.tif" /><img file="US2022121884A1_D10555.tif" /><img file="US2022121884A1_D10556.tif" /><img file="US2022121884A1_D10557.tif" /><img file="US2022121884A1_D10558.tif" /><img file="US2022121884A1_D10559.tif" /><img file="US2022121884A1_D10560.tif" /><img file="US2022121884A1_D10561.tif" /><img file="US2022121884A1_D10562.tif" /><img file="US2022121884A1_D10563.tif" /><img file="US2022121884A1_D10564.tif" /><img file="US2022121884A1_D10565.tif" /><img file="US2022121884A1_D10566.tif" /><img file="US2022121884A1_D10567.tif" /><img file="US2022121884A1_D10568.tif" /><img file="US2022121884A1_D10569.tif" /><img file="US2022121884A1_D10570.tif" /><img file="US2022121884A1_D10571.tif" /><img file="US2022121884A1_D10572.tif" /><img file="US2022121884A1_D10573.tif" /><img file="US2022121884A1_D10574.tif" /><img file="US2022121884A1_D10575.tif" /><img file="US2022121884A1_D10576.tif" /><img file="US2022121884A1_D10577.tif" /><img file="US2022121884A1_D10578.tif" /><img file="US2022121884A1_D10579.tif" /><img file="US2022121884A1_D10580.tif" /><img file="US2022121884A1_D10581.tif" /><img file="US2022121884A1_D10582.tif" /><img file="US2022121884A1_D10583.tif" /><img file="US2022121884A1_D10584.tif" /><img file="US2022121884A1_D10585.tif" /><img file="US2022121884A1_D10586.tif" /><img file="US2022121884A1_D10587.tif" /><img file="US2022121884A1_D10588.tif" /><img file="US2022121884A1_D10589.tif" /><img file="US2022121884A1_D10590.tif" /><img file="US2022121884A1_D10591.tif" /><img file="US2022121884A1_D10592.tif" /><img file="US2022121884A1_D10593.tif" /><img file="US2022121884A1_D10594.tif" /><img file="US2022121884A1_D10595.tif" /><img file="US2022121884A1_D10596.tif" /><img file="US2022121884A1_D10597.tif" /><img file="US2022121884A1_D10598.tif" /><img file="US2022121884A1_D10599.tif" /><img file="US2022121884A1_D10600.tif" /><img file="US2022121884A1_D10601.tif" /><img file="US2022121884A1_D10602.tif" /><img file="US2022121884A1_D10603.tif" /><img file="US2022121884A1_D10604.tif" /><img file="US2022121884A1_D10605.tif" /><img file="US2022121884A1_D10606.tif" /><img file="US2022121884A1_D10607.tif" /><img file="US2022121884A1_D10608.tif" /><img file="US2022121884A1_D10609.tif" /><img file="US2022121884A1_D10610.tif" /><img file="US2022121884A1_D10611.tif" /><img file="US2022121884A1_D10612.tif" /><img file="US2022121884A1_D10613.tif" /><img file="US2022121884A1_D10614.tif" /><img file="US2022121884A1_D10615.tif" /><img file="US2022121884A1_D10616.tif" /><img file="US2022121884A1_D10617.tif" /><img file="US2022121884A1_D10618.tif" /><img file="US2022121884A1_D10619.tif" /><img file="US2022121884A1_D10620.tif" /><img file="US2022121884A1_D10621.tif" /><img file="US2022121884A1_D10622.tif" /><img file="US2022121884A1_D10623.tif" /><img file="US2022121884A1_D10624.tif" /><img file="US2022121884A1_D10625.tif" /><img file="US2022121884A1_D10626.tif" /><img file="US2022121884A1_D10627.tif" /><img file="US2022121884A1_D10628.tif" /><img file="US2022121884A1_D10629.tif" /><img file="US2022121884A1_D10630.tif" /><img file="US2022121884A1_D10631.tif" /><img file="US2022121884A1_D10632.tif" /><img file="US2022121884A1_D10633.tif" /><img file="US2022121884A1_D10634.tif" /><img file="US2022121884A1_D10635.tif" /><img file="US2022121884A1_D10636.tif" /><img file="US2022121884A1_D10637.tif" /><img file="US2022121884A1_D10638.tif" /><img file="US2022121884A1_D10639.tif" /><img file="US2022121884A1_D10640.tif" /><maths id="MATH-US-00042-3" num="00042.3"><math overflow="scroll"><mrow><msub><mi>ts</mi><mi>i</mi></msub><mo>=</mo><mrow><munder><mo>∫</mo><mi>R</mi></munder><mo></mo><mrow><mrow><msub><mi>μ</mi><mi>D</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>p</mi><mi>i</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D10641.tif" /><img file="US2022121884A1_D10642.tif" /><img file="US2022121884A1_D10643.tif" /><img file="US2022121884A1_D10644.tif" /><img file="US2022121884A1_D10645.tif" /><img file="US2022121884A1_D10646.tif" /><img file="US2022121884A1_D10647.tif" /><img file="US2022121884A1_D10648.tif" /><img file="US2022121884A1_D10649.tif" /><img file="US2022121884A1_D10650.tif" /><img file="US2022121884A1_D10651.tif" /><img file="US2022121884A1_D10652.tif" /><img file="US2022121884A1_D10653.tif" /><img file="US2022121884A1_D10654.tif" /><img file="US2022121884A1_D10655.tif" /><img file="US2022121884A1_D10656.tif" /><img file="US2022121884A1_D10657.tif" /><img file="US2022121884A1_D10658.tif" /><img file="US2022121884A1_D10659.tif" /><img file="US2022121884A1_D10660.tif" /><img file="US2022121884A1_D10661.tif" /><img file="US2022121884A1_D10662.tif" /><img file="US2022121884A1_D10663.tif" /><img file="US2022121884A1_D10664.tif" /><img file="US2022121884A1_D10665.tif" /><img file="US2022121884A1_D10666.tif" /><img file="US2022121884A1_D10667.tif" /><img file="US2022121884A1_D10668.tif" /><img file="US2022121884A1_D10669.tif" /><img file="US2022121884A1_D10670.tif" /><img file="US2022121884A1_D10671.tif" /><img file="US2022121884A1_D10672.tif" /><img file="US2022121884A1_D10673.tif" /><img file="US2022121884A1_D10674.tif" /><img file="US2022121884A1_D10675.tif" /><img file="US2022121884A1_D10676.tif" /><img file="US2022121884A1_D10677.tif" /><img file="US2022121884A1_D10678.tif" /><img file="US2022121884A1_D10679.tif" /><img file="US2022121884A1_D10680.tif" /><img file="US2022121884A1_D10681.tif" /><img file="US2022121884A1_D10682.tif" /><img file="US2022121884A1_D10683.tif" /><img file="US2022121884A1_D10684.tif" /><img file="US2022121884A1_D10685.tif" /><img file="US2022121884A1_D10686.tif" /><img file="US2022121884A1_D10687.tif" /><img file="US2022121884A1_D10688.tif" /><img file="US2022121884A1_D10689.tif" /><img file="US2022121884A1_D10690.tif" /><img file="US2022121884A1_D10691.tif" /><img file="US2022121884A1_D10692.tif" /><img file="US2022121884A1_D10693.tif" /><img file="US2022121884A1_D10694.tif" /><img file="US2022121884A1_D10695.tif" /><img file="US2022121884A1_D10696.tif" /><img file="US2022121884A1_D10697.tif" /><img file="US2022121884A1_D10698.tif" /><img file="US2022121884A1_D10699.tif" /><img file="US2022121884A1_D10700.tif" /><img file="US2022121884A1_D10701.tif" /><img file="US2022121884A1_D10702.tif" /><img file="US2022121884A1_D10703.tif" /><img file="US2022121884A1_D10704.tif" /><img file="US2022121884A1_D10705.tif" /><img file="US2022121884A1_D10706.tif" /><img file="US2022121884A1_D10707.tif" /><img file="US2022121884A1_D10708.tif" /><img file="US2022121884A1_D10709.tif" /><img file="US2022121884A1_D10710.tif" /><img file="US2022121884A1_D10711.tif" /><img file="US2022121884A1_D10712.tif" /><img file="US2022121884A1_D10713.tif" /><img file="US2022121884A1_D10714.tif" /><img file="US2022121884A1_D10715.tif" /><img file="US2022121884A1_D10716.tif" /><img file="US2022121884A1_D10717.tif" /><img file="US2022121884A1_D10718.tif" /><img file="US2022121884A1_D10719.tif" /><img file="US2022121884A1_D10720.tif" /><img file="US2022121884A1_D10721.tif" /><img file="US2022121884A1_D10722.tif" /><img file="US2022121884A1_D10723.tif" /><img file="US2022121884A1_D10724.tif" /><img file="US2022121884A1_D10725.tif" /><img file="US2022121884A1_D10726.tif" /><img file="US2022121884A1_D10727.tif" /><img file="US2022121884A1_D10728.tif" /><img file="US2022121884A1_D10729.tif" /><img file="US2022121884A1_D10730.tif" /><img file="US2022121884A1_D10731.tif" /><img file="US2022121884A1_D10732.tif" /><img file="US2022121884A1_D10733.tif" /><img file="US2022121884A1_D10734.tif" /><img file="US2022121884A1_D10735.tif" /><img file="US2022121884A1_D10736.tif" /><img file="US2022121884A1_D10737.tif" /><img file="US2022121884A1_D10738.tif" /><img file="US2022121884A1_D10739.tif" /><img file="US2022121884A1_D10740.tif" /><img file="US2022121884A1_D10741.tif" /><img file="US2022121884A1_D10742.tif" /><img file="US2022121884A1_D10743.tif" /><img file="US2022121884A1_D10744.tif" /><img file="US2022121884A1_D10745.tif" /><img file="US2022121884A1_D10746.tif" /><img file="US2022121884A1_D10747.tif" /><img file="US2022121884A1_D10748.tif" /><img file="US2022121884A1_D10749.tif" /><img file="US2022121884A1_D10750.tif" /><img file="US2022121884A1_D10751.tif" /><img file="US2022121884A1_D10752.tif" /><maths id="MATH-US-00042-4" num="00042.4"><math overflow="scroll"><mrow><msubsup><mi>ts</mi><mi>i</mi><mi>′</mi></msubsup><mo>=</mo><mrow><msub><mi>μ</mi><msub><mi>B</mi><mi>X</mi></msub></msub><mo>(</mo><mrow><munder><mo>∫</mo><mi>R</mi></munder><mo></mo><mrow><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>X</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>p</mi><mi>i</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D10753.tif" /><img file="US2022121884A1_D10754.tif" /><img file="US2022121884A1_D10755.tif" /><img file="US2022121884A1_D10756.tif" /><img file="US2022121884A1_D10757.tif" /><img file="US2022121884A1_D10758.tif" /><img file="US2022121884A1_D10759.tif" /><img file="US2022121884A1_D10760.tif" /><img file="US2022121884A1_D10761.tif" /><img file="US2022121884A1_D10762.tif" /><img file="US2022121884A1_D10763.tif" /><img file="US2022121884A1_D10764.tif" /><img file="US2022121884A1_D10765.tif" /><img file="US2022121884A1_D10766.tif" /><img file="US2022121884A1_D10767.tif" /><img file="US2022121884A1_D10768.tif" /><img file="US2022121884A1_D10769.tif" /><img file="US2022121884A1_D10770.tif" /><img file="US2022121884A1_D10771.tif" /><img file="US2022121884A1_D10772.tif" /><img file="US2022121884A1_D10773.tif" /><img file="US2022121884A1_D10774.tif" /><img file="US2022121884A1_D10775.tif" /><img file="US2022121884A1_D10776.tif" /><img file="US2022121884A1_D10777.tif" /><img file="US2022121884A1_D10778.tif" /><img file="US2022121884A1_D10779.tif" /><img file="US2022121884A1_D10780.tif" /><img file="US2022121884A1_D10781.tif" /><img file="US2022121884A1_D10782.tif" /><img file="US2022121884A1_D10783.tif" /><img file="US2022121884A1_D10784.tif" /><img file="US2022121884A1_D10785.tif" /><img file="US2022121884A1_D10786.tif" /><img file="US2022121884A1_D10787.tif" /><img file="US2022121884A1_D10788.tif" /><img file="US2022121884A1_D10789.tif" /><img file="US2022121884A1_D10790.tif" /><img file="US2022121884A1_D10791.tif" /><img file="US2022121884A1_D10792.tif" /><img file="US2022121884A1_D10793.tif" /><img file="US2022121884A1_D10794.tif" /><img file="US2022121884A1_D10795.tif" /><img file="US2022121884A1_D10796.tif" /><img file="US2022121884A1_D10797.tif" /><img file="US2022121884A1_D10798.tif" /><img file="US2022121884A1_D10799.tif" /><img file="US2022121884A1_D10800.tif" /><img file="US2022121884A1_D10801.tif" /><img file="US2022121884A1_D10802.tif" /><img file="US2022121884A1_D10803.tif" /><img file="US2022121884A1_D10804.tif" /><img file="US2022121884A1_D10805.tif" /><img file="US2022121884A1_D10806.tif" /><img file="US2022121884A1_D10807.tif" /><img file="US2022121884A1_D10808.tif" /><img file="US2022121884A1_D10809.tif" /><img file="US2022121884A1_D10810.tif" /><img file="US2022121884A1_D10811.tif" /><img file="US2022121884A1_D10812.tif" /><img file="US2022121884A1_D10813.tif" /><img file="US2022121884A1_D10814.tif" /><img file="US2022121884A1_D10815.tif" /><img file="US2022121884A1_D10816.tif" /><img file="US2022121884A1_D10817.tif" /><img file="US2022121884A1_D10818.tif" /><img file="US2022121884A1_D10819.tif" /><img file="US2022121884A1_D10820.tif" /><img file="US2022121884A1_D10821.tif" /><img file="US2022121884A1_D10822.tif" /><img file="US2022121884A1_D10823.tif" /><img file="US2022121884A1_D10824.tif" /><img file="US2022121884A1_D10825.tif" /><img file="US2022121884A1_D10826.tif" /><img file="US2022121884A1_D10827.tif" /><img file="US2022121884A1_D10828.tif" /><img file="US2022121884A1_D10829.tif" /><img file="US2022121884A1_D10830.tif" /><img file="US2022121884A1_D10831.tif" /><img file="US2022121884A1_D10832.tif" /><img file="US2022121884A1_D10833.tif" /><img file="US2022121884A1_D10834.tif" /><img file="US2022121884A1_D10835.tif" /><img file="US2022121884A1_D10836.tif" /><img file="US2022121884A1_D10837.tif" /><img file="US2022121884A1_D10838.tif" /><img file="US2022121884A1_D10839.tif" /><img file="US2022121884A1_D10840.tif" /><img file="US2022121884A1_D10841.tif" /><img file="US2022121884A1_D10842.tif" /><img file="US2022121884A1_D10843.tif" /><img file="US2022121884A1_D10844.tif" /><img file="US2022121884A1_D10845.tif" /><img file="US2022121884A1_D10846.tif" /><img file="US2022121884A1_D10847.tif" /><img file="US2022121884A1_D10848.tif" /><img file="US2022121884A1_D10849.tif" /><img file="US2022121884A1_D10850.tif" /><img file="US2022121884A1_D10851.tif" /><img file="US2022121884A1_D10852.tif" /><img file="US2022121884A1_D10853.tif" /><img file="US2022121884A1_D10854.tif" /><img file="US2022121884A1_D10855.tif" /><img file="US2022121884A1_D10856.tif" /><img file="US2022121884A1_D10857.tif" /><img file="US2022121884A1_D10858.tif" /><img file="US2022121884A1_D10859.tif" /><img file="US2022121884A1_D10860.tif" /><img file="US2022121884A1_D10861.tif" /><img file="US2022121884A1_D10862.tif" /><img file="US2022121884A1_D10863.tif" /><img file="US2022121884A1_D10864.tif" />
In one embodiment, various model(s) of probability distribution is employed (based on default or other knowledge base) to parameterize ∀i . For example, a model of normal distribution may be assumed for px candidates, and the corresponding parameters will be the peak location and width of the distribution. Depending on the context, other distributions (e.g., Poisson distribution) are used. For example, in “Bus usually arrives about every 10 minutes”, where X is bus arrival time, A<sub>X </sub>is about 10 minutes, and B<sub>X </sub>is usually, a model of probability distribution for bus arrival time may be taken as a Poisson distribution with parameter τ:
<maths id="MATH-US-00043" num="00043"><math overflow="scroll"><mrow><mrow><msub><mi>p</mi><mi>i</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mfrac><mi>u</mi><msub><mi>τ</mi><mi>i</mi></msub></mfrac><mo>·</mo><msup><mi>e</mi><mfrac><mrow><mo>-</mo><mi>u</mi></mrow><msub><mi>τ</mi><mi>i</mi></msub></mfrac></msup></mrow></mrow></math></maths><img file="US2022121884A1_D10865.tif" /><img file="US2022121884A1_D10866.tif" /><img file="US2022121884A1_D10867.tif" /><img file="US2022121884A1_D10868.tif" /><img file="US2022121884A1_D10869.tif" /><img file="US2022121884A1_D10870.tif" /><img file="US2022121884A1_D10871.tif" /><img file="US2022121884A1_D10872.tif" /><img file="US2022121884A1_D10873.tif" /><img file="US2022121884A1_D10874.tif" /><img file="US2022121884A1_D10875.tif" /><img file="US2022121884A1_D10876.tif" /><img file="US2022121884A1_D10877.tif" /><img file="US2022121884A1_D10878.tif" /><img file="US2022121884A1_D10879.tif" /><img file="US2022121884A1_D10880.tif" /><img file="US2022121884A1_D10881.tif" /><img file="US2022121884A1_D10882.tif" /><img file="US2022121884A1_D10883.tif" /><img file="US2022121884A1_D10884.tif" /><img file="US2022121884A1_D10885.tif" /><img file="US2022121884A1_D10886.tif" /><img file="US2022121884A1_D10887.tif" /><img file="US2022121884A1_D10888.tif" /><img file="US2022121884A1_D10889.tif" /><img file="US2022121884A1_D10890.tif" /><img file="US2022121884A1_D10891.tif" /><img file="US2022121884A1_D10892.tif" /><img file="US2022121884A1_D10893.tif" /><img file="US2022121884A1_D10894.tif" /><img file="US2022121884A1_D10895.tif" /><img file="US2022121884A1_D10896.tif" /><img file="US2022121884A1_D10897.tif" /><img file="US2022121884A1_D10898.tif" /><img file="US2022121884A1_D10899.tif" /><img file="US2022121884A1_D10900.tif" /><img file="US2022121884A1_D10901.tif" /><img file="US2022121884A1_D10902.tif" /><img file="US2022121884A1_D10903.tif" /><img file="US2022121884A1_D10904.tif" /><img file="US2022121884A1_D10905.tif" /><img file="US2022121884A1_D10906.tif" /><img file="US2022121884A1_D10907.tif" /><img file="US2022121884A1_D10908.tif" /><img file="US2022121884A1_D10909.tif" /><img file="US2022121884A1_D10910.tif" /><img file="US2022121884A1_D10911.tif" /><img file="US2022121884A1_D10912.tif" /><img file="US2022121884A1_D10913.tif" /><img file="US2022121884A1_D10914.tif" /><img file="US2022121884A1_D10915.tif" /><img file="US2022121884A1_D10916.tif" /><img file="US2022121884A1_D10917.tif" /><img file="US2022121884A1_D10918.tif" /><img file="US2022121884A1_D10919.tif" /><img file="US2022121884A1_D10920.tif" /><img file="US2022121884A1_D10921.tif" /><img file="US2022121884A1_D10922.tif" /><img file="US2022121884A1_D10923.tif" /><img file="US2022121884A1_D10924.tif" /><img file="US2022121884A1_D10925.tif" /><img file="US2022121884A1_D10926.tif" /><img file="US2022121884A1_D10927.tif" /><img file="US2022121884A1_D10928.tif" /><img file="US2022121884A1_D10929.tif" /><img file="US2022121884A1_D10930.tif" /><img file="US2022121884A1_D10931.tif" /><img file="US2022121884A1_D10932.tif" /><img file="US2022121884A1_D10933.tif" /><img file="US2022121884A1_D10934.tif" /><img file="US2022121884A1_D10935.tif" /><img file="US2022121884A1_D10936.tif" /><img file="US2022121884A1_D10937.tif" /><img file="US2022121884A1_D10938.tif" /><img file="US2022121884A1_D10939.tif" /><img file="US2022121884A1_D10940.tif" /><img file="US2022121884A1_D10941.tif" /><img file="US2022121884A1_D10942.tif" /><img file="US2022121884A1_D10943.tif" /><img file="US2022121884A1_D10944.tif" /><img file="US2022121884A1_D10945.tif" /><img file="US2022121884A1_D10946.tif" /><img file="US2022121884A1_D10947.tif" /><img file="US2022121884A1_D10948.tif" /><img file="US2022121884A1_D10949.tif" /><img file="US2022121884A1_D10950.tif" /><img file="US2022121884A1_D10951.tif" /><img file="US2022121884A1_D10952.tif" /><img file="US2022121884A1_D10953.tif" /><img file="US2022121884A1_D10954.tif" /><img file="US2022121884A1_D10955.tif" /><img file="US2022121884A1_D10956.tif" /><img file="US2022121884A1_D10957.tif" /><img file="US2022121884A1_D10958.tif" /><img file="US2022121884A1_D10959.tif" /><img file="US2022121884A1_D10960.tif" /><img file="US2022121884A1_D10961.tif" /><img file="US2022121884A1_D10962.tif" /><img file="US2022121884A1_D10963.tif" /><img file="US2022121884A1_D10964.tif" /><img file="US2022121884A1_D10965.tif" /><img file="US2022121884A1_D10966.tif" /><img file="US2022121884A1_D10967.tif" /><img file="US2022121884A1_D10968.tif" /><img file="US2022121884A1_D10969.tif" /><img file="US2022121884A1_D10970.tif" /><img file="US2022121884A1_D10971.tif" /><img file="US2022121884A1_D10972.tif" /><img file="US2022121884A1_D10973.tif" /><img file="US2022121884A1_D10974.tif" /><img file="US2022121884A1_D10975.tif" /><img file="US2022121884A1_D10976.tif" />
Then, the antecedent truth value is determined by
<maths id="MATH-US-00044" num="00044"><math overflow="scroll"><mrow><msub><mi>T</mi><mi>ant</mi></msub><mo>=</mo><mrow><munder><mi>sup</mi><mrow><mo>∀</mo><msub><mi>τ</mi><mi>i</mi></msub></mrow></munder><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><mo>(</mo><mrow><msub><mi>ts</mi><mi>i</mi></msub><mo>⋀</mo><msubsup><mi>ts</mi><mi>i</mi><mi>′</mi></msubsup></mrow><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D10977.tif" /><img file="US2022121884A1_D10978.tif" /><img file="US2022121884A1_D10979.tif" /><img file="US2022121884A1_D10980.tif" /><img file="US2022121884A1_D10981.tif" /><img file="US2022121884A1_D10982.tif" /><img file="US2022121884A1_D10983.tif" /><img file="US2022121884A1_D10984.tif" /><img file="US2022121884A1_D10985.tif" /><img file="US2022121884A1_D10986.tif" /><img file="US2022121884A1_D10987.tif" /><img file="US2022121884A1_D10988.tif" /><img file="US2022121884A1_D10989.tif" /><img file="US2022121884A1_D10990.tif" /><img file="US2022121884A1_D10991.tif" /><img file="US2022121884A1_D10992.tif" /><img file="US2022121884A1_D10993.tif" /><img file="US2022121884A1_D10994.tif" /><img file="US2022121884A1_D10995.tif" /><img file="US2022121884A1_D10996.tif" /><img file="US2022121884A1_D10997.tif" /><img file="US2022121884A1_D10998.tif" /><img file="US2022121884A1_D10999.tif" /><img file="US2022121884A1_D11000.tif" /><img file="US2022121884A1_D11001.tif" /><img file="US2022121884A1_D11002.tif" /><img file="US2022121884A1_D11003.tif" /><img file="US2022121884A1_D11004.tif" /><img file="US2022121884A1_D11005.tif" /><img file="US2022121884A1_D11006.tif" /><img file="US2022121884A1_D11007.tif" /><img file="US2022121884A1_D11008.tif" /><img file="US2022121884A1_D11009.tif" /><img file="US2022121884A1_D11010.tif" /><img file="US2022121884A1_D11011.tif" /><img file="US2022121884A1_D11012.tif" /><img file="US2022121884A1_D11013.tif" /><img file="US2022121884A1_D11014.tif" /><img file="US2022121884A1_D11015.tif" /><img file="US2022121884A1_D11016.tif" /><img file="US2022121884A1_D11017.tif" /><img file="US2022121884A1_D11018.tif" /><img file="US2022121884A1_D11019.tif" /><img file="US2022121884A1_D11020.tif" /><img file="US2022121884A1_D11021.tif" /><img file="US2022121884A1_D11022.tif" /><img file="US2022121884A1_D11023.tif" /><img file="US2022121884A1_D11024.tif" /><img file="US2022121884A1_D11025.tif" /><img file="US2022121884A1_D11026.tif" /><img file="US2022121884A1_D11027.tif" /><img file="US2022121884A1_D11028.tif" /><img file="US2022121884A1_D11029.tif" /><img file="US2022121884A1_D11030.tif" /><img file="US2022121884A1_D11031.tif" /><img file="US2022121884A1_D11032.tif" /><img file="US2022121884A1_D11033.tif" /><img file="US2022121884A1_D11034.tif" /><img file="US2022121884A1_D11035.tif" /><img file="US2022121884A1_D11036.tif" /><img file="US2022121884A1_D11037.tif" /><img file="US2022121884A1_D11038.tif" /><img file="US2022121884A1_D11039.tif" /><img file="US2022121884A1_D11040.tif" /><img file="US2022121884A1_D11041.tif" /><img file="US2022121884A1_D11042.tif" /><img file="US2022121884A1_D11043.tif" /><img file="US2022121884A1_D11044.tif" /><img file="US2022121884A1_D11045.tif" /><img file="US2022121884A1_D11046.tif" /><img file="US2022121884A1_D11047.tif" /><img file="US2022121884A1_D11048.tif" /><img file="US2022121884A1_D11049.tif" /><img file="US2022121884A1_D11050.tif" /><img file="US2022121884A1_D11051.tif" /><img file="US2022121884A1_D11052.tif" /><img file="US2022121884A1_D11053.tif" /><img file="US2022121884A1_D11054.tif" /><img file="US2022121884A1_D11055.tif" /><img file="US2022121884A1_D11056.tif" /><img file="US2022121884A1_D11057.tif" /><img file="US2022121884A1_D11058.tif" /><img file="US2022121884A1_D11059.tif" /><img file="US2022121884A1_D11060.tif" /><img file="US2022121884A1_D11061.tif" /><img file="US2022121884A1_D11062.tif" /><img file="US2022121884A1_D11063.tif" /><img file="US2022121884A1_D11064.tif" /><img file="US2022121884A1_D11065.tif" /><img file="US2022121884A1_D11066.tif" /><img file="US2022121884A1_D11067.tif" /><img file="US2022121884A1_D11068.tif" /><img file="US2022121884A1_D11069.tif" /><img file="US2022121884A1_D11070.tif" /><img file="US2022121884A1_D11071.tif" /><img file="US2022121884A1_D11072.tif" /><img file="US2022121884A1_D11073.tif" /><img file="US2022121884A1_D11074.tif" /><img file="US2022121884A1_D11075.tif" /><img file="US2022121884A1_D11076.tif" /><img file="US2022121884A1_D11077.tif" /><img file="US2022121884A1_D11078.tif" /><img file="US2022121884A1_D11079.tif" /><img file="US2022121884A1_D11080.tif" /><img file="US2022121884A1_D11081.tif" /><img file="US2022121884A1_D11082.tif" /><img file="US2022121884A1_D11083.tif" /><img file="US2022121884A1_D11084.tif" /><img file="US2022121884A1_D11085.tif" /><img file="US2022121884A1_D11086.tif" /><img file="US2022121884A1_D11087.tif" /><img file="US2022121884A1_D11088.tif" />
In one embodiment, the truth value of the antecedent in a fuzzy rule with Z-number, e.g.,
IF (X is Z) THEN (Y is C), where Z=(A<sub>X</sub>, B<sub>X</sub>) and X is a random variable,
is determined by imposing the assumption that the probability distribution p<sub>X </sub>is compatible with the knowledge base possibility restriction (e.g., (X is D)). Then, a candidate for p<sub>X </sub>may be constructed per μ<sub>D</sub>. For example, by taking a normalized shape of possibility distribution:
<maths id="MATH-US-00045" num="00045"><math overflow="scroll"><mrow><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo>=</mo><mfrac><mrow><msub><mi>μ</mi><mi>D</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mrow><msub><mo>∫</mo><mi>R</mi></msub><mo></mo><mrow><mrow><msub><mi>μ</mi><mi>D</mi></msub><mo></mo><mrow><mo>(</mo><msup><mi>u</mi><mi>′</mi></msup><mo>)</mo></mrow></mrow><mo></mo><mi>d</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><msup><mi>u</mi><mi>′</mi></msup></mrow></mrow></mfrac></mrow></math></maths><img file="US2022121884A1_D11089.tif" /><img file="US2022121884A1_D11090.tif" /><img file="US2022121884A1_D11091.tif" /><img file="US2022121884A1_D11092.tif" /><img file="US2022121884A1_D11093.tif" /><img file="US2022121884A1_D11094.tif" /><img file="US2022121884A1_D11095.tif" /><img file="US2022121884A1_D11096.tif" /><img file="US2022121884A1_D11097.tif" /><img file="US2022121884A1_D11098.tif" /><img file="US2022121884A1_D11099.tif" /><img file="US2022121884A1_D11100.tif" /><img file="US2022121884A1_D11101.tif" /><img file="US2022121884A1_D11102.tif" /><img file="US2022121884A1_D11103.tif" /><img file="US2022121884A1_D11104.tif" /><img file="US2022121884A1_D11105.tif" /><img file="US2022121884A1_D11106.tif" /><img file="US2022121884A1_D11107.tif" /><img file="US2022121884A1_D11108.tif" /><img file="US2022121884A1_D11109.tif" /><img file="US2022121884A1_D11110.tif" /><img file="US2022121884A1_D11111.tif" /><img file="US2022121884A1_D11112.tif" /><img file="US2022121884A1_D11113.tif" /><img file="US2022121884A1_D11114.tif" /><img file="US2022121884A1_D11115.tif" /><img file="US2022121884A1_D11116.tif" /><img file="US2022121884A1_D11117.tif" /><img file="US2022121884A1_D11118.tif" /><img file="US2022121884A1_D11119.tif" /><img file="US2022121884A1_D11120.tif" /><img file="US2022121884A1_D11121.tif" /><img file="US2022121884A1_D11122.tif" /><img file="US2022121884A1_D11123.tif" /><img file="US2022121884A1_D11124.tif" /><img file="US2022121884A1_D11125.tif" /><img file="US2022121884A1_D11126.tif" /><img file="US2022121884A1_D11127.tif" /><img file="US2022121884A1_D11128.tif" /><img file="US2022121884A1_D11129.tif" /><img file="US2022121884A1_D11130.tif" /><img file="US2022121884A1_D11131.tif" /><img file="US2022121884A1_D11132.tif" /><img file="US2022121884A1_D11133.tif" /><img file="US2022121884A1_D11134.tif" /><img file="US2022121884A1_D11135.tif" /><img file="US2022121884A1_D11136.tif" /><img file="US2022121884A1_D11137.tif" /><img file="US2022121884A1_D11138.tif" /><img file="US2022121884A1_D11139.tif" /><img file="US2022121884A1_D11140.tif" /><img file="US2022121884A1_D11141.tif" /><img file="US2022121884A1_D11142.tif" /><img file="US2022121884A1_D11143.tif" /><img file="US2022121884A1_D11144.tif" /><img file="US2022121884A1_D11145.tif" /><img file="US2022121884A1_D11146.tif" /><img file="US2022121884A1_D11147.tif" /><img file="US2022121884A1_D11148.tif" /><img file="US2022121884A1_D11149.tif" /><img file="US2022121884A1_D11150.tif" /><img file="US2022121884A1_D11151.tif" /><img file="US2022121884A1_D11152.tif" /><img file="US2022121884A1_D11153.tif" /><img file="US2022121884A1_D11154.tif" /><img file="US2022121884A1_D11155.tif" /><img file="US2022121884A1_D11156.tif" /><img file="US2022121884A1_D11157.tif" /><img file="US2022121884A1_D11158.tif" /><img file="US2022121884A1_D11159.tif" /><img file="US2022121884A1_D11160.tif" /><img file="US2022121884A1_D11161.tif" /><img file="US2022121884A1_D11162.tif" /><img file="US2022121884A1_D11163.tif" /><img file="US2022121884A1_D11164.tif" /><img file="US2022121884A1_D11165.tif" /><img file="US2022121884A1_D11166.tif" /><img file="US2022121884A1_D11167.tif" /><img file="US2022121884A1_D11168.tif" /><img file="US2022121884A1_D11169.tif" /><img file="US2022121884A1_D11170.tif" /><img file="US2022121884A1_D11171.tif" /><img file="US2022121884A1_D11172.tif" /><img file="US2022121884A1_D11173.tif" /><img file="US2022121884A1_D11174.tif" /><img file="US2022121884A1_D11175.tif" /><img file="US2022121884A1_D11176.tif" /><img file="US2022121884A1_D11177.tif" /><img file="US2022121884A1_D11178.tif" /><img file="US2022121884A1_D11179.tif" /><img file="US2022121884A1_D11180.tif" /><img file="US2022121884A1_D11181.tif" /><img file="US2022121884A1_D11182.tif" /><img file="US2022121884A1_D11183.tif" /><img file="US2022121884A1_D11184.tif" /><img file="US2022121884A1_D11185.tif" /><img file="US2022121884A1_D11186.tif" /><img file="US2022121884A1_D11187.tif" /><img file="US2022121884A1_D11188.tif" /><img file="US2022121884A1_D11189.tif" /><img file="US2022121884A1_D11190.tif" /><img file="US2022121884A1_D11191.tif" /><img file="US2022121884A1_D11192.tif" /><img file="US2022121884A1_D11193.tif" /><img file="US2022121884A1_D11194.tif" /><img file="US2022121884A1_D11195.tif" /><img file="US2022121884A1_D11196.tif" /><img file="US2022121884A1_D11197.tif" /><img file="US2022121884A1_D11198.tif" /><img file="US2022121884A1_D11199.tif" /><img file="US2022121884A1_D11200.tif" />
In one embodiment, the compatibility assumption is used with a model of distribution (e.g., based on default or knowledge base). For example, assuming a model of normal distribution is selected, the candidate probability distribution is determined as follows:
<maths id="MATH-US-00046" num="00046"><math overflow="scroll"><mrow><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mfrac><mn>1</mn><msqrt><mrow><mn>2</mn><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><mi>π</mi><mo>·</mo><mi>r</mi><mo>·</mo><msub><mi>D</mi><mi>width</mi></msub></mrow></mrow></msqrt></mfrac><mo>·</mo><msup><mi>e</mi><mrow><mo>-</mo><mfrac><msup><mrow><mo>(</mo><mrow><mi>u</mi><mo>-</mo><msub><mi>D</mi><mi>cent</mi></msub></mrow><mo>)</mo></mrow><mn>2</mn></msup><mrow><mn>2</mn><mo>·</mo><msup><mi>r</mi><mn>2</mn></msup><mo>·</mo><msub><mi>D</mi><msup><mi>width</mi><mn>2</mn></msup></msub></mrow></mfrac></mrow></msup></mrow></mrow></math></maths><img file="US2022121884A1_D11201.tif" /><img file="US2022121884A1_D11202.tif" /><img file="US2022121884A1_D11203.tif" /><img file="US2022121884A1_D11204.tif" /><img file="US2022121884A1_D11205.tif" /><img file="US2022121884A1_D11206.tif" /><img file="US2022121884A1_D11207.tif" /><img file="US2022121884A1_D11208.tif" /><img file="US2022121884A1_D11209.tif" /><img file="US2022121884A1_D11210.tif" /><img file="US2022121884A1_D11211.tif" /><img file="US2022121884A1_D11212.tif" /><img file="US2022121884A1_D11213.tif" /><img file="US2022121884A1_D11214.tif" /><img file="US2022121884A1_D11215.tif" /><img file="US2022121884A1_D11216.tif" /><img file="US2022121884A1_D11217.tif" /><img file="US2022121884A1_D11218.tif" /><img file="US2022121884A1_D11219.tif" /><img file="US2022121884A1_D11220.tif" /><img file="US2022121884A1_D11221.tif" /><img file="US2022121884A1_D11222.tif" /><img file="US2022121884A1_D11223.tif" /><img file="US2022121884A1_D11224.tif" /><img file="US2022121884A1_D11225.tif" /><img file="US2022121884A1_D11226.tif" /><img file="US2022121884A1_D11227.tif" /><img file="US2022121884A1_D11228.tif" /><img file="US2022121884A1_D11229.tif" /><img file="US2022121884A1_D11230.tif" /><img file="US2022121884A1_D11231.tif" /><img file="US2022121884A1_D11232.tif" /><img file="US2022121884A1_D11233.tif" /><img file="US2022121884A1_D11234.tif" /><img file="US2022121884A1_D11235.tif" /><img file="US2022121884A1_D11236.tif" /><img file="US2022121884A1_D11237.tif" /><img file="US2022121884A1_D11238.tif" /><img file="US2022121884A1_D11239.tif" /><img file="US2022121884A1_D11240.tif" /><img file="US2022121884A1_D11241.tif" /><img file="US2022121884A1_D11242.tif" /><img file="US2022121884A1_D11243.tif" /><img file="US2022121884A1_D11244.tif" /><img file="US2022121884A1_D11245.tif" /><img file="US2022121884A1_D11246.tif" /><img file="US2022121884A1_D11247.tif" /><img file="US2022121884A1_D11248.tif" /><img file="US2022121884A1_D11249.tif" /><img file="US2022121884A1_D11250.tif" /><img file="US2022121884A1_D11251.tif" /><img file="US2022121884A1_D11252.tif" /><img file="US2022121884A1_D11253.tif" /><img file="US2022121884A1_D11254.tif" /><img file="US2022121884A1_D11255.tif" /><img file="US2022121884A1_D11256.tif" /><img file="US2022121884A1_D11257.tif" /><img file="US2022121884A1_D11258.tif" /><img file="US2022121884A1_D11259.tif" /><img file="US2022121884A1_D11260.tif" /><img file="US2022121884A1_D11261.tif" /><img file="US2022121884A1_D11262.tif" /><img file="US2022121884A1_D11263.tif" /><img file="US2022121884A1_D11264.tif" /><img file="US2022121884A1_D11265.tif" /><img file="US2022121884A1_D11266.tif" /><img file="US2022121884A1_D11267.tif" /><img file="US2022121884A1_D11268.tif" /><img file="US2022121884A1_D11269.tif" /><img file="US2022121884A1_D11270.tif" /><img file="US2022121884A1_D11271.tif" /><img file="US2022121884A1_D11272.tif" /><img file="US2022121884A1_D11273.tif" /><img file="US2022121884A1_D11274.tif" /><img file="US2022121884A1_D11275.tif" /><img file="US2022121884A1_D11276.tif" /><img file="US2022121884A1_D11277.tif" /><img file="US2022121884A1_D11278.tif" /><img file="US2022121884A1_D11279.tif" /><img file="US2022121884A1_D11280.tif" /><img file="US2022121884A1_D11281.tif" /><img file="US2022121884A1_D11282.tif" /><img file="US2022121884A1_D11283.tif" /><img file="US2022121884A1_D11284.tif" /><img file="US2022121884A1_D11285.tif" /><img file="US2022121884A1_D11286.tif" /><img file="US2022121884A1_D11287.tif" /><img file="US2022121884A1_D11288.tif" /><img file="US2022121884A1_D11289.tif" /><img file="US2022121884A1_D11290.tif" /><img file="US2022121884A1_D11291.tif" /><img file="US2022121884A1_D11292.tif" /><img file="US2022121884A1_D11293.tif" /><img file="US2022121884A1_D11294.tif" /><img file="US2022121884A1_D11295.tif" /><img file="US2022121884A1_D11296.tif" /><img file="US2022121884A1_D11297.tif" /><img file="US2022121884A1_D11298.tif" /><img file="US2022121884A1_D11299.tif" /><img file="US2022121884A1_D11300.tif" /><img file="US2022121884A1_D11301.tif" /><img file="US2022121884A1_D11302.tif" /><img file="US2022121884A1_D11303.tif" /><img file="US2022121884A1_D11304.tif" /><img file="US2022121884A1_D11305.tif" /><img file="US2022121884A1_D11306.tif" /><img file="US2022121884A1_D11307.tif" /><img file="US2022121884A1_D11308.tif" /><img file="US2022121884A1_D11309.tif" /><img file="US2022121884A1_D11310.tif" /><img file="US2022121884A1_D11311.tif" /><img file="US2022121884A1_D11312.tif" />
where D<sub>width </sub>and D<sub>cent </sub>are the width and centroid location of (e.g., a trapezoid) fuzzy set D, and r is a constant (e.g., 1/√{square root over (12)}≈0.3) or an adjustable parameter.
In one embodiment, the truth value of the antecedent in a fuzzy rule with Z-number, e.g.,
IF (X is Z) THEN (Y is C), where Z=(A<sub>X</sub>, B<sub>X</sub>) and X is a random variable,
is determined by simplifying the ∀i examination in
<maths id="MATH-US-00047" num="00047"><math overflow="scroll"><mrow><msub><mi>T</mi><mi>ant</mi></msub><mo>=</mo><mrow><munder><mi>sup</mi><mrow><mo>∀</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><msub><mi>τ</mi><mi>i</mi></msub></mrow></munder><mo></mo><mrow><mo>(</mo><mrow><mi>t</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><msub><mi>s</mi><mi>i</mi></msub><mo>⋀</mo><mi>t</mi></mrow><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><msubsup><mi>s</mi><mi>i</mi><mi>′</mi></msubsup></mrow><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D11313.tif" /><img file="US2022121884A1_D11314.tif" /><img file="US2022121884A1_D11315.tif" /><img file="US2022121884A1_D11316.tif" /><img file="US2022121884A1_D11317.tif" /><img file="US2022121884A1_D11318.tif" /><img file="US2022121884A1_D11319.tif" /><img file="US2022121884A1_D11320.tif" /><img file="US2022121884A1_D11321.tif" /><img file="US2022121884A1_D11322.tif" /><img file="US2022121884A1_D11323.tif" /><img file="US2022121884A1_D11324.tif" /><img file="US2022121884A1_D11325.tif" /><img file="US2022121884A1_D11326.tif" /><img file="US2022121884A1_D11327.tif" /><img file="US2022121884A1_D11328.tif" /><img file="US2022121884A1_D11329.tif" /><img file="US2022121884A1_D11330.tif" /><img file="US2022121884A1_D11331.tif" /><img file="US2022121884A1_D11332.tif" /><img file="US2022121884A1_D11333.tif" /><img file="US2022121884A1_D11334.tif" /><img file="US2022121884A1_D11335.tif" /><img file="US2022121884A1_D11336.tif" /><img file="US2022121884A1_D11337.tif" /><img file="US2022121884A1_D11338.tif" /><img file="US2022121884A1_D11339.tif" /><img file="US2022121884A1_D11340.tif" /><img file="US2022121884A1_D11341.tif" /><img file="US2022121884A1_D11342.tif" /><img file="US2022121884A1_D11343.tif" /><img file="US2022121884A1_D11344.tif" /><img file="US2022121884A1_D11345.tif" /><img file="US2022121884A1_D11346.tif" /><img file="US2022121884A1_D11347.tif" /><img file="US2022121884A1_D11348.tif" /><img file="US2022121884A1_D11349.tif" /><img file="US2022121884A1_D11350.tif" /><img file="US2022121884A1_D11351.tif" /><img file="US2022121884A1_D11352.tif" /><img file="US2022121884A1_D11353.tif" /><img file="US2022121884A1_D11354.tif" /><img file="US2022121884A1_D11355.tif" /><img file="US2022121884A1_D11356.tif" /><img file="US2022121884A1_D11357.tif" /><img file="US2022121884A1_D11358.tif" /><img file="US2022121884A1_D11359.tif" /><img file="US2022121884A1_D11360.tif" /><img file="US2022121884A1_D11361.tif" /><img file="US2022121884A1_D11362.tif" /><img file="US2022121884A1_D11363.tif" /><img file="US2022121884A1_D11364.tif" /><img file="US2022121884A1_D11365.tif" /><img file="US2022121884A1_D11366.tif" /><img file="US2022121884A1_D11367.tif" /><img file="US2022121884A1_D11368.tif" /><img file="US2022121884A1_D11369.tif" /><img file="US2022121884A1_D11370.tif" /><img file="US2022121884A1_D11371.tif" /><img file="US2022121884A1_D11372.tif" /><img file="US2022121884A1_D11373.tif" /><img file="US2022121884A1_D11374.tif" /><img file="US2022121884A1_D11375.tif" /><img file="US2022121884A1_D11376.tif" /><img file="US2022121884A1_D11377.tif" /><img file="US2022121884A1_D11378.tif" /><img file="US2022121884A1_D11379.tif" /><img file="US2022121884A1_D11380.tif" /><img file="US2022121884A1_D11381.tif" /><img file="US2022121884A1_D11382.tif" /><img file="US2022121884A1_D11383.tif" /><img file="US2022121884A1_D11384.tif" /><img file="US2022121884A1_D11385.tif" /><img file="US2022121884A1_D11386.tif" /><img file="US2022121884A1_D11387.tif" /><img file="US2022121884A1_D11388.tif" /><img file="US2022121884A1_D11389.tif" /><img file="US2022121884A1_D11390.tif" /><img file="US2022121884A1_D11391.tif" /><img file="US2022121884A1_D11392.tif" /><img file="US2022121884A1_D11393.tif" /><img file="US2022121884A1_D11394.tif" /><img file="US2022121884A1_D11395.tif" /><img file="US2022121884A1_D11396.tif" /><img file="US2022121884A1_D11397.tif" /><img file="US2022121884A1_D11398.tif" /><img file="US2022121884A1_D11399.tif" /><img file="US2022121884A1_D11400.tif" /><img file="US2022121884A1_D11401.tif" /><img file="US2022121884A1_D11402.tif" /><img file="US2022121884A1_D11403.tif" /><img file="US2022121884A1_D11404.tif" /><img file="US2022121884A1_D11405.tif" /><img file="US2022121884A1_D11406.tif" /><img file="US2022121884A1_D11407.tif" /><img file="US2022121884A1_D11408.tif" /><img file="US2022121884A1_D11409.tif" /><img file="US2022121884A1_D11410.tif" /><img file="US2022121884A1_D11411.tif" /><img file="US2022121884A1_D11412.tif" /><img file="US2022121884A1_D11413.tif" /><img file="US2022121884A1_D11414.tif" /><img file="US2022121884A1_D11415.tif" /><img file="US2022121884A1_D11416.tif" /><img file="US2022121884A1_D11417.tif" /><img file="US2022121884A1_D11418.tif" /><img file="US2022121884A1_D11419.tif" /><img file="US2022121884A1_D11420.tif" /><img file="US2022121884A1_D11421.tif" /><img file="US2022121884A1_D11422.tif" /><img file="US2022121884A1_D11423.tif" /><img file="US2022121884A1_D11424.tif" />
by taking a candidate for p<sub>X </sub>based on a model of probability distribution which would be compatible with fuzzy set B. Then, the antecedent truth value is determined based on such compatible probability distribution p<sub>o</sub>, as T<sub>ant</sub>=ts<sub>0</sub>{circumflex over ( )}ts′<sub>0 </sub>
In one embodiment, such optimized probability distribution is determined based on the knowledge base (e.g., X is D). For example, when the model distribution is a normal distribution, in one embodiment, the center position (parameter) of the distribution is set at the centroid position of the fuzzy set D, while the variance of the probability distribution is set based on the width of fuzzy set D.
In one embodiment, an input proposition in form of Z-valuation, e.g., (X, A<sub>X</sub>, B<sub>Y</sub>) or (X is Z) where Z=(A<sub>X</sub>, B<sub>Y</sub>) and X is a random variable, is used to evaluate an antecedent of a fuzzy rule, e.g.,
IF (X is C) THEN (Y is D), where C and D are fuzzy sets in X and Y domains, respectively. In one embodiment, candidates of p<sub>X </sub>(denoted by index i) are given test scores based on the knowledge base, and such test scores are used to evaluate the truth value of the antecedent. For example, in one embodiment, the truth value of the antecedent is determined by:
<maths id="MATH-US-00048" num="00048"><math overflow="scroll"><mrow><msub><mi>T</mi><mi>ant</mi></msub><mo>=</mo><mrow><mrow><munder><mi>sup</mi><mrow><mo>∀</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>i</mi></mrow></munder><mo></mo><mrow><mo>(</mo><mrow><mi>t</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><msub><mi>s</mi><mi>i</mi></msub><mo>⋀</mo><mi>t</mi></mrow><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><msubsup><mi>s</mi><mi>i</mi><mi>′</mi></msubsup></mrow><mo>)</mo></mrow></mrow><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>where</mi></mrow></mrow></math></maths><img file="US2022121884A1_D11425.tif" /><img file="US2022121884A1_D11426.tif" /><img file="US2022121884A1_D11427.tif" /><img file="US2022121884A1_D11428.tif" /><img file="US2022121884A1_D11429.tif" /><img file="US2022121884A1_D11430.tif" /><img file="US2022121884A1_D11431.tif" /><img file="US2022121884A1_D11432.tif" /><img file="US2022121884A1_D11433.tif" /><img file="US2022121884A1_D11434.tif" /><img file="US2022121884A1_D11435.tif" /><img file="US2022121884A1_D11436.tif" /><img file="US2022121884A1_D11437.tif" /><img file="US2022121884A1_D11438.tif" /><img file="US2022121884A1_D11439.tif" /><img file="US2022121884A1_D11440.tif" /><img file="US2022121884A1_D11441.tif" /><img file="US2022121884A1_D11442.tif" /><img file="US2022121884A1_D11443.tif" /><img file="US2022121884A1_D11444.tif" /><img file="US2022121884A1_D11445.tif" /><img file="US2022121884A1_D11446.tif" /><img file="US2022121884A1_D11447.tif" /><img file="US2022121884A1_D11448.tif" /><img file="US2022121884A1_D11449.tif" /><img file="US2022121884A1_D11450.tif" /><img file="US2022121884A1_D11451.tif" /><img file="US2022121884A1_D11452.tif" /><img file="US2022121884A1_D11453.tif" /><img file="US2022121884A1_D11454.tif" /><img file="US2022121884A1_D11455.tif" /><img file="US2022121884A1_D11456.tif" /><img file="US2022121884A1_D11457.tif" /><img file="US2022121884A1_D11458.tif" /><img file="US2022121884A1_D11459.tif" /><img file="US2022121884A1_D11460.tif" /><img file="US2022121884A1_D11461.tif" /><img file="US2022121884A1_D11462.tif" /><img file="US2022121884A1_D11463.tif" /><img file="US2022121884A1_D11464.tif" /><img file="US2022121884A1_D11465.tif" /><img file="US2022121884A1_D11466.tif" /><img file="US2022121884A1_D11467.tif" /><img file="US2022121884A1_D11468.tif" /><img file="US2022121884A1_D11469.tif" /><img file="US2022121884A1_D11470.tif" /><img file="US2022121884A1_D11471.tif" /><img file="US2022121884A1_D11472.tif" /><img file="US2022121884A1_D11473.tif" /><img file="US2022121884A1_D11474.tif" /><img file="US2022121884A1_D11475.tif" /><img file="US2022121884A1_D11476.tif" /><img file="US2022121884A1_D11477.tif" /><img file="US2022121884A1_D11478.tif" /><img file="US2022121884A1_D11479.tif" /><img file="US2022121884A1_D11480.tif" /><img file="US2022121884A1_D11481.tif" /><img file="US2022121884A1_D11482.tif" /><img file="US2022121884A1_D11483.tif" /><img file="US2022121884A1_D11484.tif" /><img file="US2022121884A1_D11485.tif" /><img file="US2022121884A1_D11486.tif" /><img file="US2022121884A1_D11487.tif" /><img file="US2022121884A1_D11488.tif" /><img file="US2022121884A1_D11489.tif" /><img file="US2022121884A1_D11490.tif" /><img file="US2022121884A1_D11491.tif" /><img file="US2022121884A1_D11492.tif" /><img file="US2022121884A1_D11493.tif" /><img file="US2022121884A1_D11494.tif" /><img file="US2022121884A1_D11495.tif" /><img file="US2022121884A1_D11496.tif" /><img file="US2022121884A1_D11497.tif" /><img file="US2022121884A1_D11498.tif" /><img file="US2022121884A1_D11499.tif" /><img file="US2022121884A1_D11500.tif" /><img file="US2022121884A1_D11501.tif" /><img file="US2022121884A1_D11502.tif" /><img file="US2022121884A1_D11503.tif" /><img file="US2022121884A1_D11504.tif" /><img file="US2022121884A1_D11505.tif" /><img file="US2022121884A1_D11506.tif" /><img file="US2022121884A1_D11507.tif" /><img file="US2022121884A1_D11508.tif" /><img file="US2022121884A1_D11509.tif" /><img file="US2022121884A1_D11510.tif" /><img file="US2022121884A1_D11511.tif" /><img file="US2022121884A1_D11512.tif" /><img file="US2022121884A1_D11513.tif" /><img file="US2022121884A1_D11514.tif" /><img file="US2022121884A1_D11515.tif" /><img file="US2022121884A1_D11516.tif" /><img file="US2022121884A1_D11517.tif" /><img file="US2022121884A1_D11518.tif" /><img file="US2022121884A1_D11519.tif" /><img file="US2022121884A1_D11520.tif" /><img file="US2022121884A1_D11521.tif" /><img file="US2022121884A1_D11522.tif" /><img file="US2022121884A1_D11523.tif" /><img file="US2022121884A1_D11524.tif" /><img file="US2022121884A1_D11525.tif" /><img file="US2022121884A1_D11526.tif" /><img file="US2022121884A1_D11527.tif" /><img file="US2022121884A1_D11528.tif" /><img file="US2022121884A1_D11529.tif" /><img file="US2022121884A1_D11530.tif" /><img file="US2022121884A1_D11531.tif" /><img file="US2022121884A1_D11532.tif" /><img file="US2022121884A1_D11533.tif" /><img file="US2022121884A1_D11534.tif" /><img file="US2022121884A1_D11535.tif" /><img file="US2022121884A1_D11536.tif" /><maths id="MATH-US-00048-2" num="00048.2"><math overflow="scroll"><mrow><mrow><mi>t</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><msub><mi>s</mi><mi>i</mi></msub></mrow><mo>=</mo><mrow><munder><mo>∫</mo><mi>R</mi></munder><mo></mo><mrow><mrow><msub><mi>μ</mi><mi>C</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>p</mi><mi>i</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>d</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>u</mi></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D11537.tif" /><img file="US2022121884A1_D11538.tif" /><img file="US2022121884A1_D11539.tif" /><img file="US2022121884A1_D11540.tif" /><img file="US2022121884A1_D11541.tif" /><img file="US2022121884A1_D11542.tif" /><img file="US2022121884A1_D11543.tif" /><img file="US2022121884A1_D11544.tif" /><img file="US2022121884A1_D11545.tif" /><img file="US2022121884A1_D11546.tif" /><img file="US2022121884A1_D11547.tif" /><img file="US2022121884A1_D11548.tif" /><img file="US2022121884A1_D11549.tif" /><img file="US2022121884A1_D11550.tif" /><img file="US2022121884A1_D11551.tif" /><img file="US2022121884A1_D11552.tif" /><img file="US2022121884A1_D11553.tif" /><img file="US2022121884A1_D11554.tif" /><img file="US2022121884A1_D11555.tif" /><img file="US2022121884A1_D11556.tif" /><img file="US2022121884A1_D11557.tif" /><img file="US2022121884A1_D11558.tif" /><img file="US2022121884A1_D11559.tif" /><img file="US2022121884A1_D11560.tif" /><img file="US2022121884A1_D11561.tif" /><img file="US2022121884A1_D11562.tif" /><img file="US2022121884A1_D11563.tif" /><img file="US2022121884A1_D11564.tif" /><img file="US2022121884A1_D11565.tif" /><img file="US2022121884A1_D11566.tif" /><img file="US2022121884A1_D11567.tif" /><img file="US2022121884A1_D11568.tif" /><img file="US2022121884A1_D11569.tif" /><img file="US2022121884A1_D11570.tif" /><img file="US2022121884A1_D11571.tif" /><img file="US2022121884A1_D11572.tif" /><img file="US2022121884A1_D11573.tif" /><img file="US2022121884A1_D11574.tif" /><img file="US2022121884A1_D11575.tif" /><img file="US2022121884A1_D11576.tif" /><img file="US2022121884A1_D11577.tif" /><img file="US2022121884A1_D11578.tif" /><img file="US2022121884A1_D11579.tif" /><img file="US2022121884A1_D11580.tif" /><img file="US2022121884A1_D11581.tif" /><img file="US2022121884A1_D11582.tif" /><img file="US2022121884A1_D11583.tif" /><img file="US2022121884A1_D11584.tif" /><img file="US2022121884A1_D11585.tif" /><img file="US2022121884A1_D11586.tif" /><img file="US2022121884A1_D11587.tif" /><img file="US2022121884A1_D11588.tif" /><img file="US2022121884A1_D11589.tif" /><img file="US2022121884A1_D11590.tif" /><img file="US2022121884A1_D11591.tif" /><img file="US2022121884A1_D11592.tif" /><img file="US2022121884A1_D11593.tif" /><img file="US2022121884A1_D11594.tif" /><img file="US2022121884A1_D11595.tif" /><img file="US2022121884A1_D11596.tif" /><img file="US2022121884A1_D11597.tif" /><img file="US2022121884A1_D11598.tif" /><img file="US2022121884A1_D11599.tif" /><img file="US2022121884A1_D11600.tif" /><img file="US2022121884A1_D11601.tif" /><img file="US2022121884A1_D11602.tif" /><img file="US2022121884A1_D11603.tif" /><img file="US2022121884A1_D11604.tif" /><img file="US2022121884A1_D11605.tif" /><img file="US2022121884A1_D11606.tif" /><img file="US2022121884A1_D11607.tif" /><img file="US2022121884A1_D11608.tif" /><img file="US2022121884A1_D11609.tif" /><img file="US2022121884A1_D11610.tif" /><img file="US2022121884A1_D11611.tif" /><img file="US2022121884A1_D11612.tif" /><img file="US2022121884A1_D11613.tif" /><img file="US2022121884A1_D11614.tif" /><img file="US2022121884A1_D11615.tif" /><img file="US2022121884A1_D11616.tif" /><img file="US2022121884A1_D11617.tif" /><img file="US2022121884A1_D11618.tif" /><img file="US2022121884A1_D11619.tif" /><img file="US2022121884A1_D11620.tif" /><img file="US2022121884A1_D11621.tif" /><img file="US2022121884A1_D11622.tif" /><img file="US2022121884A1_D11623.tif" /><img file="US2022121884A1_D11624.tif" /><img file="US2022121884A1_D11625.tif" /><img file="US2022121884A1_D11626.tif" /><img file="US2022121884A1_D11627.tif" /><img file="US2022121884A1_D11628.tif" /><img file="US2022121884A1_D11629.tif" /><img file="US2022121884A1_D11630.tif" /><img file="US2022121884A1_D11631.tif" /><img file="US2022121884A1_D11632.tif" /><img file="US2022121884A1_D11633.tif" /><img file="US2022121884A1_D11634.tif" /><img file="US2022121884A1_D11635.tif" /><img file="US2022121884A1_D11636.tif" /><img file="US2022121884A1_D11637.tif" /><img file="US2022121884A1_D11638.tif" /><img file="US2022121884A1_D11639.tif" /><img file="US2022121884A1_D11640.tif" /><img file="US2022121884A1_D11641.tif" /><img file="US2022121884A1_D11642.tif" /><img file="US2022121884A1_D11643.tif" /><img file="US2022121884A1_D11644.tif" /><img file="US2022121884A1_D11645.tif" /><img file="US2022121884A1_D11646.tif" /><img file="US2022121884A1_D11647.tif" /><img file="US2022121884A1_D11648.tif" /><maths id="MATH-US-00048-3" num="00048.3"><math overflow="scroll"><mrow><mrow><mi>t</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><msubsup><mi>s</mi><mi>i</mi><mi>′</mi></msubsup></mrow><mo>=</mo><mrow><msub><mi>μ</mi><msub><mi>B</mi><mi>X</mi></msub></msub><mo>(</mo><mrow><munder><mo>∫</mo><mi>R</mi></munder><mo></mo><mrow><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>X</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>p</mi><mi>i</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>d</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>u</mi></mrow></mrow><mo>)</mo></mrow></mrow></math></maths><img file="US2022121884A1_D11649.tif" /><img file="US2022121884A1_D11650.tif" /><img file="US2022121884A1_D11651.tif" /><img file="US2022121884A1_D11652.tif" /><img file="US2022121884A1_D11653.tif" /><img file="US2022121884A1_D11654.tif" /><img file="US2022121884A1_D11655.tif" /><img file="US2022121884A1_D11656.tif" /><img file="US2022121884A1_D11657.tif" /><img file="US2022121884A1_D11658.tif" /><img file="US2022121884A1_D11659.tif" /><img file="US2022121884A1_D11660.tif" /><img file="US2022121884A1_D11661.tif" /><img file="US2022121884A1_D11662.tif" /><img file="US2022121884A1_D11663.tif" /><img file="US2022121884A1_D11664.tif" /><img file="US2022121884A1_D11665.tif" /><img file="US2022121884A1_D11666.tif" /><img file="US2022121884A1_D11667.tif" /><img file="US2022121884A1_D11668.tif" /><img file="US2022121884A1_D11669.tif" /><img file="US2022121884A1_D11670.tif" /><img file="US2022121884A1_D11671.tif" /><img file="US2022121884A1_D11672.tif" /><img file="US2022121884A1_D11673.tif" /><img file="US2022121884A1_D11674.tif" /><img file="US2022121884A1_D11675.tif" /><img file="US2022121884A1_D11676.tif" /><img file="US2022121884A1_D11677.tif" /><img file="US2022121884A1_D11678.tif" /><img file="US2022121884A1_D11679.tif" /><img file="US2022121884A1_D11680.tif" /><img file="US2022121884A1_D11681.tif" /><img file="US2022121884A1_D11682.tif" /><img file="US2022121884A1_D11683.tif" /><img file="US2022121884A1_D11684.tif" /><img file="US2022121884A1_D11685.tif" /><img file="US2022121884A1_D11686.tif" /><img file="US2022121884A1_D11687.tif" /><img file="US2022121884A1_D11688.tif" /><img file="US2022121884A1_D11689.tif" /><img file="US2022121884A1_D11690.tif" /><img file="US2022121884A1_D11691.tif" /><img file="US2022121884A1_D11692.tif" /><img file="US2022121884A1_D11693.tif" /><img file="US2022121884A1_D11694.tif" /><img file="US2022121884A1_D11695.tif" /><img file="US2022121884A1_D11696.tif" /><img file="US2022121884A1_D11697.tif" /><img file="US2022121884A1_D11698.tif" /><img file="US2022121884A1_D11699.tif" /><img file="US2022121884A1_D11700.tif" /><img file="US2022121884A1_D11701.tif" /><img file="US2022121884A1_D11702.tif" /><img file="US2022121884A1_D11703.tif" /><img file="US2022121884A1_D11704.tif" /><img file="US2022121884A1_D11705.tif" /><img file="US2022121884A1_D11706.tif" /><img file="US2022121884A1_D11707.tif" /><img file="US2022121884A1_D11708.tif" /><img file="US2022121884A1_D11709.tif" /><img file="US2022121884A1_D11710.tif" /><img file="US2022121884A1_D11711.tif" /><img file="US2022121884A1_D11712.tif" /><img file="US2022121884A1_D11713.tif" /><img file="US2022121884A1_D11714.tif" /><img file="US2022121884A1_D11715.tif" /><img file="US2022121884A1_D11716.tif" /><img file="US2022121884A1_D11717.tif" /><img file="US2022121884A1_D11718.tif" /><img file="US2022121884A1_D11719.tif" /><img file="US2022121884A1_D11720.tif" /><img file="US2022121884A1_D11721.tif" /><img file="US2022121884A1_D11722.tif" /><img file="US2022121884A1_D11723.tif" /><img file="US2022121884A1_D11724.tif" /><img file="US2022121884A1_D11725.tif" /><img file="US2022121884A1_D11726.tif" /><img file="US2022121884A1_D11727.tif" /><img file="US2022121884A1_D11728.tif" /><img file="US2022121884A1_D11729.tif" /><img file="US2022121884A1_D11730.tif" /><img file="US2022121884A1_D11731.tif" /><img file="US2022121884A1_D11732.tif" /><img file="US2022121884A1_D11733.tif" /><img file="US2022121884A1_D11734.tif" /><img file="US2022121884A1_D11735.tif" /><img file="US2022121884A1_D11736.tif" /><img file="US2022121884A1_D11737.tif" /><img file="US2022121884A1_D11738.tif" /><img file="US2022121884A1_D11739.tif" /><img file="US2022121884A1_D11740.tif" /><img file="US2022121884A1_D11741.tif" /><img file="US2022121884A1_D11742.tif" /><img file="US2022121884A1_D11743.tif" /><img file="US2022121884A1_D11744.tif" /><img file="US2022121884A1_D11745.tif" /><img file="US2022121884A1_D11746.tif" /><img file="US2022121884A1_D11747.tif" /><img file="US2022121884A1_D11748.tif" /><img file="US2022121884A1_D11749.tif" /><img file="US2022121884A1_D11750.tif" /><img file="US2022121884A1_D11751.tif" /><img file="US2022121884A1_D11752.tif" /><img file="US2022121884A1_D11753.tif" /><img file="US2022121884A1_D11754.tif" /><img file="US2022121884A1_D11755.tif" /><img file="US2022121884A1_D11756.tif" /><img file="US2022121884A1_D11757.tif" /><img file="US2022121884A1_D11758.tif" /><img file="US2022121884A1_D11759.tif" /><img file="US2022121884A1_D11760.tif" />
Example 2
In one embodiment, a fuzzy rules database includes these two rules involving Z-valuation (e.g., for a rule-based analysis/engine). Rule 1: If the price of oil is significantly over 100 dollars/barrel, the stock of an oil company would most likely increase by more than about 10 percent. Rule 2: If the sales volume is high, the stock of an oil company would probably increase a lot. There is also this input information: The price of oil is at 120 dollars/barrel; the sales volume is at $20B; and the executive incentive bonus is a function of the company's stock price. The query or output sought is:
q4: What is the Likelihood of High Executive Incentive Bonuses?
In one embodiment, the rules engine/module evaluates the truth value of the rules' antecedents, e.g., after the precisiation of meaning for various fuzzy terms. For example, the truth value of Rule 1's antecedent, the price of oil is significantly over 100 dollars/barrel is evaluated by taking the membership function evaluation of 120 (per information input) in fuzzy set significantly over 100 dollars/barrel (see, e.g., <figref idref="DRAWINGS">FIG. 12(<i>a</i>)</figref>). Therefore, this antecedent truth value (t<sub>1</sub>) becomes, in this example, 0.67. Similarly, the truth value of Rule 2's antecedent, the sales volume is high, is evaluated by using (e.g., contextual) membership function μ<sub>High </sub>for value $20B. Let's assume the antecedent truth value (t<sub>2</sub>) is determined to be 0.8, in this example. In firing the Rules, the truth values of antecedents are imposed on those of consequents. Rule 1's consequent, is a Z-valuation (X, A<sub>1</sub>, B<sub>1</sub>) where X represents the change in stock, A<sub>1 </sub>represents more than about +10 percent, and B1 represents most likely. Rule 2's consequent, is a Z-valuation (X, A<sub>2</sub>, B<sub>2</sub>) where A<sub>2 </sub>represents a lot, and B1 represents probably. The consequent terms impose restriction on p<sub>X</sub>, therefore, the truth values of the consequent (i.e., restriction on p<sub>X</sub>) is determined by triggering of the Rules. In one embodiment, the restrictions are combined, e.g., via correlation minimum and Min/Max inference or correlation product and additive inference. In one embodiment, a model of p<sub>X</sub>, e.g., N(m<sub>x</sub>, σ<sub>x</sub>), is used to apply the restriction on p<sub>X </sub>to restrictions on parameters of the distributions (e.g., (m<sub>x</sub>, σ<sub>x</sub>)). In one embodiment, the range of X domain is taken from the knowledge base. In one embodiment X domain range(s) is determined from characteristics of A<sub>1 </sub>and/or A<sub>2</sub>. In one embodiment, a consolidated range(s′ is determined in X domain. One or more sets of X values are used to evaluate p<sub>X</sub>(m<sub>x</sub>, σ<sub>x</sub>), μ<sub>A1</sub>, and μ<sub>A2</sub>. In one embodiment, probability measures υ<sub>1 </sub>and υ<sub>2 </sub>for A<sub>1 </sub>and A<sub>2</sub>, respectively, are determined for candidate p<sub>X </sub>'s, e.g., for various (m<sub>x</sub>, σ<sub>x</sub>). The possibility measures of υ<sub>1 </sub>and υ<sub>2 </sub>in B<sub>1 </sub>and B<sub>2 </sub>are determined by evaluating μ<sub>B1</sub>(υ<sub>1</sub>) and μ<sub>B2</sub>(υ<sub>2</sub>), e.g., for various (m<sub>x</sub>, σ<sub>x</sub>). These possibility measures are test scores imposed on the probability distribution candidate for X (e.g., identified by (m<sub>x</sub>, σ<sub>x</sub>) via the consequents of the triggered rules. Therefore, in one embodiment, the fuzzy rule control system uses the restrictions on candidate distributions. For example, in a control system employing correlation minimum and Min/Max inference, the restriction on p<sub>X</sub>(m<sub>x</sub>, σ<sub>x</sub>) is determined as follows, e.g., for various (m<sub>x</sub>, σ<sub>x</sub>):
<maths id="MATH-US-00049" num="00049"><math overflow="scroll"><mrow><mrow><msub><mi>μ</mi><msub><mi>p</mi><mi>x</mi></msub></msub><mo></mo><mrow><mo>(</mo><mrow><msub><mi>m</mi><mi>x</mi></msub><mo>,</mo><msub><mi>σ</mi><mi>x</mi></msub></mrow><mo>)</mo></mrow></mrow><mo>=</mo><mrow><munder><mi>max</mi><mrow><mo>∀</mo><mi>j</mi></mrow></munder><mo></mo><mrow><mo>(</mo><mrow><mi>min</mi><mo></mo><mrow><mo>(</mo><mrow><mrow><msub><mi>μ</mi><msub><mi>B</mi><mi>j</mi></msub></msub><mo></mo><mrow><mo>(</mo><mrow><msub><mi>v</mi><mi>j</mi></msub><mo></mo><mrow><mo>(</mo><mrow><msub><mi>m</mi><mi>x</mi></msub><mo>,</mo><msub><mi>σ</mi><mi>x</mi></msub></mrow><mo>)</mo></mrow></mrow><mo>)</mo></mrow></mrow><mo>,</mo><msub><mi>t</mi><mi>j</mi></msub></mrow><mo>)</mo></mrow></mrow><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D11761.tif" /><img file="US2022121884A1_D11762.tif" /><img file="US2022121884A1_D11763.tif" /><img file="US2022121884A1_D11764.tif" /><img file="US2022121884A1_D11765.tif" /><img file="US2022121884A1_D11766.tif" /><img file="US2022121884A1_D11767.tif" /><img file="US2022121884A1_D11768.tif" /><img file="US2022121884A1_D11769.tif" /><img file="US2022121884A1_D11770.tif" /><img file="US2022121884A1_D11771.tif" /><img file="US2022121884A1_D11772.tif" /><img file="US2022121884A1_D11773.tif" /><img file="US2022121884A1_D11774.tif" /><img file="US2022121884A1_D11775.tif" /><img file="US2022121884A1_D11776.tif" /><img file="US2022121884A1_D11777.tif" /><img file="US2022121884A1_D11778.tif" /><img file="US2022121884A1_D11779.tif" /><img file="US2022121884A1_D11780.tif" /><img file="US2022121884A1_D11781.tif" /><img file="US2022121884A1_D11782.tif" /><img file="US2022121884A1_D11783.tif" /><img file="US2022121884A1_D11784.tif" /><img file="US2022121884A1_D11785.tif" /><img file="US2022121884A1_D11786.tif" /><img file="US2022121884A1_D11787.tif" /><img file="US2022121884A1_D11788.tif" /><img file="US2022121884A1_D11789.tif" /><img file="US2022121884A1_D11790.tif" /><img file="US2022121884A1_D11791.tif" /><img file="US2022121884A1_D11792.tif" /><img file="US2022121884A1_D11793.tif" /><img file="US2022121884A1_D11794.tif" /><img file="US2022121884A1_D11795.tif" /><img file="US2022121884A1_D11796.tif" /><img file="US2022121884A1_D11797.tif" /><img file="US2022121884A1_D11798.tif" /><img file="US2022121884A1_D11799.tif" /><img file="US2022121884A1_D11800.tif" /><img file="US2022121884A1_D11801.tif" /><img file="US2022121884A1_D11802.tif" /><img file="US2022121884A1_D11803.tif" /><img file="US2022121884A1_D11804.tif" /><img file="US2022121884A1_D11805.tif" /><img file="US2022121884A1_D11806.tif" /><img file="US2022121884A1_D11807.tif" /><img file="US2022121884A1_D11808.tif" /><img file="US2022121884A1_D11809.tif" /><img file="US2022121884A1_D11810.tif" /><img file="US2022121884A1_D11811.tif" /><img file="US2022121884A1_D11812.tif" /><img file="US2022121884A1_D11813.tif" /><img file="US2022121884A1_D11814.tif" /><img file="US2022121884A1_D11815.tif" /><img file="US2022121884A1_D11816.tif" /><img file="US2022121884A1_D11817.tif" /><img file="US2022121884A1_D11818.tif" /><img file="US2022121884A1_D11819.tif" /><img file="US2022121884A1_D11820.tif" /><img file="US2022121884A1_D11821.tif" /><img file="US2022121884A1_D11822.tif" /><img file="US2022121884A1_D11823.tif" /><img file="US2022121884A1_D11824.tif" /><img file="US2022121884A1_D11825.tif" /><img file="US2022121884A1_D11826.tif" /><img file="US2022121884A1_D11827.tif" /><img file="US2022121884A1_D11828.tif" /><img file="US2022121884A1_D11829.tif" /><img file="US2022121884A1_D11830.tif" /><img file="US2022121884A1_D11831.tif" /><img file="US2022121884A1_D11832.tif" /><img file="US2022121884A1_D11833.tif" /><img file="US2022121884A1_D11834.tif" /><img file="US2022121884A1_D11835.tif" /><img file="US2022121884A1_D11836.tif" /><img file="US2022121884A1_D11837.tif" /><img file="US2022121884A1_D11838.tif" /><img file="US2022121884A1_D11839.tif" /><img file="US2022121884A1_D11840.tif" /><img file="US2022121884A1_D11841.tif" /><img file="US2022121884A1_D11842.tif" /><img file="US2022121884A1_D11843.tif" /><img file="US2022121884A1_D11844.tif" /><img file="US2022121884A1_D11845.tif" /><img file="US2022121884A1_D11846.tif" /><img file="US2022121884A1_D11847.tif" /><img file="US2022121884A1_D11848.tif" /><img file="US2022121884A1_D11849.tif" /><img file="US2022121884A1_D11850.tif" /><img file="US2022121884A1_D11851.tif" /><img file="US2022121884A1_D11852.tif" /><img file="US2022121884A1_D11853.tif" /><img file="US2022121884A1_D11854.tif" /><img file="US2022121884A1_D11855.tif" /><img file="US2022121884A1_D11856.tif" /><img file="US2022121884A1_D11857.tif" /><img file="US2022121884A1_D11858.tif" /><img file="US2022121884A1_D11859.tif" /><img file="US2022121884A1_D11860.tif" /><img file="US2022121884A1_D11861.tif" /><img file="US2022121884A1_D11862.tif" /><img file="US2022121884A1_D11863.tif" /><img file="US2022121884A1_D11864.tif" /><img file="US2022121884A1_D11865.tif" /><img file="US2022121884A1_D11866.tif" /><img file="US2022121884A1_D11867.tif" /><img file="US2022121884A1_D11868.tif" /><img file="US2022121884A1_D11869.tif" /><img file="US2022121884A1_D11870.tif" /><img file="US2022121884A1_D11871.tif" /><img file="US2022121884A1_D11872.tif" />
where j is an index for triggered fuzzy rule (in this example, from 1 to 2).
As an example, in a control system employing correlation product and additive inference, the restriction on p<sub>X</sub>(m<sub>x</sub>, σ<sub>x</sub>) is determined as follows, e.g., for various (m<sub>x</sub>, σ<sub>x</sub>):
<maths id="MATH-US-00050" num="00050"><math overflow="scroll"><mrow><mrow><msub><mi>μ</mi><msub><mi>p</mi><mi>x</mi></msub></msub><mo></mo><mrow><mo>(</mo><mrow><msub><mi>m</mi><mi>x</mi></msub><mo>,</mo><msub><mi>σ</mi><mi>x</mi></msub></mrow><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mi>min</mi><mo></mo><mstyle><mspace width="0.6em" height="0.6ex" /></mstyle><mo></mo><mrow><mo>(</mo><mrow><mrow><munder><mo>∑</mo><mrow><mo>∀</mo><mi>j</mi></mrow></munder><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><mrow><msub><mi>μ</mi><msub><mi>B</mi><mi>j</mi></msub></msub><mo></mo><mrow><mo>(</mo><mrow><msub><mi>v</mi><mi>j</mi></msub><mo></mo><mrow><mo>(</mo><mrow><msub><mi>m</mi><mi>x</mi></msub><mo>,</mo><msub><mi>σ</mi><mi>x</mi></msub></mrow><mo>)</mo></mrow></mrow><mo>)</mo></mrow></mrow><mo>·</mo><msub><mi>t</mi><mi>j</mi></msub></mrow></mrow><mo>,</mo><mn>1</mn></mrow><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D11873.tif" /><img file="US2022121884A1_D11874.tif" /><img file="US2022121884A1_D11875.tif" /><img file="US2022121884A1_D11876.tif" /><img file="US2022121884A1_D11877.tif" /><img file="US2022121884A1_D11878.tif" /><img file="US2022121884A1_D11879.tif" /><img file="US2022121884A1_D11880.tif" /><img file="US2022121884A1_D11881.tif" /><img file="US2022121884A1_D11882.tif" /><img file="US2022121884A1_D11883.tif" /><img file="US2022121884A1_D11884.tif" /><img file="US2022121884A1_D11885.tif" /><img file="US2022121884A1_D11886.tif" /><img file="US2022121884A1_D11887.tif" /><img file="US2022121884A1_D11888.tif" /><img file="US2022121884A1_D11889.tif" /><img file="US2022121884A1_D11890.tif" /><img file="US2022121884A1_D11891.tif" /><img file="US2022121884A1_D11892.tif" /><img file="US2022121884A1_D11893.tif" /><img file="US2022121884A1_D11894.tif" /><img file="US2022121884A1_D11895.tif" /><img file="US2022121884A1_D11896.tif" /><img file="US2022121884A1_D11897.tif" /><img file="US2022121884A1_D11898.tif" /><img file="US2022121884A1_D11899.tif" /><img file="US2022121884A1_D11900.tif" /><img file="US2022121884A1_D11901.tif" /><img file="US2022121884A1_D11902.tif" /><img file="US2022121884A1_D11903.tif" /><img file="US2022121884A1_D11904.tif" /><img file="US2022121884A1_D11905.tif" /><img file="US2022121884A1_D11906.tif" /><img file="US2022121884A1_D11907.tif" /><img file="US2022121884A1_D11908.tif" /><img file="US2022121884A1_D11909.tif" /><img file="US2022121884A1_D11910.tif" /><img file="US2022121884A1_D11911.tif" /><img file="US2022121884A1_D11912.tif" /><img file="US2022121884A1_D11913.tif" /><img file="US2022121884A1_D11914.tif" /><img file="US2022121884A1_D11915.tif" /><img file="US2022121884A1_D11916.tif" /><img file="US2022121884A1_D11917.tif" /><img file="US2022121884A1_D11918.tif" /><img file="US2022121884A1_D11919.tif" /><img file="US2022121884A1_D11920.tif" /><img file="US2022121884A1_D11921.tif" /><img file="US2022121884A1_D11922.tif" /><img file="US2022121884A1_D11923.tif" /><img file="US2022121884A1_D11924.tif" /><img file="US2022121884A1_D11925.tif" /><img file="US2022121884A1_D11926.tif" /><img file="US2022121884A1_D11927.tif" /><img file="US2022121884A1_D11928.tif" /><img file="US2022121884A1_D11929.tif" /><img file="US2022121884A1_D11930.tif" /><img file="US2022121884A1_D11931.tif" /><img file="US2022121884A1_D11932.tif" /><img file="US2022121884A1_D11933.tif" /><img file="US2022121884A1_D11934.tif" /><img file="US2022121884A1_D11935.tif" /><img file="US2022121884A1_D11936.tif" /><img file="US2022121884A1_D11937.tif" /><img file="US2022121884A1_D11938.tif" /><img file="US2022121884A1_D11939.tif" /><img file="US2022121884A1_D11940.tif" /><img file="US2022121884A1_D11941.tif" /><img file="US2022121884A1_D11942.tif" /><img file="US2022121884A1_D11943.tif" /><img file="US2022121884A1_D11944.tif" /><img file="US2022121884A1_D11945.tif" /><img file="US2022121884A1_D11946.tif" /><img file="US2022121884A1_D11947.tif" /><img file="US2022121884A1_D11948.tif" /><img file="US2022121884A1_D11949.tif" /><img file="US2022121884A1_D11950.tif" /><img file="US2022121884A1_D11951.tif" /><img file="US2022121884A1_D11952.tif" /><img file="US2022121884A1_D11953.tif" /><img file="US2022121884A1_D11954.tif" /><img file="US2022121884A1_D11955.tif" /><img file="US2022121884A1_D11956.tif" /><img file="US2022121884A1_D11957.tif" /><img file="US2022121884A1_D11958.tif" /><img file="US2022121884A1_D11959.tif" /><img file="US2022121884A1_D11960.tif" /><img file="US2022121884A1_D11961.tif" /><img file="US2022121884A1_D11962.tif" /><img file="US2022121884A1_D11963.tif" /><img file="US2022121884A1_D11964.tif" /><img file="US2022121884A1_D11965.tif" /><img file="US2022121884A1_D11966.tif" /><img file="US2022121884A1_D11967.tif" /><img file="US2022121884A1_D11968.tif" /><img file="US2022121884A1_D11969.tif" /><img file="US2022121884A1_D11970.tif" /><img file="US2022121884A1_D11971.tif" /><img file="US2022121884A1_D11972.tif" /><img file="US2022121884A1_D11973.tif" /><img file="US2022121884A1_D11974.tif" /><img file="US2022121884A1_D11975.tif" /><img file="US2022121884A1_D11976.tif" /><img file="US2022121884A1_D11977.tif" /><img file="US2022121884A1_D11978.tif" /><img file="US2022121884A1_D11979.tif" /><img file="US2022121884A1_D11980.tif" /><img file="US2022121884A1_D11981.tif" /><img file="US2022121884A1_D11982.tif" /><img file="US2022121884A1_D11983.tif" /><img file="US2022121884A1_D11984.tif" />
In one embodiment, μ<sub>p</sub><sub><sub2>x </sub2></sub>(m<sub>x</sub>, σ<sub>x</sub>) is the basis for determining answer to q<sub>4</sub>. For example, a<sub>4 </sub>is reduced to Z-valuation (Y, A<sub>y</sub>, B<sub>y</sub>), where Y represents executive incentive bonuses, A<sub>y </sub>represents high, B<sub>y </sub>represents restriction on .Prob(Y is A<sub>y</sub>). The knowledge database, in one embodiment, provides the functional dependence (G) of executive incentive bonuses (Y) on the stock price (SP), and therefore on X, i.e., the change in stock, via the current stock price (CSP). For example:
<br /><i>Y=G</i>(<i>SP</i>)=<i>G</i>(<i>CSP+X</i>)=<i>F</i>(<i>X</i>)
In one embodiment, as in the previous examples, ω, probability measure of A<sub>y </sub>is determined. for various p<sub>X </sub>(i.e., (m<sub>x</sub>, σ<sub>x</sub>)) candidates. In one embodiment, maximum μ<sub>px</sub>(m<sub>x</sub>, σ<sub>x</sub>) for ω (or ω bin) is determined, and applied as membership function of μ<sub>B</sub><sub><sub2>y</sub2></sub>(ω). In another word, in this example, the output of rules engine provides the restriction on p<sub>X </sub>(or its parameters) similar to previous examples, and this output is used to determine restriction on a probability measure in Y.
Example 3
In one embodiment, e.g., in a car engine diagnosis, the following natural language rule “Usually, when engine makes rattling slapping sound, and it gets significantly louder or faster when revving the engine, the timing chain is loose,” is converted to a protoform, such as:
<maths id="MATH-US-00051" num="00051"><math overflow="scroll"><mrow><mtable><mtr><mtd><mrow><mi>IF</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mrow><mo>(</mo><mtable><mtr><mtd><mrow><mi>type</mi><mo></mo><mstyle><mspace width="0.6em" height="0.6ex" /></mstyle><mo></mo><mrow><mo>(</mo><mrow><mi>sound</mi><mo></mo><mstyle><mspace width="0.6em" height="0.6ex" /></mstyle><mo></mo><mrow><mo>(</mo><mi>engine</mi><mo>)</mo></mrow></mrow><mo>)</mo></mrow><mo></mo><mstyle><mspace width="0.6em" height="0.6ex" /></mstyle><mo></mo><mi>is</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>RattlingSlapping</mi></mrow></mtd></mtr><mtr><mtd><mi>AND</mi></mtd></mtr><mtr><mtd><mrow><mo>(</mo><mtable><mtr><mtd><mrow><mo>(</mo><mrow><mrow><mi>level</mi><mo></mo><mstyle><mspace width="0.6em" height="0.6ex" /></mstyle><mo></mo><mrow><mo>(</mo><mrow><mi>sound</mi><mo></mo><mstyle><mspace width="0.6em" height="0.6ex" /></mstyle><mo></mo><mrow><mo>(</mo><mrow><mi>revved</mi><mo>.</mo><mi>engine</mi></mrow><mo>)</mo></mrow></mrow><mo>)</mo></mrow></mrow><mo>,</mo><mrow><mi>level</mi><mo></mo><mstyle><mspace width="0.6em" height="0.6ex" /></mstyle><mo></mo><mrow><mo>(</mo><mrow><mi>sound</mi><mo></mo><mstyle><mspace width="0.6em" height="0.6ex" /></mstyle><mo></mo><mrow><mo>(</mo><mi>engine</mi><mo>)</mo></mrow></mrow><mo>)</mo></mrow></mrow></mrow><mo>)</mo></mrow></mtd></mtr><mtr><mtd><mrow><mi>is</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mrow><mi>significantly</mi><mo>.</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>louder</mi></mrow></mrow></mtd></mtr><mtr><mtd><mi>OR</mi></mtd></mtr><mtr><mtd><mrow><mo>(</mo><mrow><mrow><mi>rhythm</mi><mo></mo><mstyle><mspace width="0.6em" height="0.6ex" /></mstyle><mo></mo><mrow><mo>(</mo><mrow><mi>sound</mi><mo></mo><mstyle><mspace width="0.6em" height="0.6ex" /></mstyle><mo></mo><mrow><mo>(</mo><mrow><mi>revved</mi><mo>.</mo><mi>engine</mi></mrow><mo>)</mo></mrow></mrow><mo>)</mo></mrow></mrow><mo>,</mo><mrow><mi>rhythm</mi><mo></mo><mstyle><mspace width="0.6em" height="0.6ex" /></mstyle><mo></mo><mrow><mo>(</mo><mrow><mi>sound</mi><mo></mo><mstyle><mspace width="0.6em" height="0.6ex" /></mstyle><mo></mo><mrow><mo>(</mo><mi>engine</mi><mo>)</mo></mrow></mrow><mo>)</mo></mrow></mrow></mrow><mo>)</mo></mrow></mtd></mtr><mtr><mtd><mrow><mi>is</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mrow><mi>significantly</mi><mo>.</mo><mstyle><mspace width="0.6em" height="0.6ex" /></mstyle><mo></mo><mi>faster</mi></mrow></mrow></mtd></mtr></mtable><mo>)</mo></mrow></mtd></mtr></mtable><mo>)</mo></mrow></mrow></mtd></mtr><mtr><mtd><mrow><mrow><mo>(</mo><mrow><mi>Prob</mi><mo></mo><mrow><mo>{</mo><mrow><mo>(</mo><mrow><mrow><mi>tension</mi><mo></mo><mrow><mo>(</mo><mi>TimingChain</mi><mo>)</mo></mrow></mrow><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>is</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>loose</mi></mrow><mo>)</mo></mrow><mo>}</mo></mrow><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>is</mi><mo></mo><mstyle><mspace width="1.1em" height="1.1ex" /></mstyle><mo></mo><mi>usually</mi></mrow><mo>)</mo></mrow><mo>.</mo></mrow></mtd></mtr></mtable><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>Then</mi></mrow></math></maths><img file="US2022121884A1_D11985.tif" /><img file="US2022121884A1_D11986.tif" /><img file="US2022121884A1_D11987.tif" /><img file="US2022121884A1_D11988.tif" /><img file="US2022121884A1_D11989.tif" /><img file="US2022121884A1_D11990.tif" /><img file="US2022121884A1_D11991.tif" /><img file="US2022121884A1_D11992.tif" /><img file="US2022121884A1_D11993.tif" /><img file="US2022121884A1_D11994.tif" /><img file="US2022121884A1_D11995.tif" /><img file="US2022121884A1_D11996.tif" /><img file="US2022121884A1_D11997.tif" /><img file="US2022121884A1_D11998.tif" /><img file="US2022121884A1_D11999.tif" /><img file="US2022121884A1_D12000.tif" /><img file="US2022121884A1_D12001.tif" /><img file="US2022121884A1_D12002.tif" /><img file="US2022121884A1_D12003.tif" /><img file="US2022121884A1_D12004.tif" /><img file="US2022121884A1_D12005.tif" /><img file="US2022121884A1_D12006.tif" /><img file="US2022121884A1_D12007.tif" /><img file="US2022121884A1_D12008.tif" /><img file="US2022121884A1_D12009.tif" /><img file="US2022121884A1_D12010.tif" /><img file="US2022121884A1_D12011.tif" /><img file="US2022121884A1_D12012.tif" /><img file="US2022121884A1_D12013.tif" /><img file="US2022121884A1_D12014.tif" /><img file="US2022121884A1_D12015.tif" /><img file="US2022121884A1_D12016.tif" /><img file="US2022121884A1_D12017.tif" /><img file="US2022121884A1_D12018.tif" /><img file="US2022121884A1_D12019.tif" /><img file="US2022121884A1_D12020.tif" /><img file="US2022121884A1_D12021.tif" /><img file="US2022121884A1_D12022.tif" /><img file="US2022121884A1_D12023.tif" /><img file="US2022121884A1_D12024.tif" /><img file="US2022121884A1_D12025.tif" /><img file="US2022121884A1_D12026.tif" /><img file="US2022121884A1_D12027.tif" /><img file="US2022121884A1_D12028.tif" /><img file="US2022121884A1_D12029.tif" /><img file="US2022121884A1_D12030.tif" /><img file="US2022121884A1_D12031.tif" /><img file="US2022121884A1_D12032.tif" /><img file="US2022121884A1_D12033.tif" /><img file="US2022121884A1_D12034.tif" /><img file="US2022121884A1_D12035.tif" /><img file="US2022121884A1_D12036.tif" /><img file="US2022121884A1_D12037.tif" /><img file="US2022121884A1_D12038.tif" /><img file="US2022121884A1_D12039.tif" /><img file="US2022121884A1_D12040.tif" /><img file="US2022121884A1_D12041.tif" /><img file="US2022121884A1_D12042.tif" /><img file="US2022121884A1_D12043.tif" /><img file="US2022121884A1_D12044.tif" /><img file="US2022121884A1_D12045.tif" /><img file="US2022121884A1_D12046.tif" /><img file="US2022121884A1_D12047.tif" /><img file="US2022121884A1_D12048.tif" /><img file="US2022121884A1_D12049.tif" /><img file="US2022121884A1_D12050.tif" /><img file="US2022121884A1_D12051.tif" /><img file="US2022121884A1_D12052.tif" /><img file="US2022121884A1_D12053.tif" /><img file="US2022121884A1_D12054.tif" /><img file="US2022121884A1_D12055.tif" /><img file="US2022121884A1_D12056.tif" /><img file="US2022121884A1_D12057.tif" /><img file="US2022121884A1_D12058.tif" /><img file="US2022121884A1_D12059.tif" /><img file="US2022121884A1_D12060.tif" /><img file="US2022121884A1_D12061.tif" /><img file="US2022121884A1_D12062.tif" /><img file="US2022121884A1_D12063.tif" /><img file="US2022121884A1_D12064.tif" /><img file="US2022121884A1_D12065.tif" /><img file="US2022121884A1_D12066.tif" /><img file="US2022121884A1_D12067.tif" /><img file="US2022121884A1_D12068.tif" /><img file="US2022121884A1_D12069.tif" /><img file="US2022121884A1_D12070.tif" /><img file="US2022121884A1_D12071.tif" /><img file="US2022121884A1_D12072.tif" /><img file="US2022121884A1_D12073.tif" /><img file="US2022121884A1_D12074.tif" /><img file="US2022121884A1_D12075.tif" /><img file="US2022121884A1_D12076.tif" /><img file="US2022121884A1_D12077.tif" /><img file="US2022121884A1_D12078.tif" /><img file="US2022121884A1_D12079.tif" /><img file="US2022121884A1_D12080.tif" /><img file="US2022121884A1_D12081.tif" /><img file="US2022121884A1_D12082.tif" /><img file="US2022121884A1_D12083.tif" /><img file="US2022121884A1_D12084.tif" /><img file="US2022121884A1_D12085.tif" /><img file="US2022121884A1_D12086.tif" /><img file="US2022121884A1_D12087.tif" /><img file="US2022121884A1_D12088.tif" /><img file="US2022121884A1_D12089.tif" /><img file="US2022121884A1_D12090.tif" /><img file="US2022121884A1_D12091.tif" /><img file="US2022121884A1_D12092.tif" /><img file="US2022121884A1_D12093.tif" /><img file="US2022121884A1_D12094.tif" /><img file="US2022121884A1_D12095.tif" /><img file="US2022121884A1_D12096.tif" />
In one embodiment, a user, e.g., an expert, specifies the membership of a particular engine sound via a user interface, e.g., the user specifies that the truth value of the engine sound being Rattling-Slapping is 70%. In one embodiment, the user specifies such truth value as a fuzzy set, e.g., high, medium, very high. In one embodiment, a Z-mouse is used to specify the fuzzy values (i.e., membership function) of various attributes(s) of the sound (e.g., loudness, rhythm, pitch/squeakiness). The Z-mouse is for example provided through a user interface on a computing device or other controls such as sliding/knob type controls, to control the position and size of an f-mark.
In one embodiment, the engine sound is received by a sound recognition module, e.g., via a microphone input. In one embodiment, the loudness (e.g., average or peak or tonal) of the engine sound is determined, e.g., by a sound meter (analog or digital) or module. In one embodiment, the rhythm is determined via the frequency of the loudness, or using the frequency spectrum of the received sound (e.g., the separation of the peaks in the frequency domain corresponds to the period of (impulse) train making up the rhythm of the engine sound). In one embodiment, the values of these parameters are made fuzzy via evaluating the corresponding membership functions (of e.g., engine sound level) for evaluating the truth value of the predicate in fuzzy rule. In one embodiment, the fuzzy rule is rewritten to use more precision, e.g., if readily available. For example, in one embodiment, level(sound(revved.engine)) and level(sound(revved/engine)) take on measured values.
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 15(<i>a</i>)</figref>, the type of engine sound is determined automatically, by determining a set of (e.g., fuzzy) signature parameters (e.g., tonal or pattern). In one embodiment, various relevant fuzzy sets (e.g., RattlingSlapping) are expressed via veristic distribution restriction on signature parameters. In one embodiment, the truth value of the predicate is determined via comparison with the truth values of the fuzzy parameters. For example:
<maths id="MATH-US-00052" num="00052"><math overflow="scroll"><mrow><mi>ts</mi><mo>=</mo><mrow><mrow><munder><mi>min</mi><mrow><mo>∀</mo><mi>i</mi></mrow></munder><mo></mo><mrow><mo>(</mo><msub><mi>ts</mi><mi>i</mi></msub><mo>)</mo></mrow></mrow><mo>=</mo><mrow><munder><mi>min</mi><mrow><mo>∀</mo><mi>i</mi></mrow></munder><mo></mo><mrow><mo>(</mo><mrow><munder><mi>max</mi><mrow><mo>∀</mo><msub><mi>u</mi><mi>i</mi></msub></mrow></munder><mo></mo><mrow><mo>(</mo><mrow><mrow><msub><mi>μ</mi><mrow><mi>A</mi><mo>,</mo><msub><mi>P</mi><mi>i</mi></msub></mrow></msub><mo></mo><mrow><mo>(</mo><msub><mi>u</mi><mi>i</mi></msub><mo>)</mo></mrow></mrow><mo>⋀</mo><mrow><msub><mi>μ</mi><mrow><mi>B</mi><mo>,</mo><msub><mi>P</mi><mi>i</mi></msub></mrow></msub><mo></mo><mrow><mo>(</mo><msub><mi>u</mi><mi>i</mi></msub><mo>)</mo></mrow></mrow></mrow><mo>)</mo></mrow></mrow><mo>)</mo></mrow></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D12097.tif" /><img file="US2022121884A1_D12098.tif" /><img file="US2022121884A1_D12099.tif" /><img file="US2022121884A1_D12100.tif" /><img file="US2022121884A1_D12101.tif" /><img file="US2022121884A1_D12102.tif" /><img file="US2022121884A1_D12103.tif" /><img file="US2022121884A1_D12104.tif" /><img file="US2022121884A1_D12105.tif" /><img file="US2022121884A1_D12106.tif" /><img file="US2022121884A1_D12107.tif" /><img file="US2022121884A1_D12108.tif" /><img file="US2022121884A1_D12109.tif" /><img file="US2022121884A1_D12110.tif" /><img file="US2022121884A1_D12111.tif" /><img file="US2022121884A1_D12112.tif" /><img file="US2022121884A1_D12113.tif" /><img file="US2022121884A1_D12114.tif" /><img file="US2022121884A1_D12115.tif" /><img file="US2022121884A1_D12116.tif" /><img file="US2022121884A1_D12117.tif" /><img file="US2022121884A1_D12118.tif" /><img file="US2022121884A1_D12119.tif" /><img file="US2022121884A1_D12120.tif" /><img file="US2022121884A1_D12121.tif" /><img file="US2022121884A1_D12122.tif" /><img file="US2022121884A1_D12123.tif" /><img file="US2022121884A1_D12124.tif" /><img file="US2022121884A1_D12125.tif" /><img file="US2022121884A1_D12126.tif" /><img file="US2022121884A1_D12127.tif" /><img file="US2022121884A1_D12128.tif" /><img file="US2022121884A1_D12129.tif" /><img file="US2022121884A1_D12130.tif" /><img file="US2022121884A1_D12131.tif" /><img file="US2022121884A1_D12132.tif" /><img file="US2022121884A1_D12133.tif" /><img file="US2022121884A1_D12134.tif" /><img file="US2022121884A1_D12135.tif" /><img file="US2022121884A1_D12136.tif" /><img file="US2022121884A1_D12137.tif" /><img file="US2022121884A1_D12138.tif" /><img file="US2022121884A1_D12139.tif" /><img file="US2022121884A1_D12140.tif" /><img file="US2022121884A1_D12141.tif" /><img file="US2022121884A1_D12142.tif" /><img file="US2022121884A1_D12143.tif" /><img file="US2022121884A1_D12144.tif" /><img file="US2022121884A1_D12145.tif" /><img file="US2022121884A1_D12146.tif" /><img file="US2022121884A1_D12147.tif" /><img file="US2022121884A1_D12148.tif" /><img file="US2022121884A1_D12149.tif" /><img file="US2022121884A1_D12150.tif" /><img file="US2022121884A1_D12151.tif" /><img file="US2022121884A1_D12152.tif" /><img file="US2022121884A1_D12153.tif" /><img file="US2022121884A1_D12154.tif" /><img file="US2022121884A1_D12155.tif" /><img file="US2022121884A1_D12156.tif" /><img file="US2022121884A1_D12157.tif" /><img file="US2022121884A1_D12158.tif" /><img file="US2022121884A1_D12159.tif" /><img file="US2022121884A1_D12160.tif" /><img file="US2022121884A1_D12161.tif" /><img file="US2022121884A1_D12162.tif" /><img file="US2022121884A1_D12163.tif" /><img file="US2022121884A1_D12164.tif" /><img file="US2022121884A1_D12165.tif" /><img file="US2022121884A1_D12166.tif" /><img file="US2022121884A1_D12167.tif" /><img file="US2022121884A1_D12168.tif" /><img file="US2022121884A1_D12169.tif" /><img file="US2022121884A1_D12170.tif" /><img file="US2022121884A1_D12171.tif" /><img file="US2022121884A1_D12172.tif" /><img file="US2022121884A1_D12173.tif" /><img file="US2022121884A1_D12174.tif" /><img file="US2022121884A1_D12175.tif" /><img file="US2022121884A1_D12176.tif" /><img file="US2022121884A1_D12177.tif" /><img file="US2022121884A1_D12178.tif" /><img file="US2022121884A1_D12179.tif" /><img file="US2022121884A1_D12180.tif" /><img file="US2022121884A1_D12181.tif" /><img file="US2022121884A1_D12182.tif" /><img file="US2022121884A1_D12183.tif" /><img file="US2022121884A1_D12184.tif" /><img file="US2022121884A1_D12185.tif" /><img file="US2022121884A1_D12186.tif" /><img file="US2022121884A1_D12187.tif" /><img file="US2022121884A1_D12188.tif" /><img file="US2022121884A1_D12189.tif" /><img file="US2022121884A1_D12190.tif" /><img file="US2022121884A1_D12191.tif" /><img file="US2022121884A1_D12192.tif" /><img file="US2022121884A1_D12193.tif" /><img file="US2022121884A1_D12194.tif" /><img file="US2022121884A1_D12195.tif" /><img file="US2022121884A1_D12196.tif" /><img file="US2022121884A1_D12197.tif" /><img file="US2022121884A1_D12198.tif" /><img file="US2022121884A1_D12199.tif" /><img file="US2022121884A1_D12200.tif" /><img file="US2022121884A1_D12201.tif" /><img file="US2022121884A1_D12202.tif" /><img file="US2022121884A1_D12203.tif" /><img file="US2022121884A1_D12204.tif" /><img file="US2022121884A1_D12205.tif" /><img file="US2022121884A1_D12206.tif" /><img file="US2022121884A1_D12207.tif" /><img file="US2022121884A1_D12208.tif" />
where i is an index identifying the ith signature parameter P<sub>i</sub>. u<sub>i </sub>is a generic truth value parameter in [0, 1]. ts<sub>i </sub>is the test score contribution from comparison of A and B against P<sub>i</sub>. μ<sub>A,Pi </sub>and μ<sub>B,Pi </sub>are fuzzy values of the A and B with respect to signature parameter P<sub>i</sub>. For example, A represents RattlingSlapping; B represents the engine sound; ts represents the truth value of the engine sound being RattlingSlapping; and ts<sub>i </sub>represents a possibility test score match of A and B with respect to the signature (fuzzy) parameter P<sub>i</sub>, for example determined, by comparison of A's and B's truth degree in P<sub>i</sub>. In one embodiment, the comparison with respect to P<sub>i </sub>is determined by:
<maths id="MATH-US-00053" num="00053"><math overflow="scroll"><mrow><msub><mi>ts</mi><mi>i</mi></msub><mo>=</mo><mrow><munder><mi>max</mi><mrow><mo>∀</mo><msub><mi>u</mi><mi>i</mi></msub></mrow></munder><mo></mo><mrow><mo>(</mo><mrow><mrow><mrow><msub><mi>μ</mi><mrow><mi>A</mi><mo>,</mo><msub><mi>P</mi><mi>i</mi></msub></mrow></msub><mo></mo><mrow><mo>(</mo><msub><mi>u</mi><mi>i</mi></msub><mo>)</mo></mrow></mrow><mo>⋀</mo><msub><mi>μ</mi><mrow><mi>B</mi><mo>,</mo><msub><mi>P</mi><mi>i</mi></msub></mrow></msub></mrow><mo></mo><mrow><mo>(</mo><msub><mi>u</mi><mi>i</mi></msub><mo>)</mo></mrow></mrow><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D12209.tif" /><img file="US2022121884A1_D12210.tif" /><img file="US2022121884A1_D12211.tif" /><img file="US2022121884A1_D12212.tif" /><img file="US2022121884A1_D12213.tif" /><img file="US2022121884A1_D12214.tif" /><img file="US2022121884A1_D12215.tif" /><img file="US2022121884A1_D12216.tif" /><img file="US2022121884A1_D12217.tif" /><img file="US2022121884A1_D12218.tif" /><img file="US2022121884A1_D12219.tif" /><img file="US2022121884A1_D12220.tif" /><img file="US2022121884A1_D12221.tif" /><img file="US2022121884A1_D12222.tif" /><img file="US2022121884A1_D12223.tif" /><img file="US2022121884A1_D12224.tif" /><img file="US2022121884A1_D12225.tif" /><img file="US2022121884A1_D12226.tif" /><img file="US2022121884A1_D12227.tif" /><img file="US2022121884A1_D12228.tif" /><img file="US2022121884A1_D12229.tif" /><img file="US2022121884A1_D12230.tif" /><img file="US2022121884A1_D12231.tif" /><img file="US2022121884A1_D12232.tif" /><img file="US2022121884A1_D12233.tif" /><img file="US2022121884A1_D12234.tif" /><img file="US2022121884A1_D12235.tif" /><img file="US2022121884A1_D12236.tif" /><img file="US2022121884A1_D12237.tif" /><img file="US2022121884A1_D12238.tif" /><img file="US2022121884A1_D12239.tif" /><img file="US2022121884A1_D12240.tif" /><img file="US2022121884A1_D12241.tif" /><img file="US2022121884A1_D12242.tif" /><img file="US2022121884A1_D12243.tif" /><img file="US2022121884A1_D12244.tif" /><img file="US2022121884A1_D12245.tif" /><img file="US2022121884A1_D12246.tif" /><img file="US2022121884A1_D12247.tif" /><img file="US2022121884A1_D12248.tif" /><img file="US2022121884A1_D12249.tif" /><img file="US2022121884A1_D12250.tif" /><img file="US2022121884A1_D12251.tif" /><img file="US2022121884A1_D12252.tif" /><img file="US2022121884A1_D12253.tif" /><img file="US2022121884A1_D12254.tif" /><img file="US2022121884A1_D12255.tif" /><img file="US2022121884A1_D12256.tif" /><img file="US2022121884A1_D12257.tif" /><img file="US2022121884A1_D12258.tif" /><img file="US2022121884A1_D12259.tif" /><img file="US2022121884A1_D12260.tif" /><img file="US2022121884A1_D12261.tif" /><img file="US2022121884A1_D12262.tif" /><img file="US2022121884A1_D12263.tif" /><img file="US2022121884A1_D12264.tif" /><img file="US2022121884A1_D12265.tif" /><img file="US2022121884A1_D12266.tif" /><img file="US2022121884A1_D12267.tif" /><img file="US2022121884A1_D12268.tif" /><img file="US2022121884A1_D12269.tif" /><img file="US2022121884A1_D12270.tif" /><img file="US2022121884A1_D12271.tif" /><img file="US2022121884A1_D12272.tif" /><img file="US2022121884A1_D12273.tif" /><img file="US2022121884A1_D12274.tif" /><img file="US2022121884A1_D12275.tif" /><img file="US2022121884A1_D12276.tif" /><img file="US2022121884A1_D12277.tif" /><img file="US2022121884A1_D12278.tif" /><img file="US2022121884A1_D12279.tif" /><img file="US2022121884A1_D12280.tif" /><img file="US2022121884A1_D12281.tif" /><img file="US2022121884A1_D12282.tif" /><img file="US2022121884A1_D12283.tif" /><img file="US2022121884A1_D12284.tif" /><img file="US2022121884A1_D12285.tif" /><img file="US2022121884A1_D12286.tif" /><img file="US2022121884A1_D12287.tif" /><img file="US2022121884A1_D12288.tif" /><img file="US2022121884A1_D12289.tif" /><img file="US2022121884A1_D12290.tif" /><img file="US2022121884A1_D12291.tif" /><img file="US2022121884A1_D12292.tif" /><img file="US2022121884A1_D12293.tif" /><img file="US2022121884A1_D12294.tif" /><img file="US2022121884A1_D12295.tif" /><img file="US2022121884A1_D12296.tif" /><img file="US2022121884A1_D12297.tif" /><img file="US2022121884A1_D12298.tif" /><img file="US2022121884A1_D12299.tif" /><img file="US2022121884A1_D12300.tif" /><img file="US2022121884A1_D12301.tif" /><img file="US2022121884A1_D12302.tif" /><img file="US2022121884A1_D12303.tif" /><img file="US2022121884A1_D12304.tif" /><img file="US2022121884A1_D12305.tif" /><img file="US2022121884A1_D12306.tif" /><img file="US2022121884A1_D12307.tif" /><img file="US2022121884A1_D12308.tif" /><img file="US2022121884A1_D12309.tif" /><img file="US2022121884A1_D12310.tif" /><img file="US2022121884A1_D12311.tif" /><img file="US2022121884A1_D12312.tif" /><img file="US2022121884A1_D12313.tif" /><img file="US2022121884A1_D12314.tif" /><img file="US2022121884A1_D12315.tif" /><img file="US2022121884A1_D12316.tif" /><img file="US2022121884A1_D12317.tif" /><img file="US2022121884A1_D12318.tif" /><img file="US2022121884A1_D12319.tif" /><img file="US2022121884A1_D12320.tif" />
For example, as depicted in <figref idref="DRAWINGS">FIG. 15(<i>a</i>)</figref>, ts<sub>1 </sub>is 1 as μ<sub>A,P1 </sub>and μ<sub>B,P1 </sub>overlap in u<sub>1 </sub>where both are 1; and ts<sub>2 </sub>is less than 1 (e.g., say 0.4) as μ<sub>A,P2 </sub>and μ<sub>B,P2 </sub>overlap in u<sub>2 </sub>at their fuzzy edges. In one embodiment, as shown above, ts is determined by minimum of individual ts<sub>i</sub>'s. In one embodiment, ts is determined via averaging, or weighted (w<sub>i</sub>) averaging:
<maths id="MATH-US-00054" num="00054"><math overflow="scroll"><mrow><mi>ts</mi><mo>=</mo><mrow><mrow><munder><mi>ave</mi><mrow><mo>∀</mo><mi>i</mi></mrow></munder><mo></mo><mrow><mo>(</mo><msub><mi>ts</mi><mi>i</mi></msub><mo>)</mo></mrow></mrow><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>or</mi><mo></mo><mrow><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mrow><mo></mo><mfrac><mrow><munder><mo>∑</mo><mi>i</mi></munder><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><mrow><msub><mi>w</mi><mi>k</mi></msub><mo>·</mo><mi>t</mi></mrow><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><msub><mi>s</mi><mi>i</mi></msub></mrow></mrow><mrow><munder><mo>∑</mo><mi>k</mi></munder><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><msub><mi>w</mi><mi>k</mi></msub></mrow></mfrac></mrow></mrow></math></maths><img file="US2022121884A1_D12321.tif" /><img file="US2022121884A1_D12322.tif" /><img file="US2022121884A1_D12323.tif" /><img file="US2022121884A1_D12324.tif" /><img file="US2022121884A1_D12325.tif" /><img file="US2022121884A1_D12326.tif" /><img file="US2022121884A1_D12327.tif" /><img file="US2022121884A1_D12328.tif" /><img file="US2022121884A1_D12329.tif" /><img file="US2022121884A1_D12330.tif" /><img file="US2022121884A1_D12331.tif" /><img file="US2022121884A1_D12332.tif" /><img file="US2022121884A1_D12333.tif" /><img file="US2022121884A1_D12334.tif" /><img file="US2022121884A1_D12335.tif" /><img file="US2022121884A1_D12336.tif" /><img file="US2022121884A1_D12337.tif" /><img file="US2022121884A1_D12338.tif" /><img file="US2022121884A1_D12339.tif" /><img file="US2022121884A1_D12340.tif" /><img file="US2022121884A1_D12341.tif" /><img file="US2022121884A1_D12342.tif" /><img file="US2022121884A1_D12343.tif" /><img file="US2022121884A1_D12344.tif" /><img file="US2022121884A1_D12345.tif" /><img file="US2022121884A1_D12346.tif" /><img file="US2022121884A1_D12347.tif" /><img file="US2022121884A1_D12348.tif" /><img file="US2022121884A1_D12349.tif" /><img file="US2022121884A1_D12350.tif" /><img file="US2022121884A1_D12351.tif" /><img file="US2022121884A1_D12352.tif" /><img file="US2022121884A1_D12353.tif" /><img file="US2022121884A1_D12354.tif" /><img file="US2022121884A1_D12355.tif" /><img file="US2022121884A1_D12356.tif" /><img file="US2022121884A1_D12357.tif" /><img file="US2022121884A1_D12358.tif" /><img file="US2022121884A1_D12359.tif" /><img file="US2022121884A1_D12360.tif" /><img file="US2022121884A1_D12361.tif" /><img file="US2022121884A1_D12362.tif" /><img file="US2022121884A1_D12363.tif" /><img file="US2022121884A1_D12364.tif" /><img file="US2022121884A1_D12365.tif" /><img file="US2022121884A1_D12366.tif" /><img file="US2022121884A1_D12367.tif" /><img file="US2022121884A1_D12368.tif" /><img file="US2022121884A1_D12369.tif" /><img file="US2022121884A1_D12370.tif" /><img file="US2022121884A1_D12371.tif" /><img file="US2022121884A1_D12372.tif" /><img file="US2022121884A1_D12373.tif" /><img file="US2022121884A1_D12374.tif" /><img file="US2022121884A1_D12375.tif" /><img file="US2022121884A1_D12376.tif" /><img file="US2022121884A1_D12377.tif" /><img file="US2022121884A1_D12378.tif" /><img file="US2022121884A1_D12379.tif" /><img file="US2022121884A1_D12380.tif" /><img file="US2022121884A1_D12381.tif" /><img file="US2022121884A1_D12382.tif" /><img file="US2022121884A1_D12383.tif" /><img file="US2022121884A1_D12384.tif" /><img file="US2022121884A1_D12385.tif" /><img file="US2022121884A1_D12386.tif" /><img file="US2022121884A1_D12387.tif" /><img file="US2022121884A1_D12388.tif" /><img file="US2022121884A1_D12389.tif" /><img file="US2022121884A1_D12390.tif" /><img file="US2022121884A1_D12391.tif" /><img file="US2022121884A1_D12392.tif" /><img file="US2022121884A1_D12393.tif" /><img file="US2022121884A1_D12394.tif" /><img file="US2022121884A1_D12395.tif" /><img file="US2022121884A1_D12396.tif" /><img file="US2022121884A1_D12397.tif" /><img file="US2022121884A1_D12398.tif" /><img file="US2022121884A1_D12399.tif" /><img file="US2022121884A1_D12400.tif" /><img file="US2022121884A1_D12401.tif" /><img file="US2022121884A1_D12402.tif" /><img file="US2022121884A1_D12403.tif" /><img file="US2022121884A1_D12404.tif" /><img file="US2022121884A1_D12405.tif" /><img file="US2022121884A1_D12406.tif" /><img file="US2022121884A1_D12407.tif" /><img file="US2022121884A1_D12408.tif" /><img file="US2022121884A1_D12409.tif" /><img file="US2022121884A1_D12410.tif" /><img file="US2022121884A1_D12411.tif" /><img file="US2022121884A1_D12412.tif" /><img file="US2022121884A1_D12413.tif" /><img file="US2022121884A1_D12414.tif" /><img file="US2022121884A1_D12415.tif" /><img file="US2022121884A1_D12416.tif" /><img file="US2022121884A1_D12417.tif" /><img file="US2022121884A1_D12418.tif" /><img file="US2022121884A1_D12419.tif" /><img file="US2022121884A1_D12420.tif" /><img file="US2022121884A1_D12421.tif" /><img file="US2022121884A1_D12422.tif" /><img file="US2022121884A1_D12423.tif" /><img file="US2022121884A1_D12424.tif" /><img file="US2022121884A1_D12425.tif" /><img file="US2022121884A1_D12426.tif" /><img file="US2022121884A1_D12427.tif" /><img file="US2022121884A1_D12428.tif" /><img file="US2022121884A1_D12429.tif" /><img file="US2022121884A1_D12430.tif" /><img file="US2022121884A1_D12431.tif" /><img file="US2022121884A1_D12432.tif" />
In one embodiment, where not all signature parameters are used, relevant, or available for A, then a subset of those signature parameters that are used, relevant, or available for A is used to determine ts, e.g., by limiting taking minimum or averaging operations based on those signature parameters. For example,
<maths id="MATH-US-00055" num="00055"><math overflow="scroll"><mrow><mi>ts</mi><mo>=</mo><mrow><munder><mi>min</mi><mrow><mo>∀</mo><mi>i</mi></mrow></munder><mo></mo><mrow><mo>(</mo><msub><mi>ts</mi><mi>i</mi></msub><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D12433.tif" /><img file="US2022121884A1_D12434.tif" /><img file="US2022121884A1_D12435.tif" /><img file="US2022121884A1_D12436.tif" /><img file="US2022121884A1_D12437.tif" /><img file="US2022121884A1_D12438.tif" /><img file="US2022121884A1_D12439.tif" /><img file="US2022121884A1_D12440.tif" /><img file="US2022121884A1_D12441.tif" /><img file="US2022121884A1_D12442.tif" /><img file="US2022121884A1_D12443.tif" /><img file="US2022121884A1_D12444.tif" /><img file="US2022121884A1_D12445.tif" /><img file="US2022121884A1_D12446.tif" /><img file="US2022121884A1_D12447.tif" /><img file="US2022121884A1_D12448.tif" /><img file="US2022121884A1_D12449.tif" /><img file="US2022121884A1_D12450.tif" /><img file="US2022121884A1_D12451.tif" /><img file="US2022121884A1_D12452.tif" /><img file="US2022121884A1_D12453.tif" /><img file="US2022121884A1_D12454.tif" /><img file="US2022121884A1_D12455.tif" /><img file="US2022121884A1_D12456.tif" /><img file="US2022121884A1_D12457.tif" /><img file="US2022121884A1_D12458.tif" /><img file="US2022121884A1_D12459.tif" /><img file="US2022121884A1_D12460.tif" /><img file="US2022121884A1_D12461.tif" /><img file="US2022121884A1_D12462.tif" /><img file="US2022121884A1_D12463.tif" /><img file="US2022121884A1_D12464.tif" /><img file="US2022121884A1_D12465.tif" /><img file="US2022121884A1_D12466.tif" /><img file="US2022121884A1_D12467.tif" /><img file="US2022121884A1_D12468.tif" /><img file="US2022121884A1_D12469.tif" /><img file="US2022121884A1_D12470.tif" /><img file="US2022121884A1_D12471.tif" /><img file="US2022121884A1_D12472.tif" /><img file="US2022121884A1_D12473.tif" /><img file="US2022121884A1_D12474.tif" /><img file="US2022121884A1_D12475.tif" /><img file="US2022121884A1_D12476.tif" /><img file="US2022121884A1_D12477.tif" /><img file="US2022121884A1_D12478.tif" /><img file="US2022121884A1_D12479.tif" /><img file="US2022121884A1_D12480.tif" /><img file="US2022121884A1_D12481.tif" /><img file="US2022121884A1_D12482.tif" /><img file="US2022121884A1_D12483.tif" /><img file="US2022121884A1_D12484.tif" /><img file="US2022121884A1_D12485.tif" /><img file="US2022121884A1_D12486.tif" /><img file="US2022121884A1_D12487.tif" /><img file="US2022121884A1_D12488.tif" /><img file="US2022121884A1_D12489.tif" /><img file="US2022121884A1_D12490.tif" /><img file="US2022121884A1_D12491.tif" /><img file="US2022121884A1_D12492.tif" /><img file="US2022121884A1_D12493.tif" /><img file="US2022121884A1_D12494.tif" /><img file="US2022121884A1_D12495.tif" /><img file="US2022121884A1_D12496.tif" /><img file="US2022121884A1_D12497.tif" /><img file="US2022121884A1_D12498.tif" /><img file="US2022121884A1_D12499.tif" /><img file="US2022121884A1_D12500.tif" /><img file="US2022121884A1_D12501.tif" /><img file="US2022121884A1_D12502.tif" /><img file="US2022121884A1_D12503.tif" /><img file="US2022121884A1_D12504.tif" /><img file="US2022121884A1_D12505.tif" /><img file="US2022121884A1_D12506.tif" /><img file="US2022121884A1_D12507.tif" /><img file="US2022121884A1_D12508.tif" /><img file="US2022121884A1_D12509.tif" /><img file="US2022121884A1_D12510.tif" /><img file="US2022121884A1_D12511.tif" /><img file="US2022121884A1_D12512.tif" /><img file="US2022121884A1_D12513.tif" /><img file="US2022121884A1_D12514.tif" /><img file="US2022121884A1_D12515.tif" /><img file="US2022121884A1_D12516.tif" /><img file="US2022121884A1_D12517.tif" /><img file="US2022121884A1_D12518.tif" /><img file="US2022121884A1_D12519.tif" /><img file="US2022121884A1_D12520.tif" /><img file="US2022121884A1_D12521.tif" /><img file="US2022121884A1_D12522.tif" /><img file="US2022121884A1_D12523.tif" /><img file="US2022121884A1_D12524.tif" /><img file="US2022121884A1_D12525.tif" /><img file="US2022121884A1_D12526.tif" /><img file="US2022121884A1_D12527.tif" /><img file="US2022121884A1_D12528.tif" /><img file="US2022121884A1_D12529.tif" /><img file="US2022121884A1_D12530.tif" /><img file="US2022121884A1_D12531.tif" /><img file="US2022121884A1_D12532.tif" /><img file="US2022121884A1_D12533.tif" /><img file="US2022121884A1_D12534.tif" /><img file="US2022121884A1_D12535.tif" /><img file="US2022121884A1_D12536.tif" /><img file="US2022121884A1_D12537.tif" /><img file="US2022121884A1_D12538.tif" /><img file="US2022121884A1_D12539.tif" /><img file="US2022121884A1_D12540.tif" /><img file="US2022121884A1_D12541.tif" /><img file="US2022121884A1_D12542.tif" /><img file="US2022121884A1_D12543.tif" /><img file="US2022121884A1_D12544.tif" /><maths id="MATH-US-00055-2" num="00055.2"><math overflow="scroll"><mrow><mrow><mi>Subject</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>to</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><msub><mi>P</mi><mi>i</mi></msub></mrow><mo>∈</mo><mrow><mo>{</mo><mrow><mi>relevant</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>signature</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>parameters</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>to</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>A</mi></mrow><mo>}</mo></mrow></mrow></math></maths><img file="US2022121884A1_D12545.tif" /><img file="US2022121884A1_D12546.tif" /><img file="US2022121884A1_D12547.tif" /><img file="US2022121884A1_D12548.tif" /><img file="US2022121884A1_D12549.tif" /><img file="US2022121884A1_D12550.tif" /><img file="US2022121884A1_D12551.tif" /><img file="US2022121884A1_D12552.tif" /><img file="US2022121884A1_D12553.tif" /><img file="US2022121884A1_D12554.tif" /><img file="US2022121884A1_D12555.tif" /><img file="US2022121884A1_D12556.tif" /><img file="US2022121884A1_D12557.tif" /><img file="US2022121884A1_D12558.tif" /><img file="US2022121884A1_D12559.tif" /><img file="US2022121884A1_D12560.tif" /><img file="US2022121884A1_D12561.tif" /><img file="US2022121884A1_D12562.tif" /><img file="US2022121884A1_D12563.tif" /><img file="US2022121884A1_D12564.tif" /><img file="US2022121884A1_D12565.tif" /><img file="US2022121884A1_D12566.tif" /><img file="US2022121884A1_D12567.tif" /><img file="US2022121884A1_D12568.tif" /><img file="US2022121884A1_D12569.tif" /><img file="US2022121884A1_D12570.tif" /><img file="US2022121884A1_D12571.tif" /><img file="US2022121884A1_D12572.tif" /><img file="US2022121884A1_D12573.tif" /><img file="US2022121884A1_D12574.tif" /><img file="US2022121884A1_D12575.tif" /><img file="US2022121884A1_D12576.tif" /><img file="US2022121884A1_D12577.tif" /><img file="US2022121884A1_D12578.tif" /><img file="US2022121884A1_D12579.tif" /><img file="US2022121884A1_D12580.tif" /><img file="US2022121884A1_D12581.tif" /><img file="US2022121884A1_D12582.tif" /><img file="US2022121884A1_D12583.tif" /><img file="US2022121884A1_D12584.tif" /><img file="US2022121884A1_D12585.tif" /><img file="US2022121884A1_D12586.tif" /><img file="US2022121884A1_D12587.tif" /><img file="US2022121884A1_D12588.tif" /><img file="US2022121884A1_D12589.tif" /><img file="US2022121884A1_D12590.tif" /><img file="US2022121884A1_D12591.tif" /><img file="US2022121884A1_D12592.tif" /><img file="US2022121884A1_D12593.tif" /><img file="US2022121884A1_D12594.tif" /><img file="US2022121884A1_D12595.tif" /><img file="US2022121884A1_D12596.tif" /><img file="US2022121884A1_D12597.tif" /><img file="US2022121884A1_D12598.tif" /><img file="US2022121884A1_D12599.tif" /><img file="US2022121884A1_D12600.tif" /><img file="US2022121884A1_D12601.tif" /><img file="US2022121884A1_D12602.tif" /><img file="US2022121884A1_D12603.tif" /><img file="US2022121884A1_D12604.tif" /><img file="US2022121884A1_D12605.tif" /><img file="US2022121884A1_D12606.tif" /><img file="US2022121884A1_D12607.tif" /><img file="US2022121884A1_D12608.tif" /><img file="US2022121884A1_D12609.tif" /><img file="US2022121884A1_D12610.tif" /><img file="US2022121884A1_D12611.tif" /><img file="US2022121884A1_D12612.tif" /><img file="US2022121884A1_D12613.tif" /><img file="US2022121884A1_D12614.tif" /><img file="US2022121884A1_D12615.tif" /><img file="US2022121884A1_D12616.tif" /><img file="US2022121884A1_D12617.tif" /><img file="US2022121884A1_D12618.tif" /><img file="US2022121884A1_D12619.tif" /><img file="US2022121884A1_D12620.tif" /><img file="US2022121884A1_D12621.tif" /><img file="US2022121884A1_D12622.tif" /><img file="US2022121884A1_D12623.tif" /><img file="US2022121884A1_D12624.tif" /><img file="US2022121884A1_D12625.tif" /><img file="US2022121884A1_D12626.tif" /><img file="US2022121884A1_D12627.tif" /><img file="US2022121884A1_D12628.tif" /><img file="US2022121884A1_D12629.tif" /><img file="US2022121884A1_D12630.tif" /><img file="US2022121884A1_D12631.tif" /><img file="US2022121884A1_D12632.tif" /><img file="US2022121884A1_D12633.tif" /><img file="US2022121884A1_D12634.tif" /><img file="US2022121884A1_D12635.tif" /><img file="US2022121884A1_D12636.tif" /><img file="US2022121884A1_D12637.tif" /><img file="US2022121884A1_D12638.tif" /><img file="US2022121884A1_D12639.tif" /><img file="US2022121884A1_D12640.tif" /><img file="US2022121884A1_D12641.tif" /><img file="US2022121884A1_D12642.tif" /><img file="US2022121884A1_D12643.tif" /><img file="US2022121884A1_D12644.tif" /><img file="US2022121884A1_D12645.tif" /><img file="US2022121884A1_D12646.tif" /><img file="US2022121884A1_D12647.tif" /><img file="US2022121884A1_D12648.tif" /><img file="US2022121884A1_D12649.tif" /><img file="US2022121884A1_D12650.tif" /><img file="US2022121884A1_D12651.tif" /><img file="US2022121884A1_D12652.tif" /><img file="US2022121884A1_D12653.tif" /><img file="US2022121884A1_D12654.tif" /><img file="US2022121884A1_D12655.tif" /><img file="US2022121884A1_D12656.tif" />
In such an embodiment, the relevant signature parameters for A are identified, for example, via a query in the model or knowledge database.
In one embodiment, for example, when minimum of ts<sub>i</sub>'s are used to determine is, the irrelevancy of a signature parameter with respect to A may be expressed as a truth membership function of 1 for all possibilities. For example, as depicted in <figref idref="DRAWINGS">FIG. 15(<i>a</i>)</figref>, μ<sub>A,Pj </sub>is flat (=1) for all u<sub>j</sub>'s, and therefore, ts<sub>j </sub>is 1 (assuming maximum of μ<sub>B,Pj </sub>is 1 at some u<sub>j</sub>). Thus, in this case, the contribution of ts<sub>j </sub>in is effectively disappears.
In one embodiment, μ<sub>A,Pi </sub>is determined through empirical methods, user settings, or training sets. For example, in one embodiment, N training set engine sounds (denoted as T<sub>k </sub>with k from 1 to N) are used to determine μ<sub>A,Pi</sub>. In one embodiment, the truth values for the training element T<sub>k </sub>with respect to signature parameters are determined (e.g., as a crisp number, range, or a fuzzy set). For example, as depicted in <figref idref="DRAWINGS">FIG. 15(<i>b</i>)</figref>, the truth value of the training element T<sub>k </sub>in signature parameter P<sub>i</sub>, is determined (denoted as v<sub>k,i</sub>), for example through an expert assignment, rule evaluation, or functional/analytical assessment. In one embodiment, the membership value of T<sub>k </sub>in A is (denoted as m<sub>k,A</sub>) determined, e.g., by user/expert, expert system, or via analytical methods. m<sub>k,A </sub>may have crisp or fuzzy value. In one embodiment, the contribution of T<sub>k </sub>to μ<sub>A,Pi </sub>is determined similar to the execution of the consequent of a fuzzy rule, e.g., the contribution of v<sub>k,i </sub>is scaled or clipped by m<sub>k,A </sub>as depicted in <figref idref="DRAWINGS">FIG. 15(<i>b</i>)</figref>. For example, as depicted, the truth value of T<sub>1 </sub>in P<sub>i </sub>is a crisp value v<sub>1,i </sub>and the truth value of T<sub>1 </sub>in A is m<sub>1,A</sub>. Thus, the contribution of T<sub>1 </sub>to μ<sub>A,Pi </sub>appears as a dot at (v<sub>1,i</sub>, m<sub>1,A</sub>). Another example is the contribution of T<sub>2 </sub>to μ<sub>A,Pi </sub>where the truth value of T<sub>2 </sub>in P<sub>i </sub>is a fuzzy value v<sub>2,i</sub>, and the truth value of T<sub>2 </sub>in A is m<sub>2,A</sub>. Thus, the contribution of T<sub>2 </sub>to μ<sub>A,Pi </sub>appears as a clipped or scaled membership function as depicted in <figref idref="DRAWINGS">FIG. 15(<i>b</i>)</figref>. In one embodiment, μ<sub>A,Pi </sub>is determined as the envelope (e.g., convex) covering the contributions of T<sub>k</sub>'s to μ<sub>A,Pi</sub>, for example as depicted in <figref idref="DRAWINGS">FIG. 15(<i>b</i>)</figref>. In one example, truth value bins are set up in u<sub>i </sub>to determined the maximum contribution from various T<sub>k</sub>'s for a given u<sub>i </sub>(bin) to determined μ<sub>A,Pi</sub>.
In one embodiment, user/expert assigns verity membership values for T<sub>k </sub>in A.
In one embodiment, a module is used to determine correlation between the various type sounds and the corresponding engine diagnosis (by for example experts). In one embodiment, the correlation is made between the signature parameters of the sound and the diagnosis (e.g., in for of fuzzy graphs or fuzzy rules). In one embodiment, a typical and highly frequent type of sound may be identified as the signature parameter (e.g., RattlingSlapping may be taken as a signature parameter itself). Therefore, in one embodiment, the creation of new signature parameters may be governed by fuzzy rules (e.g., involving configurable fuzzy concepts as “typical” for similarity and “frequent”). In one embodiment, the reliability and consistency of the rules are enhanced by allowing the training or feedback adjust μ<sub>A,Pi</sub>.
In one embodiment, such diagnosis is used an autonomous system, e.g., in self-healing or self-repair, or through other systems/subsystems/components.
In one embodiment provides music recognition via similar analysis of its signature parameters and comparison against those from a music library/database. In one embodiment, the categories of music (e.g., classic, rock, and the like) may be used as fuzzy concept A in this example.
q5: What is the Probability of Loose Timing Chain, when the Engine Sound is a Loud “Tick, Tick, Tack, Tack” and it gets Worse when Revving the Engine?
In one embodiment, as shown by q<sub>5</sub>, the specification of an input to the system is not in form of the actual sound engine (e.g., wave form or digitized audio), but a fuzzy description of the sound. A conversion process evaluates the fuzzy description to find or construct a sound/attributes (e.g., in the data store) which may be further processed by the rules. For example, in one embodiment, within the context, the module interprets fuzzy descriptions “Tick” and “Tack” as a tonal variation of abrupt sound. In one embodiment, the sequence of such descriptions is interpreted as the pattern of such sounds. With these attributes, in one embodiment, signature parameters are determined, and as described above, the test score related to whether “Tick, Tick, Tack, Tack” is RattlingSlapping, is determined. The evaluation of the fuzzy rule predicate provides the test score for the limiting truth score for the consequent, which is a restriction on the probability of loose timing chain.
In one embodiment, e.g., in music recognition, similar fuzzy description of music is used to determine/search/find the candidates from the music library (or metadata) with best match(es) and/or rankings. When such a description accompanies other proposition(s), e.g., a user input that “the music is classical”, it would place further restrictions to narrow down the candidates, e.g., by automatic combinations of the fuzzy restrictions, as mentioned in this disclosure or via evaluation of fuzzy rules in a rules engine.
Example 4
In this example, suppose these input propositions to system: p<sub>1</sub>: the weather is seldom cold or mild. p<sub>2</sub>: Statistically, the number of people showing up for an outdoor swimming pool event is given by function having a peak of 100 at 90° F., where X is the weather temperature:
<maths id="MATH-US-00056" num="00056"><math overflow="scroll"><mrow><mi>Y</mi><mo>=</mo><mrow><mrow><mi>F</mi><mo></mo><mrow><mo>(</mo><mi>X</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mi>max</mi><mo></mo><mstyle><mspace width="0.6em" height="0.6ex" /></mstyle><mo></mo><mrow><mo>(</mo><mrow><mrow><mn>100</mn><mo>×</mo><mrow><mo>(</mo><mrow><mn>1</mn><mo>-</mo><mrow><mi>abs</mi><mo></mo><mrow><mo>(</mo><mfrac><mrow><mi>X</mi><mo>-</mo><mrow><mn>90</mn><mo></mo><mi>°</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mrow><mi>F</mi><mo>.</mo></mrow></mrow></mrow><mrow><mn>25</mn><mo></mo><mi>°</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mrow><mi>F</mi><mo>.</mo></mrow></mrow></mfrac><mo>)</mo></mrow></mrow></mrow><mo>)</mo></mrow></mrow><mo>,</mo><mn>0</mn></mrow><mo>)</mo></mrow></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D12657.tif" /><img file="US2022121884A1_D12658.tif" /><img file="US2022121884A1_D12659.tif" /><img file="US2022121884A1_D12660.tif" /><img file="US2022121884A1_D12661.tif" /><img file="US2022121884A1_D12662.tif" /><img file="US2022121884A1_D12663.tif" /><img file="US2022121884A1_D12664.tif" /><img file="US2022121884A1_D12665.tif" /><img file="US2022121884A1_D12666.tif" /><img file="US2022121884A1_D12667.tif" /><img file="US2022121884A1_D12668.tif" /><img file="US2022121884A1_D12669.tif" /><img file="US2022121884A1_D12670.tif" /><img file="US2022121884A1_D12671.tif" /><img file="US2022121884A1_D12672.tif" /><img file="US2022121884A1_D12673.tif" /><img file="US2022121884A1_D12674.tif" /><img file="US2022121884A1_D12675.tif" /><img file="US2022121884A1_D12676.tif" /><img file="US2022121884A1_D12677.tif" /><img file="US2022121884A1_D12678.tif" /><img file="US2022121884A1_D12679.tif" /><img file="US2022121884A1_D12680.tif" /><img file="US2022121884A1_D12681.tif" /><img file="US2022121884A1_D12682.tif" /><img file="US2022121884A1_D12683.tif" /><img file="US2022121884A1_D12684.tif" /><img file="US2022121884A1_D12685.tif" /><img file="US2022121884A1_D12686.tif" /><img file="US2022121884A1_D12687.tif" /><img file="US2022121884A1_D12688.tif" /><img file="US2022121884A1_D12689.tif" /><img file="US2022121884A1_D12690.tif" /><img file="US2022121884A1_D12691.tif" /><img file="US2022121884A1_D12692.tif" /><img file="US2022121884A1_D12693.tif" /><img file="US2022121884A1_D12694.tif" /><img file="US2022121884A1_D12695.tif" /><img file="US2022121884A1_D12696.tif" /><img file="US2022121884A1_D12697.tif" /><img file="US2022121884A1_D12698.tif" /><img file="US2022121884A1_D12699.tif" /><img file="US2022121884A1_D12700.tif" /><img file="US2022121884A1_D12701.tif" /><img file="US2022121884A1_D12702.tif" /><img file="US2022121884A1_D12703.tif" /><img file="US2022121884A1_D12704.tif" /><img file="US2022121884A1_D12705.tif" /><img file="US2022121884A1_D12706.tif" /><img file="US2022121884A1_D12707.tif" /><img file="US2022121884A1_D12708.tif" /><img file="US2022121884A1_D12709.tif" /><img file="US2022121884A1_D12710.tif" /><img file="US2022121884A1_D12711.tif" /><img file="US2022121884A1_D12712.tif" /><img file="US2022121884A1_D12713.tif" /><img file="US2022121884A1_D12714.tif" /><img file="US2022121884A1_D12715.tif" /><img file="US2022121884A1_D12716.tif" /><img file="US2022121884A1_D12717.tif" /><img file="US2022121884A1_D12718.tif" /><img file="US2022121884A1_D12719.tif" /><img file="US2022121884A1_D12720.tif" /><img file="US2022121884A1_D12721.tif" /><img file="US2022121884A1_D12722.tif" /><img file="US2022121884A1_D12723.tif" /><img file="US2022121884A1_D12724.tif" /><img file="US2022121884A1_D12725.tif" /><img file="US2022121884A1_D12726.tif" /><img file="US2022121884A1_D12727.tif" /><img file="US2022121884A1_D12728.tif" /><img file="US2022121884A1_D12729.tif" /><img file="US2022121884A1_D12730.tif" /><img file="US2022121884A1_D12731.tif" /><img file="US2022121884A1_D12732.tif" /><img file="US2022121884A1_D12733.tif" /><img file="US2022121884A1_D12734.tif" /><img file="US2022121884A1_D12735.tif" /><img file="US2022121884A1_D12736.tif" /><img file="US2022121884A1_D12737.tif" /><img file="US2022121884A1_D12738.tif" /><img file="US2022121884A1_D12739.tif" /><img file="US2022121884A1_D12740.tif" /><img file="US2022121884A1_D12741.tif" /><img file="US2022121884A1_D12742.tif" /><img file="US2022121884A1_D12743.tif" /><img file="US2022121884A1_D12744.tif" /><img file="US2022121884A1_D12745.tif" /><img file="US2022121884A1_D12746.tif" /><img file="US2022121884A1_D12747.tif" /><img file="US2022121884A1_D12748.tif" /><img file="US2022121884A1_D12749.tif" /><img file="US2022121884A1_D12750.tif" /><img file="US2022121884A1_D12751.tif" /><img file="US2022121884A1_D12752.tif" /><img file="US2022121884A1_D12753.tif" /><img file="US2022121884A1_D12754.tif" /><img file="US2022121884A1_D12755.tif" /><img file="US2022121884A1_D12756.tif" /><img file="US2022121884A1_D12757.tif" /><img file="US2022121884A1_D12758.tif" /><img file="US2022121884A1_D12759.tif" /><img file="US2022121884A1_D12760.tif" /><img file="US2022121884A1_D12761.tif" /><img file="US2022121884A1_D12762.tif" /><img file="US2022121884A1_D12763.tif" /><img file="US2022121884A1_D12764.tif" /><img file="US2022121884A1_D12765.tif" /><img file="US2022121884A1_D12766.tif" /><img file="US2022121884A1_D12767.tif" /><img file="US2022121884A1_D12768.tif" />
q6: How Many People will Show up at the Swimming Event?
In one embodiment, the precisiation of input proposition is in Z-valuation (X, A<sub>x</sub>, B<sub>x</sub>), where A<sub>x </sub>is cold or mild and B<sub>x </sub>is seldom. For example, as depicted in <figref idref="DRAWINGS">FIG. 16(<i>a</i>)</figref>, μ<sub>Ay </sub>is depicted as a step-down membership function with ramp from 70° F. to 85° F., representing the fuzzy edge of mild on the high side, and as depicted in <figref idref="DRAWINGS">FIG. 16(<i>b</i>)</figref>, μ<sub>Ay </sub>is depicted as a step-down membership function with ramp from 10% to 30%, representing seldom.
In one embodiment, the parsing of q<sub>6 </sub>results in an answer in form of Z-valuation, (Y, A<sub>y</sub>, B<sub>y</sub>) form, where Y is the number of people showing up for an outdoor swimming pool event. In one embodiment, as described in this disclosure, a candidate μ<sub>Ay </sub>is determined using F(X) and via extension principle. For example, as depicted in <figref idref="DRAWINGS">FIG. 16(<i>c</i>)</figref>, μ<sub>Ay </sub>(without taking maximum possibility) is determined for X ranging from 45° F. to 120° F. Given non-monotonic nature of F(X) in this example, same Y (or bin) maps to multiple X's with different membership function values, as depicted in <figref idref="DRAWINGS">FIG. 16(<i>c</i>)</figref>. The resulting μ<sub>Ay</sub>, by maximizing membership function in a Y (bin) is depicted in <figref idref="DRAWINGS">FIG. 16(<i>d</i>)</figref>. For example, in one embodiment, this μ<sub>Ay </sub>maps to quite significantly less than 80, based on the knowledge database, context, and models. In one embodiment, for example, a probability Gaussian distribution is selected for p<sub>X</sub>, N(m<sub>x</sub>, σ<sub>x</sub>), with m<sub>x </sub>selected in [60, 95] and σ<sub>x </sub>selected in (0, 5]. In one embodiment, the corresponding probability measure of A<sub>x </sub>(denoted as υ) is determined for various candidate p<sub>X</sub>'s. For example, <figref idref="DRAWINGS">FIGS. 16(<i>e</i>)-(<i>f</i>)</figref> show υ (and its contours) for various (m<sub>x</sub>, σ<sub>x</sub>). As described in this disclosure, the test score based on μ<sub>B</sub><sub><sub2>x </sub2></sub>for various (m<sub>x</sub>, σ<sub>x</sub>) is determined as depicted in <figref idref="DRAWINGS">FIG. 16(<i>g</i>)</figref>. As described in this disclosure, the probability measure of A<sub>y </sub>(denoted as ω) is determined for various υ's or px's. For example, as depicted in <figref idref="DRAWINGS">FIGS. 16(<i>h</i>)-(<i>i</i>)</figref>, ω contours are shown for various values of (m<sub>x</sub>, σ<sub>x</sub>). As described in this disclosure, the maximum μ<sub>Bx </sub>per ω (bin) is determined, for example as depicted in <figref idref="DRAWINGS">FIG. 16(<i>j</i>)</figref>. In one embodiment, μ<sub>B</sub><sub>y </sub>is determined as described in this disclosure, and is depicted in <figref idref="DRAWINGS">FIG. 16(<i>k</i>)</figref>. In one embodiment, comparison of the resulting μ<sub>B</sub><sub><sub2>y </sub2></sub>to the model database indicates that B<sub>y </sub>maps to more or less seldom. In one embodiment, the answer to q<sub>6 </sub>is provided as: More or less seldom, the number of people showing up for an outdoor swimming pool event, is quite significantly less than 80.
q7: What are the Odds that the Weather is Hot?
In one embodiment, the answer is in a Z-valuation Y, A<sub>y</sub>, B<sub>y</sub>) form, where Y is temperature (same as X, i.e., Y=F(X)=X), q<sub>6 </sub>provides A<sub>y </sub>as hot, as for example depicted in <figref idref="DRAWINGS">FIG. 17(<i>a</i>)</figref>. As described in this disclosure, in one embodiment, the probability measure of A<sub>y </sub>is determined (e.g., see <figref idref="DRAWINGS">FIG. 17(<i>b</i>)</figref>), and μ<sub>B</sub><sub><sub2>y </sub2></sub>is determined (e.g., see <figref idref="DRAWINGS">FIG. 17(<i>c</i>)</figref>). In one embodiment, this μ<sub>B</sub><sub><sub2>y </sub2></sub>is mapped to usually (or anti-seldom), and the answer is determined as: the weather temperature is usually hot.
q8: What are the Odds that More than About 50 People Show up?
In one embodiment, the answer is in a Z-valuation Y, A<sub>y</sub>, B<sub>y</sub>) form, where Y is again the number of people showing up for an outdoor swimming pool event, and A<sub>y </sub>is more than about 50. In one embodiment, μ<sub>Ay </sub>is determined from q<sub>8</sub>, e.g., by using the model database and fuzzy logic rules for modifiers within the context and domain of Y, for example, as depicted in FIG. <figref idref="DRAWINGS">FIG. 18(<i>a</i>)</figref>. In one embodiment, μ<sub>Ay </sub>is determined to be a step-up membership function with a ramp from 40 to 50 (delta=10), as depicted from <figref idref="DRAWINGS">FIG. 18(<i>b</i>)</figref>. Similar to above, B<sub>y </sub>is determined, as for example depicted in <figref idref="DRAWINGS">FIG. 18(<i>c</i>)</figref>. Then, in one embodiment, the answer becomes: Almost certainly, the number of people showing up for an outdoor swimming pool event, is more than about 50. Or the odds of the number of people showing up for an outdoor swimming pool event, being more than about 50 is more than about 95%.
q9: What are the Odds that More than About 65 People Show Up?
In one embodiment, similarly to above, μ<sub>Ay </sub>is determined to be a step up membership function with a ramp from 55 to 65, as depicted in <figref idref="DRAWINGS">FIG. 19(<i>a</i>)</figref>. Similarly, B<sub>y</sub>is determined, as for example depicted in <figref idref="DRAWINGS">FIG. 19(<i>b</i>)</figref>. Then, in one embodiment, the answer becomes: Usually, the number of people showing up for an outdoor swimming pool event, is more than about 65. Or the odds of the number of people showing up for an outdoor swimming pool event, being more than about 65 is more than about 5%.
q10: What are the Odds that About 30 People Show Up?
In one embodiment, similarly to above, μ<sub>Ay </sub>is determined to be a triangular membership function with a base from ramp from 20 to 40, as depicted in <figref idref="DRAWINGS">FIG. 20(<i>a</i>)</figref>. Similarly, B<sub>y </sub>is determined, as for example depicted in <figref idref="DRAWINGS">FIG. 20(<i>b</i>)</figref>. Then, in one embodiment, the answer becomes: The number of people showing up for an outdoor swimming pool event, is almost never about 30.
Confidence Approach on Membership Function:
As mentioned earlier, in the Z-valuation (X, A, B), a restriction on X (e.g., assuming X is a random variable), in one embodiment, is imposed via a restriction on its probability distribution p<sub>X</sub>, to the degree that the probability measure of A, defined as
<maths id="MATH-US-00057" num="00057"><math overflow="scroll"><mrow><mrow><mi>p</mi><mo>=</mo><mrow><munder><mo>∫</mo><mi>R</mi></munder><mo></mo><mrow><mrow><msub><mi>μ</mi><mi>A</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>p</mi><mi>X</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>d</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>u</mi></mrow></mrow></mrow><mo>,</mo></mrow></math></maths><img file="US2022121884A1_D12769.tif" /><img file="US2022121884A1_D12770.tif" /><img file="US2022121884A1_D12771.tif" /><img file="US2022121884A1_D12772.tif" /><img file="US2022121884A1_D12773.tif" /><img file="US2022121884A1_D12774.tif" /><img file="US2022121884A1_D12775.tif" /><img file="US2022121884A1_D12776.tif" /><img file="US2022121884A1_D12777.tif" /><img file="US2022121884A1_D12778.tif" /><img file="US2022121884A1_D12779.tif" /><img file="US2022121884A1_D12780.tif" /><img file="US2022121884A1_D12781.tif" /><img file="US2022121884A1_D12782.tif" /><img file="US2022121884A1_D12783.tif" /><img file="US2022121884A1_D12784.tif" /><img file="US2022121884A1_D12785.tif" /><img file="US2022121884A1_D12786.tif" /><img file="US2022121884A1_D12787.tif" /><img file="US2022121884A1_D12788.tif" /><img file="US2022121884A1_D12789.tif" /><img file="US2022121884A1_D12790.tif" /><img file="US2022121884A1_D12791.tif" /><img file="US2022121884A1_D12792.tif" /><img file="US2022121884A1_D12793.tif" /><img file="US2022121884A1_D12794.tif" /><img file="US2022121884A1_D12795.tif" /><img file="US2022121884A1_D12796.tif" /><img file="US2022121884A1_D12797.tif" /><img file="US2022121884A1_D12798.tif" /><img file="US2022121884A1_D12799.tif" /><img file="US2022121884A1_D12800.tif" /><img file="US2022121884A1_D12801.tif" /><img file="US2022121884A1_D12802.tif" /><img file="US2022121884A1_D12803.tif" /><img file="US2022121884A1_D12804.tif" /><img file="US2022121884A1_D12805.tif" /><img file="US2022121884A1_D12806.tif" /><img file="US2022121884A1_D12807.tif" /><img file="US2022121884A1_D12808.tif" /><img file="US2022121884A1_D12809.tif" /><img file="US2022121884A1_D12810.tif" /><img file="US2022121884A1_D12811.tif" /><img file="US2022121884A1_D12812.tif" /><img file="US2022121884A1_D12813.tif" /><img file="US2022121884A1_D12814.tif" /><img file="US2022121884A1_D12815.tif" /><img file="US2022121884A1_D12816.tif" /><img file="US2022121884A1_D12817.tif" /><img file="US2022121884A1_D12818.tif" /><img file="US2022121884A1_D12819.tif" /><img file="US2022121884A1_D12820.tif" /><img file="US2022121884A1_D12821.tif" /><img file="US2022121884A1_D12822.tif" /><img file="US2022121884A1_D12823.tif" /><img file="US2022121884A1_D12824.tif" /><img file="US2022121884A1_D12825.tif" /><img file="US2022121884A1_D12826.tif" /><img file="US2022121884A1_D12827.tif" /><img file="US2022121884A1_D12828.tif" /><img file="US2022121884A1_D12829.tif" /><img file="US2022121884A1_D12830.tif" /><img file="US2022121884A1_D12831.tif" /><img file="US2022121884A1_D12832.tif" /><img file="US2022121884A1_D12833.tif" /><img file="US2022121884A1_D12834.tif" /><img file="US2022121884A1_D12835.tif" /><img file="US2022121884A1_D12836.tif" /><img file="US2022121884A1_D12837.tif" /><img file="US2022121884A1_D12838.tif" /><img file="US2022121884A1_D12839.tif" /><img file="US2022121884A1_D12840.tif" /><img file="US2022121884A1_D12841.tif" /><img file="US2022121884A1_D12842.tif" /><img file="US2022121884A1_D12843.tif" /><img file="US2022121884A1_D12844.tif" /><img file="US2022121884A1_D12845.tif" /><img file="US2022121884A1_D12846.tif" /><img file="US2022121884A1_D12847.tif" /><img file="US2022121884A1_D12848.tif" /><img file="US2022121884A1_D12849.tif" /><img file="US2022121884A1_D12850.tif" /><img file="US2022121884A1_D12851.tif" /><img file="US2022121884A1_D12852.tif" /><img file="US2022121884A1_D12853.tif" /><img file="US2022121884A1_D12854.tif" /><img file="US2022121884A1_D12855.tif" /><img file="US2022121884A1_D12856.tif" /><img file="US2022121884A1_D12857.tif" /><img file="US2022121884A1_D12858.tif" /><img file="US2022121884A1_D12859.tif" /><img file="US2022121884A1_D12860.tif" /><img file="US2022121884A1_D12861.tif" /><img file="US2022121884A1_D12862.tif" /><img file="US2022121884A1_D12863.tif" /><img file="US2022121884A1_D12864.tif" /><img file="US2022121884A1_D12865.tif" /><img file="US2022121884A1_D12866.tif" /><img file="US2022121884A1_D12867.tif" /><img file="US2022121884A1_D12868.tif" /><img file="US2022121884A1_D12869.tif" /><img file="US2022121884A1_D12870.tif" /><img file="US2022121884A1_D12871.tif" /><img file="US2022121884A1_D12872.tif" /><img file="US2022121884A1_D12873.tif" /><img file="US2022121884A1_D12874.tif" /><img file="US2022121884A1_D12875.tif" /><img file="US2022121884A1_D12876.tif" /><img file="US2022121884A1_D12877.tif" /><img file="US2022121884A1_D12878.tif" /><img file="US2022121884A1_D12879.tif" /><img file="US2022121884A1_D12880.tif" />
satisfies the restriction that (Prob(X is A) is B). In such a case, p<sub>X </sub>is the underlying (hidden) probability density of X. In one embodiment, this approach takes a view that such Z-valuation is based on an objective evaluation against the probability distribution p<sub>X</sub>. In the following, we consider the view that 13 does not necessarily impose a restriction on p<sub>X</sub>, but on A itself. For example, B can be viewed as the confidence level on the speaker of the proposition. For example, while there may be absolutely no confidence on the propositions generated out of a random fortune teller machine, some of the propositions themselves may in fact be true or highly probable. In such a case, the confidence level imposed on the propositions have more to do with confidence in the source of the propositions rather than restriction on the probability distributions related to the random variables associated with the content of the propositions. In another example, take the proposition “Fred's height is medium height, but I am not too sure (because I don't recall too well).” In one embodiment, we take such proposition (as a matter of degree) to allow Fred's height to be medium-high or medium low. In essence, the restriction from B, in this approach, is imposed not necessarily on p<sub>X</sub>, but on imprecision of A itself. In one embodiment, this approach provides a method to deal with seemingly conflicting propositions, for example by discounting the confidence levels on such propositions (or, for example, on the speakers of those propositions), as opposed to imposing conflicting restrictions on p<sub>X</sub>.
As shown in <figref idref="DRAWINGS">FIG. 21(<i>a</i>)</figref>, (X is A) is graphically depicted by possibility distribution μ<sub>A</sub>(x). (A, B) in this context allows for possibilities of other membership functions, such as A′ or A″, as depicted in <figref idref="DRAWINGS">FIG. 1(<i>b</i>)</figref>, to various degrees, depending on the confidence level imposed by B. The fuzzy set of such membership functions are denoted as A*. In another words, whereas in (X is A) the membership degree of x is denoted by μ<sub>A</sub>(x), in (A, B), the value of membership function of x is not a singleton, but a fuzzy value itself. The possibility of such membership value is denoted by μ<sub>A</sub>*(x, η). This would indicate the possibility degree that the value of membership function of x be η. In this approach, a single crisp trace indicating membership function of X in <figref idref="DRAWINGS">FIG. 21(<i>a</i>)</figref> turns into a two dimensional fuzzy map in <figref idref="DRAWINGS">FIG. 21(<i>b</i>)</figref>, where a point in (x, η) plane is associated with a membership function μ<sub>A</sub>*(x, η). An example of such map can be visualized in one embodiment, as color (or grayscale graduation) mapping in which high possibility (for membership values) areas (e.g., a pixel or range in (x, η) plane), are associated with (for example) darker color, and low possibility (for membership values) areas are associated with (for example) lighter color. In one extreme where there is no imprecision associated with the proposition (X is A), such map results in a crisp trace, as for example shown in <figref idref="DRAWINGS">FIG. 21(<i>a</i>)</figref>.
In one embodiment, as depicted for example in <figref idref="DRAWINGS">FIG. 22(<i>a</i>)</figref>, the effect of B in (A, B) is to fuzzy the shape of membership function of X in A, primarily by making the sides of the membership function fuzzy (for example, compared to flat high/low portions). For example, such fuzziness is primarily performed laterally in (x, η) plane. In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 22(<i>b</i>)</figref>, (A, B) is presented with a fuzzy map primarily carried out vertically in (x, η) plane. In one embodiment, the map may contain bands of similar color(s) (or grayscale) indicating regions having similar possibility of membership functions of x.
In one embodiment, the possibility map of membership function of x associated with A* may be determined by superimposing all possible membership functions of x with their corresponding membership degree (or test score) in A* on (x, η) plane, for example, by taking the supreme test score (or membership degree in A* ) of such potential membership functions for each point in (x, η) plane.
As depicted in <figref idref="DRAWINGS">FIG. 23</figref>, the cross sections of the fuzzy map in (x, η) plane, for example, at various X values X<sub>1</sub>, X<sub>2</sub>, X<sub>3</sub>, and X<sub>4</sub>, show a membership function for η for each cross section. In general, the shape of membership function of η for each X value, depends on X and B (affecting the degree of fuzziness and imprecision), i.e., the membership function of η for a given X (e.g., X<sub>0</sub>) takes the value of μ<sub>A</sub>*(X<sub>0</sub>, η).
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 24</figref>, the membership function of η, μ<sub>A</sub>*(X<sub>0</sub>, η), for X value of X<sub>0</sub>, revolves around η<sub>0</sub>, which is the value of membership function of X in A at X<sub>0 </sub>(i.e., η<sub>0</sub>=μ<sub>A</sub>(X<sub>0</sub>, η). In one embodiment, the shape of μ<sub>A</sub>*(X<sub>0</sub>, η) depends on B and X<sub>0</sub>. In one embodiment, the shape of μ<sub>A</sub>*(X<sub>0</sub>, η) depends on B and η<sub>0</sub>. In such an embodiment, for two values of X, e.g., X<sub>1 </sub>and X<sub>4 </sub>(for example, as depicted in <figref idref="DRAWINGS">FIG. 23</figref>), where μ<sub>A</sub>(X) is the same for both values, μ<sub>A</sub>*(X<sub>1</sub>, η) and μ<sub>A</sub>*(X<sub>2</sub>, η)also have the same shape. In such an embodiment, μ<sub>A</sub>*(X<sub>0</sub>, η) may be expressed as μ<sub>η0, B</sub>(η), indicating its dependence on B and η<sub>0</sub>.
In one embodiment, as depicted for example in <figref idref="DRAWINGS">FIG. 25</figref>, μ<sub>η0, B</sub>(η) is depicted for various B's and η<sub>0</sub>. For example, at high confidence levels (e.g., Absolute Confidence, B<sub>1</sub>), the membership function of η, μ<sub>η0, B</sub>(η), is narrow (W<sub>η0, B1</sub>) precise function with membership value of 1 at η<sub>0</sub>. In such a case, μ<sub>A</sub>*(X, η) would resemble the crisp trace of μ<sub>A</sub>(X) (as depicted in <figref idref="DRAWINGS">FIG. 21(<i>a</i>)</figref>). At a medium confidence level (e.g., “Somewhat Sure”, B<sub>2</sub>), μ<sub>η0, B</sub>(η) is a membership function of η revolving around η<sub>0</sub>. In one embodiment, the imprecision measure of μ<sub>η0, B</sub>(η), (e.g., W<sub>η0, B2</sub>), is increased by reduction in level of confidence B. For example, when B represent very little or no confidence at all (e.g., “Absolutely No Confidence”, B<sub>3</sub>), there is no confidence on the membership function of X (e.g., at X<sub>0</sub>), and such membership function value η, may take any value (from 0 to 1), yielding flat profile for μ<sub>η0, B</sub>(η). In one embodiment, this fiat profile has value of 1. In one embodiment, this flat profile is independent of η<sub>0</sub>. In one embodiment, reduction in confidence level in B, works to increase the imprecision measure of μ<sub>η0, B</sub>(η), (e.g., W<sub>η0, B3</sub>), to encompass whole range of η. In such a case, the color (or grayscale) map μ<sub>A</sub>*(X, η) would become a block of all (or mostly) black areas, indicating that any membership value is possible for a given values of X. Then in such an embodiment, “X is A, with absolutely no confidence” will put no restriction on X.
In one embodiment, as depicted in <figref idref="DRAWINGS">FIG. 26(<i>a</i>)</figref>, “X is C” is evaluated against (A, B). Membership function of X in C is depicted as thick line (denoted as μ<sub>C</sub>(X)). In one embodiment, the degree in which C is consistent with (or satisfies restriction due) A′ is determined by coverage of μ<sub>A</sub>*(X, η) mapping on C. As an example, at X=X<sub>0</sub>, the membership function of X in C has the value of μ<sub>C</sub>(X<sub>0</sub>). As depicted in <figref idref="DRAWINGS">FIG. 26(<i>b</i>)</figref>, the possibility of such value in μ<sub>A</sub>*(X, η) map is evaluated as μ<sub>A</sub>*(X<sub>0</sub>, μ<sub>C</sub>(X<sub>0</sub>)). In one embodiment, this is the degree in which C satisfies or is consistent with A* at X<sub>0</sub>.
In one embodiment, as depicted in <figref idref="DRAWINGS">FIG. 26(<i>b</i>)</figref>, um(X<sub>0</sub>, uc(X<sub>0</sub>)) is determined by determining the membership function of η for a given X (i.e., X<sub>0</sub>). In one embodiment, the membership function of η, i.e., μ<sub>A</sub>*(X<sub>0</sub>, η) is determined based on μ<sub>A</sub>(X<sub>0</sub>) and B (as for example shown in <figref idref="DRAWINGS">FIGS. 24 and 25</figref>).
In one embodiment, the consistency of “X is C” against (A, B) is evaluated based on the degree in which C satisfies or is consistent with A* at various values of X. In one embodiment, the lowest value of such degree is taken as the degree in which C satisfies (A, B):
<br />μ<sub>A</sub>*(<i>C</i>)=min<sub>Over all x R</sub>(μ<sub>A</sub>*(<i>x, μ</i><sub>C</sub>(<i>x</i>)))
In one embodiment, with μ<sub>A</sub>*( X<sub>0</sub>, η) expressed as μ<sub>η0, B</sub>(η), where η<sub>0 </sub>is μ<sub>A</sub>(X<sub>0</sub>),
<br />μ<sub>A</sub>*(<i>C</i>)=min<sub>Over all x R</sub>(μ<sub>μ</sub><sub><sub2>A</sub2></sub><sub>(x), B</sub>(μ<sub>C</sub>(<i>x</i>)))
In one embodiment, the consistency of “X is C” against (A, B) is evaluated based on the degree in which C overall satisfies or is consistent with A* by taking an average or a weighted average of the consistency of C with A* over all X:
<maths id="MATH-US-00058" num="00058"><math overflow="scroll"><mrow><mrow><msub><mi>μ</mi><mi>A</mi></msub><mo>·</mo><mrow><mo>(</mo><mi>C</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mfrac><mn>1</mn><mi>N</mi></mfrac><mo></mo><mrow><munder><mo>∫</mo><mrow><mi>Over</mi><mo></mo><mstyle><mspace width="0.6em" height="0.6ex" /></mstyle><mo></mo><mi>all</mi><mo></mo><mstyle><mspace width="0.6em" height="0.6ex" /></mstyle><mo></mo><mi>x</mi><mo></mo><mstyle><mspace width="0.6em" height="0.6ex" /></mstyle><mo></mo><mi>in</mi><mo></mo><mstyle><mspace width="0.6em" height="0.6ex" /></mstyle><mo></mo><mi>R</mi></mrow></munder><mo></mo><mrow><mrow><msub><mi>μ</mi><mi>A</mi></msub><mo>·</mo><mrow><mo>(</mo><mrow><mi>x</mi><mo>,</mo><mrow><msub><mi>μ</mi><mi>C</mi></msub><mo></mo><mrow><mo>(</mo><mi>x</mi><mo>)</mo></mrow></mrow></mrow><mo>)</mo></mrow><mo>·</mo><mrow><mi>W</mi><mo></mo><mrow><mo>(</mo><mi>x</mi><mo>)</mo></mrow></mrow><mo>·</mo><mi>d</mi></mrow><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>x</mi></mrow></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D12881.tif" /><img file="US2022121884A1_D12882.tif" /><img file="US2022121884A1_D12883.tif" /><img file="US2022121884A1_D12884.tif" /><img file="US2022121884A1_D12885.tif" /><img file="US2022121884A1_D12886.tif" /><img file="US2022121884A1_D12887.tif" /><img file="US2022121884A1_D12888.tif" /><img file="US2022121884A1_D12889.tif" /><img file="US2022121884A1_D12890.tif" /><img file="US2022121884A1_D12891.tif" /><img file="US2022121884A1_D12892.tif" /><img file="US2022121884A1_D12893.tif" /><img file="US2022121884A1_D12894.tif" /><img file="US2022121884A1_D12895.tif" /><img file="US2022121884A1_D12896.tif" /><img file="US2022121884A1_D12897.tif" /><img file="US2022121884A1_D12898.tif" /><img file="US2022121884A1_D12899.tif" /><img file="US2022121884A1_D12900.tif" /><img file="US2022121884A1_D12901.tif" /><img file="US2022121884A1_D12902.tif" /><img file="US2022121884A1_D12903.tif" /><img file="US2022121884A1_D12904.tif" /><img file="US2022121884A1_D12905.tif" /><img file="US2022121884A1_D12906.tif" /><img file="US2022121884A1_D12907.tif" /><img file="US2022121884A1_D12908.tif" /><img file="US2022121884A1_D12909.tif" /><img file="US2022121884A1_D12910.tif" /><img file="US2022121884A1_D12911.tif" /><img file="US2022121884A1_D12912.tif" /><img file="US2022121884A1_D12913.tif" /><img file="US2022121884A1_D12914.tif" /><img file="US2022121884A1_D12915.tif" /><img file="US2022121884A1_D12916.tif" /><img file="US2022121884A1_D12917.tif" /><img file="US2022121884A1_D12918.tif" /><img file="US2022121884A1_D12919.tif" /><img file="US2022121884A1_D12920.tif" /><img file="US2022121884A1_D12921.tif" /><img file="US2022121884A1_D12922.tif" /><img file="US2022121884A1_D12923.tif" /><img file="US2022121884A1_D12924.tif" /><img file="US2022121884A1_D12925.tif" /><img file="US2022121884A1_D12926.tif" /><img file="US2022121884A1_D12927.tif" /><img file="US2022121884A1_D12928.tif" /><img file="US2022121884A1_D12929.tif" /><img file="US2022121884A1_D12930.tif" /><img file="US2022121884A1_D12931.tif" /><img file="US2022121884A1_D12932.tif" /><img file="US2022121884A1_D12933.tif" /><img file="US2022121884A1_D12934.tif" /><img file="US2022121884A1_D12935.tif" /><img file="US2022121884A1_D12936.tif" /><img file="US2022121884A1_D12937.tif" /><img file="US2022121884A1_D12938.tif" /><img file="US2022121884A1_D12939.tif" /><img file="US2022121884A1_D12940.tif" /><img file="US2022121884A1_D12941.tif" /><img file="US2022121884A1_D12942.tif" /><img file="US2022121884A1_D12943.tif" /><img file="US2022121884A1_D12944.tif" /><img file="US2022121884A1_D12945.tif" /><img file="US2022121884A1_D12946.tif" /><img file="US2022121884A1_D12947.tif" /><img file="US2022121884A1_D12948.tif" /><img file="US2022121884A1_D12949.tif" /><img file="US2022121884A1_D12950.tif" /><img file="US2022121884A1_D12951.tif" /><img file="US2022121884A1_D12952.tif" /><img file="US2022121884A1_D12953.tif" /><img file="US2022121884A1_D12954.tif" /><img file="US2022121884A1_D12955.tif" /><img file="US2022121884A1_D12956.tif" /><img file="US2022121884A1_D12957.tif" /><img file="US2022121884A1_D12958.tif" /><img file="US2022121884A1_D12959.tif" /><img file="US2022121884A1_D12960.tif" /><img file="US2022121884A1_D12961.tif" /><img file="US2022121884A1_D12962.tif" /><img file="US2022121884A1_D12963.tif" /><img file="US2022121884A1_D12964.tif" /><img file="US2022121884A1_D12965.tif" /><img file="US2022121884A1_D12966.tif" /><img file="US2022121884A1_D12967.tif" /><img file="US2022121884A1_D12968.tif" /><img file="US2022121884A1_D12969.tif" /><img file="US2022121884A1_D12970.tif" /><img file="US2022121884A1_D12971.tif" /><img file="US2022121884A1_D12972.tif" /><img file="US2022121884A1_D12973.tif" /><img file="US2022121884A1_D12974.tif" /><img file="US2022121884A1_D12975.tif" /><img file="US2022121884A1_D12976.tif" /><img file="US2022121884A1_D12977.tif" /><img file="US2022121884A1_D12978.tif" /><img file="US2022121884A1_D12979.tif" /><img file="US2022121884A1_D12980.tif" /><img file="US2022121884A1_D12981.tif" /><img file="US2022121884A1_D12982.tif" /><img file="US2022121884A1_D12983.tif" /><img file="US2022121884A1_D12984.tif" /><img file="US2022121884A1_D12985.tif" /><img file="US2022121884A1_D12986.tif" /><img file="US2022121884A1_D12987.tif" /><img file="US2022121884A1_D12988.tif" /><img file="US2022121884A1_D12989.tif" /><img file="US2022121884A1_D12990.tif" /><img file="US2022121884A1_D12991.tif" /><img file="US2022121884A1_D12992.tif" />
where N is a normalization factor and W(x) is a weight factor. In one embodiment, W(x) is one for all X. In one embodiment, W(x) is a function of μ<sub>A</sub>(X). In one embodiment, W(x) is high for low or high membership values of μ<sub>A</sub>(X), and it is low for intermediate values of μ<sub>A</sub>(X). The normalization factor is then:
<maths id="MATH-US-00059" num="00059"><math overflow="scroll"><mrow><mi>N</mi><mo>=</mo><mrow><munder><mo>∫</mo><mrow><mi>Over</mi><mo></mo><mstyle><mspace width="0.6em" height="0.6ex" /></mstyle><mo></mo><mi>all</mi><mo></mo><mstyle><mspace width="0.6em" height="0.6ex" /></mstyle><mo></mo><mi>x</mi><mo></mo><mstyle><mspace width="0.6em" height="0.6ex" /></mstyle><mo></mo><mi>in</mi><mo></mo><mstyle><mspace width="0.6em" height="0.6ex" /></mstyle><mo></mo><mi>R</mi></mrow></munder><mo></mo><mrow><mrow><mrow><mi>W</mi><mo></mo><mrow><mo>(</mo><mi>x</mi><mo>)</mo></mrow></mrow><mo>·</mo><mi>d</mi></mrow><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>x</mi></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D12993.tif" /><img file="US2022121884A1_D12994.tif" /><img file="US2022121884A1_D12995.tif" /><img file="US2022121884A1_D12996.tif" /><img file="US2022121884A1_D12997.tif" /><img file="US2022121884A1_D12998.tif" /><img file="US2022121884A1_D12999.tif" /><img file="US2022121884A1_D13000.tif" /><img file="US2022121884A1_D13001.tif" /><img file="US2022121884A1_D13002.tif" /><img file="US2022121884A1_D13003.tif" /><img file="US2022121884A1_D13004.tif" /><img file="US2022121884A1_D13005.tif" /><img file="US2022121884A1_D13006.tif" /><img file="US2022121884A1_D13007.tif" /><img file="US2022121884A1_D13008.tif" /><img file="US2022121884A1_D13009.tif" /><img file="US2022121884A1_D13010.tif" /><img file="US2022121884A1_D13011.tif" /><img file="US2022121884A1_D13012.tif" /><img file="US2022121884A1_D13013.tif" /><img file="US2022121884A1_D13014.tif" /><img file="US2022121884A1_D13015.tif" /><img file="US2022121884A1_D13016.tif" /><img file="US2022121884A1_D13017.tif" /><img file="US2022121884A1_D13018.tif" /><img file="US2022121884A1_D13019.tif" /><img file="US2022121884A1_D13020.tif" /><img file="US2022121884A1_D13021.tif" /><img file="US2022121884A1_D13022.tif" /><img file="US2022121884A1_D13023.tif" /><img file="US2022121884A1_D13024.tif" /><img file="US2022121884A1_D13025.tif" /><img file="US2022121884A1_D13026.tif" /><img file="US2022121884A1_D13027.tif" /><img file="US2022121884A1_D13028.tif" /><img file="US2022121884A1_D13029.tif" /><img file="US2022121884A1_D13030.tif" /><img file="US2022121884A1_D13031.tif" /><img file="US2022121884A1_D13032.tif" /><img file="US2022121884A1_D13033.tif" /><img file="US2022121884A1_D13034.tif" /><img file="US2022121884A1_D13035.tif" /><img file="US2022121884A1_D13036.tif" /><img file="US2022121884A1_D13037.tif" /><img file="US2022121884A1_D13038.tif" /><img file="US2022121884A1_D13039.tif" /><img file="US2022121884A1_D13040.tif" /><img file="US2022121884A1_D13041.tif" /><img file="US2022121884A1_D13042.tif" /><img file="US2022121884A1_D13043.tif" /><img file="US2022121884A1_D13044.tif" /><img file="US2022121884A1_D13045.tif" /><img file="US2022121884A1_D13046.tif" /><img file="US2022121884A1_D13047.tif" /><img file="US2022121884A1_D13048.tif" /><img file="US2022121884A1_D13049.tif" /><img file="US2022121884A1_D13050.tif" /><img file="US2022121884A1_D13051.tif" /><img file="US2022121884A1_D13052.tif" /><img file="US2022121884A1_D13053.tif" /><img file="US2022121884A1_D13054.tif" /><img file="US2022121884A1_D13055.tif" /><img file="US2022121884A1_D13056.tif" /><img file="US2022121884A1_D13057.tif" /><img file="US2022121884A1_D13058.tif" /><img file="US2022121884A1_D13059.tif" /><img file="US2022121884A1_D13060.tif" /><img file="US2022121884A1_D13061.tif" /><img file="US2022121884A1_D13062.tif" /><img file="US2022121884A1_D13063.tif" /><img file="US2022121884A1_D13064.tif" /><img file="US2022121884A1_D13065.tif" /><img file="US2022121884A1_D13066.tif" /><img file="US2022121884A1_D13067.tif" /><img file="US2022121884A1_D13068.tif" /><img file="US2022121884A1_D13069.tif" /><img file="US2022121884A1_D13070.tif" /><img file="US2022121884A1_D13071.tif" /><img file="US2022121884A1_D13072.tif" /><img file="US2022121884A1_D13073.tif" /><img file="US2022121884A1_D13074.tif" /><img file="US2022121884A1_D13075.tif" /><img file="US2022121884A1_D13076.tif" /><img file="US2022121884A1_D13077.tif" /><img file="US2022121884A1_D13078.tif" /><img file="US2022121884A1_D13079.tif" /><img file="US2022121884A1_D13080.tif" /><img file="US2022121884A1_D13081.tif" /><img file="US2022121884A1_D13082.tif" /><img file="US2022121884A1_D13083.tif" /><img file="US2022121884A1_D13084.tif" /><img file="US2022121884A1_D13085.tif" /><img file="US2022121884A1_D13086.tif" /><img file="US2022121884A1_D13087.tif" /><img file="US2022121884A1_D13088.tif" /><img file="US2022121884A1_D13089.tif" /><img file="US2022121884A1_D13090.tif" /><img file="US2022121884A1_D13091.tif" /><img file="US2022121884A1_D13092.tif" /><img file="US2022121884A1_D13093.tif" /><img file="US2022121884A1_D13094.tif" /><img file="US2022121884A1_D13095.tif" /><img file="US2022121884A1_D13096.tif" /><img file="US2022121884A1_D13097.tif" /><img file="US2022121884A1_D13098.tif" /><img file="US2022121884A1_D13099.tif" /><img file="US2022121884A1_D13100.tif" /><img file="US2022121884A1_D13101.tif" /><img file="US2022121884A1_D13102.tif" /><img file="US2022121884A1_D13103.tif" /><img file="US2022121884A1_D13104.tif" />
The above relationships may be expressed in sigma form instead of integral if X is a discrete type variable.
In one embodiment, as depicted in <figref idref="DRAWINGS">FIG. 27</figref>, two or more propositions are given, such as (A<sub>x</sub>, B<sub>x</sub>) and (A<sub>y</sub>, B<sub>y</sub>). A shorthand presentation of those propositions would be “X is A<sub>x</sub>” and “Y is A<sub>y</sub>* ”, respectively, Given, a functional relation, such as Z=f(X, Y), in one embodiment, a fuzzy membership function for Z is determined, as depicted for example in <figref idref="DRAWINGS">FIG. 27</figref>. In one embodiment, as depicted in <figref idref="DRAWINGS">FIG. 28(<i>a</i>)</figref>, fuzzy set A<sub>x</sub>* has one or more possible membership functions in X, e.g., A′<sub>x</sub>, A″<sub>x</sub>, and A′″<sub>x</sub>, and fuzzy set A<sub>y</sub>* has one or more possible membership functions in Y, e.g., A′<sub>y</sub>, A″<sub>y</sub>, and A′″<sub>y</sub>. In general, applying the functional relationship f(X,Y), a possible membership function in Z may be obtained for each pair of membership functions in X and Y (e.g., A″<sub>x</sub>, and A″<sub>y</sub>). In one embodiment, the test score associated with the resulting membership function in Z (e.g., A″<sub>z</sub>) is associated with the scores or membership values of A″<sub>x </sub>and A″<sub>y </sub>in A<sub>x </sub>* and A<sub>y</sub>* , respectively:
<br /><i>ts</i>(<i>A″</i><sub>Z</sub>)=μ<sub>A</sub><sub><sub2>X</sub2></sub>*(<i>A″</i><sub>X</sub>){circumflex over ( )}μ<sub>A</sub><sub><sub2>y</sub2></sub>*(<i>A″</i><sub>Y</sub>)
In one embodiment, multiple pairs of membership functions in X and Y may map to the same membership function in Z. For example as depicted in <figref idref="DRAWINGS">FIG. 28(<i>a</i>)</figref>, (A′<sub>x </sub>and A′<sub>y</sub>) and (A′″<sub>x </sub>and A′″<sub>y</sub>) map to A′<sub>z</sub>. In such an embodiment, the test score may be determined by:
<maths id="MATH-US-00060" num="00060"><math overflow="scroll"><mrow><mrow><mi>ts</mi><mo></mo><mrow><mo>(</mo><msubsup><mi>A</mi><mi>Z</mi><mi>′</mi></msubsup><mo>)</mo></mrow></mrow><mo>=</mo><mrow><munder><mi>sup</mi><mrow><mrow><mo>∀</mo><msubsup><mi>A</mi><mi>X</mi><mi>′</mi></msubsup></mrow><mo>,</mo><msubsup><mi>A</mi><mi>Y</mi><mi>′</mi></msubsup></mrow></munder><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><mrow><msub><mi>μ</mi><msubsup><mi>A</mi><mi>X</mi><mo>*</mo></msubsup></msub><mo></mo><mrow><mo>(</mo><msubsup><mi>A</mi><mi>X</mi><mi>′</mi></msubsup><mo>)</mo></mrow></mrow><mo>⋀</mo><mrow><msub><mi>μ</mi><msubsup><mi>A</mi><mi>Y</mi><mo>*</mo></msubsup></msub><mo></mo><mrow><mo>(</mo><msubsup><mi>A</mi><mi>Y</mi><mi>′</mi></msubsup><mo>)</mo></mrow></mrow></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D13105.tif" /><img file="US2022121884A1_D13106.tif" /><img file="US2022121884A1_D13107.tif" /><img file="US2022121884A1_D13108.tif" /><img file="US2022121884A1_D13109.tif" /><img file="US2022121884A1_D13110.tif" /><img file="US2022121884A1_D13111.tif" /><img file="US2022121884A1_D13112.tif" /><img file="US2022121884A1_D13113.tif" /><img file="US2022121884A1_D13114.tif" /><img file="US2022121884A1_D13115.tif" /><img file="US2022121884A1_D13116.tif" /><img file="US2022121884A1_D13117.tif" /><img file="US2022121884A1_D13118.tif" /><img file="US2022121884A1_D13119.tif" /><img file="US2022121884A1_D13120.tif" /><img file="US2022121884A1_D13121.tif" /><img file="US2022121884A1_D13122.tif" /><img file="US2022121884A1_D13123.tif" /><img file="US2022121884A1_D13124.tif" /><img file="US2022121884A1_D13125.tif" /><img file="US2022121884A1_D13126.tif" /><img file="US2022121884A1_D13127.tif" /><img file="US2022121884A1_D13128.tif" /><img file="US2022121884A1_D13129.tif" /><img file="US2022121884A1_D13130.tif" /><img file="US2022121884A1_D13131.tif" /><img file="US2022121884A1_D13132.tif" /><img file="US2022121884A1_D13133.tif" /><img file="US2022121884A1_D13134.tif" /><img file="US2022121884A1_D13135.tif" /><img file="US2022121884A1_D13136.tif" /><img file="US2022121884A1_D13137.tif" /><img file="US2022121884A1_D13138.tif" /><img file="US2022121884A1_D13139.tif" /><img file="US2022121884A1_D13140.tif" /><img file="US2022121884A1_D13141.tif" /><img file="US2022121884A1_D13142.tif" /><img file="US2022121884A1_D13143.tif" /><img file="US2022121884A1_D13144.tif" /><img file="US2022121884A1_D13145.tif" /><img file="US2022121884A1_D13146.tif" /><img file="US2022121884A1_D13147.tif" /><img file="US2022121884A1_D13148.tif" /><img file="US2022121884A1_D13149.tif" /><img file="US2022121884A1_D13150.tif" /><img file="US2022121884A1_D13151.tif" /><img file="US2022121884A1_D13152.tif" /><img file="US2022121884A1_D13153.tif" /><img file="US2022121884A1_D13154.tif" /><img file="US2022121884A1_D13155.tif" /><img file="US2022121884A1_D13156.tif" /><img file="US2022121884A1_D13157.tif" /><img file="US2022121884A1_D13158.tif" /><img file="US2022121884A1_D13159.tif" /><img file="US2022121884A1_D13160.tif" /><img file="US2022121884A1_D13161.tif" /><img file="US2022121884A1_D13162.tif" /><img file="US2022121884A1_D13163.tif" /><img file="US2022121884A1_D13164.tif" /><img file="US2022121884A1_D13165.tif" /><img file="US2022121884A1_D13166.tif" /><img file="US2022121884A1_D13167.tif" /><img file="US2022121884A1_D13168.tif" /><img file="US2022121884A1_D13169.tif" /><img file="US2022121884A1_D13170.tif" /><img file="US2022121884A1_D13171.tif" /><img file="US2022121884A1_D13172.tif" /><img file="US2022121884A1_D13173.tif" /><img file="US2022121884A1_D13174.tif" /><img file="US2022121884A1_D13175.tif" /><img file="US2022121884A1_D13176.tif" /><img file="US2022121884A1_D13177.tif" /><img file="US2022121884A1_D13178.tif" /><img file="US2022121884A1_D13179.tif" /><img file="US2022121884A1_D13180.tif" /><img file="US2022121884A1_D13181.tif" /><img file="US2022121884A1_D13182.tif" /><img file="US2022121884A1_D13183.tif" /><img file="US2022121884A1_D13184.tif" /><img file="US2022121884A1_D13185.tif" /><img file="US2022121884A1_D13186.tif" /><img file="US2022121884A1_D13187.tif" /><img file="US2022121884A1_D13188.tif" /><img file="US2022121884A1_D13189.tif" /><img file="US2022121884A1_D13190.tif" /><img file="US2022121884A1_D13191.tif" /><img file="US2022121884A1_D13192.tif" /><img file="US2022121884A1_D13193.tif" /><img file="US2022121884A1_D13194.tif" /><img file="US2022121884A1_D13195.tif" /><img file="US2022121884A1_D13196.tif" /><img file="US2022121884A1_D13197.tif" /><img file="US2022121884A1_D13198.tif" /><img file="US2022121884A1_D13199.tif" /><img file="US2022121884A1_D13200.tif" /><img file="US2022121884A1_D13201.tif" /><img file="US2022121884A1_D13202.tif" /><img file="US2022121884A1_D13203.tif" /><img file="US2022121884A1_D13204.tif" /><img file="US2022121884A1_D13205.tif" /><img file="US2022121884A1_D13206.tif" /><img file="US2022121884A1_D13207.tif" /><img file="US2022121884A1_D13208.tif" /><img file="US2022121884A1_D13209.tif" /><img file="US2022121884A1_D13210.tif" /><img file="US2022121884A1_D13211.tif" /><img file="US2022121884A1_D13212.tif" /><img file="US2022121884A1_D13213.tif" /><img file="US2022121884A1_D13214.tif" /><img file="US2022121884A1_D13215.tif" /><img file="US2022121884A1_D13216.tif" />
subject to the possibility distribution of X and Y being A′<sub>x </sub>and A′<sub>y</sub>, respectively, and Z=f(X,Y), map to a possibility distribution of Z as A′<sub>z</sub>.
Therefore, in an embodiment, possible membership functions of X and Y, belonging to fuzzy sets A<sub>x</sub>* and A<sub>y</sub>*, are used to determine the corresponding membership functions of Z, with their degrees of membership in A<sub>z</sub>* determined via extension principle (from the degrees of membership of the possible membership functions of X and Y in fuzzy sets A<sub>x</sub>* and A<sub>y</sub>*, respectively).
In one embodiment, the set of resulting membership functions of Z (e.g., A′<sub>z</sub>) with their corresponding test score (e.g., ts(A′<sub>z</sub>)) are used to setup a fuzzy map (A<sub>z</sub>*) describing the membership function of Z:
<maths id="MATH-US-00061" num="00061"><math overflow="scroll"><mrow><mrow><msub><mi>μ</mi><msubsup><mi>A</mi><mi>Z</mi><mo>*</mo></msubsup></msub><mo></mo><mrow><mo>(</mo><mrow><mi>z</mi><mo>,</mo><mi>η</mi></mrow><mo>)</mo></mrow></mrow><mo>=</mo><mrow><munder><mi>sup</mi><mrow><mo>∀</mo><msubsup><mi>A</mi><mi>Z</mi><mi>′</mi></msubsup></mrow></munder><mo></mo><mrow><mo>(</mo><mrow><mi>ts</mi><mo></mo><mrow><mo>(</mo><msubsup><mi>A</mi><mi>Z</mi><mi>′</mi></msubsup><mo>)</mo></mrow></mrow><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D13217.tif" /><img file="US2022121884A1_D13218.tif" /><img file="US2022121884A1_D13219.tif" /><img file="US2022121884A1_D13220.tif" /><img file="US2022121884A1_D13221.tif" /><img file="US2022121884A1_D13222.tif" /><img file="US2022121884A1_D13223.tif" /><img file="US2022121884A1_D13224.tif" /><img file="US2022121884A1_D13225.tif" /><img file="US2022121884A1_D13226.tif" /><img file="US2022121884A1_D13227.tif" /><img file="US2022121884A1_D13228.tif" /><img file="US2022121884A1_D13229.tif" /><img file="US2022121884A1_D13230.tif" /><img file="US2022121884A1_D13231.tif" /><img file="US2022121884A1_D13232.tif" /><img file="US2022121884A1_D13233.tif" /><img file="US2022121884A1_D13234.tif" /><img file="US2022121884A1_D13235.tif" /><img file="US2022121884A1_D13236.tif" /><img file="US2022121884A1_D13237.tif" /><img file="US2022121884A1_D13238.tif" /><img file="US2022121884A1_D13239.tif" /><img file="US2022121884A1_D13240.tif" /><img file="US2022121884A1_D13241.tif" /><img file="US2022121884A1_D13242.tif" /><img file="US2022121884A1_D13243.tif" /><img file="US2022121884A1_D13244.tif" /><img file="US2022121884A1_D13245.tif" /><img file="US2022121884A1_D13246.tif" /><img file="US2022121884A1_D13247.tif" /><img file="US2022121884A1_D13248.tif" /><img file="US2022121884A1_D13249.tif" /><img file="US2022121884A1_D13250.tif" /><img file="US2022121884A1_D13251.tif" /><img file="US2022121884A1_D13252.tif" /><img file="US2022121884A1_D13253.tif" /><img file="US2022121884A1_D13254.tif" /><img file="US2022121884A1_D13255.tif" /><img file="US2022121884A1_D13256.tif" /><img file="US2022121884A1_D13257.tif" /><img file="US2022121884A1_D13258.tif" /><img file="US2022121884A1_D13259.tif" /><img file="US2022121884A1_D13260.tif" /><img file="US2022121884A1_D13261.tif" /><img file="US2022121884A1_D13262.tif" /><img file="US2022121884A1_D13263.tif" /><img file="US2022121884A1_D13264.tif" /><img file="US2022121884A1_D13265.tif" /><img file="US2022121884A1_D13266.tif" /><img file="US2022121884A1_D13267.tif" /><img file="US2022121884A1_D13268.tif" /><img file="US2022121884A1_D13269.tif" /><img file="US2022121884A1_D13270.tif" /><img file="US2022121884A1_D13271.tif" /><img file="US2022121884A1_D13272.tif" /><img file="US2022121884A1_D13273.tif" /><img file="US2022121884A1_D13274.tif" /><img file="US2022121884A1_D13275.tif" /><img file="US2022121884A1_D13276.tif" /><img file="US2022121884A1_D13277.tif" /><img file="US2022121884A1_D13278.tif" /><img file="US2022121884A1_D13279.tif" /><img file="US2022121884A1_D13280.tif" /><img file="US2022121884A1_D13281.tif" /><img file="US2022121884A1_D13282.tif" /><img file="US2022121884A1_D13283.tif" /><img file="US2022121884A1_D13284.tif" /><img file="US2022121884A1_D13285.tif" /><img file="US2022121884A1_D13286.tif" /><img file="US2022121884A1_D13287.tif" /><img file="US2022121884A1_D13288.tif" /><img file="US2022121884A1_D13289.tif" /><img file="US2022121884A1_D13290.tif" /><img file="US2022121884A1_D13291.tif" /><img file="US2022121884A1_D13292.tif" /><img file="US2022121884A1_D13293.tif" /><img file="US2022121884A1_D13294.tif" /><img file="US2022121884A1_D13295.tif" /><img file="US2022121884A1_D13296.tif" /><img file="US2022121884A1_D13297.tif" /><img file="US2022121884A1_D13298.tif" /><img file="US2022121884A1_D13299.tif" /><img file="US2022121884A1_D13300.tif" /><img file="US2022121884A1_D13301.tif" /><img file="US2022121884A1_D13302.tif" /><img file="US2022121884A1_D13303.tif" /><img file="US2022121884A1_D13304.tif" /><img file="US2022121884A1_D13305.tif" /><img file="US2022121884A1_D13306.tif" /><img file="US2022121884A1_D13307.tif" /><img file="US2022121884A1_D13308.tif" /><img file="US2022121884A1_D13309.tif" /><img file="US2022121884A1_D13310.tif" /><img file="US2022121884A1_D13311.tif" /><img file="US2022121884A1_D13312.tif" /><img file="US2022121884A1_D13313.tif" /><img file="US2022121884A1_D13314.tif" /><img file="US2022121884A1_D13315.tif" /><img file="US2022121884A1_D13316.tif" /><img file="US2022121884A1_D13317.tif" /><img file="US2022121884A1_D13318.tif" /><img file="US2022121884A1_D13319.tif" /><img file="US2022121884A1_D13320.tif" /><img file="US2022121884A1_D13321.tif" /><img file="US2022121884A1_D13322.tif" /><img file="US2022121884A1_D13323.tif" /><img file="US2022121884A1_D13324.tif" /><img file="US2022121884A1_D13325.tif" /><img file="US2022121884A1_D13326.tif" /><img file="US2022121884A1_D13327.tif" /><img file="US2022121884A1_D13328.tif" /><maths id="MATH-US-00061-2" num="00061.2"><math overflow="scroll"><mrow><mrow><mi>subject</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>to</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>η</mi></mrow><mo>=</mo><mrow><msub><mi>μ</mi><msubsup><mi>A</mi><mi>Z</mi><mi>′</mi></msubsup></msub><mo></mo><mrow><mo>(</mo><mi>z</mi><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D13329.tif" /><img file="US2022121884A1_D13330.tif" /><img file="US2022121884A1_D13331.tif" /><img file="US2022121884A1_D13332.tif" /><img file="US2022121884A1_D13333.tif" /><img file="US2022121884A1_D13334.tif" /><img file="US2022121884A1_D13335.tif" /><img file="US2022121884A1_D13336.tif" /><img file="US2022121884A1_D13337.tif" /><img file="US2022121884A1_D13338.tif" /><img file="US2022121884A1_D13339.tif" /><img file="US2022121884A1_D13340.tif" /><img file="US2022121884A1_D13341.tif" /><img file="US2022121884A1_D13342.tif" /><img file="US2022121884A1_D13343.tif" /><img file="US2022121884A1_D13344.tif" /><img file="US2022121884A1_D13345.tif" /><img file="US2022121884A1_D13346.tif" /><img file="US2022121884A1_D13347.tif" /><img file="US2022121884A1_D13348.tif" /><img file="US2022121884A1_D13349.tif" /><img file="US2022121884A1_D13350.tif" /><img file="US2022121884A1_D13351.tif" /><img file="US2022121884A1_D13352.tif" /><img file="US2022121884A1_D13353.tif" /><img file="US2022121884A1_D13354.tif" /><img file="US2022121884A1_D13355.tif" /><img file="US2022121884A1_D13356.tif" /><img file="US2022121884A1_D13357.tif" /><img file="US2022121884A1_D13358.tif" /><img file="US2022121884A1_D13359.tif" /><img file="US2022121884A1_D13360.tif" /><img file="US2022121884A1_D13361.tif" /><img file="US2022121884A1_D13362.tif" /><img file="US2022121884A1_D13363.tif" /><img file="US2022121884A1_D13364.tif" /><img file="US2022121884A1_D13365.tif" /><img file="US2022121884A1_D13366.tif" /><img file="US2022121884A1_D13367.tif" /><img file="US2022121884A1_D13368.tif" /><img file="US2022121884A1_D13369.tif" /><img file="US2022121884A1_D13370.tif" /><img file="US2022121884A1_D13371.tif" /><img file="US2022121884A1_D13372.tif" /><img file="US2022121884A1_D13373.tif" /><img file="US2022121884A1_D13374.tif" /><img file="US2022121884A1_D13375.tif" /><img file="US2022121884A1_D13376.tif" /><img file="US2022121884A1_D13377.tif" /><img file="US2022121884A1_D13378.tif" /><img file="US2022121884A1_D13379.tif" /><img file="US2022121884A1_D13380.tif" /><img file="US2022121884A1_D13381.tif" /><img file="US2022121884A1_D13382.tif" /><img file="US2022121884A1_D13383.tif" /><img file="US2022121884A1_D13384.tif" /><img file="US2022121884A1_D13385.tif" /><img file="US2022121884A1_D13386.tif" /><img file="US2022121884A1_D13387.tif" /><img file="US2022121884A1_D13388.tif" /><img file="US2022121884A1_D13389.tif" /><img file="US2022121884A1_D13390.tif" /><img file="US2022121884A1_D13391.tif" /><img file="US2022121884A1_D13392.tif" /><img file="US2022121884A1_D13393.tif" /><img file="US2022121884A1_D13394.tif" /><img file="US2022121884A1_D13395.tif" /><img file="US2022121884A1_D13396.tif" /><img file="US2022121884A1_D13397.tif" /><img file="US2022121884A1_D13398.tif" /><img file="US2022121884A1_D13399.tif" /><img file="US2022121884A1_D13400.tif" /><img file="US2022121884A1_D13401.tif" /><img file="US2022121884A1_D13402.tif" /><img file="US2022121884A1_D13403.tif" /><img file="US2022121884A1_D13404.tif" /><img file="US2022121884A1_D13405.tif" /><img file="US2022121884A1_D13406.tif" /><img file="US2022121884A1_D13407.tif" /><img file="US2022121884A1_D13408.tif" /><img file="US2022121884A1_D13409.tif" /><img file="US2022121884A1_D13410.tif" /><img file="US2022121884A1_D13411.tif" /><img file="US2022121884A1_D13412.tif" /><img file="US2022121884A1_D13413.tif" /><img file="US2022121884A1_D13414.tif" /><img file="US2022121884A1_D13415.tif" /><img file="US2022121884A1_D13416.tif" /><img file="US2022121884A1_D13417.tif" /><img file="US2022121884A1_D13418.tif" /><img file="US2022121884A1_D13419.tif" /><img file="US2022121884A1_D13420.tif" /><img file="US2022121884A1_D13421.tif" /><img file="US2022121884A1_D13422.tif" /><img file="US2022121884A1_D13423.tif" /><img file="US2022121884A1_D13424.tif" /><img file="US2022121884A1_D13425.tif" /><img file="US2022121884A1_D13426.tif" /><img file="US2022121884A1_D13427.tif" /><img file="US2022121884A1_D13428.tif" /><img file="US2022121884A1_D13429.tif" /><img file="US2022121884A1_D13430.tif" /><img file="US2022121884A1_D13431.tif" /><img file="US2022121884A1_D13432.tif" /><img file="US2022121884A1_D13433.tif" /><img file="US2022121884A1_D13434.tif" /><img file="US2022121884A1_D13435.tif" /><img file="US2022121884A1_D13436.tif" /><img file="US2022121884A1_D13437.tif" /><img file="US2022121884A1_D13438.tif" /><img file="US2022121884A1_D13439.tif" /><img file="US2022121884A1_D13440.tif" />
In another words, in one embodiment, for all possible A′<sub>z</sub>, passing through point (z, η), the maximum corresponding test score is used to assign the fuzzy membership value of A<sub>z </sub>* for that point. In one embodiment 4′<sub>x</sub>, and A′<sub>y </sub>candidates are iteratively used to determine the corresponding A′<sub>z</sub>. Then, a corresponding test score for A′<sub>z </sub>is determined based on membership values of A′<sub>x </sub>and A′<sub>y </sub>candidates in A<sub>x </sub>* and A<sub>y </sub>* respectively. To drive the mapping A<sub>z</sub>*, in one embodiment, (z, η) plane is granulized into segments (e.g., pixels or granules). In one embodiment, as depicted in <figref idref="DRAWINGS">FIG. 28(<i>b</i>)</figref>, each granularized segment of (z, η) plane is represented by a point (z<sub>g</sub>, <b>72</b><sub>g</sub>), for example, a corner or a midpoint of the granularized segment. Then, μ<sub>A′z </sub>is evaluated at various granularized segments (e.g., by evaluating it at the representative point z<sub>g</sub>, and determining η<sub>g </sub>as the granular containing μ<sub>A′z</sub>(z<sub>g</sub>), and assigning ts(A′<sub>z</sub>) to μ<sub>Az</sub>*(z<sub>g</sub>, η<sub>g</sub>) if ts(A′<sub>z</sub>) larger than the current value of μ<sub>Az</sub>*(z<sub>g</sub>, η<sub>g</sub>). In one embodiment, at the conclusion of the iteration, μ<sub>Az</sub>*(z<sub>g</sub>, η<sub>g</sub>) estimates μ<sub>Az</sub>*(z, η). In one embodiment, A′<sub>z </sub>is presented by a discrete set of points or ranges in (z, η) (as for example depicted in <figref idref="DRAWINGS">FIG. 28(<i>b</i>)</figref> by circles on A′<sub>z </sub>trace) and for each point/ranges, the corresponding (z<sub>g</sub>, η<sub>g</sub>) granular is determined, and the test score contribution is imported, e.g., if larger than (z<sub>g</sub>, η<sub>g</sub>) granular's current test score. In one embodiment, various size pixel or granular (e.g., both big and fine pixels) are used to monitor and evaluate the limits on iterations through candidate A′<sub>z</sub>. In one embodiment, test scores are used as color (gray) scale assignment to each pixel/granular overriding a lower assigned test score to the granular.
In one embodiment, instead of taking the approach from candidate membership functions from X and Y domain to arrive at resulting membership function at Z domain, candidates are taken from X and Y domain themselves to arrive at Z domain directly. Where the membership functions in X and Y are crisp (e.g., A<sub>x </sub>and A<sub>y</sub>), the resulting membership function in Z has the following form:
<maths id="MATH-US-00062" num="00062"><math overflow="scroll"><mrow><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>Z</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>z</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><munder><mi>sup</mi><mrow><mrow><mo>∀</mo><msup><mi>x</mi><mi>′</mi></msup></mrow><mo>,</mo><msup><mi>y</mi><mi>′</mi></msup></mrow></munder><mo></mo><mrow><mo>(</mo><mrow><mrow><msub><mi>μ</mi><msubsup><mi>A</mi><mi>X</mi><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></msubsup></msub><mo></mo><mrow><mo>(</mo><msup><mi>x</mi><mi>′</mi></msup><mo>)</mo></mrow></mrow><mo>⋀</mo><mrow><msub><mi>μ</mi><msubsup><mi>A</mi><mi>Y</mi><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></msubsup></msub><mo></mo><mrow><mo>(</mo><msup><mi>y</mi><mi>′</mi></msup><mo>)</mo></mrow></mrow></mrow><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D13441.tif" /><img file="US2022121884A1_D13442.tif" /><img file="US2022121884A1_D13443.tif" /><img file="US2022121884A1_D13444.tif" /><img file="US2022121884A1_D13445.tif" /><img file="US2022121884A1_D13446.tif" /><img file="US2022121884A1_D13447.tif" /><img file="US2022121884A1_D13448.tif" /><img file="US2022121884A1_D13449.tif" /><img file="US2022121884A1_D13450.tif" /><img file="US2022121884A1_D13451.tif" /><img file="US2022121884A1_D13452.tif" /><img file="US2022121884A1_D13453.tif" /><img file="US2022121884A1_D13454.tif" /><img file="US2022121884A1_D13455.tif" /><img file="US2022121884A1_D13456.tif" /><img file="US2022121884A1_D13457.tif" /><img file="US2022121884A1_D13458.tif" /><img file="US2022121884A1_D13459.tif" /><img file="US2022121884A1_D13460.tif" /><img file="US2022121884A1_D13461.tif" /><img file="US2022121884A1_D13462.tif" /><img file="US2022121884A1_D13463.tif" /><img file="US2022121884A1_D13464.tif" /><img file="US2022121884A1_D13465.tif" /><img file="US2022121884A1_D13466.tif" /><img file="US2022121884A1_D13467.tif" /><img file="US2022121884A1_D13468.tif" /><img file="US2022121884A1_D13469.tif" /><img file="US2022121884A1_D13470.tif" /><img file="US2022121884A1_D13471.tif" /><img file="US2022121884A1_D13472.tif" /><img file="US2022121884A1_D13473.tif" /><img file="US2022121884A1_D13474.tif" /><img file="US2022121884A1_D13475.tif" /><img file="US2022121884A1_D13476.tif" /><img file="US2022121884A1_D13477.tif" /><img file="US2022121884A1_D13478.tif" /><img file="US2022121884A1_D13479.tif" /><img file="US2022121884A1_D13480.tif" /><img file="US2022121884A1_D13481.tif" /><img file="US2022121884A1_D13482.tif" /><img file="US2022121884A1_D13483.tif" /><img file="US2022121884A1_D13484.tif" /><img file="US2022121884A1_D13485.tif" /><img file="US2022121884A1_D13486.tif" /><img file="US2022121884A1_D13487.tif" /><img file="US2022121884A1_D13488.tif" /><img file="US2022121884A1_D13489.tif" /><img file="US2022121884A1_D13490.tif" /><img file="US2022121884A1_D13491.tif" /><img file="US2022121884A1_D13492.tif" /><img file="US2022121884A1_D13493.tif" /><img file="US2022121884A1_D13494.tif" /><img file="US2022121884A1_D13495.tif" /><img file="US2022121884A1_D13496.tif" /><img file="US2022121884A1_D13497.tif" /><img file="US2022121884A1_D13498.tif" /><img file="US2022121884A1_D13499.tif" /><img file="US2022121884A1_D13500.tif" /><img file="US2022121884A1_D13501.tif" /><img file="US2022121884A1_D13502.tif" /><img file="US2022121884A1_D13503.tif" /><img file="US2022121884A1_D13504.tif" /><img file="US2022121884A1_D13505.tif" /><img file="US2022121884A1_D13506.tif" /><img file="US2022121884A1_D13507.tif" /><img file="US2022121884A1_D13508.tif" /><img file="US2022121884A1_D13509.tif" /><img file="US2022121884A1_D13510.tif" /><img file="US2022121884A1_D13511.tif" /><img file="US2022121884A1_D13512.tif" /><img file="US2022121884A1_D13513.tif" /><img file="US2022121884A1_D13514.tif" /><img file="US2022121884A1_D13515.tif" /><img file="US2022121884A1_D13516.tif" /><img file="US2022121884A1_D13517.tif" /><img file="US2022121884A1_D13518.tif" /><img file="US2022121884A1_D13519.tif" /><img file="US2022121884A1_D13520.tif" /><img file="US2022121884A1_D13521.tif" /><img file="US2022121884A1_D13522.tif" /><img file="US2022121884A1_D13523.tif" /><img file="US2022121884A1_D13524.tif" /><img file="US2022121884A1_D13525.tif" /><img file="US2022121884A1_D13526.tif" /><img file="US2022121884A1_D13527.tif" /><img file="US2022121884A1_D13528.tif" /><img file="US2022121884A1_D13529.tif" /><img file="US2022121884A1_D13530.tif" /><img file="US2022121884A1_D13531.tif" /><img file="US2022121884A1_D13532.tif" /><img file="US2022121884A1_D13533.tif" /><img file="US2022121884A1_D13534.tif" /><img file="US2022121884A1_D13535.tif" /><img file="US2022121884A1_D13536.tif" /><img file="US2022121884A1_D13537.tif" /><img file="US2022121884A1_D13538.tif" /><img file="US2022121884A1_D13539.tif" /><img file="US2022121884A1_D13540.tif" /><img file="US2022121884A1_D13541.tif" /><img file="US2022121884A1_D13542.tif" /><img file="US2022121884A1_D13543.tif" /><img file="US2022121884A1_D13544.tif" /><img file="US2022121884A1_D13545.tif" /><img file="US2022121884A1_D13546.tif" /><img file="US2022121884A1_D13547.tif" /><img file="US2022121884A1_D13548.tif" /><img file="US2022121884A1_D13549.tif" /><img file="US2022121884A1_D13550.tif" /><img file="US2022121884A1_D13551.tif" /><img file="US2022121884A1_D13552.tif" /><maths id="MATH-US-00062-2" num="00062.2"><math overflow="scroll"><mrow><mrow><mi>Subject</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>to</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>z</mi></mrow><mo>=</mo><mrow><mi>f</mi><mo></mo><mrow><mo>(</mo><mrow><msup><mi>x</mi><mi>′</mi></msup><mo>,</mo><msup><mi>y</mi><mi>′</mi></msup></mrow><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D13553.tif" /><img file="US2022121884A1_D13554.tif" /><img file="US2022121884A1_D13555.tif" /><img file="US2022121884A1_D13556.tif" /><img file="US2022121884A1_D13557.tif" /><img file="US2022121884A1_D13558.tif" /><img file="US2022121884A1_D13559.tif" /><img file="US2022121884A1_D13560.tif" /><img file="US2022121884A1_D13561.tif" /><img file="US2022121884A1_D13562.tif" /><img file="US2022121884A1_D13563.tif" /><img file="US2022121884A1_D13564.tif" /><img file="US2022121884A1_D13565.tif" /><img file="US2022121884A1_D13566.tif" /><img file="US2022121884A1_D13567.tif" /><img file="US2022121884A1_D13568.tif" /><img file="US2022121884A1_D13569.tif" /><img file="US2022121884A1_D13570.tif" /><img file="US2022121884A1_D13571.tif" /><img file="US2022121884A1_D13572.tif" /><img file="US2022121884A1_D13573.tif" /><img file="US2022121884A1_D13574.tif" /><img file="US2022121884A1_D13575.tif" /><img file="US2022121884A1_D13576.tif" /><img file="US2022121884A1_D13577.tif" /><img file="US2022121884A1_D13578.tif" /><img file="US2022121884A1_D13579.tif" /><img file="US2022121884A1_D13580.tif" /><img file="US2022121884A1_D13581.tif" /><img file="US2022121884A1_D13582.tif" /><img file="US2022121884A1_D13583.tif" /><img file="US2022121884A1_D13584.tif" /><img file="US2022121884A1_D13585.tif" /><img file="US2022121884A1_D13586.tif" /><img file="US2022121884A1_D13587.tif" /><img file="US2022121884A1_D13588.tif" /><img file="US2022121884A1_D13589.tif" /><img file="US2022121884A1_D13590.tif" /><img file="US2022121884A1_D13591.tif" /><img file="US2022121884A1_D13592.tif" /><img file="US2022121884A1_D13593.tif" /><img file="US2022121884A1_D13594.tif" /><img file="US2022121884A1_D13595.tif" /><img file="US2022121884A1_D13596.tif" /><img file="US2022121884A1_D13597.tif" /><img file="US2022121884A1_D13598.tif" /><img file="US2022121884A1_D13599.tif" /><img file="US2022121884A1_D13600.tif" /><img file="US2022121884A1_D13601.tif" /><img file="US2022121884A1_D13602.tif" /><img file="US2022121884A1_D13603.tif" /><img file="US2022121884A1_D13604.tif" /><img file="US2022121884A1_D13605.tif" /><img file="US2022121884A1_D13606.tif" /><img file="US2022121884A1_D13607.tif" /><img file="US2022121884A1_D13608.tif" /><img file="US2022121884A1_D13609.tif" /><img file="US2022121884A1_D13610.tif" /><img file="US2022121884A1_D13611.tif" /><img file="US2022121884A1_D13612.tif" /><img file="US2022121884A1_D13613.tif" /><img file="US2022121884A1_D13614.tif" /><img file="US2022121884A1_D13615.tif" /><img file="US2022121884A1_D13616.tif" /><img file="US2022121884A1_D13617.tif" /><img file="US2022121884A1_D13618.tif" /><img file="US2022121884A1_D13619.tif" /><img file="US2022121884A1_D13620.tif" /><img file="US2022121884A1_D13621.tif" /><img file="US2022121884A1_D13622.tif" /><img file="US2022121884A1_D13623.tif" /><img file="US2022121884A1_D13624.tif" /><img file="US2022121884A1_D13625.tif" /><img file="US2022121884A1_D13626.tif" /><img file="US2022121884A1_D13627.tif" /><img file="US2022121884A1_D13628.tif" /><img file="US2022121884A1_D13629.tif" /><img file="US2022121884A1_D13630.tif" /><img file="US2022121884A1_D13631.tif" /><img file="US2022121884A1_D13632.tif" /><img file="US2022121884A1_D13633.tif" /><img file="US2022121884A1_D13634.tif" /><img file="US2022121884A1_D13635.tif" /><img file="US2022121884A1_D13636.tif" /><img file="US2022121884A1_D13637.tif" /><img file="US2022121884A1_D13638.tif" /><img file="US2022121884A1_D13639.tif" /><img file="US2022121884A1_D13640.tif" /><img file="US2022121884A1_D13641.tif" /><img file="US2022121884A1_D13642.tif" /><img file="US2022121884A1_D13643.tif" /><img file="US2022121884A1_D13644.tif" /><img file="US2022121884A1_D13645.tif" /><img file="US2022121884A1_D13646.tif" /><img file="US2022121884A1_D13647.tif" /><img file="US2022121884A1_D13648.tif" /><img file="US2022121884A1_D13649.tif" /><img file="US2022121884A1_D13650.tif" /><img file="US2022121884A1_D13651.tif" /><img file="US2022121884A1_D13652.tif" /><img file="US2022121884A1_D13653.tif" /><img file="US2022121884A1_D13654.tif" /><img file="US2022121884A1_D13655.tif" /><img file="US2022121884A1_D13656.tif" /><img file="US2022121884A1_D13657.tif" /><img file="US2022121884A1_D13658.tif" /><img file="US2022121884A1_D13659.tif" /><img file="US2022121884A1_D13660.tif" /><img file="US2022121884A1_D13661.tif" /><img file="US2022121884A1_D13662.tif" /><img file="US2022121884A1_D13663.tif" /><img file="US2022121884A1_D13664.tif" />
When the membership functions in X and Y are themselves fuzzy (e.g., A<sub>x </sub>* and A<sub>y</sub>*), the resulting map in Z domain, in one embodiment, is expressed as:
<maths id="MATH-US-00063" num="00063"><math overflow="scroll"><mrow><mrow><msub><mi>μ</mi><msubsup><mi>A</mi><mi>Z</mi><mo>*</mo></msubsup></msub><mo></mo><mrow><mo>(</mo><mrow><mi>z</mi><mo>,</mo><mi>η</mi></mrow><mo>)</mo></mrow></mrow><mo>=</mo><mrow><munder><mi>sup</mi><mrow><mrow><mo>∀</mo><msup><mi>x</mi><mi>′</mi></msup></mrow><mo>,</mo><msup><mi>y</mi><mi>′</mi></msup></mrow></munder><mo></mo><mrow><mo>(</mo><mrow><munder><mi>sup</mi><mrow><mrow><mo>∀</mo><msup><mi>η</mi><mi>′</mi></msup></mrow><mo>,</mo><msup><mi>η</mi><mi>″</mi></msup></mrow></munder><mo></mo><mrow><mrow><msub><mi>μ</mi><msubsup><mi>A</mi><mi>X</mi><mo>*</mo></msubsup></msub><mo></mo><mrow><mo>(</mo><mrow><msup><mi>x</mi><mi>′</mi></msup><mo>,</mo><msup><mi>η</mi><mi>′</mi></msup></mrow><mo>)</mo></mrow></mrow><mo>⋀</mo><mrow><msub><mi>μ</mi><msubsup><mi>A</mi><mi>Y</mi><mo>*</mo></msubsup></msub><mo></mo><mrow><mo>(</mo><mrow><msup><mi>y</mi><mi>′</mi></msup><mo>,</mo><msup><mi>η</mi><mi>″</mi></msup></mrow><mo>)</mo></mrow></mrow></mrow></mrow><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D13665.tif" /><img file="US2022121884A1_D13666.tif" /><img file="US2022121884A1_D13667.tif" /><img file="US2022121884A1_D13668.tif" /><img file="US2022121884A1_D13669.tif" /><img file="US2022121884A1_D13670.tif" /><img file="US2022121884A1_D13671.tif" /><img file="US2022121884A1_D13672.tif" /><img file="US2022121884A1_D13673.tif" /><img file="US2022121884A1_D13674.tif" /><img file="US2022121884A1_D13675.tif" /><img file="US2022121884A1_D13676.tif" /><img file="US2022121884A1_D13677.tif" /><img file="US2022121884A1_D13678.tif" /><img file="US2022121884A1_D13679.tif" /><img file="US2022121884A1_D13680.tif" /><img file="US2022121884A1_D13681.tif" /><img file="US2022121884A1_D13682.tif" /><img file="US2022121884A1_D13683.tif" /><img file="US2022121884A1_D13684.tif" /><img file="US2022121884A1_D13685.tif" /><img file="US2022121884A1_D13686.tif" /><img file="US2022121884A1_D13687.tif" /><img file="US2022121884A1_D13688.tif" /><img file="US2022121884A1_D13689.tif" /><img file="US2022121884A1_D13690.tif" /><img file="US2022121884A1_D13691.tif" /><img file="US2022121884A1_D13692.tif" /><img file="US2022121884A1_D13693.tif" /><img file="US2022121884A1_D13694.tif" /><img file="US2022121884A1_D13695.tif" /><img file="US2022121884A1_D13696.tif" /><img file="US2022121884A1_D13697.tif" /><img file="US2022121884A1_D13698.tif" /><img file="US2022121884A1_D13699.tif" /><img file="US2022121884A1_D13700.tif" /><img file="US2022121884A1_D13701.tif" /><img file="US2022121884A1_D13702.tif" /><img file="US2022121884A1_D13703.tif" /><img file="US2022121884A1_D13704.tif" /><img file="US2022121884A1_D13705.tif" /><img file="US2022121884A1_D13706.tif" /><img file="US2022121884A1_D13707.tif" /><img file="US2022121884A1_D13708.tif" /><img file="US2022121884A1_D13709.tif" /><img file="US2022121884A1_D13710.tif" /><img file="US2022121884A1_D13711.tif" /><img file="US2022121884A1_D13712.tif" /><img file="US2022121884A1_D13713.tif" /><img file="US2022121884A1_D13714.tif" /><img file="US2022121884A1_D13715.tif" /><img file="US2022121884A1_D13716.tif" /><img file="US2022121884A1_D13717.tif" /><img file="US2022121884A1_D13718.tif" /><img file="US2022121884A1_D13719.tif" /><img file="US2022121884A1_D13720.tif" /><img file="US2022121884A1_D13721.tif" /><img file="US2022121884A1_D13722.tif" /><img file="US2022121884A1_D13723.tif" /><img file="US2022121884A1_D13724.tif" /><img file="US2022121884A1_D13725.tif" /><img file="US2022121884A1_D13726.tif" /><img file="US2022121884A1_D13727.tif" /><img file="US2022121884A1_D13728.tif" /><img file="US2022121884A1_D13729.tif" /><img file="US2022121884A1_D13730.tif" /><img file="US2022121884A1_D13731.tif" /><img file="US2022121884A1_D13732.tif" /><img file="US2022121884A1_D13733.tif" /><img file="US2022121884A1_D13734.tif" /><img file="US2022121884A1_D13735.tif" /><img file="US2022121884A1_D13736.tif" /><img file="US2022121884A1_D13737.tif" /><img file="US2022121884A1_D13738.tif" /><img file="US2022121884A1_D13739.tif" /><img file="US2022121884A1_D13740.tif" /><img file="US2022121884A1_D13741.tif" /><img file="US2022121884A1_D13742.tif" /><img file="US2022121884A1_D13743.tif" /><img file="US2022121884A1_D13744.tif" /><img file="US2022121884A1_D13745.tif" /><img file="US2022121884A1_D13746.tif" /><img file="US2022121884A1_D13747.tif" /><img file="US2022121884A1_D13748.tif" /><img file="US2022121884A1_D13749.tif" /><img file="US2022121884A1_D13750.tif" /><img file="US2022121884A1_D13751.tif" /><img file="US2022121884A1_D13752.tif" /><img file="US2022121884A1_D13753.tif" /><img file="US2022121884A1_D13754.tif" /><img file="US2022121884A1_D13755.tif" /><img file="US2022121884A1_D13756.tif" /><img file="US2022121884A1_D13757.tif" /><img file="US2022121884A1_D13758.tif" /><img file="US2022121884A1_D13759.tif" /><img file="US2022121884A1_D13760.tif" /><img file="US2022121884A1_D13761.tif" /><img file="US2022121884A1_D13762.tif" /><img file="US2022121884A1_D13763.tif" /><img file="US2022121884A1_D13764.tif" /><img file="US2022121884A1_D13765.tif" /><img file="US2022121884A1_D13766.tif" /><img file="US2022121884A1_D13767.tif" /><img file="US2022121884A1_D13768.tif" /><img file="US2022121884A1_D13769.tif" /><img file="US2022121884A1_D13770.tif" /><img file="US2022121884A1_D13771.tif" /><img file="US2022121884A1_D13772.tif" /><img file="US2022121884A1_D13773.tif" /><img file="US2022121884A1_D13774.tif" /><img file="US2022121884A1_D13775.tif" /><img file="US2022121884A1_D13776.tif" /><maths id="MATH-US-00063-2" num="00063.2"><math overflow="scroll"><mrow><mi>Subject</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>to</mi></mrow></math></maths><img file="US2022121884A1_D13777.tif" /><img file="US2022121884A1_D13778.tif" /><img file="US2022121884A1_D13779.tif" /><img file="US2022121884A1_D13780.tif" /><img file="US2022121884A1_D13781.tif" /><img file="US2022121884A1_D13782.tif" /><img file="US2022121884A1_D13783.tif" /><img file="US2022121884A1_D13784.tif" /><img file="US2022121884A1_D13785.tif" /><img file="US2022121884A1_D13786.tif" /><img file="US2022121884A1_D13787.tif" /><img file="US2022121884A1_D13788.tif" /><img file="US2022121884A1_D13789.tif" /><img file="US2022121884A1_D13790.tif" /><img file="US2022121884A1_D13791.tif" /><img file="US2022121884A1_D13792.tif" /><img file="US2022121884A1_D13793.tif" /><img file="US2022121884A1_D13794.tif" /><img file="US2022121884A1_D13795.tif" /><img file="US2022121884A1_D13796.tif" /><img file="US2022121884A1_D13797.tif" /><img file="US2022121884A1_D13798.tif" /><img file="US2022121884A1_D13799.tif" /><img file="US2022121884A1_D13800.tif" /><img file="US2022121884A1_D13801.tif" /><img file="US2022121884A1_D13802.tif" /><img file="US2022121884A1_D13803.tif" /><img file="US2022121884A1_D13804.tif" /><img file="US2022121884A1_D13805.tif" /><img file="US2022121884A1_D13806.tif" /><img file="US2022121884A1_D13807.tif" /><img file="US2022121884A1_D13808.tif" /><img file="US2022121884A1_D13809.tif" /><img file="US2022121884A1_D13810.tif" /><img file="US2022121884A1_D13811.tif" /><img file="US2022121884A1_D13812.tif" /><img file="US2022121884A1_D13813.tif" /><img file="US2022121884A1_D13814.tif" /><img file="US2022121884A1_D13815.tif" /><img file="US2022121884A1_D13816.tif" /><img file="US2022121884A1_D13817.tif" /><img file="US2022121884A1_D13818.tif" /><img file="US2022121884A1_D13819.tif" /><img file="US2022121884A1_D13820.tif" /><img file="US2022121884A1_D13821.tif" /><img file="US2022121884A1_D13822.tif" /><img file="US2022121884A1_D13823.tif" /><img file="US2022121884A1_D13824.tif" /><img file="US2022121884A1_D13825.tif" /><img file="US2022121884A1_D13826.tif" /><img file="US2022121884A1_D13827.tif" /><img file="US2022121884A1_D13828.tif" /><img file="US2022121884A1_D13829.tif" /><img file="US2022121884A1_D13830.tif" /><img file="US2022121884A1_D13831.tif" /><img file="US2022121884A1_D13832.tif" /><img file="US2022121884A1_D13833.tif" /><img file="US2022121884A1_D13834.tif" /><img file="US2022121884A1_D13835.tif" /><img file="US2022121884A1_D13836.tif" /><img file="US2022121884A1_D13837.tif" /><img file="US2022121884A1_D13838.tif" /><img file="US2022121884A1_D13839.tif" /><img file="US2022121884A1_D13840.tif" /><img file="US2022121884A1_D13841.tif" /><img file="US2022121884A1_D13842.tif" /><img file="US2022121884A1_D13843.tif" /><img file="US2022121884A1_D13844.tif" /><img file="US2022121884A1_D13845.tif" /><img file="US2022121884A1_D13846.tif" /><img file="US2022121884A1_D13847.tif" /><img file="US2022121884A1_D13848.tif" /><img file="US2022121884A1_D13849.tif" /><img file="US2022121884A1_D13850.tif" /><img file="US2022121884A1_D13851.tif" /><img file="US2022121884A1_D13852.tif" /><img file="US2022121884A1_D13853.tif" /><img file="US2022121884A1_D13854.tif" /><img file="US2022121884A1_D13855.tif" /><img file="US2022121884A1_D13856.tif" /><img file="US2022121884A1_D13857.tif" /><img file="US2022121884A1_D13858.tif" /><img file="US2022121884A1_D13859.tif" /><img file="US2022121884A1_D13860.tif" /><img file="US2022121884A1_D13861.tif" /><img file="US2022121884A1_D13862.tif" /><img file="US2022121884A1_D13863.tif" /><img file="US2022121884A1_D13864.tif" /><img file="US2022121884A1_D13865.tif" /><img file="US2022121884A1_D13866.tif" /><img file="US2022121884A1_D13867.tif" /><img file="US2022121884A1_D13868.tif" /><img file="US2022121884A1_D13869.tif" /><img file="US2022121884A1_D13870.tif" /><img file="US2022121884A1_D13871.tif" /><img file="US2022121884A1_D13872.tif" /><img file="US2022121884A1_D13873.tif" /><img file="US2022121884A1_D13874.tif" /><img file="US2022121884A1_D13875.tif" /><img file="US2022121884A1_D13876.tif" /><img file="US2022121884A1_D13877.tif" /><img file="US2022121884A1_D13878.tif" /><img file="US2022121884A1_D13879.tif" /><img file="US2022121884A1_D13880.tif" /><img file="US2022121884A1_D13881.tif" /><img file="US2022121884A1_D13882.tif" /><img file="US2022121884A1_D13883.tif" /><img file="US2022121884A1_D13884.tif" /><img file="US2022121884A1_D13885.tif" /><img file="US2022121884A1_D13886.tif" /><img file="US2022121884A1_D13887.tif" /><img file="US2022121884A1_D13888.tif" /><maths id="MATH-US-00063-3" num="00063.3"><math overflow="scroll"><mrow><mi>η</mi><mo>=</mo><mrow><msup><mi>η</mi><mi>′</mi></msup><mo>⋀</mo><msup><mi>η</mi><mi>″</mi></msup></mrow></mrow></math></maths><img file="US2022121884A1_D13889.tif" /><img file="US2022121884A1_D13890.tif" /><img file="US2022121884A1_D13891.tif" /><img file="US2022121884A1_D13892.tif" /><img file="US2022121884A1_D13893.tif" /><img file="US2022121884A1_D13894.tif" /><img file="US2022121884A1_D13895.tif" /><img file="US2022121884A1_D13896.tif" /><img file="US2022121884A1_D13897.tif" /><img file="US2022121884A1_D13898.tif" /><img file="US2022121884A1_D13899.tif" /><img file="US2022121884A1_D13900.tif" /><img file="US2022121884A1_D13901.tif" /><img file="US2022121884A1_D13902.tif" /><img file="US2022121884A1_D13903.tif" /><img file="US2022121884A1_D13904.tif" /><img file="US2022121884A1_D13905.tif" /><img file="US2022121884A1_D13906.tif" /><img file="US2022121884A1_D13907.tif" /><img file="US2022121884A1_D13908.tif" /><img file="US2022121884A1_D13909.tif" /><img file="US2022121884A1_D13910.tif" /><img file="US2022121884A1_D13911.tif" /><img file="US2022121884A1_D13912.tif" /><img file="US2022121884A1_D13913.tif" /><img file="US2022121884A1_D13914.tif" /><img file="US2022121884A1_D13915.tif" /><img file="US2022121884A1_D13916.tif" /><img file="US2022121884A1_D13917.tif" /><img file="US2022121884A1_D13918.tif" /><img file="US2022121884A1_D13919.tif" /><img file="US2022121884A1_D13920.tif" /><img file="US2022121884A1_D13921.tif" /><img file="US2022121884A1_D13922.tif" /><img file="US2022121884A1_D13923.tif" /><img file="US2022121884A1_D13924.tif" /><img file="US2022121884A1_D13925.tif" /><img file="US2022121884A1_D13926.tif" /><img file="US2022121884A1_D13927.tif" /><img file="US2022121884A1_D13928.tif" /><img file="US2022121884A1_D13929.tif" /><img file="US2022121884A1_D13930.tif" /><img file="US2022121884A1_D13931.tif" /><img file="US2022121884A1_D13932.tif" /><img file="US2022121884A1_D13933.tif" /><img file="US2022121884A1_D13934.tif" /><img file="US2022121884A1_D13935.tif" /><img file="US2022121884A1_D13936.tif" /><img file="US2022121884A1_D13937.tif" /><img file="US2022121884A1_D13938.tif" /><img file="US2022121884A1_D13939.tif" /><img file="US2022121884A1_D13940.tif" /><img file="US2022121884A1_D13941.tif" /><img file="US2022121884A1_D13942.tif" /><img file="US2022121884A1_D13943.tif" /><img file="US2022121884A1_D13944.tif" /><img file="US2022121884A1_D13945.tif" /><img file="US2022121884A1_D13946.tif" /><img file="US2022121884A1_D13947.tif" /><img file="US2022121884A1_D13948.tif" /><img file="US2022121884A1_D13949.tif" /><img file="US2022121884A1_D13950.tif" /><img file="US2022121884A1_D13951.tif" /><img file="US2022121884A1_D13952.tif" /><img file="US2022121884A1_D13953.tif" /><img file="US2022121884A1_D13954.tif" /><img file="US2022121884A1_D13955.tif" /><img file="US2022121884A1_D13956.tif" /><img file="US2022121884A1_D13957.tif" /><img file="US2022121884A1_D13958.tif" /><img file="US2022121884A1_D13959.tif" /><img file="US2022121884A1_D13960.tif" /><img file="US2022121884A1_D13961.tif" /><img file="US2022121884A1_D13962.tif" /><img file="US2022121884A1_D13963.tif" /><img file="US2022121884A1_D13964.tif" /><img file="US2022121884A1_D13965.tif" /><img file="US2022121884A1_D13966.tif" /><img file="US2022121884A1_D13967.tif" /><img file="US2022121884A1_D13968.tif" /><img file="US2022121884A1_D13969.tif" /><img file="US2022121884A1_D13970.tif" /><img file="US2022121884A1_D13971.tif" /><img file="US2022121884A1_D13972.tif" /><img file="US2022121884A1_D13973.tif" /><img file="US2022121884A1_D13974.tif" /><img file="US2022121884A1_D13975.tif" /><img file="US2022121884A1_D13976.tif" /><img file="US2022121884A1_D13977.tif" /><img file="US2022121884A1_D13978.tif" /><img file="US2022121884A1_D13979.tif" /><img file="US2022121884A1_D13980.tif" /><img file="US2022121884A1_D13981.tif" /><img file="US2022121884A1_D13982.tif" /><img file="US2022121884A1_D13983.tif" /><img file="US2022121884A1_D13984.tif" /><img file="US2022121884A1_D13985.tif" /><img file="US2022121884A1_D13986.tif" /><img file="US2022121884A1_D13987.tif" /><img file="US2022121884A1_D13988.tif" /><img file="US2022121884A1_D13989.tif" /><img file="US2022121884A1_D13990.tif" /><img file="US2022121884A1_D13991.tif" /><img file="US2022121884A1_D13992.tif" /><img file="US2022121884A1_D13993.tif" /><img file="US2022121884A1_D13994.tif" /><img file="US2022121884A1_D13995.tif" /><img file="US2022121884A1_D13996.tif" /><img file="US2022121884A1_D13997.tif" /><img file="US2022121884A1_D13998.tif" /><img file="US2022121884A1_D13999.tif" /><img file="US2022121884A1_D14000.tif" /><maths id="MATH-US-00063-4" num="00063.4"><math overflow="scroll"><mrow><mi>z</mi><mo>=</mo><mrow><mi>f</mi><mo></mo><mrow><mo>(</mo><mrow><msup><mi>x</mi><mi>′</mi></msup><mo>,</mo><msup><mi>y</mi><mi>′</mi></msup></mrow><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D14001.tif" /><img file="US2022121884A1_D14002.tif" /><img file="US2022121884A1_D14003.tif" /><img file="US2022121884A1_D14004.tif" /><img file="US2022121884A1_D14005.tif" /><img file="US2022121884A1_D14006.tif" /><img file="US2022121884A1_D14007.tif" /><img file="US2022121884A1_D14008.tif" /><img file="US2022121884A1_D14009.tif" /><img file="US2022121884A1_D14010.tif" /><img file="US2022121884A1_D14011.tif" /><img file="US2022121884A1_D14012.tif" /><img file="US2022121884A1_D14013.tif" /><img file="US2022121884A1_D14014.tif" /><img file="US2022121884A1_D14015.tif" /><img file="US2022121884A1_D14016.tif" /><img file="US2022121884A1_D14017.tif" /><img file="US2022121884A1_D14018.tif" /><img file="US2022121884A1_D14019.tif" /><img file="US2022121884A1_D14020.tif" /><img file="US2022121884A1_D14021.tif" /><img file="US2022121884A1_D14022.tif" /><img file="US2022121884A1_D14023.tif" /><img file="US2022121884A1_D14024.tif" /><img file="US2022121884A1_D14025.tif" /><img file="US2022121884A1_D14026.tif" /><img file="US2022121884A1_D14027.tif" /><img file="US2022121884A1_D14028.tif" /><img file="US2022121884A1_D14029.tif" /><img file="US2022121884A1_D14030.tif" /><img file="US2022121884A1_D14031.tif" /><img file="US2022121884A1_D14032.tif" /><img file="US2022121884A1_D14033.tif" /><img file="US2022121884A1_D14034.tif" /><img file="US2022121884A1_D14035.tif" /><img file="US2022121884A1_D14036.tif" /><img file="US2022121884A1_D14037.tif" /><img file="US2022121884A1_D14038.tif" /><img file="US2022121884A1_D14039.tif" /><img file="US2022121884A1_D14040.tif" /><img file="US2022121884A1_D14041.tif" /><img file="US2022121884A1_D14042.tif" /><img file="US2022121884A1_D14043.tif" /><img file="US2022121884A1_D14044.tif" /><img file="US2022121884A1_D14045.tif" /><img file="US2022121884A1_D14046.tif" /><img file="US2022121884A1_D14047.tif" /><img file="US2022121884A1_D14048.tif" /><img file="US2022121884A1_D14049.tif" /><img file="US2022121884A1_D14050.tif" /><img file="US2022121884A1_D14051.tif" /><img file="US2022121884A1_D14052.tif" /><img file="US2022121884A1_D14053.tif" /><img file="US2022121884A1_D14054.tif" /><img file="US2022121884A1_D14055.tif" /><img file="US2022121884A1_D14056.tif" /><img file="US2022121884A1_D14057.tif" /><img file="US2022121884A1_D14058.tif" /><img file="US2022121884A1_D14059.tif" /><img file="US2022121884A1_D14060.tif" /><img file="US2022121884A1_D14061.tif" /><img file="US2022121884A1_D14062.tif" /><img file="US2022121884A1_D14063.tif" /><img file="US2022121884A1_D14064.tif" /><img file="US2022121884A1_D14065.tif" /><img file="US2022121884A1_D14066.tif" /><img file="US2022121884A1_D14067.tif" /><img file="US2022121884A1_D14068.tif" /><img file="US2022121884A1_D14069.tif" /><img file="US2022121884A1_D14070.tif" /><img file="US2022121884A1_D14071.tif" /><img file="US2022121884A1_D14072.tif" /><img file="US2022121884A1_D14073.tif" /><img file="US2022121884A1_D14074.tif" /><img file="US2022121884A1_D14075.tif" /><img file="US2022121884A1_D14076.tif" /><img file="US2022121884A1_D14077.tif" /><img file="US2022121884A1_D14078.tif" /><img file="US2022121884A1_D14079.tif" /><img file="US2022121884A1_D14080.tif" /><img file="US2022121884A1_D14081.tif" /><img file="US2022121884A1_D14082.tif" /><img file="US2022121884A1_D14083.tif" /><img file="US2022121884A1_D14084.tif" /><img file="US2022121884A1_D14085.tif" /><img file="US2022121884A1_D14086.tif" /><img file="US2022121884A1_D14087.tif" /><img file="US2022121884A1_D14088.tif" /><img file="US2022121884A1_D14089.tif" /><img file="US2022121884A1_D14090.tif" /><img file="US2022121884A1_D14091.tif" /><img file="US2022121884A1_D14092.tif" /><img file="US2022121884A1_D14093.tif" /><img file="US2022121884A1_D14094.tif" /><img file="US2022121884A1_D14095.tif" /><img file="US2022121884A1_D14096.tif" /><img file="US2022121884A1_D14097.tif" /><img file="US2022121884A1_D14098.tif" /><img file="US2022121884A1_D14099.tif" /><img file="US2022121884A1_D14100.tif" /><img file="US2022121884A1_D14101.tif" /><img file="US2022121884A1_D14102.tif" /><img file="US2022121884A1_D14103.tif" /><img file="US2022121884A1_D14104.tif" /><img file="US2022121884A1_D14105.tif" /><img file="US2022121884A1_D14106.tif" /><img file="US2022121884A1_D14107.tif" /><img file="US2022121884A1_D14108.tif" /><img file="US2022121884A1_D14109.tif" /><img file="US2022121884A1_D14110.tif" /><img file="US2022121884A1_D14111.tif" /><img file="US2022121884A1_D14112.tif" />
Or alternatively expressed as:
<maths id="MATH-US-00064" num="00064"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><msub><mi>μ</mi><msubsup><mi>A</mi><mi>Z</mi><mo>*</mo></msubsup></msub><mo></mo><mrow><mo>(</mo><mrow><mi>z</mi><mo>,</mo><mi>η</mi></mrow><mo>)</mo></mrow></mrow><mo>=</mo><mrow><munder><mi>sup</mi><mrow><mrow><mo>∀</mo><msup><mi>η</mi><mi>′</mi></msup></mrow><mo>,</mo><msup><mi>η</mi><mi>″</mi></msup></mrow></munder><mo></mo><mrow><mo>(</mo><mrow><munder><mi>sup</mi><mrow><mrow><mo>∀</mo><msup><mi>x</mi><mi>′</mi></msup></mrow><mo>,</mo><msup><mi>y</mi><mi>′</mi></msup></mrow></munder><mo></mo><mrow><mrow><msub><mi>μ</mi><msubsup><mi>A</mi><mi>X</mi><mo>*</mo></msubsup></msub><mo></mo><mrow><mo>(</mo><mrow><msup><mi>x</mi><mi>′</mi></msup><mo>,</mo><msup><mi>η</mi><mi>′</mi></msup></mrow><mo>)</mo></mrow></mrow><mo>⋀</mo><mrow><msub><mi>μ</mi><msubsup><mi>A</mi><mi>Y</mi><mo>*</mo></msubsup></msub><mo></mo><mrow><mo>(</mo><mrow><msup><mi>y</mi><mi>′</mi></msup><mo>,</mo><msup><mi>η</mi><mi>″</mi></msup></mrow><mo>)</mo></mrow></mrow></mrow></mrow><mo>)</mo></mrow></mrow></mrow></mtd></mtr><mtr><mtd><mrow><mo>=</mo><mrow><munder><mi>sup</mi><mrow><mrow><mo>∀</mo><msup><mi>x</mi><mi>′</mi></msup></mrow><mo>,</mo><msup><mi>y</mi><mi>′</mi></msup><mo>,</mo><msup><mi>η</mi><mi>′</mi></msup><mo>,</mo><msup><mi>η</mi><mi>″</mi></msup></mrow></munder><mo></mo><mrow><mrow><msub><mi>μ</mi><msubsup><mi>A</mi><mi>X</mi><mo>*</mo></msubsup></msub><mo></mo><mrow><mo>(</mo><mrow><msup><mi>x</mi><mi>′</mi></msup><mo>,</mo><msup><mi>η</mi><mi>′</mi></msup></mrow><mo>)</mo></mrow></mrow><mo>⋀</mo><mrow><msub><mi>μ</mi><msubsup><mi>A</mi><mi>Y</mi><mo>*</mo></msubsup></msub><mo></mo><mrow><mo>(</mo><mrow><msup><mi>y</mi><mi>′</mi></msup><mo>,</mo><msup><mi>η</mi><mi>″</mi></msup></mrow><mo>)</mo></mrow></mrow></mrow></mrow></mrow></mtd></mtr></mtable></math></maths><img file="US2022121884A1_D14113.tif" /><img file="US2022121884A1_D14114.tif" /><img file="US2022121884A1_D14115.tif" /><img file="US2022121884A1_D14116.tif" /><img file="US2022121884A1_D14117.tif" /><img file="US2022121884A1_D14118.tif" /><img file="US2022121884A1_D14119.tif" /><img file="US2022121884A1_D14120.tif" /><img file="US2022121884A1_D14121.tif" /><img file="US2022121884A1_D14122.tif" /><img file="US2022121884A1_D14123.tif" /><img file="US2022121884A1_D14124.tif" /><img file="US2022121884A1_D14125.tif" /><img file="US2022121884A1_D14126.tif" /><img file="US2022121884A1_D14127.tif" /><img file="US2022121884A1_D14128.tif" /><img file="US2022121884A1_D14129.tif" /><img file="US2022121884A1_D14130.tif" /><img file="US2022121884A1_D14131.tif" /><img file="US2022121884A1_D14132.tif" /><img file="US2022121884A1_D14133.tif" /><img file="US2022121884A1_D14134.tif" /><img file="US2022121884A1_D14135.tif" /><img file="US2022121884A1_D14136.tif" /><img file="US2022121884A1_D14137.tif" /><img file="US2022121884A1_D14138.tif" /><img file="US2022121884A1_D14139.tif" /><img file="US2022121884A1_D14140.tif" /><img file="US2022121884A1_D14141.tif" /><img file="US2022121884A1_D14142.tif" /><img file="US2022121884A1_D14143.tif" /><img file="US2022121884A1_D14144.tif" /><img file="US2022121884A1_D14145.tif" /><img file="US2022121884A1_D14146.tif" /><img file="US2022121884A1_D14147.tif" /><img file="US2022121884A1_D14148.tif" /><img file="US2022121884A1_D14149.tif" /><img file="US2022121884A1_D14150.tif" /><img file="US2022121884A1_D14151.tif" /><img file="US2022121884A1_D14152.tif" /><img file="US2022121884A1_D14153.tif" /><img file="US2022121884A1_D14154.tif" /><img file="US2022121884A1_D14155.tif" /><img file="US2022121884A1_D14156.tif" /><img file="US2022121884A1_D14157.tif" /><img file="US2022121884A1_D14158.tif" /><img file="US2022121884A1_D14159.tif" /><img file="US2022121884A1_D14160.tif" /><img file="US2022121884A1_D14161.tif" /><img file="US2022121884A1_D14162.tif" /><img file="US2022121884A1_D14163.tif" /><img file="US2022121884A1_D14164.tif" /><img file="US2022121884A1_D14165.tif" /><img file="US2022121884A1_D14166.tif" /><img file="US2022121884A1_D14167.tif" /><img file="US2022121884A1_D14168.tif" /><img file="US2022121884A1_D14169.tif" /><img file="US2022121884A1_D14170.tif" /><img file="US2022121884A1_D14171.tif" /><img file="US2022121884A1_D14172.tif" /><img file="US2022121884A1_D14173.tif" /><img file="US2022121884A1_D14174.tif" /><img file="US2022121884A1_D14175.tif" /><img file="US2022121884A1_D14176.tif" /><img file="US2022121884A1_D14177.tif" /><img file="US2022121884A1_D14178.tif" /><img file="US2022121884A1_D14179.tif" /><img file="US2022121884A1_D14180.tif" /><img file="US2022121884A1_D14181.tif" /><img file="US2022121884A1_D14182.tif" /><img file="US2022121884A1_D14183.tif" /><img file="US2022121884A1_D14184.tif" /><img file="US2022121884A1_D14185.tif" /><img file="US2022121884A1_D14186.tif" /><img file="US2022121884A1_D14187.tif" /><img file="US2022121884A1_D14188.tif" /><img file="US2022121884A1_D14189.tif" /><img file="US2022121884A1_D14190.tif" /><img file="US2022121884A1_D14191.tif" /><img file="US2022121884A1_D14192.tif" /><img file="US2022121884A1_D14193.tif" /><img file="US2022121884A1_D14194.tif" /><img file="US2022121884A1_D14195.tif" /><img file="US2022121884A1_D14196.tif" /><img file="US2022121884A1_D14197.tif" /><img file="US2022121884A1_D14198.tif" /><img file="US2022121884A1_D14199.tif" /><img file="US2022121884A1_D14200.tif" /><img file="US2022121884A1_D14201.tif" /><img file="US2022121884A1_D14202.tif" /><img file="US2022121884A1_D14203.tif" /><img file="US2022121884A1_D14204.tif" /><img file="US2022121884A1_D14205.tif" /><img file="US2022121884A1_D14206.tif" /><img file="US2022121884A1_D14207.tif" /><img file="US2022121884A1_D14208.tif" /><img file="US2022121884A1_D14209.tif" /><img file="US2022121884A1_D14210.tif" /><img file="US2022121884A1_D14211.tif" /><img file="US2022121884A1_D14212.tif" /><img file="US2022121884A1_D14213.tif" /><img file="US2022121884A1_D14214.tif" /><img file="US2022121884A1_D14215.tif" /><img file="US2022121884A1_D14216.tif" /><img file="US2022121884A1_D14217.tif" /><img file="US2022121884A1_D14218.tif" /><img file="US2022121884A1_D14219.tif" /><img file="US2022121884A1_D14220.tif" /><img file="US2022121884A1_D14221.tif" /><img file="US2022121884A1_D14222.tif" /><img file="US2022121884A1_D14223.tif" /><img file="US2022121884A1_D14224.tif" /><maths id="MATH-US-00064-2" num="00064.2"><math overflow="scroll"><mrow><mi>Subject</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>to</mi></mrow></math></maths><img file="US2022121884A1_D14225.tif" /><img file="US2022121884A1_D14226.tif" /><img file="US2022121884A1_D14227.tif" /><img file="US2022121884A1_D14228.tif" /><img file="US2022121884A1_D14229.tif" /><img file="US2022121884A1_D14230.tif" /><img file="US2022121884A1_D14231.tif" /><img file="US2022121884A1_D14232.tif" /><img file="US2022121884A1_D14233.tif" /><img file="US2022121884A1_D14234.tif" /><img file="US2022121884A1_D14235.tif" /><img file="US2022121884A1_D14236.tif" /><img file="US2022121884A1_D14237.tif" /><img file="US2022121884A1_D14238.tif" /><img file="US2022121884A1_D14239.tif" /><img file="US2022121884A1_D14240.tif" /><img file="US2022121884A1_D14241.tif" /><img file="US2022121884A1_D14242.tif" /><img file="US2022121884A1_D14243.tif" /><img file="US2022121884A1_D14244.tif" /><img file="US2022121884A1_D14245.tif" /><img file="US2022121884A1_D14246.tif" /><img file="US2022121884A1_D14247.tif" /><img file="US2022121884A1_D14248.tif" /><img file="US2022121884A1_D14249.tif" /><img file="US2022121884A1_D14250.tif" /><img file="US2022121884A1_D14251.tif" /><img file="US2022121884A1_D14252.tif" /><img file="US2022121884A1_D14253.tif" /><img file="US2022121884A1_D14254.tif" /><img file="US2022121884A1_D14255.tif" /><img file="US2022121884A1_D14256.tif" /><img file="US2022121884A1_D14257.tif" /><img file="US2022121884A1_D14258.tif" /><img file="US2022121884A1_D14259.tif" /><img file="US2022121884A1_D14260.tif" /><img file="US2022121884A1_D14261.tif" /><img file="US2022121884A1_D14262.tif" /><img file="US2022121884A1_D14263.tif" /><img file="US2022121884A1_D14264.tif" /><img file="US2022121884A1_D14265.tif" /><img file="US2022121884A1_D14266.tif" /><img file="US2022121884A1_D14267.tif" /><img file="US2022121884A1_D14268.tif" /><img file="US2022121884A1_D14269.tif" /><img file="US2022121884A1_D14270.tif" /><img file="US2022121884A1_D14271.tif" /><img file="US2022121884A1_D14272.tif" /><img file="US2022121884A1_D14273.tif" /><img file="US2022121884A1_D14274.tif" /><img file="US2022121884A1_D14275.tif" /><img file="US2022121884A1_D14276.tif" /><img file="US2022121884A1_D14277.tif" /><img file="US2022121884A1_D14278.tif" /><img file="US2022121884A1_D14279.tif" /><img file="US2022121884A1_D14280.tif" /><img file="US2022121884A1_D14281.tif" /><img file="US2022121884A1_D14282.tif" /><img file="US2022121884A1_D14283.tif" /><img file="US2022121884A1_D14284.tif" /><img file="US2022121884A1_D14285.tif" /><img file="US2022121884A1_D14286.tif" /><img file="US2022121884A1_D14287.tif" /><img file="US2022121884A1_D14288.tif" /><img file="US2022121884A1_D14289.tif" /><img file="US2022121884A1_D14290.tif" /><img file="US2022121884A1_D14291.tif" /><img file="US2022121884A1_D14292.tif" /><img file="US2022121884A1_D14293.tif" /><img file="US2022121884A1_D14294.tif" /><img file="US2022121884A1_D14295.tif" /><img file="US2022121884A1_D14296.tif" /><img file="US2022121884A1_D14297.tif" /><img file="US2022121884A1_D14298.tif" /><img file="US2022121884A1_D14299.tif" /><img file="US2022121884A1_D14300.tif" /><img file="US2022121884A1_D14301.tif" /><img file="US2022121884A1_D14302.tif" /><img file="US2022121884A1_D14303.tif" /><img file="US2022121884A1_D14304.tif" /><img file="US2022121884A1_D14305.tif" /><img file="US2022121884A1_D14306.tif" /><img file="US2022121884A1_D14307.tif" /><img file="US2022121884A1_D14308.tif" /><img file="US2022121884A1_D14309.tif" /><img file="US2022121884A1_D14310.tif" /><img file="US2022121884A1_D14311.tif" /><img file="US2022121884A1_D14312.tif" /><img file="US2022121884A1_D14313.tif" /><img file="US2022121884A1_D14314.tif" /><img file="US2022121884A1_D14315.tif" /><img file="US2022121884A1_D14316.tif" /><img file="US2022121884A1_D14317.tif" /><img file="US2022121884A1_D14318.tif" /><img file="US2022121884A1_D14319.tif" /><img file="US2022121884A1_D14320.tif" /><img file="US2022121884A1_D14321.tif" /><img file="US2022121884A1_D14322.tif" /><img file="US2022121884A1_D14323.tif" /><img file="US2022121884A1_D14324.tif" /><img file="US2022121884A1_D14325.tif" /><img file="US2022121884A1_D14326.tif" /><img file="US2022121884A1_D14327.tif" /><img file="US2022121884A1_D14328.tif" /><img file="US2022121884A1_D14329.tif" /><img file="US2022121884A1_D14330.tif" /><img file="US2022121884A1_D14331.tif" /><img file="US2022121884A1_D14332.tif" /><img file="US2022121884A1_D14333.tif" /><img file="US2022121884A1_D14334.tif" /><img file="US2022121884A1_D14335.tif" /><img file="US2022121884A1_D14336.tif" /><maths id="MATH-US-00064-3" num="00064.3"><math overflow="scroll"><mrow><mi>η</mi><mo>=</mo><mrow><msup><mi>η</mi><mi>′</mi></msup><mo>⋀</mo><msup><mi>η</mi><mi>″</mi></msup></mrow></mrow></math></maths><img file="US2022121884A1_D14337.tif" /><img file="US2022121884A1_D14338.tif" /><img file="US2022121884A1_D14339.tif" /><img file="US2022121884A1_D14340.tif" /><img file="US2022121884A1_D14341.tif" /><img file="US2022121884A1_D14342.tif" /><img file="US2022121884A1_D14343.tif" /><img file="US2022121884A1_D14344.tif" /><img file="US2022121884A1_D14345.tif" /><img file="US2022121884A1_D14346.tif" /><img file="US2022121884A1_D14347.tif" /><img file="US2022121884A1_D14348.tif" /><img file="US2022121884A1_D14349.tif" /><img file="US2022121884A1_D14350.tif" /><img file="US2022121884A1_D14351.tif" /><img file="US2022121884A1_D14352.tif" /><img file="US2022121884A1_D14353.tif" /><img file="US2022121884A1_D14354.tif" /><img file="US2022121884A1_D14355.tif" /><img file="US2022121884A1_D14356.tif" /><img file="US2022121884A1_D14357.tif" /><img file="US2022121884A1_D14358.tif" /><img file="US2022121884A1_D14359.tif" /><img file="US2022121884A1_D14360.tif" /><img file="US2022121884A1_D14361.tif" /><img file="US2022121884A1_D14362.tif" /><img file="US2022121884A1_D14363.tif" /><img file="US2022121884A1_D14364.tif" /><img file="US2022121884A1_D14365.tif" /><img file="US2022121884A1_D14366.tif" /><img file="US2022121884A1_D14367.tif" /><img file="US2022121884A1_D14368.tif" /><img file="US2022121884A1_D14369.tif" /><img file="US2022121884A1_D14370.tif" /><img file="US2022121884A1_D14371.tif" /><img file="US2022121884A1_D14372.tif" /><img file="US2022121884A1_D14373.tif" /><img file="US2022121884A1_D14374.tif" /><img file="US2022121884A1_D14375.tif" /><img file="US2022121884A1_D14376.tif" /><img file="US2022121884A1_D14377.tif" /><img file="US2022121884A1_D14378.tif" /><img file="US2022121884A1_D14379.tif" /><img file="US2022121884A1_D14380.tif" /><img file="US2022121884A1_D14381.tif" /><img file="US2022121884A1_D14382.tif" /><img file="US2022121884A1_D14383.tif" /><img file="US2022121884A1_D14384.tif" /><img file="US2022121884A1_D14385.tif" /><img file="US2022121884A1_D14386.tif" /><img file="US2022121884A1_D14387.tif" /><img file="US2022121884A1_D14388.tif" /><img file="US2022121884A1_D14389.tif" /><img file="US2022121884A1_D14390.tif" /><img file="US2022121884A1_D14391.tif" /><img file="US2022121884A1_D14392.tif" /><img file="US2022121884A1_D14393.tif" /><img file="US2022121884A1_D14394.tif" /><img file="US2022121884A1_D14395.tif" /><img file="US2022121884A1_D14396.tif" /><img file="US2022121884A1_D14397.tif" /><img file="US2022121884A1_D14398.tif" /><img file="US2022121884A1_D14399.tif" /><img file="US2022121884A1_D14400.tif" /><img file="US2022121884A1_D14401.tif" /><img file="US2022121884A1_D14402.tif" /><img file="US2022121884A1_D14403.tif" /><img file="US2022121884A1_D14404.tif" /><img file="US2022121884A1_D14405.tif" /><img file="US2022121884A1_D14406.tif" /><img file="US2022121884A1_D14407.tif" /><img file="US2022121884A1_D14408.tif" /><img file="US2022121884A1_D14409.tif" /><img file="US2022121884A1_D14410.tif" /><img file="US2022121884A1_D14411.tif" /><img file="US2022121884A1_D14412.tif" /><img file="US2022121884A1_D14413.tif" /><img file="US2022121884A1_D14414.tif" /><img file="US2022121884A1_D14415.tif" /><img file="US2022121884A1_D14416.tif" /><img file="US2022121884A1_D14417.tif" /><img file="US2022121884A1_D14418.tif" /><img file="US2022121884A1_D14419.tif" /><img file="US2022121884A1_D14420.tif" /><img file="US2022121884A1_D14421.tif" /><img file="US2022121884A1_D14422.tif" /><img file="US2022121884A1_D14423.tif" /><img file="US2022121884A1_D14424.tif" /><img file="US2022121884A1_D14425.tif" /><img file="US2022121884A1_D14426.tif" /><img file="US2022121884A1_D14427.tif" /><img file="US2022121884A1_D14428.tif" /><img file="US2022121884A1_D14429.tif" /><img file="US2022121884A1_D14430.tif" /><img file="US2022121884A1_D14431.tif" /><img file="US2022121884A1_D14432.tif" /><img file="US2022121884A1_D14433.tif" /><img file="US2022121884A1_D14434.tif" /><img file="US2022121884A1_D14435.tif" /><img file="US2022121884A1_D14436.tif" /><img file="US2022121884A1_D14437.tif" /><img file="US2022121884A1_D14438.tif" /><img file="US2022121884A1_D14439.tif" /><img file="US2022121884A1_D14440.tif" /><img file="US2022121884A1_D14441.tif" /><img file="US2022121884A1_D14442.tif" /><img file="US2022121884A1_D14443.tif" /><img file="US2022121884A1_D14444.tif" /><img file="US2022121884A1_D14445.tif" /><img file="US2022121884A1_D14446.tif" /><img file="US2022121884A1_D14447.tif" /><img file="US2022121884A1_D14448.tif" /><maths id="MATH-US-00064-4" num="00064.4"><math overflow="scroll"><mrow><mi>z</mi><mo>=</mo><mrow><mi>f</mi><mo></mo><mrow><mo>(</mo><mrow><msup><mi>x</mi><mi>′</mi></msup><mo>,</mo><msup><mi>y</mi><mi>′</mi></msup></mrow><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D14449.tif" /><img file="US2022121884A1_D14450.tif" /><img file="US2022121884A1_D14451.tif" /><img file="US2022121884A1_D14452.tif" /><img file="US2022121884A1_D14453.tif" /><img file="US2022121884A1_D14454.tif" /><img file="US2022121884A1_D14455.tif" /><img file="US2022121884A1_D14456.tif" /><img file="US2022121884A1_D14457.tif" /><img file="US2022121884A1_D14458.tif" /><img file="US2022121884A1_D14459.tif" /><img file="US2022121884A1_D14460.tif" /><img file="US2022121884A1_D14461.tif" /><img file="US2022121884A1_D14462.tif" /><img file="US2022121884A1_D14463.tif" /><img file="US2022121884A1_D14464.tif" /><img file="US2022121884A1_D14465.tif" /><img file="US2022121884A1_D14466.tif" /><img file="US2022121884A1_D14467.tif" /><img file="US2022121884A1_D14468.tif" /><img file="US2022121884A1_D14469.tif" /><img file="US2022121884A1_D14470.tif" /><img file="US2022121884A1_D14471.tif" /><img file="US2022121884A1_D14472.tif" /><img file="US2022121884A1_D14473.tif" /><img file="US2022121884A1_D14474.tif" /><img file="US2022121884A1_D14475.tif" /><img file="US2022121884A1_D14476.tif" /><img file="US2022121884A1_D14477.tif" /><img file="US2022121884A1_D14478.tif" /><img file="US2022121884A1_D14479.tif" /><img file="US2022121884A1_D14480.tif" /><img file="US2022121884A1_D14481.tif" /><img file="US2022121884A1_D14482.tif" /><img file="US2022121884A1_D14483.tif" /><img file="US2022121884A1_D14484.tif" /><img file="US2022121884A1_D14485.tif" /><img file="US2022121884A1_D14486.tif" /><img file="US2022121884A1_D14487.tif" /><img file="US2022121884A1_D14488.tif" /><img file="US2022121884A1_D14489.tif" /><img file="US2022121884A1_D14490.tif" /><img file="US2022121884A1_D14491.tif" /><img file="US2022121884A1_D14492.tif" /><img file="US2022121884A1_D14493.tif" /><img file="US2022121884A1_D14494.tif" /><img file="US2022121884A1_D14495.tif" /><img file="US2022121884A1_D14496.tif" /><img file="US2022121884A1_D14497.tif" /><img file="US2022121884A1_D14498.tif" /><img file="US2022121884A1_D14499.tif" /><img file="US2022121884A1_D14500.tif" /><img file="US2022121884A1_D14501.tif" /><img file="US2022121884A1_D14502.tif" /><img file="US2022121884A1_D14503.tif" /><img file="US2022121884A1_D14504.tif" /><img file="US2022121884A1_D14505.tif" /><img file="US2022121884A1_D14506.tif" /><img file="US2022121884A1_D14507.tif" /><img file="US2022121884A1_D14508.tif" /><img file="US2022121884A1_D14509.tif" /><img file="US2022121884A1_D14510.tif" /><img file="US2022121884A1_D14511.tif" /><img file="US2022121884A1_D14512.tif" /><img file="US2022121884A1_D14513.tif" /><img file="US2022121884A1_D14514.tif" /><img file="US2022121884A1_D14515.tif" /><img file="US2022121884A1_D14516.tif" /><img file="US2022121884A1_D14517.tif" /><img file="US2022121884A1_D14518.tif" /><img file="US2022121884A1_D14519.tif" /><img file="US2022121884A1_D14520.tif" /><img file="US2022121884A1_D14521.tif" /><img file="US2022121884A1_D14522.tif" /><img file="US2022121884A1_D14523.tif" /><img file="US2022121884A1_D14524.tif" /><img file="US2022121884A1_D14525.tif" /><img file="US2022121884A1_D14526.tif" /><img file="US2022121884A1_D14527.tif" /><img file="US2022121884A1_D14528.tif" /><img file="US2022121884A1_D14529.tif" /><img file="US2022121884A1_D14530.tif" /><img file="US2022121884A1_D14531.tif" /><img file="US2022121884A1_D14532.tif" /><img file="US2022121884A1_D14533.tif" /><img file="US2022121884A1_D14534.tif" /><img file="US2022121884A1_D14535.tif" /><img file="US2022121884A1_D14536.tif" /><img file="US2022121884A1_D14537.tif" /><img file="US2022121884A1_D14538.tif" /><img file="US2022121884A1_D14539.tif" /><img file="US2022121884A1_D14540.tif" /><img file="US2022121884A1_D14541.tif" /><img file="US2022121884A1_D14542.tif" /><img file="US2022121884A1_D14543.tif" /><img file="US2022121884A1_D14544.tif" /><img file="US2022121884A1_D14545.tif" /><img file="US2022121884A1_D14546.tif" /><img file="US2022121884A1_D14547.tif" /><img file="US2022121884A1_D14548.tif" /><img file="US2022121884A1_D14549.tif" /><img file="US2022121884A1_D14550.tif" /><img file="US2022121884A1_D14551.tif" /><img file="US2022121884A1_D14552.tif" /><img file="US2022121884A1_D14553.tif" /><img file="US2022121884A1_D14554.tif" /><img file="US2022121884A1_D14555.tif" /><img file="US2022121884A1_D14556.tif" /><img file="US2022121884A1_D14557.tif" /><img file="US2022121884A1_D14558.tif" /><img file="US2022121884A1_D14559.tif" /><img file="US2022121884A1_D14560.tif" />
In one embodiment, fuzzy maps in X and Y domains are scanned, and μ<sub>Az</sub>*(z, η) is determined by granularizing (z, η) to (Z<sub>g</sub>, η<sub>g</sub>) as described above and illustrated in <figref idref="DRAWINGS">FIG. 28(<i>c</i>)</figref>.
In one embodiment, the fuzzy map is derived based on candidate fuzzy sets in X and Y (each having same color/grayscale along its trace, e.g., based on color/grayscale contour of fuzzy maps A<sub>x </sub>* or A<sub>y</sub>*) and/or using alphα-cut approach in membership functions of candidate fuzzy sets from A<sub>x </sub>* and/or A<sub>y </sub>* (e.g., explained in this disclosure) to derive candidate fuzzy sets and their associated color/grayscale representing A<sub>z </sub>* in Z.
In one embodiment, a derived fuzzy map, such as A<sub>z </sub>* mentioned above, is used to test consistency against a candidate A<sub>z</sub>. Above, a method to derive the test score for such consistency was provided. In one embodiment, a fuzzy map based on such a candidate A<sub>z </sub>is used to determine the consistency of a pair (A<sub>z</sub>, B<sub>z</sub>) against a derived map A<sub>z</sub>*. In one embodiment, the confidence level B, is determined so that (A<sub>z</sub>, B<sub>z</sub>) is a representative approximation of derived map A<sub>z</sub>*. As depicted in <figref idref="DRAWINGS">FIG. 29</figref> (which is using X instead of Z variable), in one embodiment, starting with a derived map A<sub>x </sub>* (or calculated map from (A, B)), a candidate membership function of X in fuzzy set C is made fuzzy by D, to form another fuzzy map C*. In one embodiment, the consistency of C* against A* is determined. In one embodiment, D or a restriction on D is determined to make C* consistent with A*. In one embodiment, D or a restriction on D is determined to make C* consistent with or cover A*, while maintaining higher level of confidence for D.
In one embodiment, the fuzzy maps are compared for consistency over (x and η), e.g., by comparing color/gray scale at corresponding points/granular. In one embodiment, weight is assigned to such comparison where the color/gray scale difference or the possibility of such membership value in each map is large. In one embodiment, the test score comparison between fuzzy maps is determined by point-wise coverage (e.g., with weight). In one embodiment, a threshold or a fuzzy rule is used to get point-wise coverage degree through summation or integration over map or portion of the map (e.g., where A* is above a threshold).
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 29</figref>, a candidate fuzzy set C is used with a parametric certainty measure D (e.g., D=D(α)). In one embodiment, a model of (C, D) is used with various values of α to test the coverage over (A, B). In one embodiment, an optimization is used to optimize or select among various (e.g., candidate) C's by minimizing uncertainty level/values with respect to α. In one embodiment, coverage test score of C* over A* is treated as a constraint in an optimization engine, while coverage test score of A* over C* is used as an objective function.
In one embodiment, as depicted in <figref idref="DRAWINGS">FIG. 30</figref>, by varying D (e.g., by increasing uncertainty) from D<sub>1 </sub>to D<sub>2</sub>, the fuzzy map (at x<sub>0 </sub>cross section) of μ<sub>(C, D2)</sub>(x<sub>0</sub>, η) (shown in dotted line) widens from μ<sub>(C, D1)</sub>(x<sub>0</sub>, η) (shown in solid thick line), to cover the fuzzy map of μ<sub>(A, B)</sub>(x<sub>0</sub>, η). In one embodiment, as shown in <figref idref="DRAWINGS">FIG. 30</figref>, when μ<sub>C</sub>(x<sub>0</sub>) does not coincide with μ<sub>A</sub>(x<sub>0</sub>), it would take larger degree of uncertainty (e.g., from D<sub>1 </sub>to D<sub>2</sub>) to cover the fuzzy map. In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 31</figref>, D is parameterized (e.g., by α indicating the level of certainty of D). The variation of the cross section of the fuzzy map μ<sub>(C, Dα)</sub>(x<sub>0</sub>, η), in one embodiment, is illustrated in <figref idref="DRAWINGS">FIG. 31</figref>, for various values of α (from α<sub>max </sub>to α<sub>min</sub>). For example, in one embodiment, μ<sub>(C,Dα)</sub>(x<sub>0</sub>, η) reduces to μ<sub>C</sub>(x<sub>0</sub>) at α<sub>max </sub>while it becomes fiat 1 at α<sub>min </sub>(implying any membership function is possible at x<sub>0</sub>). For example, in one embodiment, the core and support of fuzzy map cross section μ<sub>(C,Dα)</sub>(x<sub>0</sub>η) is determined based on parameter α, using for example the model database and the context. For example, in one embodiment, as depicted in <figref idref="DRAWINGS">FIG. 32</figref>, the width of core and support of the fuzzy map cross section μ<sub>(C,Dα)</sub>(x<sub>0</sub>, η) and how they get clipped at limits of 0 and 1, are determined by D<sub>α</sub> and μ<sub>C</sub>(x<sub>0</sub>). In such an embodiment, two values of x having the same μ<sub>C</sub>(x) values will result in the same fuzzy map cross section as shown for example in <figref idref="DRAWINGS">FIG. 32</figref>.
In one embodiment, as depicted in <figref idref="DRAWINGS">FIG. 22(<i>a</i>)</figref>, a fuzzy map A* is constructed by lateral fuzziness of A by an amount determined by B. In one embodiment, as depicted in <figref idref="DRAWINGS">FIG. 33(<i>a</i>)</figref>, the possibility of membership value at (x′, η′), denoted by μ<sub>A</sub>*(x′, η′) is determined by the location of the set of x values denoted by {x<sub>i</sub>} where μ<sub>A</sub>(x<sub>i</sub>) is η′. For example, as depicted in <figref idref="DRAWINGS">FIG. 33(<i>a</i>)</figref>, x<sub>1 </sub>and x<sub>i </sub>belong to this set as they have the same membership function value (i.e., η′) in A. In one embodiment, μ<sub>A</sub>*(x′, η′) is determined by the location of {x<sub>i</sub>} and B. In one embodiment, the characteristics of B is made parametric, e.g., B=B(α), where α (e.g., [0, 1]) represents the degree of sureness or certainty of B. In one embodiment, μ<sub>A</sub>*(x′, η′) is determined by the contributions from each x in {x<sub>i</sub>}. In one embodiment, the contribution of possibility of membership value to μ<sub>A</sub>*(x′, η′) from x<sub>i </sub>is determined by a model (e.g., trapezoid or triangular) based on x<sub>i </sub>and B (or α). In one embodiment, as depicted in <figref idref="DRAWINGS">FIG. 33(<i>b</i>)</figref>, the contribution of x<sub>i </sub>is represented by a fuzzy set (denoted. μ<sub>xi,α,L</sub>(x)), where L is a characteristics obtained from or dependent on the context of X domain A). For example, as depicted in <figref idref="DRAWINGS">FIG. 33(<i>b</i>)</figref>, the trapezoid model around x<sub>i</sub>, has a core and support (denoted as C<sub>α,L </sub>and S<sub>α,L</sub>, respectively) which are dependent on the characteristic length (in X domain) and severity of α. Given α and x<sub>i</sub>, μ<sub>xi,α,L</sub>(x) is constructed or determined and the contribution at x′ is determined by μ<sub>xi,α,L</sub>(x′), as depicted in <figref idref="DRAWINGS">FIG. 33(<i>b</i>)</figref>. Therefore, in one embodiment, the fuzzy map is determined as:
<maths id="MATH-US-00065" num="00065"><math overflow="scroll"><mrow><mrow><msub><mi>μ</mi><msup><mi>A</mi><mo>*</mo></msup></msub><mo></mo><mrow><mo>(</mo><mrow><msup><mi>x</mi><mi>′</mi></msup><mo>,</mo><msup><mi>η</mi><mi>′</mi></msup></mrow><mo>)</mo></mrow></mrow><mo>=</mo><mrow><munder><mi>sup</mi><mrow><mo>∀</mo><mrow><msub><mi>x</mi><mi>i</mi></msub><mo>∈</mo><mrow><mo>{</mo><mrow><msub><mi>x</mi><mi>k</mi></msub><mo></mo><mrow><mo></mo><mrow><msup><mi>η</mi><mi>′</mi></msup><mo>=</mo><mrow><msub><mi>μ</mi><mi>A</mi></msub><mo></mo><mrow><mo>(</mo><msub><mi>x</mi><mi>k</mi></msub><mo>)</mo></mrow></mrow></mrow><mo>}</mo></mrow></mrow></mrow></mrow></mrow></munder><mo></mo><mrow><mo>(</mo><mrow><msub><mi>μ</mi><msub><mi>x</mi><mrow><mi>i</mi><mo>,</mo><mi>α</mi><mo>,</mo><mi>L</mi></mrow></msub></msub><mo></mo><mrow><mo>(</mo><msup><mi>x</mi><mi>′</mi></msup><mo>)</mo></mrow></mrow><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D14561.tif" /><img file="US2022121884A1_D14562.tif" /><img file="US2022121884A1_D14563.tif" /><img file="US2022121884A1_D14564.tif" /><img file="US2022121884A1_D14565.tif" /><img file="US2022121884A1_D14566.tif" /><img file="US2022121884A1_D14567.tif" /><img file="US2022121884A1_D14568.tif" /><img file="US2022121884A1_D14569.tif" /><img file="US2022121884A1_D14570.tif" /><img file="US2022121884A1_D14571.tif" /><img file="US2022121884A1_D14572.tif" /><img file="US2022121884A1_D14573.tif" /><img file="US2022121884A1_D14574.tif" /><img file="US2022121884A1_D14575.tif" /><img file="US2022121884A1_D14576.tif" /><img file="US2022121884A1_D14577.tif" /><img file="US2022121884A1_D14578.tif" /><img file="US2022121884A1_D14579.tif" /><img file="US2022121884A1_D14580.tif" /><img file="US2022121884A1_D14581.tif" /><img file="US2022121884A1_D14582.tif" /><img file="US2022121884A1_D14583.tif" /><img file="US2022121884A1_D14584.tif" /><img file="US2022121884A1_D14585.tif" /><img file="US2022121884A1_D14586.tif" /><img file="US2022121884A1_D14587.tif" /><img file="US2022121884A1_D14588.tif" /><img file="US2022121884A1_D14589.tif" /><img file="US2022121884A1_D14590.tif" /><img file="US2022121884A1_D14591.tif" /><img file="US2022121884A1_D14592.tif" /><img file="US2022121884A1_D14593.tif" /><img file="US2022121884A1_D14594.tif" /><img file="US2022121884A1_D14595.tif" /><img file="US2022121884A1_D14596.tif" /><img file="US2022121884A1_D14597.tif" /><img file="US2022121884A1_D14598.tif" /><img file="US2022121884A1_D14599.tif" /><img file="US2022121884A1_D14600.tif" /><img file="US2022121884A1_D14601.tif" /><img file="US2022121884A1_D14602.tif" /><img file="US2022121884A1_D14603.tif" /><img file="US2022121884A1_D14604.tif" /><img file="US2022121884A1_D14605.tif" /><img file="US2022121884A1_D14606.tif" /><img file="US2022121884A1_D14607.tif" /><img file="US2022121884A1_D14608.tif" /><img file="US2022121884A1_D14609.tif" /><img file="US2022121884A1_D14610.tif" /><img file="US2022121884A1_D14611.tif" /><img file="US2022121884A1_D14612.tif" /><img file="US2022121884A1_D14613.tif" /><img file="US2022121884A1_D14614.tif" /><img file="US2022121884A1_D14615.tif" /><img file="US2022121884A1_D14616.tif" /><img file="US2022121884A1_D14617.tif" /><img file="US2022121884A1_D14618.tif" /><img file="US2022121884A1_D14619.tif" /><img file="US2022121884A1_D14620.tif" /><img file="US2022121884A1_D14621.tif" /><img file="US2022121884A1_D14622.tif" /><img file="US2022121884A1_D14623.tif" /><img file="US2022121884A1_D14624.tif" /><img file="US2022121884A1_D14625.tif" /><img file="US2022121884A1_D14626.tif" /><img file="US2022121884A1_D14627.tif" /><img file="US2022121884A1_D14628.tif" /><img file="US2022121884A1_D14629.tif" /><img file="US2022121884A1_D14630.tif" /><img file="US2022121884A1_D14631.tif" /><img file="US2022121884A1_D14632.tif" /><img file="US2022121884A1_D14633.tif" /><img file="US2022121884A1_D14634.tif" /><img file="US2022121884A1_D14635.tif" /><img file="US2022121884A1_D14636.tif" /><img file="US2022121884A1_D14637.tif" /><img file="US2022121884A1_D14638.tif" /><img file="US2022121884A1_D14639.tif" /><img file="US2022121884A1_D14640.tif" /><img file="US2022121884A1_D14641.tif" /><img file="US2022121884A1_D14642.tif" /><img file="US2022121884A1_D14643.tif" /><img file="US2022121884A1_D14644.tif" /><img file="US2022121884A1_D14645.tif" /><img file="US2022121884A1_D14646.tif" /><img file="US2022121884A1_D14647.tif" /><img file="US2022121884A1_D14648.tif" /><img file="US2022121884A1_D14649.tif" /><img file="US2022121884A1_D14650.tif" /><img file="US2022121884A1_D14651.tif" /><img file="US2022121884A1_D14652.tif" /><img file="US2022121884A1_D14653.tif" /><img file="US2022121884A1_D14654.tif" /><img file="US2022121884A1_D14655.tif" /><img file="US2022121884A1_D14656.tif" /><img file="US2022121884A1_D14657.tif" /><img file="US2022121884A1_D14658.tif" /><img file="US2022121884A1_D14659.tif" /><img file="US2022121884A1_D14660.tif" /><img file="US2022121884A1_D14661.tif" /><img file="US2022121884A1_D14662.tif" /><img file="US2022121884A1_D14663.tif" /><img file="US2022121884A1_D14664.tif" /><img file="US2022121884A1_D14665.tif" /><img file="US2022121884A1_D14666.tif" /><img file="US2022121884A1_D14667.tif" /><img file="US2022121884A1_D14668.tif" /><img file="US2022121884A1_D14669.tif" /><img file="US2022121884A1_D14670.tif" /><img file="US2022121884A1_D14671.tif" /><img file="US2022121884A1_D14672.tif" />
In one embodiment, C<sub>α,L </sub>and S<sub>α,L </sub>are further dependent on x<sub>i </sub>or μ<sub>A</sub>(x<sub>i</sub>).
In one embodiment, a fuzzy map A* is constructed by both lateral and vertical fuzziness of A by an amount determined by B. In one embodiment, for example as depicted in <figref idref="DRAWINGS">FIG. 34</figref>, a fuzzy region around a set of points, e.g., (x<sub>i</sub>, μ<sub>A</sub>(x<sub>i</sub>)) on trace of μ<sub>A</sub>(x), is used to determine μ<sub>A</sub>*(x′, η′). In one embodiment, such a fuzzy region describes a color/grey scale region about (x<sub>i</sub>, μ<sub>A</sub>(x<sub>i</sub>)) based on the certainty level of B. In one embodiment, B is parameterized, e.g., B=B(α), and value of α is used to determine the extent of the fuzzy region denoted by (μ<sub>xi,ηi,α</sub>(x, η)) for a given point (x<sub>i</sub>, η<sub>i</sub>) on trace of μ<sub>A</sub>(x). In one embodiment, μ<sub>A</sub>*(x′, η′) is determined as follows:
<maths id="MATH-US-00066" num="00066"><math overflow="scroll"><mrow><mrow><msub><mi>μ</mi><msup><mi>A</mi><mo>*</mo></msup></msub><mo></mo><mrow><mo>(</mo><mrow><msup><mi>x</mi><mi>′</mi></msup><mo>,</mo><msup><mi>η</mi><mi>′</mi></msup></mrow><mo>)</mo></mrow></mrow><mo>=</mo><mrow><munder><mi>sup</mi><mrow><mrow><mo>∀</mo><mrow><mrow><mo>(</mo><mrow><msub><mi>x</mi><mi>i</mi></msub><mo>,</mo><msub><mi>η</mi><mi>i</mi></msub></mrow><mo>)</mo></mrow><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>subject</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>to</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><msub><mi>η</mi><mi>i</mi></msub></mrow></mrow><mo>=</mo><mrow><msub><mi>μ</mi><mi>A</mi></msub><mo></mo><mrow><mo>(</mo><msub><mi>x</mi><mi>i</mi></msub><mo>)</mo></mrow></mrow></mrow></munder><mo></mo><mrow><mo>(</mo><mrow><msub><mi>μ</mi><mrow><msub><mi>x</mi><mi>i</mi></msub><mo>,</mo><msub><mi>η</mi><mi>i</mi></msub><mo>,</mo><mi>α</mi></mrow></msub><mo></mo><mrow><mo>(</mo><mrow><msup><mi>x</mi><mi>′</mi></msup><mo>,</mo><msup><mi>η</mi><mi>′</mi></msup></mrow><mo>)</mo></mrow></mrow><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D14673.tif" /><img file="US2022121884A1_D14674.tif" /><img file="US2022121884A1_D14675.tif" /><img file="US2022121884A1_D14676.tif" /><img file="US2022121884A1_D14677.tif" /><img file="US2022121884A1_D14678.tif" /><img file="US2022121884A1_D14679.tif" /><img file="US2022121884A1_D14680.tif" /><img file="US2022121884A1_D14681.tif" /><img file="US2022121884A1_D14682.tif" /><img file="US2022121884A1_D14683.tif" /><img file="US2022121884A1_D14684.tif" /><img file="US2022121884A1_D14685.tif" /><img file="US2022121884A1_D14686.tif" /><img file="US2022121884A1_D14687.tif" /><img file="US2022121884A1_D14688.tif" /><img file="US2022121884A1_D14689.tif" /><img file="US2022121884A1_D14690.tif" /><img file="US2022121884A1_D14691.tif" /><img file="US2022121884A1_D14692.tif" /><img file="US2022121884A1_D14693.tif" /><img file="US2022121884A1_D14694.tif" /><img file="US2022121884A1_D14695.tif" /><img file="US2022121884A1_D14696.tif" /><img file="US2022121884A1_D14697.tif" /><img file="US2022121884A1_D14698.tif" /><img file="US2022121884A1_D14699.tif" /><img file="US2022121884A1_D14700.tif" /><img file="US2022121884A1_D14701.tif" /><img file="US2022121884A1_D14702.tif" /><img file="US2022121884A1_D14703.tif" /><img file="US2022121884A1_D14704.tif" /><img file="US2022121884A1_D14705.tif" /><img file="US2022121884A1_D14706.tif" /><img file="US2022121884A1_D14707.tif" /><img file="US2022121884A1_D14708.tif" /><img file="US2022121884A1_D14709.tif" /><img file="US2022121884A1_D14710.tif" /><img file="US2022121884A1_D14711.tif" /><img file="US2022121884A1_D14712.tif" /><img file="US2022121884A1_D14713.tif" /><img file="US2022121884A1_D14714.tif" /><img file="US2022121884A1_D14715.tif" /><img file="US2022121884A1_D14716.tif" /><img file="US2022121884A1_D14717.tif" /><img file="US2022121884A1_D14718.tif" /><img file="US2022121884A1_D14719.tif" /><img file="US2022121884A1_D14720.tif" /><img file="US2022121884A1_D14721.tif" /><img file="US2022121884A1_D14722.tif" /><img file="US2022121884A1_D14723.tif" /><img file="US2022121884A1_D14724.tif" /><img file="US2022121884A1_D14725.tif" /><img file="US2022121884A1_D14726.tif" /><img file="US2022121884A1_D14727.tif" /><img file="US2022121884A1_D14728.tif" /><img file="US2022121884A1_D14729.tif" /><img file="US2022121884A1_D14730.tif" /><img file="US2022121884A1_D14731.tif" /><img file="US2022121884A1_D14732.tif" /><img file="US2022121884A1_D14733.tif" /><img file="US2022121884A1_D14734.tif" /><img file="US2022121884A1_D14735.tif" /><img file="US2022121884A1_D14736.tif" /><img file="US2022121884A1_D14737.tif" /><img file="US2022121884A1_D14738.tif" /><img file="US2022121884A1_D14739.tif" /><img file="US2022121884A1_D14740.tif" /><img file="US2022121884A1_D14741.tif" /><img file="US2022121884A1_D14742.tif" /><img file="US2022121884A1_D14743.tif" /><img file="US2022121884A1_D14744.tif" /><img file="US2022121884A1_D14745.tif" /><img file="US2022121884A1_D14746.tif" /><img file="US2022121884A1_D14747.tif" /><img file="US2022121884A1_D14748.tif" /><img file="US2022121884A1_D14749.tif" /><img file="US2022121884A1_D14750.tif" /><img file="US2022121884A1_D14751.tif" /><img file="US2022121884A1_D14752.tif" /><img file="US2022121884A1_D14753.tif" /><img file="US2022121884A1_D14754.tif" /><img file="US2022121884A1_D14755.tif" /><img file="US2022121884A1_D14756.tif" /><img file="US2022121884A1_D14757.tif" /><img file="US2022121884A1_D14758.tif" /><img file="US2022121884A1_D14759.tif" /><img file="US2022121884A1_D14760.tif" /><img file="US2022121884A1_D14761.tif" /><img file="US2022121884A1_D14762.tif" /><img file="US2022121884A1_D14763.tif" /><img file="US2022121884A1_D14764.tif" /><img file="US2022121884A1_D14765.tif" /><img file="US2022121884A1_D14766.tif" /><img file="US2022121884A1_D14767.tif" /><img file="US2022121884A1_D14768.tif" /><img file="US2022121884A1_D14769.tif" /><img file="US2022121884A1_D14770.tif" /><img file="US2022121884A1_D14771.tif" /><img file="US2022121884A1_D14772.tif" /><img file="US2022121884A1_D14773.tif" /><img file="US2022121884A1_D14774.tif" /><img file="US2022121884A1_D14775.tif" /><img file="US2022121884A1_D14776.tif" /><img file="US2022121884A1_D14777.tif" /><img file="US2022121884A1_D14778.tif" /><img file="US2022121884A1_D14779.tif" /><img file="US2022121884A1_D14780.tif" /><img file="US2022121884A1_D14781.tif" /><img file="US2022121884A1_D14782.tif" /><img file="US2022121884A1_D14783.tif" /><img file="US2022121884A1_D14784.tif" />
In one embodiment, the fuzzy region μ<sub>xi,ηi,α</sub>(x, η) is selected to decouple (x, η) into vertical and horizontal fuzzy components, e.g.:
<br />μ<sub>x</sub><sub><sub2>i</sub2></sub><sub>,η</sub><sub><sub2>i</sub2></sub><sub>,α</sub>(<i>x</i>′, η′)=μ<sub>Lat,x</sub><sub><sub2>i</sub2></sub><sub>,η</sub><sub><sub2>i</sub2></sub><sub>,α</sub>(<i>x</i>′) {circumflex over ( )}μ<sub>Ver,x</sub><sub><sub2>i</sub2></sub><sub>,η</sub><sub><sub2>i</sub2></sub><sub>,α</sub>(η′)
In one embodiment, the above test is limited to set of signature points (e.g., defining the corners of μ<sub>Ax</sub>, or certain pre-defined values of η). In such an embodiment, color/grey scale contours (e.g., convex) are determined to envelope neighboring (x′, η′) points having the same assigned μ<sub>A</sub>*(x′, η′) value. The envelopes are then assigned the common color/grey scale value of μ<sub>A</sub>*(x′, η′). In one embodiment, these envelops of contours define μ<sub>A</sub>*(x, η).
Example 5
In one embodiment, a fuzzy rules engine employs a fuzzy rule with A* at its antecedent. E.g.,:
IF (X is A*) THEN (Y is C), where A*=(A<sub>X</sub>, B<sub>Y</sub>).
In one embodiment, an input proposition, e.g., X is D, is used to evaluate the truth value (T<sub>ant</sub>) of the rule's antecedent. In one embodiment, T<sub>ant </sub>is determined based on the coverage of A* against D, such as a test score. In one embodiment, T<sub>ant </sub>is determined from (μ<sub>A</sub>* {circumflex over ( )} μ<sub>D</sub>), as illustrated in <figref idref="DRAWINGS">FIGS. 35(<i>a</i>)-(<i>d</i>)</figref>. As depicted in <figref idref="DRAWINGS">FIG. 3</figref><b>5</b>(<i>a</i>), max(μ<sub>A </sub>{circumflex over ( )} μ<sub>D</sub>) occurs at η<sub>0</sub>. To determine (μ<sub>A </sub>* {circumflex over ( )} μ<sub>D</sub>), in one embodiment, at various x values, such as x′, possible η values (in [0, 1]) and μ<sub>D</sub>(x′) are compared for minimum (with the result denoted as η<sub>min</sub>). In one embodiment, this result is given the weight of max( (μ<sub>A</sub>*(x′, η) {circumflex over ( )} μ<sub>D</sub>(x′) ) subject to min(η, μ<sub>D</sub>(x′))=η<sub>min</sub>. This result/weight is a fuzzy map in (x, η<sub>min</sub>) domain, as for example depicted in <figref idref="DRAWINGS">FIG. 35(<i>b</i>)</figref>, representing (μ<sub>A </sub>* {circumflex over ( )}°μ<sub>D</sub>). In one embodiment, max(μ<sub>A</sub>* {circumflex over ( )}μ<sub>D</sub>) is used as the truth value of the antecedent. Note that in special case of extreme sureness for B<sub>x</sub>, T<sub>ant </sub>is η<sub>0 </sub>(or max(μ<sub>A </sub>{circumflex over ( )} μ<sub>D</sub>)). In one embodiment, based on (μ<sub>A </sub>* {circumflex over ( )} μ<sub>D</sub>), for various η<sub>min </sub>values, their corresponding degree of possibility (denoted as μ<sub>ηmin</sub>) are determined, as depicted for example in <figref idref="DRAWINGS">FIG. 35(<i>c</i>)</figref>. For special case of (μ<sub>A</sub>{circumflex over ( )} μ<sub>D</sub>), such μ<sub>ηmin </sub>possibility becomes a crisp set with an edge at η<sub>0</sub>. However, due to (μ<sub>A </sub>* {circumflex over ( )} μ<sub>D</sub>) fuzzy map, the edge of μ<sub>ηmin </sub>is fuzzy (ramping at to η<sub>1 </sub>to η<sub>2</sub>) and also extended to higher values (i.e., η<sub>2 </sub>instead of η<sub>0</sub>, if for example, the core of A* fuzziness has non-zero width). In one embodiment, T<sub>ant </sub>is determined by taking maximum of η<sub>min</sub>, as for example depicted in <figref idref="DRAWINGS">FIG. 35(<i>d</i>)</figref>. In this example, the maximum η<sub>min </sub>has a possibility distribution (denoted as μ<sub>max(ηmin)</sub>) starting up at η<sub>1 </sub>and ramping down at η<sub>2</sub>.
In one embodiment, a centroid location of μ<sub>max(ηmin) </sub>(depicted as η<sub>c </sub>in <figref idref="DRAWINGS">FIG. 35(<i>d</i>)</figref>) is taken as T<sub>ant</sub>. In one embodiment, a defuzzied value of μ<sub>max(ηmin) </sub>(e.g. η<sub>1</sub>) is taken as T<sub>ant</sub>. In one embodiment, the fuzzy set μ<sub>max(ηmin) </sub>is used directly to impact the truth value of the consequent, e.g., by fuzzy clipping of fuzzy scaling of the consequent's corresponding membership function.
Generalization of Some of the Concepts:
(a) Apparent Confidence of a Speaker:
For example, let's start from the following statement: “Event A is very rare”. Let's consider the following situation: Person B (a source of information, or the speaker, or the writer) says: “Event A is very rare, and I am sure about it.”. In this example, the word “rare” signifies the statistical frequency of the event A happening. “Being sure about the statement above” indicates the “apparent” confidence of the speaker (person B). In this case, the degree of the “apparent confidence of the speaker” is high. Please note that this is just the “apparent” confidence of the speaker, and it may not be the “real” confidence of the speaker, due to the parameters mentioned below, such as speaker's truthfulness (which can make the apparent confidence different from the real confidence of the speaker).
In one model, the degree of the apparent confidence of the speaker is set between 0 and 1, as a normalized axis (or scale), for example, corresponding to zero (minimum) apparent confidence of the speaker level and maximum apparent confidence of the speaker level, respectively.
Please note that sometimes, the speaker only says “Event A is very rare.”, and he does not mention “and I think it is true.” in his statement. However, a listener may conclude that the speaker meant to say that “Event A is very rare, and I think it is true.”, which may be understood from the context of the statement by the speaker.
(b) Speaker's Truthfulness:
In one embodiment, person B (the speaker) might have a bias or bad faith, or may be a liar (e.g. for the statement “Event A is very rare.”). For example, he may lie very often, or he may lie often only on a specific subject or in a specific context. Or, we may have a history of lies coming from person B (as a source of information). In all of these cases, the person B “intentionally” twists his own belief, when he expresses his statement verbally or in writing. Of course, if his own belief is false (in the first place), the end result (his twisted statement) may become valid or partially valid, anyway. Thus, for any speaker who is biased, has a bad faith, or is a liar, the degree of the “speaker's truthfulness” is low. The degree of the “speaker's truthfulness” is usually hidden or unknown to the listener or reader.
In one model, the degree of the truthfulness of the speaker is set between 0 and 1, as a normalized axis (or scale), for example, corresponding to zero (minimum) and maximum truthfulness of the speaker levels, respectively. For example, 0 and 1 correspond to the always-“liar” and always-“not-liar” speakers, respectively.
Please note that the “truthfulness of a statement” is different from the “truthfulness of a speaker”.
(c) Expertise of the Speaker:
Another factor is the degree of expertise or knowledge of a person about a subject (or how well a person can analyze the data received on a given subject, or how well a person can express the ideas and conclusions to others using the right language and phrases). For example, if the event A is about astronomy and the speaker has low or no knowledge about astronomy, then the “degree of expertise of the speaker” (or source of information) is low. In one model, the degree of the expertise of the speaker is set between 0 and 1, or 0 to 100 percent, as a normalized axis (or scale), for example, corresponding to zero (minimum) and maximum expertise levels, respectively.
(d) Perception of the Speaker:
Another factor is the degree of “perception of the speaker” about an event or subject. For example, a person with a weak eye sight (and without eyeglasses) cannot be a good witness for a visual observation of an event from a far distance, for example as a witness in a court. In one model, the degree of the perception of the speaker is set between 0 and 1, as a normalized axis (or scale), for example, corresponding to zero (minimum) and maximum levels, respectively.
(e) Trustworthiness of a Speaker:
Now, here is a new parameter, the “trustworthiness of a speaker”, which depends on at least the 4 factors mentioned above: <ul id="ul0017" list-style="none"><li id="ul0017-0001" num="0000"><ul id="ul0018" list-style="none"><li id="ul0018-0001" num="0814">1—the degree of the “apparent confidence of the speaker”</li><li id="ul0018-0002" num="0815">2—the degree of the “speaker's truthfulness”</li><li id="ul0018-0003" num="0816">3—the degree of “expertise of the speaker”</li><li id="ul0018-0004" num="0817">4—the degree of “perception of the speaker”</li></ul></li></ul>
For example, as shown in <figref idref="DRAWINGS">FIG. 43</figref>, the trustworthiness of a speaker is high (or the speaker is “trustworthy”), if: <ul id="ul0019" list-style="none"><li id="ul0019-0001" num="0000"><ul id="ul0020" list-style="none"><li id="ul0020-0001" num="0819">1—the degree of the “apparent confidence of the speaker” is high &</li><li id="ul0020-0002" num="0820">2—the degree of the “speaker's truthfulness” is high &</li><li id="ul0020-0003" num="0821">3—the degree of “expertise of the speaker” is high &</li><li id="ul0020-0004" num="0822">4—the degree of “perception of the speaker” is high</li></ul></li></ul>
In one model, the degree of the “trustworthiness” of a speaker is set between 0 and 1, as a normalized axis (or scale), for example, corresponding to zero (or minimum) and maximum trustworthiness levels, respectively,
Please note that, in some situations, the “apparent confidence of the speaker” may become dependent or intertwined on the statement itself or one of the other parameters mentioned above, e.g. the “perception of the speaker”.
(f) Sureness of a Speaker:
Similarly, here is another parameter, the “sureness” of a speaker, which depends on at least the 4 factors mentioned above: <ul id="ul0021" list-style="none"><li id="ul0021-0001" num="0000"><ul id="ul0022" list-style="none"><li id="ul0022-0001" num="0826">1—the degree of the “apparent confidence of the speaker”</li><li id="ul0022-0002" num="0827">2—the degree of the “speaker's truthfulness”</li><li id="ul0022-0003" num="0828">3—the degree of “expertise of the speaker”</li><li id="ul0022-0004" num="0829">4—the degree of “perception of the speaker”</li></ul></li></ul>
For example, as shown in <figref idref="DRAWINGS">FIG. 44</figref>, the “sureness” of a speaker of a statement is high, if: <ul id="ul0023" list-style="none"><li id="ul0023-0001" num="0000"><ul id="ul0024" list-style="none"><li id="ul0024-0001" num="0831">1—the degree of the “apparent confidence of the speaker” is high &</li><li id="ul0024-0002" num="0832">2—the degree of the “speaker's truthfulness” is either high or low (but not medium) (i.e. when speaker's truthfulness is close to either 1 or 0. but away from 0.5) &</li><li id="ul0024-0003" num="0833">3—the degree of “expertise of the speaker” is high &</li><li id="ul0024-0004" num="0834">4—the degree of “perception of the speaker” is high</li></ul></li></ul>
In one model, the degree of the “sureness of a speaker” of a statement is set between 0 and 1, as a normalized axis (or scale), for example, corresponding to zero (or minimum) and maximum sureness levels, respectively.
Please note that in our definitions here, there is a difference between the “sureness” and “trustworthiness” (of a speaker). For example, a speaker may have low trustworthiness, but has a high sureness. For example, for an always-liar speaker (i.e. when the speaker's degree of truthfulness is 0), the speaker has a low trustworthiness (for the listener), but has a high level of sureness. That is, for an always-liar speaker (i.e. not “trustworthy”), the conclusion from a statement becomes the reverse of the original statement, which means that the speaker has a high level of sureness (for the listener). For example, for an always-liar speaker, the statement “Event A is very rare” results in the following conclusion for the listener: “Event A is not very rare”. That is, once the listener knows (or has the knowledge) that the speaker is an always-liar speaker, the listener can still “count on” the “reverse” of the statement given by the speaker (with a high degree of “sureness”).
In another example, for a speaker that “sometimes lies” (i.e. a “sometimes-liar”, with the speaker's degree of truthfulness around 0.5), the “sureness” about the speaker is low.
(g) Broadness of a Statement:
Now, let's look at another factor, “the degree of the broadness of the statement”, with some examples. For example, in response to the question that “What is the color of the table?”, the statement “The color of the table may be green, blue, or red.” has higher degree of broadness than that of the statement “The color of the table is green.”, with respect to the information about the color of the table.
For example, in response to the question that “When does the meeting start today?”, the statement “The meeting may start in the next few hours,” has higher degree of broadness than that of the statement “The meeting starts at 10 am.”, with respect to the information about the starting time of the meeting.
In one model, the degree of the “broadness” of a statement is set between 0 and 1, as a normalized axis (or scale), for example, corresponding to zero (or minimum) and maximum (or 100 percent) broadness levels, respectively.
(h) Helpfulness of a Statement:
Now, let's look at another parameter, the degree of “helpfulness” (for a statement (for a listener or reader)), which depends on at least the following 2 parameters: <ul id="ul0025" list-style="none"><li id="ul0025-0001" num="0000"><ul id="ul0026" list-style="none"><li id="ul0026-0001" num="0842">1—the degree of the “sureness of the speaker” of the statement</li><li id="ul0026-0002" num="0843">2—the degree of “broadness of the statement”</li></ul></li></ul>
The degree of “helpfulness of a statement” is one measure of the information of a statement (for a listener or reader or the recipient of information), which is very contextual (e.g. dependent on the question asked).
For example, as shown in <figref idref="DRAWINGS">FIG. 45</figref>, the degree of “helpfulness” for a statement (or information or data) is high (or the statement is “helpful”), if: <ul id="ul0027" list-style="none"><li id="ul0027-0001" num="0000"><ul id="ul0028" list-style="none"><li id="ul0028-0001" num="0846">1—the degree of the “sureness of the speaker” of the statement is high &</li><li id="ul0028-0002" num="0847">2—the degree of the “broadness of the statement” is low (i.e. the statement is very “specific”).</li></ul></li></ul>
In one model, the degree of the “helpfulness” of a statement is set between 0 and 1, as a normalized axis (or scale), for example, corresponding to zero (or minimum) and maximum helpfulness levels, respectively. The degree of the “helpfulness” of a statement or information (I) is denoted by function H(I).
Please note that all the parameters above (e.g. the degree of the helpfulness) can also be expressed by percentages between 0 to 100 percent (or by any other scale, instead of scale of 0 to 1, respectively). The parameters above (e.g. the degree of the helpfulness) can be expressed by Fuzzy representations, as well.
Some Applications:
The parameters above are useful for situations that one gets input or information from one or more sources, and one wants to evaluate, filter, sort, rank, data-mine, validate, score, combine, find and remove or isolate contradictions, conclude, simplify, find and delete or isolate redundancies, criticize, analyze, summarize, or highlight a collection of multiple information pieces or data, from multiple sources with various levels of reliability, credibility, reputation, weight, risk, risk-to-benefit ratio, scoring, statistics, or past performance.
For example, these parameters are useful for editors of an article (such as Wikipedia, with various writers with various levels of credibility, knowledge, and bias), search engines in a database or on Internet (with information coming various sources, with different levels of confidence or credibility), economy or stock market prediction (based on different parameter inputs or opinions of different analysts, and various political, natural, and economical events), background check for security for people (based on multiple inputs from various sources and people, each with different credibility and security risk), medical doctors' opinions or diagnosis (based on doctors with various expertise and experience, information from various articles and books, and data from various measurements and equipment), booking flights and hotel online (with information from various web sites and travel agents, each with different reliability and confidence), an auction web site (with different seller's credibility, reliability, history, and scoring by other users), customize and purchase a computer online (with different pricing and seller's credibility, reliability, history, and scoring by other users), customer feedback (with various credibility), voting on an issue (with various bias), data mining (from various sources with different credibility and weight), and news gathering (from multiple sources of news, on TV or Internet, with various reliability and weight).
In one embodiment, an information source (S) may get its input or information from one or more other sources. In one embodiment, there is a network of other sources, connected in parallel or in series, or in combinations or mixtures of other sources in different configurations. In one embodiment, the information source S0 supplies some information to another information source S1, in a cascade of sources (with each source acting as a node in the structure), e.g. in a tree, pyramid, or hierarchical configuration (with many branches interconnected), where a listener gathers all the information from different sources and analyzes them to make a conclusion from all the information received, as shown in <figref idref="DRAWINGS">FIG. 46</figref>, as an example. The listener itself (in turn) can be a source of information for others (not shown in <figref idref="DRAWINGS">FIG. 46</figref>).
Thus, the overall reliability and the overall credibility of the system (or other parameters describing the system) depends on (is a function of) the components, or the chain of sources in the relevant branch(es), going back to the source(s) of information. That is, for the overall reliability, R, we have:
<br />R=Function (R<sub>S0</sub>, R<sub>S1</sub>, . . . , R<sub>Sm</sub>),
for m sources in the chain, starting from S0.
In one embodiment, for a source of information, when it comes through a cascade or chain of sources, the weakest link dominates the result. For example, the most unreliable link or source determines or dominates the overall reliability. In one embodiment, this can be modeled based on the MINIMUM function for reliability values for multiple sources. In one embodiment, this can be based on the AND function between the values. In one embodiment, this can be based on the additions on inverse values, e.g.:
<br />(1<i>/R</i>)=(1<i>/R</i><sub>1</sub>)+(1<i>/R</i><sub>2</sub>)+. . . +(1<i>/R</i><sub>N</sub>)
(with R as the overall reliability, and R<sub>N </sub>as the reliability for source N)
In one embodiment, the sources are independent sources. In one embodiment, the sources are dependent sources (dependent on each other).
One of the advantages of the fuzzy analysis mentioned here in this disclosure is that, the system can handle contradictory and duplicative information, to sort them out and make a conclusion from various inputs.
In one embodiment, the information can go through a source as a conduit, only (with no changes made on the received information by the source, itself). In another embodiment, the information can be generated, analyzed, and/or modified by the source, based on all the inputs to the source, and/or based on the source's own knowledge base (or database) and processor (or CPU, controller, analyzing module, computer, or microprocessor, to analyze, edit, modify, convert, mix, combine, conclude, summarize, or process the data).
In one embodiment, the source of information has time-dependent parameters. For example, the credibility or reliability of the source changes over time (with respect to a specific subject or all subjects). Or, the bias of the source may change for a specific topic or subject, as the time passes. For example, a news blog, newspaper, radio show, radio host, TV show, TV news, or Internet source may have a predetermined bias or tendency toward a specific party, political idea, social agenda, or economic agenda, which may change due to the new management, owner, or host.
Search Engines and Question-Answering Systems:
Part of this section is a part of a paper by one of our inventors on the subject of search engines, titled “From search engines to question answering systems”, appeared in “Fuzzy logic and semantic web”, edited by Elie Sanchez, 2006, Elsevier B. V. publisher, Chapter 9, pages 163-210.
For one embodiment, for search engines or question-answering systems, one of the main goals is the deduction capability—the capability to synthesize an answer to a query by drawing on bodies of information which reside in various parts of the knowledge base. B<sub>Y </sub>definition, a question-answering system, or Q/A system for short, is a system which has deduction capability. The first obstacle is world knowledge—the knowledge which humans acquire through experience, communication and education. Simple examples are: “Icy roads are slippery,” “Princeton usually means Princeton University,” “Paris is the capital of France,” and “There are no honest politicians.” World knowledge plays a central role in search, assessment of relevance and deduction.
The problem with world knowledge is that much of it is perception-based, Perceptions—and especially perceptions of probabilities—are intrinsically imprecise, reflecting the fact that human sensory organs, and ultimately the brain, have a bounded ability to resolve detail and store information. Imprecision of perceptions stands in the way of using conventional techniques—techniques which are based on bivalent logic and probability theory—to deal with perception-based information. A further complication is that much of world knowledge is negative knowledge in the sense that it relates to what is impossible and/or non-existent. For example, “A person cannot have two fathers,” and “Netherlands has no mountains.”
The second obstacle centers on the concept of relevance. There is an extensive literature on relevance, and every search engine deals with relevance in its own way, some at a high level of sophistication. There are two kinds of relevance: (a) question relevance and (b) topic relevance. Both are matters of degree. For example, on a very basic level, if the question is q: Number of cars in California’? and the available information is p: Population of California is 37,000,000, then what is the degree of relevance of p to q? Another example: To what degree is a paper entitled “A New Approach to Natural Language Understanding” of relevance to the topic of machine translation.
Basically, there are two ways of approaching assessment of relevance: (a) semantic; and (b) statistical. To illustrate, in the number of cars example, relevance of p to q is a matter of semantics and world knowledge. In existing search engines, relevance is largely a matter of statistics, involving counts of links and words, with little if any consideration of semantics, Assessment of semantic relevance presents difficult problems whose solutions lie beyond the reach of bivalent logic and probability theory. What should be noted is that assessment of topic relevance is more amendable to the use of statistical techniques, which explains why existing search engines are much better at assessment of topic relevance than question relevance.
The third obstacle is deduction from perception-based information. As a basic example, assume that the question is q: What is the average height of Swedes?, and the available information is p: Most adult Swedes are tall. Another example is: Usually Robert returns from work at about 6 pm. What is the probability that Robert is home at about 6:15 pm? Neither bivalent logic nor probability theory provide effective tools for dealing with problems of this type. The difficulty is centered on deduction from premises which are both uncertain and imprecise.
Underlying the problems of world knowledge, relevance, and deduction is a very basic problem—the problem of natural language understanding. Much of world knowledge and web knowledge is expressed in a natural language. A natural language is basically a system for describing perceptions. Since perceptions are intrinsically imprecise, so are natural languages, especially in the realm of semantics.
A prerequisite to mechanization of question-answering is mechanization of natural language understanding, and a prerequisite to mechanization of natural language understanding is precisiation of meaning of concepts and proposition drawn from a natural language. To deal effectively with world knowledge, relevance, deduction and precisiation, new tools are needed. The principal new tools are: Precisiated Natural Language (PNL); Protoform Theory (PFT); and the Generalized Theory of Uncertainty (GTU). These tools are drawn from fuzzy logic a logic in which everything is, or is allowed to be, a matter of degree.
The centerpiece of new tools is the concept of a generalized constraint. The importance of the concept of a generalized constraint derives from the fact that in PNL and GTU it serves as a basis for generalizing the universally accepted view that information is statistical in nature. More specifically, the point of departure in PNL and GTU is the fundamental premise that, in general, information is representable as a system of generalized constraints, with statistical information constituting a special case. Thus, much more general view of information is needed to deal effectively with world knowledge, relevance, deduction, precisiation and related problems. Therefore, a quantum jump in search engine IQ cannot be achieved through the use of methods based on bivalent logic and probability theory.
Deduction capability is a very important capability which the current search engines generally have not fully developed, yet. What should be noted, however, is that there are many widely used special purpose Q/A systems which have limited deduction capability. Examples of such systems are driving direction systems, reservation systems, diagnostic systems and specialized expert systems, especially in the domain of medicine.
It is of historical interest to note that question-answering systems were an object of considerable attention in the early seventies. The literature abounded with papers dealing with them. Interest in question-answering systems dwindled in the early eighties, when it became obvious that AI was not advanced enough to provide the needed tools and technology. In recent years, significant progress toward enhancement of web intelligence has been achieved through the use of concepts and techniques related to the Semantic Web, OWL, CYC and other approaches. But such approaches, based on bivalent logic and probability theory, cannot do the job. The reason, which is not widely recognized as yet, is that bivalent logic and bivalent-logic-based probability theory have intrinsic limitations. To circumvent these limitations what are needed are new tools based on fuzzy logic and fuzzy-logic-based probability theory. What distinguishes fuzzy logic from standard logical systems is that in fuzzy logic everything is, or is allowed to be graduated, that is, be a matter of degree. Furthermore, in fuzzy logic everything is allowed to be granulated, with a granule being a clump of values drawn together by indistinguishability, similarity or proximity. It is these fundamental features of fuzzy logic that give it a far greater power to deal with problems related to web intelligence than standard tools based on bivalent logic and probability theory. An analogy to this is: In general, a valid model of a nonlinear system cannot be constructed through the use of linear components.
There are three major obstacles to upgrading a search engine to a question-answering system: (a) the problem of world knowledge; (b) the problem of relevance; and (c) the underlying problem of mechanization of natural language understanding and, in particular, the basic problem of precisiation of meaning. Since the issues to be discussed are not restricted to web-related problems, our discussion will be general in nature.
The Problem of World Knowledge:
World knowledge is the knowledge which humans acquire through experience, education and communication. Simple examples are: <ul id="ul0029" list-style="none"><li id="ul0029-0001" num="0000"><ul id="ul0030" list-style="none"><li id="ul0030-0001" num="0874">Few professors are rich</li><li id="ul0030-0002" num="0875">There are no honest politicians</li><li id="ul0030-0003" num="0876">It is not likely to rain in San Francisco in midsummer</li><li id="ul0030-0004" num="0877">Most adult Swedes are tall</li><li id="ul0030-0005" num="0878">There are no mountains in Holland</li><li id="ul0030-0006" num="0879">Usually Princeton means Princeton University</li><li id="ul0030-0007" num="0880">Paris is the capital of France</li><li id="ul0030-0008" num="0881">In Europe, the child-bearing age ranges from about sixteen to about forty-two The problem with world knowledge is that much of it is perception-based. Examples:</li><li id="ul0030-0009" num="0882">Most adult Swedes are tall</li><li id="ul0030-0010" num="0883">Most adult Swedes are much taller than most adult Italians</li><li id="ul0030-0011" num="0884">Usually a large house costs more than a small house</li><li id="ul0030-0012" num="0885">There are no honest politicians</li></ul></li></ul>
Perception-based knowledge is intrinsically imprecise, reflecting the bounded ability of sensory organs, and ultimately the brain, to resolve detail and store information. More specifically, perception-based knowledge is f-granular in the sense that (a) the boundaries of perceived classes are unsharp (fuzzy); and (b) the values of perceived attributes are imprecise (fuzzy). Bivalent-logic-based approaches provide no methods for deduction from perception-based knowledge. For example, given the datum: Most adult Swedes are tall, existing bivalent-logic-based methods cannot be employed to come up with valid answers to the questions q1: Flow many adult Swedes are short; and q2: What is the average height of adult Swedes?
The Problem of Relevance:
The importance of the concept of relevance is hard to exaggerate. Relevance is central to search. Indeed, the initial success of Google is due, in large measure, to its simple but ingenious page ranking algorithm for assessment of relevance. Despite its importance, there are no satisfactory definitions of relevance in the literature.
In fact, it may be argued that, as in the case of world knowledge, the concept of relevance is much too complex to lend itself to treatment within the limited conceptual framework of bivalent logic and bivalent-logic-based probability theory. An immediate problem is that relevance is not a bivalent concept. Relevance is a matter of degree, that is, it is a fuzzy concept. To define fuzzy concepts, what is needed is the conceptual structure of fuzzy logic. As was stated earlier, in fuzzy logic everything is, or is allowed to be, a matter of degree.
For concreteness, it is convenient to define a relevance function, R(q/p), as a function in which the first argument, q, is a question or a topic; the second argument, p, is a proposition, topic, document, web page or a collection of such objects; and R is the degree to which p is relevant to q. When q is a question, computation of R(q/p) involves an assessment of the degree of relevance of p to q, with p playing the role of question-relevant information. For example, if q: What is the number of cars in California, and p: Population of California is 37 million, then p is question-relevant to q in the sense that p constrains, albeit imprecisely, the number of cars in California. The constraint is a function of world knowledge.
If q is a topic, e.g., q: Ontology, then a document entitled p: What is ontology?, is of obvious relevance to q, i.e., p is topic-relevant. The problem in both cases is that of assessment of degree of relevance. Basically, what we need is a method of computing the degree of relevance based on the meaning of q and p, that is, we need semantic relevance. Existing search engines have a very limited capability to deal with semantic relevance. Instead, what they use is what may be called statistical relevance. In statistical relevance, what is used is, in the main, statistics of links and counts of words. Performance of statistical methods of assessment of relevance is unreliable.
A major source of difficulty in assessment of relevance relates to non-compositionality of the relevance function. More specifically, assume that we have a question, q, and two propositions p and r. Can the value of R(q/p, r) be composed from the values of R(q/p) and R(q/r)? The answer, in general, is: No. As a simple, not web-related, example, suppose that q: How old is Vera; p: Vera's age is the same as Irene's; r: Irene is 65 In this case, R(q/p)=0R(q/r)=0 and yet R(q/p, r)=1. What this implies is that, in general, relevance cannot be assessed in isolation. This suggests a need for differentiation between relevance and what may be called i-relevance, that is, relevance in isolation. In other words, a proposition, p, is i-relevant if it is relevant by itself, and it is i-irrelevant if it is not of relevance by itself, but might be relevant in combination with other propositions.
The Problem of Precisiation of Meaning a Prerequisite to Mechanization of Natural Language Understanding:
Much of world knowledge and web knowledge is expressed in a natural language. This is why issues relating to natural language understanding and natural language reasoning are of direct relevance to search and, even more so, to question-answering.
Humans have no difficulty in understanding natural language, but machines have many. One basic problem is that of imprecision of meaning. A human can understand an instruction such as “Take a few steps,” but a machine cannot. To execute this instruction, a machine needs a precisiation of “few.” Precisiation of propositions drawn from a natural language is the province of PNL (Precisiated Natural Language). A forerunner of PNL is PRUF. In PNL, precisiation is interpreted as meaning precisiation, rather than value precisiation, A proposition is precisiated through translation into the Generalized Constraint Language (GCL). An element of GCL which precisiates p is referred to as a precisiand of p, GC(p), with GC(p) representing a generalized constraint. A precisiand may be viewed as a model of meaning.
A concept which plays a key role in precisiation is cointension, with intension used in its usual logical sense as attribute-based meaning. Thus, p and q are cointensive if the meaning of p is a close approximation to that of q. In this sense, a precisiand, GC(p), is valid if GC(p) is cointensive with p. The concept of cointensive precisiation has an important implication for validity of definitions of concepts. More specifically, if C is a concept and Def(C) is its definition, then for Def(C) to be a valid definition, Def(C) must be cointensive with C (see <figref idref="DRAWINGS">FIG. 4</figref>, regarding cointension: degree of goodness of fit of the intension of definiens to the intension of definiendum).
The concept of cointensive definition leads to an important conclusion: In general, a cointensive definition of a fuzzy concept cannot be formulated within the conceptual structure of bivalent logic and bivalent-logic-based probability theory.
See <figref idref="DRAWINGS">FIG. 5</figref>, regarding structure of the new tools: <ul id="ul0031" list-style="none"><li id="ul0031-0001" num="0000"><ul id="ul0032" list-style="none"><li id="ul0032-0001" num="0897">PT: standard bivalent-logic-based probability theory</li><li id="ul0032-0002" num="0898">CTPM : Computational Theory of Precisiation of Meaning</li><li id="ul0032-0003" num="0899">PM; Precisiated Natural Language</li><li id="ul0032-0004" num="0900">CW: Computing with Words</li><li id="ul0032-0005" num="0901">GUI: Generalized Theory of Uncertainty</li><li id="ul0032-0006" num="0902">GCR: Theory of Generalized-Constraint-Based Reasoning</li></ul></li></ul>
The Concept of a Generalized Constraint:
Constraints are ubiquitous. A typical constraint is an expression of the form X ∈ C, where X is the constrained variable and C is the set of values which X is allowed to take. A typical constraint is hard (inelastic) in the sense that if u is a value of X then u satisfies the constraint if and only if u ∈ C.
The problem with hard constraints is that most real-world constraints are not hard, meaning that most real-world constraints have some degree of elasticity. For example, the constraints “check-out time is 1 pm,” and “speed limit is 100 km/h,” are, in reality, not hard. Flow can such constraints be defined? The concept of a generalized constraint is motivated by questions of this kind.
Real-world constraints may assume a variety of forms. They may be simple in appearance and yet have a complex structure. Reflecting this reality, a generalized constraint, GC, is defined as an expression of the form.
GC: X isr R, where X is the constrained variable; R is a constraining relation which, in general, is nonbivalent; and r is an indexing variable which identifies the modality of the constraint, that is, its semantics. R will be referred to as a granular value of X.
The constrained variable, X, may assume a variety of forms. In particular, <ul id="ul0033" list-style="none"><li id="ul0033-0001" num="0000"><ul id="ul0034" list-style="none"><li id="ul0034-0001" num="0908">X is an n-ary variable, X=(X<sub>1</sub>, . . . , Xn)</li><li id="ul0034-0002" num="0909">X is a proposition, e.g., X=Leslie is tall</li><li id="ul0034-0003" num="0910">X is a function</li><li id="ul0034-0004" num="0911">X is a function of another variable, X=f (Y)</li><li id="ul0034-0005" num="0912">X is conditioned on another variable, X/Y</li><li id="ul0034-0006" num="0913">X has a structure, e.g., X=Location(Residence(Carol))</li><li id="ul0034-0007" num="0914">X is a group variable. In this case, there is a group, G[A]; with each member of the group, Name<sub>i</sub>, i=1, . . . , n, associated with an attribute-value, . A<sub>i </sub>may be vector-valued. Symbolically:</li><li id="ul0034-0008" num="0915">G[A]: Name<sub>1</sub>/A<sub>1</sub>+. . . +Name<sub>n</sub>/A<sub>n</sub>.</li><li id="ul0034-0009" num="0916">Basically, G[A] is a relation.</li><li id="ul0034-0010" num="0917">X is a generalized constraint, X=Y isr R.</li></ul></li></ul>
A generalized constraint, GC, is associated with a test-score function, ts(u) which associates with each object, u, to which the constraint is applicable, the degree to which u satisfies the constraint. Usually, ts(u) is a point in the unit interval. However, if necessary, the test-score may be a vector, an element of a semi-ring, an element of a lattice or, more generally, an element of a partially ordered set, or a bimodal distribution. The test-score function defines the semantics of the constraint with which it is associated.
The constraining relation, R, is, or is allowed to be, non-bivalent (fuzzy). The principal modalities of generalized constraints are summarized in the following.
Principal Modalities of Generalized Constraints:
(a) Possibilistic (r=blank)
X is R
with R playing the role of the possibility distribution of X. For example:
X is [a, b]
means that [a, b] is the set of possible values of X. Another example:
X is small.
In this case, the fuzzy set labeled small is the possibility distribution of X. If μ<sub>small </sub>is the membership function of small, then the semantics of “X is small” is defined by
<br />Poss{<i>X=u}=μ</i><sub>small</sub>(<i>u</i>)
where u is a generic value of X,
(b) Probabilistic (r=p)
X isp R,
with R playing the role of the probability distribution of X. For example:
X isp N(m, σ2) means that X is a normally distributed random variable with mean m and variance σ<sup>2</sup>.
If X is a random variable which takes values in a finite set {u<sub>1</sub>, . . . , u<sub>n</sub>} with respective probabilities p<sub>1</sub>, . . . , p<sub>n</sub>, then X may be expressed symbolically as
<br />X isp (p<sub>1</sub>\u<sub>1</sub>+. . . +p<sub>n</sub>\u<sub>n</sub>),
with the semantics
<br />Prob(<i>X=u</i><sub>i</sub>)=<i>p</i><sub>i</sub>, (<i>i</i>=1<i>, . . . , n</i>).
What is important to note is that in the Generalized Theory of Uncertainty (GTU), a probabilistic constraint is viewed as an instance of a generalized constraint.
When X is a generalized constraint, the expression
X isp R
is interpreted as a probability qualification of X, with R being the probability of X. For example:
(X is small) isp likely,
where small is a fuzzy subset of the real line, means that the probability of the fuzzy event {X is small} is likely. More specifically, if X takes values in the interval [a, b] and g is the probability density function of X, then the probability of the fuzzy event “X is small” may be expressed as the following integral, taken between a and b interval:
<maths id="MATH-US-00067" num="00067"><math overflow="scroll"><mrow><mrow><mi>Prob</mi><mo></mo><mrow><mo>(</mo><mrow><mi>X</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>is</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>small</mi></mrow><mo>)</mo></mrow></mrow><mo>=</mo><mrow><munder><mo>∫</mo><mrow><mrow><mi>between</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>a</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>and</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>b</mi></mrow><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle></mrow></munder><mo></mo><mrow><mrow><mo>(</mo><mrow><msub><mi>μ</mi><mi>small</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo>)</mo></mrow><mo></mo><mrow><mi>g</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D14785.tif" /><img file="US2022121884A1_D14786.tif" /><img file="US2022121884A1_D14787.tif" /><img file="US2022121884A1_D14788.tif" /><img file="US2022121884A1_D14789.tif" /><img file="US2022121884A1_D14790.tif" /><img file="US2022121884A1_D14791.tif" /><img file="US2022121884A1_D14792.tif" /><img file="US2022121884A1_D14793.tif" /><img file="US2022121884A1_D14794.tif" /><img file="US2022121884A1_D14795.tif" /><img file="US2022121884A1_D14796.tif" /><img file="US2022121884A1_D14797.tif" /><img file="US2022121884A1_D14798.tif" /><img file="US2022121884A1_D14799.tif" /><img file="US2022121884A1_D14800.tif" /><img file="US2022121884A1_D14801.tif" /><img file="US2022121884A1_D14802.tif" /><img file="US2022121884A1_D14803.tif" /><img file="US2022121884A1_D14804.tif" /><img file="US2022121884A1_D14805.tif" /><img file="US2022121884A1_D14806.tif" /><img file="US2022121884A1_D14807.tif" /><img file="US2022121884A1_D14808.tif" /><img file="US2022121884A1_D14809.tif" /><img file="US2022121884A1_D14810.tif" /><img file="US2022121884A1_D14811.tif" /><img file="US2022121884A1_D14812.tif" /><img file="US2022121884A1_D14813.tif" /><img file="US2022121884A1_D14814.tif" /><img file="US2022121884A1_D14815.tif" /><img file="US2022121884A1_D14816.tif" /><img file="US2022121884A1_D14817.tif" /><img file="US2022121884A1_D14818.tif" /><img file="US2022121884A1_D14819.tif" /><img file="US2022121884A1_D14820.tif" /><img file="US2022121884A1_D14821.tif" /><img file="US2022121884A1_D14822.tif" /><img file="US2022121884A1_D14823.tif" /><img file="US2022121884A1_D14824.tif" /><img file="US2022121884A1_D14825.tif" /><img file="US2022121884A1_D14826.tif" /><img file="US2022121884A1_D14827.tif" /><img file="US2022121884A1_D14828.tif" /><img file="US2022121884A1_D14829.tif" /><img file="US2022121884A1_D14830.tif" /><img file="US2022121884A1_D14831.tif" /><img file="US2022121884A1_D14832.tif" /><img file="US2022121884A1_D14833.tif" /><img file="US2022121884A1_D14834.tif" /><img file="US2022121884A1_D14835.tif" /><img file="US2022121884A1_D14836.tif" /><img file="US2022121884A1_D14837.tif" /><img file="US2022121884A1_D14838.tif" /><img file="US2022121884A1_D14839.tif" /><img file="US2022121884A1_D14840.tif" /><img file="US2022121884A1_D14841.tif" /><img file="US2022121884A1_D14842.tif" /><img file="US2022121884A1_D14843.tif" /><img file="US2022121884A1_D14844.tif" /><img file="US2022121884A1_D14845.tif" /><img file="US2022121884A1_D14846.tif" /><img file="US2022121884A1_D14847.tif" /><img file="US2022121884A1_D14848.tif" /><img file="US2022121884A1_D14849.tif" /><img file="US2022121884A1_D14850.tif" /><img file="US2022121884A1_D14851.tif" /><img file="US2022121884A1_D14852.tif" /><img file="US2022121884A1_D14853.tif" /><img file="US2022121884A1_D14854.tif" /><img file="US2022121884A1_D14855.tif" /><img file="US2022121884A1_D14856.tif" /><img file="US2022121884A1_D14857.tif" /><img file="US2022121884A1_D14858.tif" /><img file="US2022121884A1_D14859.tif" /><img file="US2022121884A1_D14860.tif" /><img file="US2022121884A1_D14861.tif" /><img file="US2022121884A1_D14862.tif" /><img file="US2022121884A1_D14863.tif" /><img file="US2022121884A1_D14864.tif" /><img file="US2022121884A1_D14865.tif" /><img file="US2022121884A1_D14866.tif" /><img file="US2022121884A1_D14867.tif" /><img file="US2022121884A1_D14868.tif" /><img file="US2022121884A1_D14869.tif" /><img file="US2022121884A1_D14870.tif" /><img file="US2022121884A1_D14871.tif" /><img file="US2022121884A1_D14872.tif" /><img file="US2022121884A1_D14873.tif" /><img file="US2022121884A1_D14874.tif" /><img file="US2022121884A1_D14875.tif" /><img file="US2022121884A1_D14876.tif" /><img file="US2022121884A1_D14877.tif" /><img file="US2022121884A1_D14878.tif" /><img file="US2022121884A1_D14879.tif" /><img file="US2022121884A1_D14880.tif" /><img file="US2022121884A1_D14881.tif" /><img file="US2022121884A1_D14882.tif" /><img file="US2022121884A1_D14883.tif" /><img file="US2022121884A1_D14884.tif" /><img file="US2022121884A1_D14885.tif" /><img file="US2022121884A1_D14886.tif" /><img file="US2022121884A1_D14887.tif" /><img file="US2022121884A1_D14888.tif" /><img file="US2022121884A1_D14889.tif" /><img file="US2022121884A1_D14890.tif" /><img file="US2022121884A1_D14891.tif" /><img file="US2022121884A1_D14892.tif" /><img file="US2022121884A1_D14893.tif" /><img file="US2022121884A1_D14894.tif" /><img file="US2022121884A1_D14895.tif" /><img file="US2022121884A1_D14896.tif" />
Hence:
<maths id="MATH-US-00068" num="00068"><math overflow="scroll"><mrow><mrow><mi>ts</mi><mo></mo><mrow><mo>(</mo><mi>g</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><msub><mi>μ</mi><mi>likely</mi></msub><mo>(</mo><mrow><munder><mo>∫</mo><mrow><mrow><mi>between</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>a</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>and</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>b</mi></mrow><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle></mrow></munder><mo></mo><mrow><mrow><mo>(</mo><mrow><msub><mi>μ</mi><mi>small</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo>)</mo></mrow><mo></mo><mrow><mi>g</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>)</mo></mrow></mrow></math></maths><img file="US2022121884A1_D14897.tif" /><img file="US2022121884A1_D14898.tif" /><img file="US2022121884A1_D14899.tif" /><img file="US2022121884A1_D14900.tif" /><img file="US2022121884A1_D14901.tif" /><img file="US2022121884A1_D14902.tif" /><img file="US2022121884A1_D14903.tif" /><img file="US2022121884A1_D14904.tif" /><img file="US2022121884A1_D14905.tif" /><img file="US2022121884A1_D14906.tif" /><img file="US2022121884A1_D14907.tif" /><img file="US2022121884A1_D14908.tif" /><img file="US2022121884A1_D14909.tif" /><img file="US2022121884A1_D14910.tif" /><img file="US2022121884A1_D14911.tif" /><img file="US2022121884A1_D14912.tif" /><img file="US2022121884A1_D14913.tif" /><img file="US2022121884A1_D14914.tif" /><img file="US2022121884A1_D14915.tif" /><img file="US2022121884A1_D14916.tif" /><img file="US2022121884A1_D14917.tif" /><img file="US2022121884A1_D14918.tif" /><img file="US2022121884A1_D14919.tif" /><img file="US2022121884A1_D14920.tif" /><img file="US2022121884A1_D14921.tif" /><img file="US2022121884A1_D14922.tif" /><img file="US2022121884A1_D14923.tif" /><img file="US2022121884A1_D14924.tif" /><img file="US2022121884A1_D14925.tif" /><img file="US2022121884A1_D14926.tif" /><img file="US2022121884A1_D14927.tif" /><img file="US2022121884A1_D14928.tif" /><img file="US2022121884A1_D14929.tif" /><img file="US2022121884A1_D14930.tif" /><img file="US2022121884A1_D14931.tif" /><img file="US2022121884A1_D14932.tif" /><img file="US2022121884A1_D14933.tif" /><img file="US2022121884A1_D14934.tif" /><img file="US2022121884A1_D14935.tif" /><img file="US2022121884A1_D14936.tif" /><img file="US2022121884A1_D14937.tif" /><img file="US2022121884A1_D14938.tif" /><img file="US2022121884A1_D14939.tif" /><img file="US2022121884A1_D14940.tif" /><img file="US2022121884A1_D14941.tif" /><img file="US2022121884A1_D14942.tif" /><img file="US2022121884A1_D14943.tif" /><img file="US2022121884A1_D14944.tif" /><img file="US2022121884A1_D14945.tif" /><img file="US2022121884A1_D14946.tif" /><img file="US2022121884A1_D14947.tif" /><img file="US2022121884A1_D14948.tif" /><img file="US2022121884A1_D14949.tif" /><img file="US2022121884A1_D14950.tif" /><img file="US2022121884A1_D14951.tif" /><img file="US2022121884A1_D14952.tif" /><img file="US2022121884A1_D14953.tif" /><img file="US2022121884A1_D14954.tif" /><img file="US2022121884A1_D14955.tif" /><img file="US2022121884A1_D14956.tif" /><img file="US2022121884A1_D14957.tif" /><img file="US2022121884A1_D14958.tif" /><img file="US2022121884A1_D14959.tif" /><img file="US2022121884A1_D14960.tif" /><img file="US2022121884A1_D14961.tif" /><img file="US2022121884A1_D14962.tif" /><img file="US2022121884A1_D14963.tif" /><img file="US2022121884A1_D14964.tif" /><img file="US2022121884A1_D14965.tif" /><img file="US2022121884A1_D14966.tif" /><img file="US2022121884A1_D14967.tif" /><img file="US2022121884A1_D14968.tif" /><img file="US2022121884A1_D14969.tif" /><img file="US2022121884A1_D14970.tif" /><img file="US2022121884A1_D14971.tif" /><img file="US2022121884A1_D14972.tif" /><img file="US2022121884A1_D14973.tif" /><img file="US2022121884A1_D14974.tif" /><img file="US2022121884A1_D14975.tif" /><img file="US2022121884A1_D14976.tif" /><img file="US2022121884A1_D14977.tif" /><img file="US2022121884A1_D14978.tif" /><img file="US2022121884A1_D14979.tif" /><img file="US2022121884A1_D14980.tif" /><img file="US2022121884A1_D14981.tif" /><img file="US2022121884A1_D14982.tif" /><img file="US2022121884A1_D14983.tif" /><img file="US2022121884A1_D14984.tif" /><img file="US2022121884A1_D14985.tif" /><img file="US2022121884A1_D14986.tif" /><img file="US2022121884A1_D14987.tif" /><img file="US2022121884A1_D14988.tif" /><img file="US2022121884A1_D14989.tif" /><img file="US2022121884A1_D14990.tif" /><img file="US2022121884A1_D14991.tif" /><img file="US2022121884A1_D14992.tif" /><img file="US2022121884A1_D14993.tif" /><img file="US2022121884A1_D14994.tif" /><img file="US2022121884A1_D14995.tif" /><img file="US2022121884A1_D14996.tif" /><img file="US2022121884A1_D14997.tif" /><img file="US2022121884A1_D14998.tif" /><img file="US2022121884A1_D14999.tif" /><img file="US2022121884A1_D15000.tif" /><img file="US2022121884A1_D15001.tif" /><img file="US2022121884A1_D15002.tif" /><img file="US2022121884A1_D15003.tif" /><img file="US2022121884A1_D15004.tif" /><img file="US2022121884A1_D15005.tif" /><img file="US2022121884A1_D15006.tif" /><img file="US2022121884A1_D15007.tif" /><img file="US2022121884A1_D15008.tif" />
This expression for the test-score function defines the semantics of probability qualification of a possibillistic constraint.
(c) Veristic (r=v)
X isv R.
where R plays the role of a verity (truth) distribution of X. In particular, if X takes values in a finite set {u<sub>1</sub>, . . . , u<sub>n</sub>} with respective verity (truth) values t<sub>1</sub>, . . . , t<sub>n</sub>, then X may be expressed as
<br />X isv (t<sub>1</sub>|u<sub>1</sub>+. . . +t<sub>n</sub>|u<sub>n</sub>),
meaning that Ver(X=u<sub>i</sub>)=t<sub>i</sub>, i=1, . . . , n.
For example, it Robert is half German, quarter French and quarter Italian, then
Ethnicity(Robert) isv (0.5|German+0.25|French+0.25|Italian).
When X is a generalized constraint, the expression
X isv R
is interpreted as verity (truth) qualification of X. For example,
(X is small) isv very.true,
should be interpreted as “It is very true that X is small,” The semantics of truth qualification is defined this way.
<br />Ver(X is R) is t→X is μ<sub>R</sub><sup>−1 </sup>(t),
where μ<sub>R</sub><sup>−1 </sup>is inverse of the membership function of R and t is a fuzzy truth value which is a subset of [0, 1], as shown in <figref idref="DRAWINGS">FIG. 37</figref>.
Note. There are two classes of fuzzy sets: (a) possibilistic, and (b) vetistic. In the case of a possibilistic fuzzy set, the grade of membership is the degree of possibility. In the case of a veristic fuzzy set, the grade of membership is the degree of verity (truth). Unless stated to the contrary, a fuzzy set is assumed to be possibilistic.
(d) Usuality (r=u)
X isu R.
The usuality constraint presupposes that X is a random variable, and that probability of the event {X isu R} is usually, where usually plays the role of a fuzzy probability which is a fuzzy number. For example:
X isu small
means that “usually X is small” or, equivalently,
Prob{X is small} is usually.
In this expression, small may be interpreted as the usual value of X. The concept of a usual value has the potential of playing a significant role in decision analysis, since it is more informative than the concept of expected value.
(e) Random-set (r=rs)
In
X isrs R,
X is a fuzzy-set-valued random variable and R is a fuzzy random set.
(f) Fuzzy-graph (r=fg)
In
X isfg R,
X is a function, f, and R is a fuzzy graph which constrains f (see <figref idref="DRAWINGS">FIG. 38</figref>). A fuzzy graph is a disjunction of Cartesian granules expressed as
<br /><i>R=A</i><sub>1</sub><i>+B</i><sub>1</sub><i>+. . . +A</i><sub>n</sub><i>×B</i><sub>n</sub>,
where the A<sub>i </sub>and B<sub>i</sub>, i=1, . . . , n, are fuzzy subsets of the real line, and × is the Cartesian product. A fuzzy graph is frequently described as a collection of fuzzy if-then rules.
R: if X is A<sub>1 </sub>then Y is B<sub>1</sub>, i=1, . . . , n.
The concept of a fuzzy-graph constraint plays an important role in applications of fuzzy logic.
(g) Bimodal (r=bm)
the bimodal constraint,
X isbm R,
R is a bimodal distribution of the form
R: Σ<sub>i</sub>Pi\Ai, i=1, . . . , n,
which means that Prob(X is Ai) is Pi.
To clarify the meaning of a bimodal distribution, it is expedient to start with an example, I am considering buying Ford stock. I ask my stockbroker, “What is your perception of the near-term prospects for Ford stock?” He tells me, “A moderate decline is very likely; a steep decline is unlikely; and a moderate gain is not likely.” My question is: What is the probability of a large gain?
Information provided by my stock broker may be represented as a collection of ordered pairs:
Price: ((unlikely, steep.decline), (very.likely, moderate.decline) (notlikely, moderate.gain)).
In this collection, the second element of an ordered pair is a fuzzy event or, generally, a possibility distribution, and the first element is a fuzzy probability. The expression for Price is an example of a bimodal distribution.
The importance of the concept of a bimodal. distribution derives from the fact that in the context of human-centric systems, most probability distributions are bimodal. Bimodal distributions can assume a variety of forms. The principal types are Type 1, Type 2 and Type 3. Type 1, 2 and 3 bimodal distributions have a common framework but differ in important detail. A bimodal distribution may be viewed as an important generalization of standard probability distribution. For this reason, bimodal distributions of Type 1, 2, 3 are discussed in greater detail in the following. <ul id="ul0035" list-style="none"><li id="ul0035-0001" num="0000"><ul id="ul0036" list-style="none"><li id="ul0036-0001" num="0984">Type 1 (default): X is a random variable taking values in U</li></ul></li></ul>
A1, . . . , An, A are events (fuzzy sets)
pi=Prob(X is Ai), Prob(X is Ai) is Pi, i =1, . . . , n,
Σ<sub>i </sub>p<sub>i </sub>is unconstrained
BD: bimodal distribution: ((P1,A1), . . . , (Pn,An))
or, equivalently,
X isbm (P1\A1+. . . +Pn\An)
Now, what is the probability, p, of A? In general, this probability is fuzzy-set-valued.
A special case of bimodal distribution of Type 1 is the basic bimodal distribution (BBD). BBD, X is a real-valued random variable, and X and P are granular. See <figref idref="DRAWINGS">FIG. 6</figref>, regarding basic bimodal distribution) <ul id="ul0037" list-style="none"><li id="ul0037-0001" num="0000"><ul id="ul0038" list-style="none"><li id="ul0038-0001" num="0993">Type 2 (fuzzy random set): X is a fuzzy-set-valued random variable with values</li></ul></li></ul>
A1, . . . , An (fuzzy sets)
pi=Prob(X=Ai), Pri.Db(X is Ai) is P<sub>1</sub>, i=1, . . . , n
BD: X isrs (P1\A1+. . . +Pn\An)
Σ<sub>i </sub>Pi=1,
where the P<sub>1 </sub>are granular probabilities.
Now, what is the probability, P, of A? P is not definable. What are definable are (a) the expected value of the conditional possibility of A given BD, and (b) the expected value of the conditional necessity of A given BD. <ul id="ul0039" list-style="none"><li id="ul0039-0001" num="0000"><ul id="ul0040" list-style="none"><li id="ul0040-0001" num="1000">Type 3 (Dempster-Shafer): X is a random variable taking values X<sub>1</sub>, . . . , Xn with probabilities p1, . . . , pn.</li></ul></li></ul>
X<sub>1 </sub>is a random variable taking values in Ai, i=1, . . . , n
Probability distribution of X<sub>1 </sub>in Ai, i=1, . . . , n, is not specified.
Now, what is the probability, p, that X is in A? Because probability distributions of the X<sub>1 </sub>in the Ai are not specified, p is interval-valued. What is important to note is that the concepts of upper and lower probabilities break down when the Ai are fuzzy sets.
Note: In applying Dempster-Shafer theory, it is important to check on whether the data fit Type 3 model. In many cases, the correct model is Type 1 rather than Type 3.
The importance of bimodal distributions derives from the fact that in many realistic settings a bimodal distribution is the best approximation to our state of knowledge. An example is assessment of degree of relevance, since relevance is generally not well defined. If I am asked to assess the degree of relevance of a book on knowledge representation to summarization, my state of knowledge about the book may not be sufficient to justify an answer such as 0.7. A better approximation to my state of knowledge may be “likely to be high.” Such an answer is an instance of a bimodal distribution.
(h) Group (r=g)
In
X isg R,
X is a group variable, G[A], and R is a group constraint on G[A]. More specifically, if X is a group variable of the form
G[A]: Name<sub>1</sub>/A1+. . . +Name<sub>n</sub>/An
or
G[A]: Σ<sub>i </sub>Name<sub>i</sub>/Ai, for short, i=1, . . . , n,
then R is a constraint on the Ai. To illustrate, if we have a group of η Swedes, with Name<sub>i </sub>being the name of i-th Swede, and Ai being the height of Name<sub>i</sub>, then the proposition “most Swedes are tall,” is a constraint on the Ai which may be expressed as:
(1/n) Σ Count(tall.Swedes) is most
or, more explicitly,
(1/n) (μ<sub>tall</sub>(A<sub>1</sub>)+. . . +μ<sub>tall</sub>(A<sub>n</sub>) is most,
where most is a fuzzy quantifier which is interpreted as a fuzzy number.
Operations on Generalized Constraints:
There are many ways in which generalized constraints may be operated on. The basic operations—expressed in symbolic form—are the following.
(a) Conjunction
X isr R
Y iss S
(X, Y) ist T
EXAMPLE (possibilistic constraints).
X is R
Y is S
(X, Y) is R×S
where× is the Cartesian product.
EXAMPLE (probabilistic/possibilistic).
X isp R
(X, Y) is S
(X, Y) isrs T
In this example, if S is a fuzzy relation then T is a fuzzy random set. What is involved in this example is a conjunction of a probabilistic constraint and a possibilistic constraint. This type of probabilistic/possibilistic constraint plays a key role in the Dempster-Shafer theory of evidence, and in its extension to fuzzy sets and fuzzy probabilities.
EXAMPLE (possibilistic/probabilistic).
X is R
(X, Y) isp S
Y/X isp T
This example, which is a dual of the proceeding example, is an instance of conditioning.
(b) Projection (possibilistic)
(X, Y) is R
X is S
where X takes values in U={u}; Y takes values in V={v}; and the projection
S=Proj<sub>x </sub>R,
is defined as
<br />μ<sub>S</sub>(<i>u</i>)=μ<sub>Proj×R</sub>(<i>u</i>)=max<sub>v </sub>μ<sub>R </sub>(<i>u, v</i>),
where μ<sub>R </sub>and μ<sub>s </sub>are the membership functions of R and S, respectively.
(c) Projection (probabilistic)
(X, Y) isp R
X isp S
where X and Y are real-valued random variables, and R and S are the probability distributions of (X, Y) and X, respectively. The probability density function of S, p<sub>S</sub>, is related to that of R, p<sub>R</sub>, by the familiar equation
<br /><i>ps</i>(<i>u</i>)=∫ <i>pR</i>(<i>u, v</i>) <i>dv </i>
with the integral taken over the real line.
(d) Propagation
f (X) isr R
g(X) iss S
where f and g are functions or functionals,
EXAMPLE (possibilistic constraints).
f (X) is R
g(X) is S
where R and S are fuzzy sets. In terms of the membership function of R, the membership function of S is given by the solution of the variational problem
μ<sub>S</sub>(v)=sup<sub>u </sub>(μ<sub>R</sub>f (u))
subject to
v=g(u).
Note. The constraint propagation rule described in this example is the well-known extension principle of fuzzy logic. Basically, this principle provides a way of computing the possibilistic constraint on g(X) given a possibilistic constraint on f (X).
See <figref idref="DRAWINGS">FIG. 7</figref>, regarding extension principle:
f (X) is A
g(X) is B
<br />μ<sub>S</sub>(<i>v</i>)=sup<sub>u </sub>(μ<sub>A</sub>(<i>f</i>(<i>u</i>)))
subject to
v=g(u).
Primary Constraints, Composite Constraints and Standard Constraints:
Among the principal generalized constraints there are three that play the role of primary generalized constraints. They are:
Possibilistic constraint: X is R
Probabilistic constraint: X isp R
and
Veristic constraint: X isv R
A special case of primary constraints is what may be called standard constraints: bivalent possibilistic, probabilistic and bivalent veristic. Standard constraints form the basis for the conceptual framework of bivalent logic and probability theory. A generalized constraint, GC, is composite if it can be generated from other generalized constraints through conjunction, and/or projection, and/or constraint propagation, and/or qualification and/or possibly other operations. For example, a random-set constraint may be viewed. as a conjunction of a probabilistic constraint and either a possibilistic or veristic constraint. The Dempster-Shafer theory of evidence is, in effect, a theory of possibilistic random-set constraints. The derivation graph of a composite constraint defines how it can be derived from primary constraints.
The three primary constraints—possibilistic, probabilistic and veristic—are closely related to a concept which has a position of centrality in human cognition—the concept of partiality. In the sense used here, partial means: a matter of degree or, more or less equivalently, fuzzy. In this sense, almost all human concepts are partial (fuzzy). Familiar examples of fuzzy concepts are: knowledge, understanding, friendship, love, beauty, intelligence, belief, causality, relevance, honesty, mountain and, most important, truth, likelihood and possibility. Is a specified concept, C, fuzzy? A simple test is: If C can be hedged, then it is fuzzy. For example, in the case of relevance, we can say: very relevant, quite relevant, slightly relevant, etc. Consequently, relevance is a fuzzy concept.
The three primary constraints may be likened to the three primary colors: red, blue and green. In terms of this analogy, existing theories of uncertainty may be viewed as theories of different mixtures of primary constraints. For example, the Dempster-Shafer theory of evidence is a theory of a mixture of probabilistic and possibilistic constraints. The Generalized Theory of Uncertainty (GTU) embraces all possible mixtures. In this sense the conceptual structure of GTU accommodates most, and perhaps all, of the existing theories of uncertainty.
The Generalized Constraint Language and Standard Constraint Language:
A concept which has a position of centrality in PNL is that of Generalized Constraint Language (GCL). Informally, GCL is the set of all generalized constraints together with the rules governing syntax, semantics and generation. Simple examples of elements of GCL are:
((X, Y) isp A) {circumflex over ( )} (X is B)
(X isp A) {circumflex over ( )} ((X, Y) isv B)
Proj<sub>Y </sub>((X is A) {circumflex over ( )} ((X, Y) isp B)),
where A is conjunction.
A very simple example of a semantic rule is:
<br />(<i>X </i>is <i>A</i>) {circumflex over ( )} (<i>Y </i>is <i>B</i>)→Poss(<i>X=u, Y=v</i>)=μ<sub>A</sub>(u) {circumflex over ( )} μ<sub>B</sub>(<i>v</i>),
where u and v are generic values of X, Y , and μ<sub>A </sub>and μ<sub>B </sub>are the membership functions of A and B, respectively.
In principle, GCL is an infinite set. However, in most applications only a small subset of CCL is likely to be needed.
In PNL, the set of all standard constraints together with the rules governing syntax, semantics and generation constitute the Standard Constraint Language (SCL). SCL is a subset of GCL.
The Concept of Cointensive Precisiation:
As was pointed out already, much of world knowledge and web knowledge is expressed in a natural language. For this reason, mechanization of natural language understanding is of direct relevance to enhancement of web intelligence. In recent years, considerable progress has been made in areas of computational linguistics which relate to mechanization of natural language understanding. But what is widely unrecognized is that there is a fundamental limitation to what can be achieved through the use of commonly-employed methods of meaning representation. The aim of what follows is, first, to highlight this limitation and, second, to present ways of removing it.
To understand the nature of the limitation, two facts have to be considered. First, as was pointed out earlier, a natural language, NL, is basically a system for describing perceptions; and second, perceptions are intrinsically imprecise, reflecting the bounded ability of human sensory organs, and ultimately the brain, to resolve detail and store information. A direct consequence of imprecision of perceptions is semantic imprecision of natural languages. Semantic imprecision of natural languages is not a problem for humans, but is a major problem for machines.
To clarify the issue, let p be a proposition, concept, question or command. For p to be understood by a machine, it must be precisiated, that is, expressed in a mathematically well-defined language. A precisiated form of p, Pre(p), will be referred to as a precisiand of p and will be denoted as p*. The object of precisiation, p, will be referred to us precisiend.
To precisiate p we can employ a number of meaning-representation languages, e.g., Prolog, predicate logic, semantic networks, conceptual graphs, LISP, SQL, etc. The commonly-used meaning-representation languages are bivalent, i.e., are based on bivalent logic. Are we moving in the right direction when we employ such languages for mechanization of natural language understanding? The answer is: No. The reason relates to an important issue which we have not addressed: cointension of p*, with intension used in its logical sense as attribute-based meaning. More specifically, cointension is a measure of the goodness of fit of the intension of a precisiand, p*, to the intended intension of precisiend, p. Thus, cointension is a desideratum of precisiation. What this implies is that mechanization of natural language understanding requires more than precisiation—it requires cointensive precisiation. Note that definition is a form of precisiation. In plain words, a definition is cointensive if its meaning is a good fit to the intended meaning of the definiendum.
Here is where the fundamental limitation which was alluded to earlier comes into view. In a natural language, NL, most p's are fuzzy, that is, are in one way or another, a matter of degree. Simple examples: propositions “most Swedes are tall” and “overeating causes obesity;” concepts “mountain” and “honest;” question “is Albert honest?” and command “take a few steps.”
Employment of commonly-used meaning-representation languages to precisiate a fuzzy p leads to a bivalent (crisp) precisiand p*. The problem is that, in general, a bivalent p* is not cointensive. As a simple illustration, consider the concept of recession. The standard definition of recession is: A period of general economic decline; specifically, a decline in GDP for two or more consecutive quarters. Similarly, a definition of bear market is: We classify a bear market as a 30 percent decline after 50 days, or a 13 percent decline after 145 days. (Robert Shuster, Ned Davis Research.) Clearly, neither definition is cointensive.
Another example is the classical definition of stability. Consider a ball of diameter D which is placed on an open bottle whose mouth is of diameter d. If D is somewhat larger than d, the configuration is stable: Obviously, as D increases, the configuration becomes less and less stable. But, according to Lyapounov's bivalent definition of stability, the configuration is stable for all values of D greater than d. This contradiction is characteristic of crisp definitions of fuzzy concepts—a well-known example of which is the Greek sorites (heap) paradox.
The magnitude of the problem becomes apparent when we consider that many concepts in scientific theories are fuzzy, but are defined and treated as if they are crisp. This is particularly true in fields in which the concepts which are defined are descriptions of perceptions. To remove the fundamental limitation, bivalence must be abandoned. Furthermore, new concepts, ideas and tools must be developed and deployed to deal with the issues of cointensive precisiation, definability and deduction. The principal tools are Precisiated Natural Language (PNL); Protoform Theory (PFT); and the Generalized Theory of Uncertainty (GTU). These tools form the core of what may be called the Computational Theory of Precisiation of Meaning (CTPM). The centerpiece of CTPM is the concept of a generalized constraint.
The concept of a generalized constraint plays a key role in CTPM by providing a basis for precisiation of meaning. More specifically, if p is a proposition or a concept, its precisiand, Pre(p), is represented as a generalized constraint, GC. Thus, Pre(p)=GC. In this sense, the concept of a generalized constraint may be viewed as a bridge from natural languages to mathematics.
See <figref idref="DRAWINGS">FIG. 8</figref>, regarding precisiation=translation into GCL:
Annotated translation:
<br />p→X/A isr P/B ←GC(p)
Representing precisiands of p as elements of GCL is the pivotal. idea in CTPM. Each precisiand is associated with the degree to which it is cointensive with p. Given p, the problem is that of finding those precisiands which are cointensive, that is, have a high degree of cointension. If p is a fuzzy proposition or concept, then in general there are no cointensive precisiands in SCL.
In CTPM, a refinement of the concept of precisiation is needed. First, a differentiation is made between v-precision (precision in value) and m-precision (precision in meaning). For example, proposition p: X is 5, is both v-precise and m-precise; p: X is between 5 and 7, is v-imprecise and m-precise; and p: X is small, is both v-imprecise and m-imprecise; however, p can be m-precisiated by defining small as a fuzzy set or a probability distribution. A perception is v-imprecise and its description is m-imprecise. PNL makes it possible to m-precisiate descriptions of perceptions.
Granulation of a variable, e.g., representing the values of age as young, middle-aged and old, may be viewed as a form of v-imprecisiation. Granulation plays an important role in human cognition by serving as a means of (a) exploiting a tolerance for imprecision through omission of irrelevant information; (b) lowering precision and thereby lowering cost; and (c) facilitating understanding and articulation. In fuzzy logic, granulation is m-precisiated through the use of the concept of a linguistic variable, Further refinement of the concept of precisiation relates to two modalities of m-precisiation: (a) human-oriented, denoted as mh-precisiation; and (b) machine-oriented, denoted as mm-precisiation. Unless stated to the contrary, in CTPM, precisiation should be understood as mm-precisiation. (See <figref idref="DRAWINGS">FIG. 9</figref>, regarding modalities of m-precisiation.)
In a bimodal dictionary or lexicon, the first entry, p, is a concept or proposition; the second entry, p*, is mh-precisiand of p; and the third entry is mm-precisiand of p. To illustrate, the entries for recession might read: mh-precisiand—a period of general economic decline; and mm-precisiand—a decline in GDP for two or more consecutive quarters. (See <figref idref="DRAWINGS">FIG. 36(<i>a</i>)</figref>, regarding bimodal lexicon (PNL).)
There is a simple analogy which helps to understand the meaning of cointensive precisiation. Specifically, a proposition, p, is analogous to a system, S; precisiation is analogous to modelization; a precisiand, expressed as a generalized constraint, GC(p), is analogous to a model, M(S), of S; test-score function is analogous to input-output relation; cointensive precisiand is analogous to well-fitting model; GCL is analogous to the class of all fuzzy-logic-based systems; and SCL is analogous to the subclass of all bivalent-logic-based systems. To say that, in general, a cointensive definition of a fuzzy concept cannot be formulated within the conceptual structure of bivalent logic and probability theory, is similar to saying that, in general, a linear system cannot be a well-fitting model of a nonlinear system.
See <figref idref="DRAWINGS">FIG. 36(<i>b</i>)</figref>, regarding analogy between precisiation and modelization:
input-output relation→intension
degree of match between M(S) and S→cointension
Ramifications of the concept of cointensive precisiation extend well beyond mechanization of natural language understanding. A broader basic issue is validity of definitions in scientific theories, especially in the realms of human-oriented fields such as law, economics, medicine, psychology and linguistics. More specifically, the concept of cointensive precisiation calls into question the validity of many of the existing definitions of basic concepts—among them the concepts of causality, relevance, independence, stability, complexity, and optimality.
Translation of p into GCL is made more transparent though annotation. To illustrate,
(a) p: Monika is young→X/Age(Monika) is R/young
(b) p: It is likely that Monika is young→Prob(X/Age(Monika) is :R/young) is S/likely
Note: Example (b) is an instance of probability qualification.
More concretely, let g(u) be the probability density function of the random variable, Age(Monika). Then, with reference to our earlier discussion of probability qualification, we have:
<maths id="MATH-US-00069" num="00069"><math overflow="scroll"><mrow><mrow><mrow><mi>Prob</mi><mo></mo><mrow><mo>(</mo><mrow><mrow><mi>Age</mi><mo></mo><mrow><mo>(</mo><mi>Monika</mi><mo>)</mo></mrow></mrow><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>is</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>young</mi></mrow><mo>)</mo></mrow></mrow><mo></mo><mi>is</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>likely</mi></mrow><mo>→</mo><mrow><mover><munder><mo>∫</mo><mn>0</mn></munder><mn>100</mn></mover><mo></mo><mrow><mrow><mi>g</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>μ</mi><mi>young</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D15009.tif" /><img file="US2022121884A1_D15010.tif" /><img file="US2022121884A1_D15011.tif" /><img file="US2022121884A1_D15012.tif" /><img file="US2022121884A1_D15013.tif" /><img file="US2022121884A1_D15014.tif" /><img file="US2022121884A1_D15015.tif" /><img file="US2022121884A1_D15016.tif" /><img file="US2022121884A1_D15017.tif" /><img file="US2022121884A1_D15018.tif" /><img file="US2022121884A1_D15019.tif" /><img file="US2022121884A1_D15020.tif" /><img file="US2022121884A1_D15021.tif" /><img file="US2022121884A1_D15022.tif" /><img file="US2022121884A1_D15023.tif" /><img file="US2022121884A1_D15024.tif" /><img file="US2022121884A1_D15025.tif" /><img file="US2022121884A1_D15026.tif" /><img file="US2022121884A1_D15027.tif" /><img file="US2022121884A1_D15028.tif" /><img file="US2022121884A1_D15029.tif" /><img file="US2022121884A1_D15030.tif" /><img file="US2022121884A1_D15031.tif" /><img file="US2022121884A1_D15032.tif" /><img file="US2022121884A1_D15033.tif" /><img file="US2022121884A1_D15034.tif" /><img file="US2022121884A1_D15035.tif" /><img file="US2022121884A1_D15036.tif" /><img file="US2022121884A1_D15037.tif" /><img file="US2022121884A1_D15038.tif" /><img file="US2022121884A1_D15039.tif" /><img file="US2022121884A1_D15040.tif" /><img file="US2022121884A1_D15041.tif" /><img file="US2022121884A1_D15042.tif" /><img file="US2022121884A1_D15043.tif" /><img file="US2022121884A1_D15044.tif" /><img file="US2022121884A1_D15045.tif" /><img file="US2022121884A1_D15046.tif" /><img file="US2022121884A1_D15047.tif" /><img file="US2022121884A1_D15048.tif" /><img file="US2022121884A1_D15049.tif" /><img file="US2022121884A1_D15050.tif" /><img file="US2022121884A1_D15051.tif" /><img file="US2022121884A1_D15052.tif" /><img file="US2022121884A1_D15053.tif" /><img file="US2022121884A1_D15054.tif" /><img file="US2022121884A1_D15055.tif" /><img file="US2022121884A1_D15056.tif" /><img file="US2022121884A1_D15057.tif" /><img file="US2022121884A1_D15058.tif" /><img file="US2022121884A1_D15059.tif" /><img file="US2022121884A1_D15060.tif" /><img file="US2022121884A1_D15061.tif" /><img file="US2022121884A1_D15062.tif" /><img file="US2022121884A1_D15063.tif" /><img file="US2022121884A1_D15064.tif" /><img file="US2022121884A1_D15065.tif" /><img file="US2022121884A1_D15066.tif" /><img file="US2022121884A1_D15067.tif" /><img file="US2022121884A1_D15068.tif" /><img file="US2022121884A1_D15069.tif" /><img file="US2022121884A1_D15070.tif" /><img file="US2022121884A1_D15071.tif" /><img file="US2022121884A1_D15072.tif" /><img file="US2022121884A1_D15073.tif" /><img file="US2022121884A1_D15074.tif" /><img file="US2022121884A1_D15075.tif" /><img file="US2022121884A1_D15076.tif" /><img file="US2022121884A1_D15077.tif" /><img file="US2022121884A1_D15078.tif" /><img file="US2022121884A1_D15079.tif" /><img file="US2022121884A1_D15080.tif" /><img file="US2022121884A1_D15081.tif" /><img file="US2022121884A1_D15082.tif" /><img file="US2022121884A1_D15083.tif" /><img file="US2022121884A1_D15084.tif" /><img file="US2022121884A1_D15085.tif" /><img file="US2022121884A1_D15086.tif" /><img file="US2022121884A1_D15087.tif" /><img file="US2022121884A1_D15088.tif" /><img file="US2022121884A1_D15089.tif" /><img file="US2022121884A1_D15090.tif" /><img file="US2022121884A1_D15091.tif" /><img file="US2022121884A1_D15092.tif" /><img file="US2022121884A1_D15093.tif" /><img file="US2022121884A1_D15094.tif" /><img file="US2022121884A1_D15095.tif" /><img file="US2022121884A1_D15096.tif" /><img file="US2022121884A1_D15097.tif" /><img file="US2022121884A1_D15098.tif" /><img file="US2022121884A1_D15099.tif" /><img file="US2022121884A1_D15100.tif" /><img file="US2022121884A1_D15101.tif" /><img file="US2022121884A1_D15102.tif" /><img file="US2022121884A1_D15103.tif" /><img file="US2022121884A1_D15104.tif" /><img file="US2022121884A1_D15105.tif" /><img file="US2022121884A1_D15106.tif" /><img file="US2022121884A1_D15107.tif" /><img file="US2022121884A1_D15108.tif" /><img file="US2022121884A1_D15109.tif" /><img file="US2022121884A1_D15110.tif" /><img file="US2022121884A1_D15111.tif" /><img file="US2022121884A1_D15112.tif" /><img file="US2022121884A1_D15113.tif" /><img file="US2022121884A1_D15114.tif" /><img file="US2022121884A1_D15115.tif" /><img file="US2022121884A1_D15116.tif" /><img file="US2022121884A1_D15117.tif" /><img file="US2022121884A1_D15118.tif" /><img file="US2022121884A1_D15119.tif" /><img file="US2022121884A1_D15120.tif" />
is likely, or, in annotated form,
<maths id="MATH-US-00070" num="00070"><math overflow="scroll"><mrow><mrow><mrow><mi>GC</mi><mo></mo><mrow><mo>(</mo><mi>g</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mi>X</mi><mo></mo><mrow><mover><munder><mo>∫</mo><mn>0</mn></munder><mn>100</mn></mover><mo></mo><mrow><mrow><mi>g</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>μ</mi><mi>young</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow></mrow></mrow><mo>,</mo></mrow></math></maths><img file="US2022121884A1_D15121.tif" /><img file="US2022121884A1_D15122.tif" /><img file="US2022121884A1_D15123.tif" /><img file="US2022121884A1_D15124.tif" /><img file="US2022121884A1_D15125.tif" /><img file="US2022121884A1_D15126.tif" /><img file="US2022121884A1_D15127.tif" /><img file="US2022121884A1_D15128.tif" /><img file="US2022121884A1_D15129.tif" /><img file="US2022121884A1_D15130.tif" /><img file="US2022121884A1_D15131.tif" /><img file="US2022121884A1_D15132.tif" /><img file="US2022121884A1_D15133.tif" /><img file="US2022121884A1_D15134.tif" /><img file="US2022121884A1_D15135.tif" /><img file="US2022121884A1_D15136.tif" /><img file="US2022121884A1_D15137.tif" /><img file="US2022121884A1_D15138.tif" /><img file="US2022121884A1_D15139.tif" /><img file="US2022121884A1_D15140.tif" /><img file="US2022121884A1_D15141.tif" /><img file="US2022121884A1_D15142.tif" /><img file="US2022121884A1_D15143.tif" /><img file="US2022121884A1_D15144.tif" /><img file="US2022121884A1_D15145.tif" /><img file="US2022121884A1_D15146.tif" /><img file="US2022121884A1_D15147.tif" /><img file="US2022121884A1_D15148.tif" /><img file="US2022121884A1_D15149.tif" /><img file="US2022121884A1_D15150.tif" /><img file="US2022121884A1_D15151.tif" /><img file="US2022121884A1_D15152.tif" /><img file="US2022121884A1_D15153.tif" /><img file="US2022121884A1_D15154.tif" /><img file="US2022121884A1_D15155.tif" /><img file="US2022121884A1_D15156.tif" /><img file="US2022121884A1_D15157.tif" /><img file="US2022121884A1_D15158.tif" /><img file="US2022121884A1_D15159.tif" /><img file="US2022121884A1_D15160.tif" /><img file="US2022121884A1_D15161.tif" /><img file="US2022121884A1_D15162.tif" /><img file="US2022121884A1_D15163.tif" /><img file="US2022121884A1_D15164.tif" /><img file="US2022121884A1_D15165.tif" /><img file="US2022121884A1_D15166.tif" /><img file="US2022121884A1_D15167.tif" /><img file="US2022121884A1_D15168.tif" /><img file="US2022121884A1_D15169.tif" /><img file="US2022121884A1_D15170.tif" /><img file="US2022121884A1_D15171.tif" /><img file="US2022121884A1_D15172.tif" /><img file="US2022121884A1_D15173.tif" /><img file="US2022121884A1_D15174.tif" /><img file="US2022121884A1_D15175.tif" /><img file="US2022121884A1_D15176.tif" /><img file="US2022121884A1_D15177.tif" /><img file="US2022121884A1_D15178.tif" /><img file="US2022121884A1_D15179.tif" /><img file="US2022121884A1_D15180.tif" /><img file="US2022121884A1_D15181.tif" /><img file="US2022121884A1_D15182.tif" /><img file="US2022121884A1_D15183.tif" /><img file="US2022121884A1_D15184.tif" /><img file="US2022121884A1_D15185.tif" /><img file="US2022121884A1_D15186.tif" /><img file="US2022121884A1_D15187.tif" /><img file="US2022121884A1_D15188.tif" /><img file="US2022121884A1_D15189.tif" /><img file="US2022121884A1_D15190.tif" /><img file="US2022121884A1_D15191.tif" /><img file="US2022121884A1_D15192.tif" /><img file="US2022121884A1_D15193.tif" /><img file="US2022121884A1_D15194.tif" /><img file="US2022121884A1_D15195.tif" /><img file="US2022121884A1_D15196.tif" /><img file="US2022121884A1_D15197.tif" /><img file="US2022121884A1_D15198.tif" /><img file="US2022121884A1_D15199.tif" /><img file="US2022121884A1_D15200.tif" /><img file="US2022121884A1_D15201.tif" /><img file="US2022121884A1_D15202.tif" /><img file="US2022121884A1_D15203.tif" /><img file="US2022121884A1_D15204.tif" /><img file="US2022121884A1_D15205.tif" /><img file="US2022121884A1_D15206.tif" /><img file="US2022121884A1_D15207.tif" /><img file="US2022121884A1_D15208.tif" /><img file="US2022121884A1_D15209.tif" /><img file="US2022121884A1_D15210.tif" /><img file="US2022121884A1_D15211.tif" /><img file="US2022121884A1_D15212.tif" /><img file="US2022121884A1_D15213.tif" /><img file="US2022121884A1_D15214.tif" /><img file="US2022121884A1_D15215.tif" /><img file="US2022121884A1_D15216.tif" /><img file="US2022121884A1_D15217.tif" /><img file="US2022121884A1_D15218.tif" /><img file="US2022121884A1_D15219.tif" /><img file="US2022121884A1_D15220.tif" /><img file="US2022121884A1_D15221.tif" /><img file="US2022121884A1_D15222.tif" /><img file="US2022121884A1_D15223.tif" /><img file="US2022121884A1_D15224.tif" /><img file="US2022121884A1_D15225.tif" /><img file="US2022121884A1_D15226.tif" /><img file="US2022121884A1_D15227.tif" /><img file="US2022121884A1_D15228.tif" /><img file="US2022121884A1_D15229.tif" /><img file="US2022121884A1_D15230.tif" /><img file="US2022121884A1_D15231.tif" /><img file="US2022121884A1_D15232.tif" />
is R/likely.
The test-score of this constraint on g is given by
<maths id="MATH-US-00071" num="00071"><math overflow="scroll"><mrow><mrow><mi>ts</mi><mo></mo><mrow><mo>(</mo><mi>g</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><msub><mi>μ</mi><mi>likely</mi></msub><mo></mo><mrow><mo>(</mo><mrow><mover><munder><mo>∫</mo><mn>0</mn></munder><mn>100</mn></mover><mo></mo><mrow><mrow><mi>g</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>μ</mi><mi>young</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D15233.tif" /><img file="US2022121884A1_D15234.tif" /><img file="US2022121884A1_D15235.tif" /><img file="US2022121884A1_D15236.tif" /><img file="US2022121884A1_D15237.tif" /><img file="US2022121884A1_D15238.tif" /><img file="US2022121884A1_D15239.tif" /><img file="US2022121884A1_D15240.tif" /><img file="US2022121884A1_D15241.tif" /><img file="US2022121884A1_D15242.tif" /><img file="US2022121884A1_D15243.tif" /><img file="US2022121884A1_D15244.tif" /><img file="US2022121884A1_D15245.tif" /><img file="US2022121884A1_D15246.tif" /><img file="US2022121884A1_D15247.tif" /><img file="US2022121884A1_D15248.tif" /><img file="US2022121884A1_D15249.tif" /><img file="US2022121884A1_D15250.tif" /><img file="US2022121884A1_D15251.tif" /><img file="US2022121884A1_D15252.tif" /><img file="US2022121884A1_D15253.tif" /><img file="US2022121884A1_D15254.tif" /><img file="US2022121884A1_D15255.tif" /><img file="US2022121884A1_D15256.tif" /><img file="US2022121884A1_D15257.tif" /><img file="US2022121884A1_D15258.tif" /><img file="US2022121884A1_D15259.tif" /><img file="US2022121884A1_D15260.tif" /><img file="US2022121884A1_D15261.tif" /><img file="US2022121884A1_D15262.tif" /><img file="US2022121884A1_D15263.tif" /><img file="US2022121884A1_D15264.tif" /><img file="US2022121884A1_D15265.tif" /><img file="US2022121884A1_D15266.tif" /><img file="US2022121884A1_D15267.tif" /><img file="US2022121884A1_D15268.tif" /><img file="US2022121884A1_D15269.tif" /><img file="US2022121884A1_D15270.tif" /><img file="US2022121884A1_D15271.tif" /><img file="US2022121884A1_D15272.tif" /><img file="US2022121884A1_D15273.tif" /><img file="US2022121884A1_D15274.tif" /><img file="US2022121884A1_D15275.tif" /><img file="US2022121884A1_D15276.tif" /><img file="US2022121884A1_D15277.tif" /><img file="US2022121884A1_D15278.tif" /><img file="US2022121884A1_D15279.tif" /><img file="US2022121884A1_D15280.tif" /><img file="US2022121884A1_D15281.tif" /><img file="US2022121884A1_D15282.tif" /><img file="US2022121884A1_D15283.tif" /><img file="US2022121884A1_D15284.tif" /><img file="US2022121884A1_D15285.tif" /><img file="US2022121884A1_D15286.tif" /><img file="US2022121884A1_D15287.tif" /><img file="US2022121884A1_D15288.tif" /><img file="US2022121884A1_D15289.tif" /><img file="US2022121884A1_D15290.tif" /><img file="US2022121884A1_D15291.tif" /><img file="US2022121884A1_D15292.tif" /><img file="US2022121884A1_D15293.tif" /><img file="US2022121884A1_D15294.tif" /><img file="US2022121884A1_D15295.tif" /><img file="US2022121884A1_D15296.tif" /><img file="US2022121884A1_D15297.tif" /><img file="US2022121884A1_D15298.tif" /><img file="US2022121884A1_D15299.tif" /><img file="US2022121884A1_D15300.tif" /><img file="US2022121884A1_D15301.tif" /><img file="US2022121884A1_D15302.tif" /><img file="US2022121884A1_D15303.tif" /><img file="US2022121884A1_D15304.tif" /><img file="US2022121884A1_D15305.tif" /><img file="US2022121884A1_D15306.tif" /><img file="US2022121884A1_D15307.tif" /><img file="US2022121884A1_D15308.tif" /><img file="US2022121884A1_D15309.tif" /><img file="US2022121884A1_D15310.tif" /><img file="US2022121884A1_D15311.tif" /><img file="US2022121884A1_D15312.tif" /><img file="US2022121884A1_D15313.tif" /><img file="US2022121884A1_D15314.tif" /><img file="US2022121884A1_D15315.tif" /><img file="US2022121884A1_D15316.tif" /><img file="US2022121884A1_D15317.tif" /><img file="US2022121884A1_D15318.tif" /><img file="US2022121884A1_D15319.tif" /><img file="US2022121884A1_D15320.tif" /><img file="US2022121884A1_D15321.tif" /><img file="US2022121884A1_D15322.tif" /><img file="US2022121884A1_D15323.tif" /><img file="US2022121884A1_D15324.tif" /><img file="US2022121884A1_D15325.tif" /><img file="US2022121884A1_D15326.tif" /><img file="US2022121884A1_D15327.tif" /><img file="US2022121884A1_D15328.tif" /><img file="US2022121884A1_D15329.tif" /><img file="US2022121884A1_D15330.tif" /><img file="US2022121884A1_D15331.tif" /><img file="US2022121884A1_D15332.tif" /><img file="US2022121884A1_D15333.tif" /><img file="US2022121884A1_D15334.tif" /><img file="US2022121884A1_D15335.tif" /><img file="US2022121884A1_D15336.tif" /><img file="US2022121884A1_D15337.tif" /><img file="US2022121884A1_D15338.tif" /><img file="US2022121884A1_D15339.tif" /><img file="US2022121884A1_D15340.tif" /><img file="US2022121884A1_D15341.tif" /><img file="US2022121884A1_D15342.tif" /><img file="US2022121884A1_D15343.tif" /><img file="US2022121884A1_D15344.tif" />
(c) p: Most Swedes are tall
Following (b), let h(u) be the count density function of Swedes, meaning that h(u) du=fraction of Swedes whose height lies in the interval [u, u+du]. Assume that height of Swedes lies in the interval [a, b]. Then,
fraction of tall Swedes:
<maths id="MATH-US-00072" num="00072"><math overflow="scroll"><mrow><mrow><mover><munder><mo>∫</mo><mi>b</mi></munder><mi>a</mi></mover><mo></mo><mrow><mrow><mi>h</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>μ</mi><mi>tall</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>,</mo></mrow></math></maths><img file="US2022121884A1_D15345.tif" /><img file="US2022121884A1_D15346.tif" /><img file="US2022121884A1_D15347.tif" /><img file="US2022121884A1_D15348.tif" /><img file="US2022121884A1_D15349.tif" /><img file="US2022121884A1_D15350.tif" /><img file="US2022121884A1_D15351.tif" /><img file="US2022121884A1_D15352.tif" /><img file="US2022121884A1_D15353.tif" /><img file="US2022121884A1_D15354.tif" /><img file="US2022121884A1_D15355.tif" /><img file="US2022121884A1_D15356.tif" /><img file="US2022121884A1_D15357.tif" /><img file="US2022121884A1_D15358.tif" /><img file="US2022121884A1_D15359.tif" /><img file="US2022121884A1_D15360.tif" /><img file="US2022121884A1_D15361.tif" /><img file="US2022121884A1_D15362.tif" /><img file="US2022121884A1_D15363.tif" /><img file="US2022121884A1_D15364.tif" /><img file="US2022121884A1_D15365.tif" /><img file="US2022121884A1_D15366.tif" /><img file="US2022121884A1_D15367.tif" /><img file="US2022121884A1_D15368.tif" /><img file="US2022121884A1_D15369.tif" /><img file="US2022121884A1_D15370.tif" /><img file="US2022121884A1_D15371.tif" /><img file="US2022121884A1_D15372.tif" /><img file="US2022121884A1_D15373.tif" /><img file="US2022121884A1_D15374.tif" /><img file="US2022121884A1_D15375.tif" /><img file="US2022121884A1_D15376.tif" /><img file="US2022121884A1_D15377.tif" /><img file="US2022121884A1_D15378.tif" /><img file="US2022121884A1_D15379.tif" /><img file="US2022121884A1_D15380.tif" /><img file="US2022121884A1_D15381.tif" /><img file="US2022121884A1_D15382.tif" /><img file="US2022121884A1_D15383.tif" /><img file="US2022121884A1_D15384.tif" /><img file="US2022121884A1_D15385.tif" /><img file="US2022121884A1_D15386.tif" /><img file="US2022121884A1_D15387.tif" /><img file="US2022121884A1_D15388.tif" /><img file="US2022121884A1_D15389.tif" /><img file="US2022121884A1_D15390.tif" /><img file="US2022121884A1_D15391.tif" /><img file="US2022121884A1_D15392.tif" /><img file="US2022121884A1_D15393.tif" /><img file="US2022121884A1_D15394.tif" /><img file="US2022121884A1_D15395.tif" /><img file="US2022121884A1_D15396.tif" /><img file="US2022121884A1_D15397.tif" /><img file="US2022121884A1_D15398.tif" /><img file="US2022121884A1_D15399.tif" /><img file="US2022121884A1_D15400.tif" /><img file="US2022121884A1_D15401.tif" /><img file="US2022121884A1_D15402.tif" /><img file="US2022121884A1_D15403.tif" /><img file="US2022121884A1_D15404.tif" /><img file="US2022121884A1_D15405.tif" /><img file="US2022121884A1_D15406.tif" /><img file="US2022121884A1_D15407.tif" /><img file="US2022121884A1_D15408.tif" /><img file="US2022121884A1_D15409.tif" /><img file="US2022121884A1_D15410.tif" /><img file="US2022121884A1_D15411.tif" /><img file="US2022121884A1_D15412.tif" /><img file="US2022121884A1_D15413.tif" /><img file="US2022121884A1_D15414.tif" /><img file="US2022121884A1_D15415.tif" /><img file="US2022121884A1_D15416.tif" /><img file="US2022121884A1_D15417.tif" /><img file="US2022121884A1_D15418.tif" /><img file="US2022121884A1_D15419.tif" /><img file="US2022121884A1_D15420.tif" /><img file="US2022121884A1_D15421.tif" /><img file="US2022121884A1_D15422.tif" /><img file="US2022121884A1_D15423.tif" /><img file="US2022121884A1_D15424.tif" /><img file="US2022121884A1_D15425.tif" /><img file="US2022121884A1_D15426.tif" /><img file="US2022121884A1_D15427.tif" /><img file="US2022121884A1_D15428.tif" /><img file="US2022121884A1_D15429.tif" /><img file="US2022121884A1_D15430.tif" /><img file="US2022121884A1_D15431.tif" /><img file="US2022121884A1_D15432.tif" /><img file="US2022121884A1_D15433.tif" /><img file="US2022121884A1_D15434.tif" /><img file="US2022121884A1_D15435.tif" /><img file="US2022121884A1_D15436.tif" /><img file="US2022121884A1_D15437.tif" /><img file="US2022121884A1_D15438.tif" /><img file="US2022121884A1_D15439.tif" /><img file="US2022121884A1_D15440.tif" /><img file="US2022121884A1_D15441.tif" /><img file="US2022121884A1_D15442.tif" /><img file="US2022121884A1_D15443.tif" /><img file="US2022121884A1_D15444.tif" /><img file="US2022121884A1_D15445.tif" /><img file="US2022121884A1_D15446.tif" /><img file="US2022121884A1_D15447.tif" /><img file="US2022121884A1_D15448.tif" /><img file="US2022121884A1_D15449.tif" /><img file="US2022121884A1_D15450.tif" /><img file="US2022121884A1_D15451.tif" /><img file="US2022121884A1_D15452.tif" /><img file="US2022121884A1_D15453.tif" /><img file="US2022121884A1_D15454.tif" /><img file="US2022121884A1_D15455.tif" /><img file="US2022121884A1_D15456.tif" />
is most.
Interpreting this relation as a generalized constraint on h, the test-score may be expressed as:
<maths id="MATH-US-00073" num="00073"><math overflow="scroll"><mrow><mrow><mi>ts</mi><mo></mo><mrow><mo>(</mo><mi>h</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><msub><mi>μ</mi><mi>most</mi></msub><mo></mo><mrow><mo>(</mo><mrow><mover><munder><mo>∫</mo><mn>0</mn></munder><mi>h</mi></mover><mo></mo><mrow><mrow><mi>h</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>μ</mi><mi>tall</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D15457.tif" /><img file="US2022121884A1_D15458.tif" /><img file="US2022121884A1_D15459.tif" /><img file="US2022121884A1_D15460.tif" /><img file="US2022121884A1_D15461.tif" /><img file="US2022121884A1_D15462.tif" /><img file="US2022121884A1_D15463.tif" /><img file="US2022121884A1_D15464.tif" /><img file="US2022121884A1_D15465.tif" /><img file="US2022121884A1_D15466.tif" /><img file="US2022121884A1_D15467.tif" /><img file="US2022121884A1_D15468.tif" /><img file="US2022121884A1_D15469.tif" /><img file="US2022121884A1_D15470.tif" /><img file="US2022121884A1_D15471.tif" /><img file="US2022121884A1_D15472.tif" /><img file="US2022121884A1_D15473.tif" /><img file="US2022121884A1_D15474.tif" /><img file="US2022121884A1_D15475.tif" /><img file="US2022121884A1_D15476.tif" /><img file="US2022121884A1_D15477.tif" /><img file="US2022121884A1_D15478.tif" /><img file="US2022121884A1_D15479.tif" /><img file="US2022121884A1_D15480.tif" /><img file="US2022121884A1_D15481.tif" /><img file="US2022121884A1_D15482.tif" /><img file="US2022121884A1_D15483.tif" /><img file="US2022121884A1_D15484.tif" /><img file="US2022121884A1_D15485.tif" /><img file="US2022121884A1_D15486.tif" /><img file="US2022121884A1_D15487.tif" /><img file="US2022121884A1_D15488.tif" /><img file="US2022121884A1_D15489.tif" /><img file="US2022121884A1_D15490.tif" /><img file="US2022121884A1_D15491.tif" /><img file="US2022121884A1_D15492.tif" /><img file="US2022121884A1_D15493.tif" /><img file="US2022121884A1_D15494.tif" /><img file="US2022121884A1_D15495.tif" /><img file="US2022121884A1_D15496.tif" /><img file="US2022121884A1_D15497.tif" /><img file="US2022121884A1_D15498.tif" /><img file="US2022121884A1_D15499.tif" /><img file="US2022121884A1_D15500.tif" /><img file="US2022121884A1_D15501.tif" /><img file="US2022121884A1_D15502.tif" /><img file="US2022121884A1_D15503.tif" /><img file="US2022121884A1_D15504.tif" /><img file="US2022121884A1_D15505.tif" /><img file="US2022121884A1_D15506.tif" /><img file="US2022121884A1_D15507.tif" /><img file="US2022121884A1_D15508.tif" /><img file="US2022121884A1_D15509.tif" /><img file="US2022121884A1_D15510.tif" /><img file="US2022121884A1_D15511.tif" /><img file="US2022121884A1_D15512.tif" /><img file="US2022121884A1_D15513.tif" /><img file="US2022121884A1_D15514.tif" /><img file="US2022121884A1_D15515.tif" /><img file="US2022121884A1_D15516.tif" /><img file="US2022121884A1_D15517.tif" /><img file="US2022121884A1_D15518.tif" /><img file="US2022121884A1_D15519.tif" /><img file="US2022121884A1_D15520.tif" /><img file="US2022121884A1_D15521.tif" /><img file="US2022121884A1_D15522.tif" /><img file="US2022121884A1_D15523.tif" /><img file="US2022121884A1_D15524.tif" /><img file="US2022121884A1_D15525.tif" /><img file="US2022121884A1_D15526.tif" /><img file="US2022121884A1_D15527.tif" /><img file="US2022121884A1_D15528.tif" /><img file="US2022121884A1_D15529.tif" /><img file="US2022121884A1_D15530.tif" /><img file="US2022121884A1_D15531.tif" /><img file="US2022121884A1_D15532.tif" /><img file="US2022121884A1_D15533.tif" /><img file="US2022121884A1_D15534.tif" /><img file="US2022121884A1_D15535.tif" /><img file="US2022121884A1_D15536.tif" /><img file="US2022121884A1_D15537.tif" /><img file="US2022121884A1_D15538.tif" /><img file="US2022121884A1_D15539.tif" /><img file="US2022121884A1_D15540.tif" /><img file="US2022121884A1_D15541.tif" /><img file="US2022121884A1_D15542.tif" /><img file="US2022121884A1_D15543.tif" /><img file="US2022121884A1_D15544.tif" /><img file="US2022121884A1_D15545.tif" /><img file="US2022121884A1_D15546.tif" /><img file="US2022121884A1_D15547.tif" /><img file="US2022121884A1_D15548.tif" /><img file="US2022121884A1_D15549.tif" /><img file="US2022121884A1_D15550.tif" /><img file="US2022121884A1_D15551.tif" /><img file="US2022121884A1_D15552.tif" /><img file="US2022121884A1_D15553.tif" /><img file="US2022121884A1_D15554.tif" /><img file="US2022121884A1_D15555.tif" /><img file="US2022121884A1_D15556.tif" /><img file="US2022121884A1_D15557.tif" /><img file="US2022121884A1_D15558.tif" /><img file="US2022121884A1_D15559.tif" /><img file="US2022121884A1_D15560.tif" /><img file="US2022121884A1_D15561.tif" /><img file="US2022121884A1_D15562.tif" /><img file="US2022121884A1_D15563.tif" /><img file="US2022121884A1_D15564.tif" /><img file="US2022121884A1_D15565.tif" /><img file="US2022121884A1_D15566.tif" /><img file="US2022121884A1_D15567.tif" /><img file="US2022121884A1_D15568.tif" />
In summary, precisiation of “Most Swedes are tall” may be expressed as the generalized constraint.
<maths id="MATH-US-00074" num="00074"><math overflow="scroll"><mrow><mrow><mrow><mi>Most</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>Swedes</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>are</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>tall</mi></mrow><mo>→</mo><mrow><mi>GC</mi><mo></mo><mrow><mo>(</mo><mi>h</mi><mo>)</mo></mrow></mrow></mrow><mo>=</mo><mrow><msub><mi>μ</mi><mi>most</mi></msub><mo></mo><mrow><mo>(</mo><mrow><mover><munder><mo>∫</mo><mi>a</mi></munder><mi>b</mi></mover><mo></mo><mrow><mrow><mi>h</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>μ</mi><mi>tall</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D15569.tif" /><img file="US2022121884A1_D15570.tif" /><img file="US2022121884A1_D15571.tif" /><img file="US2022121884A1_D15572.tif" /><img file="US2022121884A1_D15573.tif" /><img file="US2022121884A1_D15574.tif" /><img file="US2022121884A1_D15575.tif" /><img file="US2022121884A1_D15576.tif" /><img file="US2022121884A1_D15577.tif" /><img file="US2022121884A1_D15578.tif" /><img file="US2022121884A1_D15579.tif" /><img file="US2022121884A1_D15580.tif" /><img file="US2022121884A1_D15581.tif" /><img file="US2022121884A1_D15582.tif" /><img file="US2022121884A1_D15583.tif" /><img file="US2022121884A1_D15584.tif" /><img file="US2022121884A1_D15585.tif" /><img file="US2022121884A1_D15586.tif" /><img file="US2022121884A1_D15587.tif" /><img file="US2022121884A1_D15588.tif" /><img file="US2022121884A1_D15589.tif" /><img file="US2022121884A1_D15590.tif" /><img file="US2022121884A1_D15591.tif" /><img file="US2022121884A1_D15592.tif" /><img file="US2022121884A1_D15593.tif" /><img file="US2022121884A1_D15594.tif" /><img file="US2022121884A1_D15595.tif" /><img file="US2022121884A1_D15596.tif" /><img file="US2022121884A1_D15597.tif" /><img file="US2022121884A1_D15598.tif" /><img file="US2022121884A1_D15599.tif" /><img file="US2022121884A1_D15600.tif" /><img file="US2022121884A1_D15601.tif" /><img file="US2022121884A1_D15602.tif" /><img file="US2022121884A1_D15603.tif" /><img file="US2022121884A1_D15604.tif" /><img file="US2022121884A1_D15605.tif" /><img file="US2022121884A1_D15606.tif" /><img file="US2022121884A1_D15607.tif" /><img file="US2022121884A1_D15608.tif" /><img file="US2022121884A1_D15609.tif" /><img file="US2022121884A1_D15610.tif" /><img file="US2022121884A1_D15611.tif" /><img file="US2022121884A1_D15612.tif" /><img file="US2022121884A1_D15613.tif" /><img file="US2022121884A1_D15614.tif" /><img file="US2022121884A1_D15615.tif" /><img file="US2022121884A1_D15616.tif" /><img file="US2022121884A1_D15617.tif" /><img file="US2022121884A1_D15618.tif" /><img file="US2022121884A1_D15619.tif" /><img file="US2022121884A1_D15620.tif" /><img file="US2022121884A1_D15621.tif" /><img file="US2022121884A1_D15622.tif" /><img file="US2022121884A1_D15623.tif" /><img file="US2022121884A1_D15624.tif" /><img file="US2022121884A1_D15625.tif" /><img file="US2022121884A1_D15626.tif" /><img file="US2022121884A1_D15627.tif" /><img file="US2022121884A1_D15628.tif" /><img file="US2022121884A1_D15629.tif" /><img file="US2022121884A1_D15630.tif" /><img file="US2022121884A1_D15631.tif" /><img file="US2022121884A1_D15632.tif" /><img file="US2022121884A1_D15633.tif" /><img file="US2022121884A1_D15634.tif" /><img file="US2022121884A1_D15635.tif" /><img file="US2022121884A1_D15636.tif" /><img file="US2022121884A1_D15637.tif" /><img file="US2022121884A1_D15638.tif" /><img file="US2022121884A1_D15639.tif" /><img file="US2022121884A1_D15640.tif" /><img file="US2022121884A1_D15641.tif" /><img file="US2022121884A1_D15642.tif" /><img file="US2022121884A1_D15643.tif" /><img file="US2022121884A1_D15644.tif" /><img file="US2022121884A1_D15645.tif" /><img file="US2022121884A1_D15646.tif" /><img file="US2022121884A1_D15647.tif" /><img file="US2022121884A1_D15648.tif" /><img file="US2022121884A1_D15649.tif" /><img file="US2022121884A1_D15650.tif" /><img file="US2022121884A1_D15651.tif" /><img file="US2022121884A1_D15652.tif" /><img file="US2022121884A1_D15653.tif" /><img file="US2022121884A1_D15654.tif" /><img file="US2022121884A1_D15655.tif" /><img file="US2022121884A1_D15656.tif" /><img file="US2022121884A1_D15657.tif" /><img file="US2022121884A1_D15658.tif" /><img file="US2022121884A1_D15659.tif" /><img file="US2022121884A1_D15660.tif" /><img file="US2022121884A1_D15661.tif" /><img file="US2022121884A1_D15662.tif" /><img file="US2022121884A1_D15663.tif" /><img file="US2022121884A1_D15664.tif" /><img file="US2022121884A1_D15665.tif" /><img file="US2022121884A1_D15666.tif" /><img file="US2022121884A1_D15667.tif" /><img file="US2022121884A1_D15668.tif" /><img file="US2022121884A1_D15669.tif" /><img file="US2022121884A1_D15670.tif" /><img file="US2022121884A1_D15671.tif" /><img file="US2022121884A1_D15672.tif" /><img file="US2022121884A1_D15673.tif" /><img file="US2022121884A1_D15674.tif" /><img file="US2022121884A1_D15675.tif" /><img file="US2022121884A1_D15676.tif" /><img file="US2022121884A1_D15677.tif" /><img file="US2022121884A1_D15678.tif" /><img file="US2022121884A1_D15679.tif" /><img file="US2022121884A1_D15680.tif" />
An important application of the concept of precisiation relates to precisiation of propositions of the form “X is approximately a,” where a is a real number. Flow can “approximately a,” or *a (for short), be precisiated? In other words, how can the uncertainty associated with the value of X which is described as *a, be defined precisely? There is a hierarchy of ways in which this can be done. The simplest is to define *a as a. This mode of precisiation will be referred to as singular precisiation, or s-precisiation, for short. s-precisiation is employed very widely, especially in probabilistic computations in which an imprecise probability, *a, is computed with as if it were an exact number, a.
The other ways will be referred to as granular precisiation, or g-precisiation, for short. In g-precisiation, *a is treated as a granule. What we see is that various modes of precisiating *a are instances of the generalized constraint. The concept of precisiation has an inverse the concept of imprecisiation, which involves replacing a with *a, with the understanding that *a is not unique. Imprecisiation has a negative connotation. In fact, imprecisiation serves an important purpose. More specifically, consider a proposition p of the form
p: X is V,
where X is a variable and V is its value. X may assume a variety of forms. In particular, X may be a real-valued variable, an nary variable, a function or a relation. The value, V , is v-precise if it is singular, that is, V is a singleton, V is v-imprecise if it is granular. In this framework, v-imprecisiation may be interpreted as a transition from singular to granular value of V .
v-imprecisiation is forced (necessary) when the value of V is not known precisely, v-imprecisiation is deliberate (optional) if there is no need for V to be known precisely. In this case, what may be called v-imprecisiation principle comes into play.
v-imprecisiation principle: Precision carries a cost. If there is a tolerance for imprecision, exploit it by employing v-imprecisiation to achieve lower cost, robustness, tractability, decision-relevance and higher level of confidence.
A word about confidence: If V is uncertain, the confidence in p, Con(p), may be defined as the probability that p is true. Generally, v-imprecisiation of V serves to increase Con(p). For example, Con(Carol is young) >Con(Carol is 23). Thus, as a rule, confidence increases when specificity decreases.
An important example is granulation. In fuzzy logic, granulation may be interpreted as v-imprecisiation followed by mm-precisiation. In this perspective, the concept of granulation—in combination with the associated concept of a linguistic variable—may be viewed as one of the major contributions of fuzzy logic.
A basic problem which relates to imprecisiation is the following. Assume for simplicity that we have two linear equations involving real-valued coefficients and real-valued variables:
<br /><i>a</i><sub>11</sub><i>X+a</i><sub>12</sub><i>Y=b</i><sub>1</sub>,
<br /><i>a</i><sub>21</sub><i>X+a</i><sub>22</sub><i>Y=b</i><sub>2</sub>.
Solutions of these equations read,
<br /><i>X</i>=((<i>a</i><sub>22</sub><i>b</i><sub>1</sub><i>−a</i><sub>12</sub><i>b</i><sub>2</sub>)/(<i>a</i><sub>11</sub><i>a</i><sub>22</sub><i>−a</i><sub>12</sub><i>a</i><sub>21</sub>)),
<br /><i>Y</i>=((<i>a</i><sub>11</sub><i>b</i><sub>2</sub><i>−a</i><sub>21</sub><i>b</i><sub>1</sub>)/(<i>a</i><sub>11</sub><i>a</i><sub>22</sub><i>−a</i><sub>12</sub><i>a</i><sub>21</sub>)).
Now suppose that we imprecisiate the coefficients, replacing, *a<sub>ij</sub>, i=1, 2, and replacing b<sub>i </sub>with *b<sub>i</sub>, i=1, 2. How can we solve these equations when imprecisiated coefficients are defined as generalized constraints?
There is no general answer to this question. Assuming that all coefficients are defined in the same way, the method of solution will depend on the modality of the constraint. For example, if the coefficients are interval-valued, the problem falls within the province of interval analysis. If the coefficients are fuzzy-interval-valued, the problem falls within the province of the theory of relational equations. And if the coefficients are real-valued random variables, we are dealing with the problem of solution of stochastic equations.
One complication is the following. If (a) we solve the original equations, as we have done above; (b) imprecisiate the coefficients in the solution; and (c) employ the extension principle to complete X and Y, will we obtain solutions of imprecisiated equations? The answer, in general, is: No
Nevertheless, when we are faced with a problem which we do not know how to solve correctly, we proceed as if the answer is: Yes. This common practice may be described as Precisiation/Imprecisiation Principle which is defined in the following.
Precisiation/Imprecisiation Principle (P/I Principle):
Informally, let f be a function or a functional. Y=f (X), where X and Y are assumed to be imprecise, Pr(X) and Pr(Y) are precisiations of X and Y, and *Pr(X) and *Pr(Y) are imprecisiations of Pr(X) and Pr(Y), respectively. In symbolic form, the P/I principle may be expressed as
<br /><i>f</i>(<i>X</i>) *=*<i>f</i>(<i>Pr</i>(<i>X</i>)),
where *=denotes “approximately equal,” and *f is imprecisiation of f . In words, to compute f (X) when X is imprecise, (a) precisiate X, (b) compute f (Pr(X)); and (c) imprecisiate f (Pr(X)), Then, usually, *f (Pr(X)) will be approximately equal to f (X). An underlying assumption is that approximations are commensurate in the sense that the closer Pr(X) is to X, the closer f (Pr(X)) is to f (X). This assumption is related to the concept of gradual rules of Dubois and Prade.
As an example, suppose that X is a real-valued function; f is the operation of differentiation, and *X is the fuzzy graph of X. Then, using the P/I principle, *f (X) is obtained. It should be underscored that imprecisiation is an imprecise concept.
Use of the P/I principle underlies many computations in science, engineering, economics and other fields. In particular, as was alluded to earlier, this applies to many computations in probability theory which involve imprecise probabilities. It should be emphasized that the PI principle is neither normative (prescriptive) nor precise; it merely describes imprecisely what is common practice—without suggesting that common practice is correct.
Precisiation of Propositions:
In preceding discussion, we focused our attention on precisiation of propositions of the special form “X is *a.” In the following, we shall consider precisiation in a more general setting. In this setting, the concept of precisiation in PNL opens the door to a wide-ranging enlargement of the role of natural languages in scientific theories, especially in fields such as economics, law and decision analysis.
Within CTPM, precisiation of propositions—and the related issues of precisiation of questions, commands and concepts—falls within the province of PNL. As was stated earlier, the point of departure in PNL is representation of a precisiand of a proposition, p, as a generalized constraint.
p→X isr R.
To illustrate precisiation of propositions and questions, it will be useful to consider some examples.
(a) The Robert example:
p: Usually Robert returns from work at about 6 pm.
Q: What is the probability that Robert is home at about 6:15 pm?
Precisiation of p may be expressed as
p: Prob(Time(Return(Robert)) is *6:00 pm) is usually
where “usually” is a fuzzy probability.
Assuming that Robert stays home after returning from work, precisiation of q may be expressed as
q: Prob(Time(Return(Robert)) is ≤ °6:15 pm) is A?
where ° is the operation of composition, and A is a fuzzy probability.
(b) The balls-in-box problem:
p1: A box contains about 20 black and white balls
p2: Most are black
p3: There are several times as many black balls as white balls
q1: What is the number of white balls?
q2: What is the probability that a ball drawn at random is white?
Let X be the number of black balls and let Y be the number of white balls. Then, in precisiated form, the statement of the problem may be expressed as:
For the data, we have:
p1: (X Y) is *20
p2: X is most×*20
p3: X is several×Y,
And, for the questions, we have:
q1: Y is ?A
q2: Y/*20 is ?B,
where Y/*20 is the granular probability that a ball drawn at random is white.
Solution of these equations reduces to an application of fuzzy integer programming. See <figref idref="DRAWINGS">FIG. 37</figref>, which specifies a region of intersections or overlaps, corresponding to pairs of X and Y coordinates, which provide solutions for our questions, related to the values for Y.)
(c) The tall Swedes problem:
p: Most Swedes are tall.
Q: What is the average height of Swedes?
Q: How many Swedes are short?
As was shown earlier,
p:
<maths id="MATH-US-00075" num="00075"><math overflow="scroll"><mrow><mrow><mrow><mi>Most</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>Swedes</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>are</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>tall</mi></mrow><mo></mo><mstyle><mspace width="0.6em" height="0.6ex" /></mstyle><mo>→</mo><mrow><munder><mover><mo>∫</mo><mi>b</mi></mover><mi>a</mi></munder><mo></mo><mrow><mrow><mi>h</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>μ</mi><mi>tall</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow></mrow><mo>,</mo></mrow></math></maths><img file="US2022121884A1_D15681.tif" /><img file="US2022121884A1_D15682.tif" /><img file="US2022121884A1_D15683.tif" /><img file="US2022121884A1_D15684.tif" /><img file="US2022121884A1_D15685.tif" /><img file="US2022121884A1_D15686.tif" /><img file="US2022121884A1_D15687.tif" /><img file="US2022121884A1_D15688.tif" /><img file="US2022121884A1_D15689.tif" /><img file="US2022121884A1_D15690.tif" /><img file="US2022121884A1_D15691.tif" /><img file="US2022121884A1_D15692.tif" /><img file="US2022121884A1_D15693.tif" /><img file="US2022121884A1_D15694.tif" /><img file="US2022121884A1_D15695.tif" /><img file="US2022121884A1_D15696.tif" /><img file="US2022121884A1_D15697.tif" /><img file="US2022121884A1_D15698.tif" /><img file="US2022121884A1_D15699.tif" /><img file="US2022121884A1_D15700.tif" /><img file="US2022121884A1_D15701.tif" /><img file="US2022121884A1_D15702.tif" /><img file="US2022121884A1_D15703.tif" /><img file="US2022121884A1_D15704.tif" /><img file="US2022121884A1_D15705.tif" /><img file="US2022121884A1_D15706.tif" /><img file="US2022121884A1_D15707.tif" /><img file="US2022121884A1_D15708.tif" /><img file="US2022121884A1_D15709.tif" /><img file="US2022121884A1_D15710.tif" /><img file="US2022121884A1_D15711.tif" /><img file="US2022121884A1_D15712.tif" /><img file="US2022121884A1_D15713.tif" /><img file="US2022121884A1_D15714.tif" /><img file="US2022121884A1_D15715.tif" /><img file="US2022121884A1_D15716.tif" /><img file="US2022121884A1_D15717.tif" /><img file="US2022121884A1_D15718.tif" /><img file="US2022121884A1_D15719.tif" /><img file="US2022121884A1_D15720.tif" /><img file="US2022121884A1_D15721.tif" /><img file="US2022121884A1_D15722.tif" /><img file="US2022121884A1_D15723.tif" /><img file="US2022121884A1_D15724.tif" /><img file="US2022121884A1_D15725.tif" /><img file="US2022121884A1_D15726.tif" /><img file="US2022121884A1_D15727.tif" /><img file="US2022121884A1_D15728.tif" /><img file="US2022121884A1_D15729.tif" /><img file="US2022121884A1_D15730.tif" /><img file="US2022121884A1_D15731.tif" /><img file="US2022121884A1_D15732.tif" /><img file="US2022121884A1_D15733.tif" /><img file="US2022121884A1_D15734.tif" /><img file="US2022121884A1_D15735.tif" /><img file="US2022121884A1_D15736.tif" /><img file="US2022121884A1_D15737.tif" /><img file="US2022121884A1_D15738.tif" /><img file="US2022121884A1_D15739.tif" /><img file="US2022121884A1_D15740.tif" /><img file="US2022121884A1_D15741.tif" /><img file="US2022121884A1_D15742.tif" /><img file="US2022121884A1_D15743.tif" /><img file="US2022121884A1_D15744.tif" /><img file="US2022121884A1_D15745.tif" /><img file="US2022121884A1_D15746.tif" /><img file="US2022121884A1_D15747.tif" /><img file="US2022121884A1_D15748.tif" /><img file="US2022121884A1_D15749.tif" /><img file="US2022121884A1_D15750.tif" /><img file="US2022121884A1_D15751.tif" /><img file="US2022121884A1_D15752.tif" /><img file="US2022121884A1_D15753.tif" /><img file="US2022121884A1_D15754.tif" /><img file="US2022121884A1_D15755.tif" /><img file="US2022121884A1_D15756.tif" /><img file="US2022121884A1_D15757.tif" /><img file="US2022121884A1_D15758.tif" /><img file="US2022121884A1_D15759.tif" /><img file="US2022121884A1_D15760.tif" /><img file="US2022121884A1_D15761.tif" /><img file="US2022121884A1_D15762.tif" /><img file="US2022121884A1_D15763.tif" /><img file="US2022121884A1_D15764.tif" /><img file="US2022121884A1_D15765.tif" /><img file="US2022121884A1_D15766.tif" /><img file="US2022121884A1_D15767.tif" /><img file="US2022121884A1_D15768.tif" /><img file="US2022121884A1_D15769.tif" /><img file="US2022121884A1_D15770.tif" /><img file="US2022121884A1_D15771.tif" /><img file="US2022121884A1_D15772.tif" /><img file="US2022121884A1_D15773.tif" /><img file="US2022121884A1_D15774.tif" /><img file="US2022121884A1_D15775.tif" /><img file="US2022121884A1_D15776.tif" /><img file="US2022121884A1_D15777.tif" /><img file="US2022121884A1_D15778.tif" /><img file="US2022121884A1_D15779.tif" /><img file="US2022121884A1_D15780.tif" /><img file="US2022121884A1_D15781.tif" /><img file="US2022121884A1_D15782.tif" /><img file="US2022121884A1_D15783.tif" /><img file="US2022121884A1_D15784.tif" /><img file="US2022121884A1_D15785.tif" /><img file="US2022121884A1_D15786.tif" /><img file="US2022121884A1_D15787.tif" /><img file="US2022121884A1_D15788.tif" /><img file="US2022121884A1_D15789.tif" /><img file="US2022121884A1_D15790.tif" /><img file="US2022121884A1_D15791.tif" /><img file="US2022121884A1_D15792.tif" />
is most,
where h is the count density function.
Precisiations of q1 and q2 may be expressed as
q1:
<maths id="MATH-US-00076" num="00076"><math overflow="scroll"><mrow><mrow><munder><mover><mo>∫</mo><mi>b</mi></mover><mi>a</mi></munder><mo></mo><mrow><mrow><mi>uh</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>,</mo></mrow></math></maths><img file="US2022121884A1_D15793.tif" /><img file="US2022121884A1_D15794.tif" /><img file="US2022121884A1_D15795.tif" /><img file="US2022121884A1_D15796.tif" /><img file="US2022121884A1_D15797.tif" /><img file="US2022121884A1_D15798.tif" /><img file="US2022121884A1_D15799.tif" /><img file="US2022121884A1_D15800.tif" /><img file="US2022121884A1_D15801.tif" /><img file="US2022121884A1_D15802.tif" /><img file="US2022121884A1_D15803.tif" /><img file="US2022121884A1_D15804.tif" /><img file="US2022121884A1_D15805.tif" /><img file="US2022121884A1_D15806.tif" /><img file="US2022121884A1_D15807.tif" /><img file="US2022121884A1_D15808.tif" /><img file="US2022121884A1_D15809.tif" /><img file="US2022121884A1_D15810.tif" /><img file="US2022121884A1_D15811.tif" /><img file="US2022121884A1_D15812.tif" /><img file="US2022121884A1_D15813.tif" /><img file="US2022121884A1_D15814.tif" /><img file="US2022121884A1_D15815.tif" /><img file="US2022121884A1_D15816.tif" /><img file="US2022121884A1_D15817.tif" /><img file="US2022121884A1_D15818.tif" /><img file="US2022121884A1_D15819.tif" /><img file="US2022121884A1_D15820.tif" /><img file="US2022121884A1_D15821.tif" /><img file="US2022121884A1_D15822.tif" /><img file="US2022121884A1_D15823.tif" /><img file="US2022121884A1_D15824.tif" /><img file="US2022121884A1_D15825.tif" /><img file="US2022121884A1_D15826.tif" /><img file="US2022121884A1_D15827.tif" /><img file="US2022121884A1_D15828.tif" /><img file="US2022121884A1_D15829.tif" /><img file="US2022121884A1_D15830.tif" /><img file="US2022121884A1_D15831.tif" /><img file="US2022121884A1_D15832.tif" /><img file="US2022121884A1_D15833.tif" /><img file="US2022121884A1_D15834.tif" /><img file="US2022121884A1_D15835.tif" /><img file="US2022121884A1_D15836.tif" /><img file="US2022121884A1_D15837.tif" /><img file="US2022121884A1_D15838.tif" /><img file="US2022121884A1_D15839.tif" /><img file="US2022121884A1_D15840.tif" /><img file="US2022121884A1_D15841.tif" /><img file="US2022121884A1_D15842.tif" /><img file="US2022121884A1_D15843.tif" /><img file="US2022121884A1_D15844.tif" /><img file="US2022121884A1_D15845.tif" /><img file="US2022121884A1_D15846.tif" /><img file="US2022121884A1_D15847.tif" /><img file="US2022121884A1_D15848.tif" /><img file="US2022121884A1_D15849.tif" /><img file="US2022121884A1_D15850.tif" /><img file="US2022121884A1_D15851.tif" /><img file="US2022121884A1_D15852.tif" /><img file="US2022121884A1_D15853.tif" /><img file="US2022121884A1_D15854.tif" /><img file="US2022121884A1_D15855.tif" /><img file="US2022121884A1_D15856.tif" /><img file="US2022121884A1_D15857.tif" /><img file="US2022121884A1_D15858.tif" /><img file="US2022121884A1_D15859.tif" /><img file="US2022121884A1_D15860.tif" /><img file="US2022121884A1_D15861.tif" /><img file="US2022121884A1_D15862.tif" /><img file="US2022121884A1_D15863.tif" /><img file="US2022121884A1_D15864.tif" /><img file="US2022121884A1_D15865.tif" /><img file="US2022121884A1_D15866.tif" /><img file="US2022121884A1_D15867.tif" /><img file="US2022121884A1_D15868.tif" /><img file="US2022121884A1_D15869.tif" /><img file="US2022121884A1_D15870.tif" /><img file="US2022121884A1_D15871.tif" /><img file="US2022121884A1_D15872.tif" /><img file="US2022121884A1_D15873.tif" /><img file="US2022121884A1_D15874.tif" /><img file="US2022121884A1_D15875.tif" /><img file="US2022121884A1_D15876.tif" /><img file="US2022121884A1_D15877.tif" /><img file="US2022121884A1_D15878.tif" /><img file="US2022121884A1_D15879.tif" /><img file="US2022121884A1_D15880.tif" /><img file="US2022121884A1_D15881.tif" /><img file="US2022121884A1_D15882.tif" /><img file="US2022121884A1_D15883.tif" /><img file="US2022121884A1_D15884.tif" /><img file="US2022121884A1_D15885.tif" /><img file="US2022121884A1_D15886.tif" /><img file="US2022121884A1_D15887.tif" /><img file="US2022121884A1_D15888.tif" /><img file="US2022121884A1_D15889.tif" /><img file="US2022121884A1_D15890.tif" /><img file="US2022121884A1_D15891.tif" /><img file="US2022121884A1_D15892.tif" /><img file="US2022121884A1_D15893.tif" /><img file="US2022121884A1_D15894.tif" /><img file="US2022121884A1_D15895.tif" /><img file="US2022121884A1_D15896.tif" /><img file="US2022121884A1_D15897.tif" /><img file="US2022121884A1_D15898.tif" /><img file="US2022121884A1_D15899.tif" /><img file="US2022121884A1_D15900.tif" /><img file="US2022121884A1_D15901.tif" /><img file="US2022121884A1_D15902.tif" /><img file="US2022121884A1_D15903.tif" /><img file="US2022121884A1_D15904.tif" />
is ?A,
where A is a fuzzy number which represents the average height of Swedes, and
q2:
<maths id="MATH-US-00077" num="00077"><math overflow="scroll"><mrow><mrow><munder><mover><mo>∫</mo><mi>b</mi></mover><mi>a</mi></munder><mo></mo><mrow><mrow><mi>h</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>μ</mi><mi>short</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>,</mo></mrow></math></maths><img file="US2022121884A1_D15905.tif" /><img file="US2022121884A1_D15906.tif" /><img file="US2022121884A1_D15907.tif" /><img file="US2022121884A1_D15908.tif" /><img file="US2022121884A1_D15909.tif" /><img file="US2022121884A1_D15910.tif" /><img file="US2022121884A1_D15911.tif" /><img file="US2022121884A1_D15912.tif" /><img file="US2022121884A1_D15913.tif" /><img file="US2022121884A1_D15914.tif" /><img file="US2022121884A1_D15915.tif" /><img file="US2022121884A1_D15916.tif" /><img file="US2022121884A1_D15917.tif" /><img file="US2022121884A1_D15918.tif" /><img file="US2022121884A1_D15919.tif" /><img file="US2022121884A1_D15920.tif" /><img file="US2022121884A1_D15921.tif" /><img file="US2022121884A1_D15922.tif" /><img file="US2022121884A1_D15923.tif" /><img file="US2022121884A1_D15924.tif" /><img file="US2022121884A1_D15925.tif" /><img file="US2022121884A1_D15926.tif" /><img file="US2022121884A1_D15927.tif" /><img file="US2022121884A1_D15928.tif" /><img file="US2022121884A1_D15929.tif" /><img file="US2022121884A1_D15930.tif" /><img file="US2022121884A1_D15931.tif" /><img file="US2022121884A1_D15932.tif" /><img file="US2022121884A1_D15933.tif" /><img file="US2022121884A1_D15934.tif" /><img file="US2022121884A1_D15935.tif" /><img file="US2022121884A1_D15936.tif" /><img file="US2022121884A1_D15937.tif" /><img file="US2022121884A1_D15938.tif" /><img file="US2022121884A1_D15939.tif" /><img file="US2022121884A1_D15940.tif" /><img file="US2022121884A1_D15941.tif" /><img file="US2022121884A1_D15942.tif" /><img file="US2022121884A1_D15943.tif" /><img file="US2022121884A1_D15944.tif" /><img file="US2022121884A1_D15945.tif" /><img file="US2022121884A1_D15946.tif" /><img file="US2022121884A1_D15947.tif" /><img file="US2022121884A1_D15948.tif" /><img file="US2022121884A1_D15949.tif" /><img file="US2022121884A1_D15950.tif" /><img file="US2022121884A1_D15951.tif" /><img file="US2022121884A1_D15952.tif" /><img file="US2022121884A1_D15953.tif" /><img file="US2022121884A1_D15954.tif" /><img file="US2022121884A1_D15955.tif" /><img file="US2022121884A1_D15956.tif" /><img file="US2022121884A1_D15957.tif" /><img file="US2022121884A1_D15958.tif" /><img file="US2022121884A1_D15959.tif" /><img file="US2022121884A1_D15960.tif" /><img file="US2022121884A1_D15961.tif" /><img file="US2022121884A1_D15962.tif" /><img file="US2022121884A1_D15963.tif" /><img file="US2022121884A1_D15964.tif" /><img file="US2022121884A1_D15965.tif" /><img file="US2022121884A1_D15966.tif" /><img file="US2022121884A1_D15967.tif" /><img file="US2022121884A1_D15968.tif" /><img file="US2022121884A1_D15969.tif" /><img file="US2022121884A1_D15970.tif" /><img file="US2022121884A1_D15971.tif" /><img file="US2022121884A1_D15972.tif" /><img file="US2022121884A1_D15973.tif" /><img file="US2022121884A1_D15974.tif" /><img file="US2022121884A1_D15975.tif" /><img file="US2022121884A1_D15976.tif" /><img file="US2022121884A1_D15977.tif" /><img file="US2022121884A1_D15978.tif" /><img file="US2022121884A1_D15979.tif" /><img file="US2022121884A1_D15980.tif" /><img file="US2022121884A1_D15981.tif" /><img file="US2022121884A1_D15982.tif" /><img file="US2022121884A1_D15983.tif" /><img file="US2022121884A1_D15984.tif" /><img file="US2022121884A1_D15985.tif" /><img file="US2022121884A1_D15986.tif" /><img file="US2022121884A1_D15987.tif" /><img file="US2022121884A1_D15988.tif" /><img file="US2022121884A1_D15989.tif" /><img file="US2022121884A1_D15990.tif" /><img file="US2022121884A1_D15991.tif" /><img file="US2022121884A1_D15992.tif" /><img file="US2022121884A1_D15993.tif" /><img file="US2022121884A1_D15994.tif" /><img file="US2022121884A1_D15995.tif" /><img file="US2022121884A1_D15996.tif" /><img file="US2022121884A1_D15997.tif" /><img file="US2022121884A1_D15998.tif" /><img file="US2022121884A1_D15999.tif" /><img file="US2022121884A1_D16000.tif" /><img file="US2022121884A1_D16001.tif" /><img file="US2022121884A1_D16002.tif" /><img file="US2022121884A1_D16003.tif" /><img file="US2022121884A1_D16004.tif" /><img file="US2022121884A1_D16005.tif" /><img file="US2022121884A1_D16006.tif" /><img file="US2022121884A1_D16007.tif" /><img file="US2022121884A1_D16008.tif" /><img file="US2022121884A1_D16009.tif" /><img file="US2022121884A1_D16010.tif" /><img file="US2022121884A1_D16011.tif" /><img file="US2022121884A1_D16012.tif" /><img file="US2022121884A1_D16013.tif" /><img file="US2022121884A1_D16014.tif" /><img file="US2022121884A1_D16015.tif" /><img file="US2022121884A1_D16016.tif" />
is ?B
where μ<sub>short </sub>is the membership function of short, and B is the fraction of short Swedes.
(d) The partial existence problem:
X is a real number. I am uncertain about the value of X. What I know about X is:
p1: X is much larger than approximately a,
p2: X is much smaller than approximately b,
where a and b are real numbers, with a <b.
What is the value of X?
In this case, precisiations of data may be expressed as
p1: X is much larger ° *a
p2: X is much smaller ° *b,
where ° is the operation of composition. Precisiation of the question is:
q: X is?A,
where A is a fuzzy number. The solution is immediate:
X is (much.larger ∘ *a {circumflex over ( )} A much.smaller ∘ *b),
when {circumflex over ( )} is min or a t-norm. In this instance, depending on a and b, X may exist to a degree.
These examples point to an important aspect of precisiation. Specifically, to precisiate p, we have to precisiate or, equivalently, calibrate its lexical constituents. For example, in the case of “Most Swedes are tall,” we have to calibrate “most” and “tall.” Likewise, in the case of the Robert example, we have to calibrate “about 6:00 pm,” “about 6:15 pm” and “usually.” In effect, we are composing the meaning of p from the meaning of its constituents. This process is in the spirit of frege's principle of compositionality, Montague grammar and the semantics of programming languages.
In probability theory, for example, independence of events is a bivalent: concept. But, in reality, independence is a matter of degree, i.e., is a fuzzy concept. PNL, used as a definition language, makes it possible, more realistically, to define independence and other bivalent concepts in probability theory as fuzzy concepts. For this purpose, when PNL is used as a definition language, a concept is first defined in a natural language and then its definition is precisiated through the use of PNL.
The Concept of a Protoform:
Viewed in a broader perspective, what should be noted is that precisiation of meaning is not the ultimate goal it is an intermediate goal. Once precisiation of meaning is achieved, the next goal is that of deduction from decision-relevant information. The ultimate goal is decision.
In CTPM, a concept which plays a key role in deduction is that of a protoform—an abbreviation for prototypical form. Informally, a protoform of an object is its abstracted summary. More specifically, a protoform is a symbolic expression which defines the deep semantic structure of an object such as a proposition, question, command, concept, scenario, or a system of such objects. In the following, our attention will be focused on protoforms of propositions, with PF(p) denoting a protoform of p. Abstraction has levels, just as summarization does. For this reason, an object may have a multiplicity of protoforms. Conversely, many objects may have the same protoform. Such objects are said to be protoform-equivalent, or PF-equivalent, for short. The set of protoforms of all precisiable propositions in NL, together with rules which govern propagation of generalized constraints, constitute what is called the Protoform Language (PFL), (See <figref idref="DRAWINGS">FIG. 38</figref>, regarding definition of protoform of p, with S(p), summary of p, and PF(p), abstracted summary of p, deep structure of p.) (See also <figref idref="DRAWINGS">FIG. 39</figref>, regarding protoforms and PF-equivalence. Note that at a given level of abstraction and summarization, objects p and q are PF-equivalent, if PF(p)=PF(q).)
EXAMPLES
<ul id="ul0041" list-style="none"><li id="ul0041-0001" num="0000"><ul id="ul0042" list-style="none"><li id="ul0042-0001" num="1193">Monika is young→Age(Monika) is young→A(B) is C, where Age refers to A, Monika to B (as instantiation), and Young to C (as abstraction).</li><li id="ul0042-0002" num="1194">Monika is much younger than Pat→(A(B), A(C)) is R, where Age refers to A, Monika to B, Pat to C, and “much younger” to R.</li><li id="ul0042-0003" num="1195">distance between New York and Boston is about 200 mi→A(B,C) is R, where Distance refers to A, New York to B, Boston to C, and “about 200 miles” to D.</li><li id="ul0042-0004" num="1196">usually Robert returns from work at about 6 pm→Prob{A is B} is C, where “Time(Robert.returns.from.work)” refers to A, “about 6 pm” to B, and Usually to C.</li><li id="ul0042-0005" num="1197">Carol lives in a small city near San Francisco→A(B(C)) is (D and E),</li></ul></li></ul>
where “small city” refers to E, “city near SF” to D, Carol to C, Residence to B, and Location to A. <ul id="ul0043" list-style="none"><li id="ul0043-0001" num="0000"><ul id="ul0044" list-style="none"><li id="ul0044-0001" num="1199">most Swedes are tall→1/n Σ Count(G[A] is R) is Q,</li></ul></li></ul>
where Most refers to Q, Swedes to G, tall to R, and Height to A.
Another example: Alan has severe back pain. He goes to see a doctor. The doctor tells him that there are two options: (1) do nothing; and (2) do surgery. In the case of surgery, there are two possibilities: (a) surgery is successful, in which case, Alan will be pain free; and (b) surgery is not successful, in which case Alan will be paralyzed from the neck down. (See <figref idref="DRAWINGS">FIG. 40</figref>)
Protoformal Deduction:
The rules of deduction in CTPM are, basically, the rules which govern constraint propagation. In CTPM, such rules reside in the Deduction Database (DDB). The Deduction Database comprises a collection of agent-controlled modules and submodules, each of which contains rules drawn from various fields and various modalities of generalized constraints. A typical rule has a symbolic part, which is expressed in terms of protoforms; and a computational part which defines the computation that has to be carried out to arrive at a conclusion.
See <figref idref="DRAWINGS">FIG. 41</figref>, regarding basic structure of PNL: <ul id="ul0045" list-style="none"><li id="ul0045-0001" num="0000"><ul id="ul0046" list-style="none"><li id="ul0046-0001" num="1204">In PNL, deduction=generalized constraint propagation</li><li id="ul0046-0002" num="1205">PFL: Protoform Language</li><li id="ul0046-0003" num="1206">DDB: deduction database=collection of protoformal rules governing generalized constraint propagation</li><li id="ul0046-0004" num="1207">WKDB: World Knowledge Database (PNL-based)</li></ul></li></ul>
See also <figref idref="DRAWINGS">FIG. 42</figref>, regarding structure of deduction database, DDB.
(a) Computational rule of inference:
For symbolic part, we have:
X is A
(X, Y) is B
Y is C
For computational part, we have:
<br />μ<sub>C</sub>(<i>v</i>)=max<sub>u</sub>(μ<sub>A</sub>(<i>u</i>) {circumflex over ( )} μ<sub>B</sub>(<i>u, v</i>))
(b) Intersection/product syllogism:
For symbolic part, we have:
Q1 A's are B's
Q2 (A&B)'s are C's
Q3 A's are (B&C)'s
For computational part, we have:
<br />Q3=Q1* Q2
where Q1 l and Q2 are fuzzy quantifiers; A, B,C are fuzzy sets; * is product in fuzzy arithmetic.
(c) Basic extension principle:
For symbolic part, we have:
X is A
f (X) is B
For computational part, we have:
<br />μ<sub>B</sub>(<i>v</i>)=sup<sub>u </sub>(μ<sub>A</sub>)<i>u</i>))
subject to
v=f (u)
g is a given function or functional; A and B are fuzzy sets.
(d) Extension principle:
This is the principal rule governing possibilistic constraint propagation.
For symbolic part, we have:
f (X) is A
g(X) is B
For computational part, we have:
<br />μ<sub>B</sub>(<i>v</i>)=sup<sub>u </sub>(μ<sub>B</sub>(<i>f</i>(<i>u</i>)))
subject to
v=g(u)
Note. The extension principle is a primary deduction rule in the sense that many other deduction rules are derivable from the extension principle. An example is the following rule,
(e) Basic probability rule:
For symbolic part, we have:
Prob(X is A) is B
Prob(X is C) is D
For computational part, we have:
<maths id="MATH-US-00078" num="00078"><math overflow="scroll"><mrow><mrow><msub><mi>μ</mi><mi>D</mi></msub><mo></mo><mrow><mo>(</mo><mi>v</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><msub><mi>sup</mi><mi>r</mi></msub><mo></mo><mrow><mo>(</mo><mrow><msub><mi>μ</mi><mi>B</mi></msub><mo></mo><mrow><mo>(</mo><mrow><munder><mover><mo>∫</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mover><mi>U</mi></munder><mo></mo><mrow><mrow><msub><mi>μ</mi><mi>A</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>)</mo></mrow></mrow><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D16017.tif" /><img file="US2022121884A1_D16018.tif" /><img file="US2022121884A1_D16019.tif" /><img file="US2022121884A1_D16020.tif" /><img file="US2022121884A1_D16021.tif" /><img file="US2022121884A1_D16022.tif" /><img file="US2022121884A1_D16023.tif" /><img file="US2022121884A1_D16024.tif" /><img file="US2022121884A1_D16025.tif" /><img file="US2022121884A1_D16026.tif" /><img file="US2022121884A1_D16027.tif" /><img file="US2022121884A1_D16028.tif" /><img file="US2022121884A1_D16029.tif" /><img file="US2022121884A1_D16030.tif" /><img file="US2022121884A1_D16031.tif" /><img file="US2022121884A1_D16032.tif" /><img file="US2022121884A1_D16033.tif" /><img file="US2022121884A1_D16034.tif" /><img file="US2022121884A1_D16035.tif" /><img file="US2022121884A1_D16036.tif" /><img file="US2022121884A1_D16037.tif" /><img file="US2022121884A1_D16038.tif" /><img file="US2022121884A1_D16039.tif" /><img file="US2022121884A1_D16040.tif" /><img file="US2022121884A1_D16041.tif" /><img file="US2022121884A1_D16042.tif" /><img file="US2022121884A1_D16043.tif" /><img file="US2022121884A1_D16044.tif" /><img file="US2022121884A1_D16045.tif" /><img file="US2022121884A1_D16046.tif" /><img file="US2022121884A1_D16047.tif" /><img file="US2022121884A1_D16048.tif" /><img file="US2022121884A1_D16049.tif" /><img file="US2022121884A1_D16050.tif" /><img file="US2022121884A1_D16051.tif" /><img file="US2022121884A1_D16052.tif" /><img file="US2022121884A1_D16053.tif" /><img file="US2022121884A1_D16054.tif" /><img file="US2022121884A1_D16055.tif" /><img file="US2022121884A1_D16056.tif" /><img file="US2022121884A1_D16057.tif" /><img file="US2022121884A1_D16058.tif" /><img file="US2022121884A1_D16059.tif" /><img file="US2022121884A1_D16060.tif" /><img file="US2022121884A1_D16061.tif" /><img file="US2022121884A1_D16062.tif" /><img file="US2022121884A1_D16063.tif" /><img file="US2022121884A1_D16064.tif" /><img file="US2022121884A1_D16065.tif" /><img file="US2022121884A1_D16066.tif" /><img file="US2022121884A1_D16067.tif" /><img file="US2022121884A1_D16068.tif" /><img file="US2022121884A1_D16069.tif" /><img file="US2022121884A1_D16070.tif" /><img file="US2022121884A1_D16071.tif" /><img file="US2022121884A1_D16072.tif" /><img file="US2022121884A1_D16073.tif" /><img file="US2022121884A1_D16074.tif" /><img file="US2022121884A1_D16075.tif" /><img file="US2022121884A1_D16076.tif" /><img file="US2022121884A1_D16077.tif" /><img file="US2022121884A1_D16078.tif" /><img file="US2022121884A1_D16079.tif" /><img file="US2022121884A1_D16080.tif" /><img file="US2022121884A1_D16081.tif" /><img file="US2022121884A1_D16082.tif" /><img file="US2022121884A1_D16083.tif" /><img file="US2022121884A1_D16084.tif" /><img file="US2022121884A1_D16085.tif" /><img file="US2022121884A1_D16086.tif" /><img file="US2022121884A1_D16087.tif" /><img file="US2022121884A1_D16088.tif" /><img file="US2022121884A1_D16089.tif" /><img file="US2022121884A1_D16090.tif" /><img file="US2022121884A1_D16091.tif" /><img file="US2022121884A1_D16092.tif" /><img file="US2022121884A1_D16093.tif" /><img file="US2022121884A1_D16094.tif" /><img file="US2022121884A1_D16095.tif" /><img file="US2022121884A1_D16096.tif" /><img file="US2022121884A1_D16097.tif" /><img file="US2022121884A1_D16098.tif" /><img file="US2022121884A1_D16099.tif" /><img file="US2022121884A1_D16100.tif" /><img file="US2022121884A1_D16101.tif" /><img file="US2022121884A1_D16102.tif" /><img file="US2022121884A1_D16103.tif" /><img file="US2022121884A1_D16104.tif" /><img file="US2022121884A1_D16105.tif" /><img file="US2022121884A1_D16106.tif" /><img file="US2022121884A1_D16107.tif" /><img file="US2022121884A1_D16108.tif" /><img file="US2022121884A1_D16109.tif" /><img file="US2022121884A1_D16110.tif" /><img file="US2022121884A1_D16111.tif" /><img file="US2022121884A1_D16112.tif" /><img file="US2022121884A1_D16113.tif" /><img file="US2022121884A1_D16114.tif" /><img file="US2022121884A1_D16115.tif" /><img file="US2022121884A1_D16116.tif" /><img file="US2022121884A1_D16117.tif" /><img file="US2022121884A1_D16118.tif" /><img file="US2022121884A1_D16119.tif" /><img file="US2022121884A1_D16120.tif" /><img file="US2022121884A1_D16121.tif" /><img file="US2022121884A1_D16122.tif" /><img file="US2022121884A1_D16123.tif" /><img file="US2022121884A1_D16124.tif" /><img file="US2022121884A1_D16125.tif" /><img file="US2022121884A1_D16126.tif" /><img file="US2022121884A1_D16127.tif" /><img file="US2022121884A1_D16128.tif" /><maths id="MATH-US-00078-2" num="00078.2"><math overflow="scroll"><mrow><mi>subject</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>to</mi></mrow></math></maths><img file="US2022121884A1_D16129.tif" /><img file="US2022121884A1_D16130.tif" /><img file="US2022121884A1_D16131.tif" /><img file="US2022121884A1_D16132.tif" /><img file="US2022121884A1_D16133.tif" /><img file="US2022121884A1_D16134.tif" /><img file="US2022121884A1_D16135.tif" /><img file="US2022121884A1_D16136.tif" /><img file="US2022121884A1_D16137.tif" /><img file="US2022121884A1_D16138.tif" /><img file="US2022121884A1_D16139.tif" /><img file="US2022121884A1_D16140.tif" /><img file="US2022121884A1_D16141.tif" /><img file="US2022121884A1_D16142.tif" /><img file="US2022121884A1_D16143.tif" /><img file="US2022121884A1_D16144.tif" /><img file="US2022121884A1_D16145.tif" /><img file="US2022121884A1_D16146.tif" /><img file="US2022121884A1_D16147.tif" /><img file="US2022121884A1_D16148.tif" /><img file="US2022121884A1_D16149.tif" /><img file="US2022121884A1_D16150.tif" /><img file="US2022121884A1_D16151.tif" /><img file="US2022121884A1_D16152.tif" /><img file="US2022121884A1_D16153.tif" /><img file="US2022121884A1_D16154.tif" /><img file="US2022121884A1_D16155.tif" /><img file="US2022121884A1_D16156.tif" /><img file="US2022121884A1_D16157.tif" /><img file="US2022121884A1_D16158.tif" /><img file="US2022121884A1_D16159.tif" /><img file="US2022121884A1_D16160.tif" /><img file="US2022121884A1_D16161.tif" /><img file="US2022121884A1_D16162.tif" /><img file="US2022121884A1_D16163.tif" /><img file="US2022121884A1_D16164.tif" /><img file="US2022121884A1_D16165.tif" /><img file="US2022121884A1_D16166.tif" /><img file="US2022121884A1_D16167.tif" /><img file="US2022121884A1_D16168.tif" /><img file="US2022121884A1_D16169.tif" /><img file="US2022121884A1_D16170.tif" /><img file="US2022121884A1_D16171.tif" /><img file="US2022121884A1_D16172.tif" /><img file="US2022121884A1_D16173.tif" /><img file="US2022121884A1_D16174.tif" /><img file="US2022121884A1_D16175.tif" /><img file="US2022121884A1_D16176.tif" /><img file="US2022121884A1_D16177.tif" /><img file="US2022121884A1_D16178.tif" /><img file="US2022121884A1_D16179.tif" /><img file="US2022121884A1_D16180.tif" /><img file="US2022121884A1_D16181.tif" /><img file="US2022121884A1_D16182.tif" /><img file="US2022121884A1_D16183.tif" /><img file="US2022121884A1_D16184.tif" /><img file="US2022121884A1_D16185.tif" /><img file="US2022121884A1_D16186.tif" /><img file="US2022121884A1_D16187.tif" /><img file="US2022121884A1_D16188.tif" /><img file="US2022121884A1_D16189.tif" /><img file="US2022121884A1_D16190.tif" /><img file="US2022121884A1_D16191.tif" /><img file="US2022121884A1_D16192.tif" /><img file="US2022121884A1_D16193.tif" /><img file="US2022121884A1_D16194.tif" /><img file="US2022121884A1_D16195.tif" /><img file="US2022121884A1_D16196.tif" /><img file="US2022121884A1_D16197.tif" /><img file="US2022121884A1_D16198.tif" /><img file="US2022121884A1_D16199.tif" /><img file="US2022121884A1_D16200.tif" /><img file="US2022121884A1_D16201.tif" /><img file="US2022121884A1_D16202.tif" /><img file="US2022121884A1_D16203.tif" /><img file="US2022121884A1_D16204.tif" /><img file="US2022121884A1_D16205.tif" /><img file="US2022121884A1_D16206.tif" /><img file="US2022121884A1_D16207.tif" /><img file="US2022121884A1_D16208.tif" /><img file="US2022121884A1_D16209.tif" /><img file="US2022121884A1_D16210.tif" /><img file="US2022121884A1_D16211.tif" /><img file="US2022121884A1_D16212.tif" /><img file="US2022121884A1_D16213.tif" /><img file="US2022121884A1_D16214.tif" /><img file="US2022121884A1_D16215.tif" /><img file="US2022121884A1_D16216.tif" /><img file="US2022121884A1_D16217.tif" /><img file="US2022121884A1_D16218.tif" /><img file="US2022121884A1_D16219.tif" /><img file="US2022121884A1_D16220.tif" /><img file="US2022121884A1_D16221.tif" /><img file="US2022121884A1_D16222.tif" /><img file="US2022121884A1_D16223.tif" /><img file="US2022121884A1_D16224.tif" /><img file="US2022121884A1_D16225.tif" /><img file="US2022121884A1_D16226.tif" /><img file="US2022121884A1_D16227.tif" /><img file="US2022121884A1_D16228.tif" /><img file="US2022121884A1_D16229.tif" /><img file="US2022121884A1_D16230.tif" /><img file="US2022121884A1_D16231.tif" /><img file="US2022121884A1_D16232.tif" /><img file="US2022121884A1_D16233.tif" /><img file="US2022121884A1_D16234.tif" /><img file="US2022121884A1_D16235.tif" /><img file="US2022121884A1_D16236.tif" /><img file="US2022121884A1_D16237.tif" /><img file="US2022121884A1_D16238.tif" /><img file="US2022121884A1_D16239.tif" /><img file="US2022121884A1_D16240.tif" /><maths id="MATH-US-00078-3" num="00078.3"><math overflow="scroll"><mrow><mrow><mi>v</mi><mo>=</mo><mrow><munder><mover><mo>∫</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mover><mi>U</mi></munder><mo></mo><mrow><mrow><msub><mi>μ</mi><mi>C</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow></mrow><mo>,</mo><mstyle><mtext></mtext></mstyle><mo></mo><mrow><mrow><munder><mover><mo>∫</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mover><mi>U</mi></munder><mo></mo><mrow><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>=</mo><mn>1.</mn></mrow></mrow></math></maths><img file="US2022121884A1_D16241.tif" /><img file="US2022121884A1_D16242.tif" /><img file="US2022121884A1_D16243.tif" /><img file="US2022121884A1_D16244.tif" /><img file="US2022121884A1_D16245.tif" /><img file="US2022121884A1_D16246.tif" /><img file="US2022121884A1_D16247.tif" /><img file="US2022121884A1_D16248.tif" /><img file="US2022121884A1_D16249.tif" /><img file="US2022121884A1_D16250.tif" /><img file="US2022121884A1_D16251.tif" /><img file="US2022121884A1_D16252.tif" /><img file="US2022121884A1_D16253.tif" /><img file="US2022121884A1_D16254.tif" /><img file="US2022121884A1_D16255.tif" /><img file="US2022121884A1_D16256.tif" /><img file="US2022121884A1_D16257.tif" /><img file="US2022121884A1_D16258.tif" /><img file="US2022121884A1_D16259.tif" /><img file="US2022121884A1_D16260.tif" /><img file="US2022121884A1_D16261.tif" /><img file="US2022121884A1_D16262.tif" /><img file="US2022121884A1_D16263.tif" /><img file="US2022121884A1_D16264.tif" /><img file="US2022121884A1_D16265.tif" /><img file="US2022121884A1_D16266.tif" /><img file="US2022121884A1_D16267.tif" /><img file="US2022121884A1_D16268.tif" /><img file="US2022121884A1_D16269.tif" /><img file="US2022121884A1_D16270.tif" /><img file="US2022121884A1_D16271.tif" /><img file="US2022121884A1_D16272.tif" /><img file="US2022121884A1_D16273.tif" /><img file="US2022121884A1_D16274.tif" /><img file="US2022121884A1_D16275.tif" /><img file="US2022121884A1_D16276.tif" /><img file="US2022121884A1_D16277.tif" /><img file="US2022121884A1_D16278.tif" /><img file="US2022121884A1_D16279.tif" /><img file="US2022121884A1_D16280.tif" /><img file="US2022121884A1_D16281.tif" /><img file="US2022121884A1_D16282.tif" /><img file="US2022121884A1_D16283.tif" /><img file="US2022121884A1_D16284.tif" /><img file="US2022121884A1_D16285.tif" /><img file="US2022121884A1_D16286.tif" /><img file="US2022121884A1_D16287.tif" /><img file="US2022121884A1_D16288.tif" /><img file="US2022121884A1_D16289.tif" /><img file="US2022121884A1_D16290.tif" /><img file="US2022121884A1_D16291.tif" /><img file="US2022121884A1_D16292.tif" /><img file="US2022121884A1_D16293.tif" /><img file="US2022121884A1_D16294.tif" /><img file="US2022121884A1_D16295.tif" /><img file="US2022121884A1_D16296.tif" /><img file="US2022121884A1_D16297.tif" /><img file="US2022121884A1_D16298.tif" /><img file="US2022121884A1_D16299.tif" /><img file="US2022121884A1_D16300.tif" /><img file="US2022121884A1_D16301.tif" /><img file="US2022121884A1_D16302.tif" /><img file="US2022121884A1_D16303.tif" /><img file="US2022121884A1_D16304.tif" /><img file="US2022121884A1_D16305.tif" /><img file="US2022121884A1_D16306.tif" /><img file="US2022121884A1_D16307.tif" /><img file="US2022121884A1_D16308.tif" /><img file="US2022121884A1_D16309.tif" /><img file="US2022121884A1_D16310.tif" /><img file="US2022121884A1_D16311.tif" /><img file="US2022121884A1_D16312.tif" /><img file="US2022121884A1_D16313.tif" /><img file="US2022121884A1_D16314.tif" /><img file="US2022121884A1_D16315.tif" /><img file="US2022121884A1_D16316.tif" /><img file="US2022121884A1_D16317.tif" /><img file="US2022121884A1_D16318.tif" /><img file="US2022121884A1_D16319.tif" /><img file="US2022121884A1_D16320.tif" /><img file="US2022121884A1_D16321.tif" /><img file="US2022121884A1_D16322.tif" /><img file="US2022121884A1_D16323.tif" /><img file="US2022121884A1_D16324.tif" /><img file="US2022121884A1_D16325.tif" /><img file="US2022121884A1_D16326.tif" /><img file="US2022121884A1_D16327.tif" /><img file="US2022121884A1_D16328.tif" /><img file="US2022121884A1_D16329.tif" /><img file="US2022121884A1_D16330.tif" /><img file="US2022121884A1_D16331.tif" /><img file="US2022121884A1_D16332.tif" /><img file="US2022121884A1_D16333.tif" /><img file="US2022121884A1_D16334.tif" /><img file="US2022121884A1_D16335.tif" /><img file="US2022121884A1_D16336.tif" /><img file="US2022121884A1_D16337.tif" /><img file="US2022121884A1_D16338.tif" /><img file="US2022121884A1_D16339.tif" /><img file="US2022121884A1_D16340.tif" /><img file="US2022121884A1_D16341.tif" /><img file="US2022121884A1_D16342.tif" /><img file="US2022121884A1_D16343.tif" /><img file="US2022121884A1_D16344.tif" /><img file="US2022121884A1_D16345.tif" /><img file="US2022121884A1_D16346.tif" /><img file="US2022121884A1_D16347.tif" /><img file="US2022121884A1_D16348.tif" /><img file="US2022121884A1_D16349.tif" /><img file="US2022121884A1_D16350.tif" /><img file="US2022121884A1_D16351.tif" /><img file="US2022121884A1_D16352.tif" />
X is a real-valued random variable; A, B, C, and D are fuzzy sets: r is the probability density of X; and U={u}. To derive this rule, we note that
<maths id="MATH-US-00079" num="00079"><math overflow="scroll"><mrow><mrow><mrow><mi>Prob</mi><mo></mo><mrow><mo>(</mo><mrow><mi>X</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>is</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>A</mi></mrow><mo>)</mo></mrow></mrow><mo></mo><mstyle><mspace width="0.6em" height="0.6ex" /></mstyle><mo></mo><mi>is</mi><mo></mo><mstyle><mspace width="0.6em" height="0.6ex" /></mstyle><mo></mo><mi>B</mi></mrow><mo>→</mo><mrow><munder><mover><mo>∫</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mover><mi>U</mi></munder><mo></mo><mrow><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>μ</mi><mi>A</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>is</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>B</mi></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D16353.tif" /><img file="US2022121884A1_D16354.tif" /><img file="US2022121884A1_D16355.tif" /><img file="US2022121884A1_D16356.tif" /><img file="US2022121884A1_D16357.tif" /><img file="US2022121884A1_D16358.tif" /><img file="US2022121884A1_D16359.tif" /><img file="US2022121884A1_D16360.tif" /><img file="US2022121884A1_D16361.tif" /><img file="US2022121884A1_D16362.tif" /><img file="US2022121884A1_D16363.tif" /><img file="US2022121884A1_D16364.tif" /><img file="US2022121884A1_D16365.tif" /><img file="US2022121884A1_D16366.tif" /><img file="US2022121884A1_D16367.tif" /><img file="US2022121884A1_D16368.tif" /><img file="US2022121884A1_D16369.tif" /><img file="US2022121884A1_D16370.tif" /><img file="US2022121884A1_D16371.tif" /><img file="US2022121884A1_D16372.tif" /><img file="US2022121884A1_D16373.tif" /><img file="US2022121884A1_D16374.tif" /><img file="US2022121884A1_D16375.tif" /><img file="US2022121884A1_D16376.tif" /><img file="US2022121884A1_D16377.tif" /><img file="US2022121884A1_D16378.tif" /><img file="US2022121884A1_D16379.tif" /><img file="US2022121884A1_D16380.tif" /><img file="US2022121884A1_D16381.tif" /><img file="US2022121884A1_D16382.tif" /><img file="US2022121884A1_D16383.tif" /><img file="US2022121884A1_D16384.tif" /><img file="US2022121884A1_D16385.tif" /><img file="US2022121884A1_D16386.tif" /><img file="US2022121884A1_D16387.tif" /><img file="US2022121884A1_D16388.tif" /><img file="US2022121884A1_D16389.tif" /><img file="US2022121884A1_D16390.tif" /><img file="US2022121884A1_D16391.tif" /><img file="US2022121884A1_D16392.tif" /><img file="US2022121884A1_D16393.tif" /><img file="US2022121884A1_D16394.tif" /><img file="US2022121884A1_D16395.tif" /><img file="US2022121884A1_D16396.tif" /><img file="US2022121884A1_D16397.tif" /><img file="US2022121884A1_D16398.tif" /><img file="US2022121884A1_D16399.tif" /><img file="US2022121884A1_D16400.tif" /><img file="US2022121884A1_D16401.tif" /><img file="US2022121884A1_D16402.tif" /><img file="US2022121884A1_D16403.tif" /><img file="US2022121884A1_D16404.tif" /><img file="US2022121884A1_D16405.tif" /><img file="US2022121884A1_D16406.tif" /><img file="US2022121884A1_D16407.tif" /><img file="US2022121884A1_D16408.tif" /><img file="US2022121884A1_D16409.tif" /><img file="US2022121884A1_D16410.tif" /><img file="US2022121884A1_D16411.tif" /><img file="US2022121884A1_D16412.tif" /><img file="US2022121884A1_D16413.tif" /><img file="US2022121884A1_D16414.tif" /><img file="US2022121884A1_D16415.tif" /><img file="US2022121884A1_D16416.tif" /><img file="US2022121884A1_D16417.tif" /><img file="US2022121884A1_D16418.tif" /><img file="US2022121884A1_D16419.tif" /><img file="US2022121884A1_D16420.tif" /><img file="US2022121884A1_D16421.tif" /><img file="US2022121884A1_D16422.tif" /><img file="US2022121884A1_D16423.tif" /><img file="US2022121884A1_D16424.tif" /><img file="US2022121884A1_D16425.tif" /><img file="US2022121884A1_D16426.tif" /><img file="US2022121884A1_D16427.tif" /><img file="US2022121884A1_D16428.tif" /><img file="US2022121884A1_D16429.tif" /><img file="US2022121884A1_D16430.tif" /><img file="US2022121884A1_D16431.tif" /><img file="US2022121884A1_D16432.tif" /><img file="US2022121884A1_D16433.tif" /><img file="US2022121884A1_D16434.tif" /><img file="US2022121884A1_D16435.tif" /><img file="US2022121884A1_D16436.tif" /><img file="US2022121884A1_D16437.tif" /><img file="US2022121884A1_D16438.tif" /><img file="US2022121884A1_D16439.tif" /><img file="US2022121884A1_D16440.tif" /><img file="US2022121884A1_D16441.tif" /><img file="US2022121884A1_D16442.tif" /><img file="US2022121884A1_D16443.tif" /><img file="US2022121884A1_D16444.tif" /><img file="US2022121884A1_D16445.tif" /><img file="US2022121884A1_D16446.tif" /><img file="US2022121884A1_D16447.tif" /><img file="US2022121884A1_D16448.tif" /><img file="US2022121884A1_D16449.tif" /><img file="US2022121884A1_D16450.tif" /><img file="US2022121884A1_D16451.tif" /><img file="US2022121884A1_D16452.tif" /><img file="US2022121884A1_D16453.tif" /><img file="US2022121884A1_D16454.tif" /><img file="US2022121884A1_D16455.tif" /><img file="US2022121884A1_D16456.tif" /><img file="US2022121884A1_D16457.tif" /><img file="US2022121884A1_D16458.tif" /><img file="US2022121884A1_D16459.tif" /><img file="US2022121884A1_D16460.tif" /><img file="US2022121884A1_D16461.tif" /><img file="US2022121884A1_D16462.tif" /><img file="US2022121884A1_D16463.tif" /><img file="US2022121884A1_D16464.tif" /><maths id="MATH-US-00079-2" num="00079.2"><math overflow="scroll"><mrow><mrow><mrow><mi>Prob</mi><mo></mo><mrow><mo>(</mo><mrow><mi>X</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>is</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>C</mi></mrow><mo>)</mo></mrow></mrow><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>is</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>D</mi></mrow><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo>→</mo><mrow><munder><mover><mo>∫</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mover><mi>U</mi></munder><mo></mo><mrow><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>μ</mi><mi>C</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>is</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>D</mi></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D16465.tif" /><img file="US2022121884A1_D16466.tif" /><img file="US2022121884A1_D16467.tif" /><img file="US2022121884A1_D16468.tif" /><img file="US2022121884A1_D16469.tif" /><img file="US2022121884A1_D16470.tif" /><img file="US2022121884A1_D16471.tif" /><img file="US2022121884A1_D16472.tif" /><img file="US2022121884A1_D16473.tif" /><img file="US2022121884A1_D16474.tif" /><img file="US2022121884A1_D16475.tif" /><img file="US2022121884A1_D16476.tif" /><img file="US2022121884A1_D16477.tif" /><img file="US2022121884A1_D16478.tif" /><img file="US2022121884A1_D16479.tif" /><img file="US2022121884A1_D16480.tif" /><img file="US2022121884A1_D16481.tif" /><img file="US2022121884A1_D16482.tif" /><img file="US2022121884A1_D16483.tif" /><img file="US2022121884A1_D16484.tif" /><img file="US2022121884A1_D16485.tif" /><img file="US2022121884A1_D16486.tif" /><img file="US2022121884A1_D16487.tif" /><img file="US2022121884A1_D16488.tif" /><img file="US2022121884A1_D16489.tif" /><img file="US2022121884A1_D16490.tif" /><img file="US2022121884A1_D16491.tif" /><img file="US2022121884A1_D16492.tif" /><img file="US2022121884A1_D16493.tif" /><img file="US2022121884A1_D16494.tif" /><img file="US2022121884A1_D16495.tif" /><img file="US2022121884A1_D16496.tif" /><img file="US2022121884A1_D16497.tif" /><img file="US2022121884A1_D16498.tif" /><img file="US2022121884A1_D16499.tif" /><img file="US2022121884A1_D16500.tif" /><img file="US2022121884A1_D16501.tif" /><img file="US2022121884A1_D16502.tif" /><img file="US2022121884A1_D16503.tif" /><img file="US2022121884A1_D16504.tif" /><img file="US2022121884A1_D16505.tif" /><img file="US2022121884A1_D16506.tif" /><img file="US2022121884A1_D16507.tif" /><img file="US2022121884A1_D16508.tif" /><img file="US2022121884A1_D16509.tif" /><img file="US2022121884A1_D16510.tif" /><img file="US2022121884A1_D16511.tif" /><img file="US2022121884A1_D16512.tif" /><img file="US2022121884A1_D16513.tif" /><img file="US2022121884A1_D16514.tif" /><img file="US2022121884A1_D16515.tif" /><img file="US2022121884A1_D16516.tif" /><img file="US2022121884A1_D16517.tif" /><img file="US2022121884A1_D16518.tif" /><img file="US2022121884A1_D16519.tif" /><img file="US2022121884A1_D16520.tif" /><img file="US2022121884A1_D16521.tif" /><img file="US2022121884A1_D16522.tif" /><img file="US2022121884A1_D16523.tif" /><img file="US2022121884A1_D16524.tif" /><img file="US2022121884A1_D16525.tif" /><img file="US2022121884A1_D16526.tif" /><img file="US2022121884A1_D16527.tif" /><img file="US2022121884A1_D16528.tif" /><img file="US2022121884A1_D16529.tif" /><img file="US2022121884A1_D16530.tif" /><img file="US2022121884A1_D16531.tif" /><img file="US2022121884A1_D16532.tif" /><img file="US2022121884A1_D16533.tif" /><img file="US2022121884A1_D16534.tif" /><img file="US2022121884A1_D16535.tif" /><img file="US2022121884A1_D16536.tif" /><img file="US2022121884A1_D16537.tif" /><img file="US2022121884A1_D16538.tif" /><img file="US2022121884A1_D16539.tif" /><img file="US2022121884A1_D16540.tif" /><img file="US2022121884A1_D16541.tif" /><img file="US2022121884A1_D16542.tif" /><img file="US2022121884A1_D16543.tif" /><img file="US2022121884A1_D16544.tif" /><img file="US2022121884A1_D16545.tif" /><img file="US2022121884A1_D16546.tif" /><img file="US2022121884A1_D16547.tif" /><img file="US2022121884A1_D16548.tif" /><img file="US2022121884A1_D16549.tif" /><img file="US2022121884A1_D16550.tif" /><img file="US2022121884A1_D16551.tif" /><img file="US2022121884A1_D16552.tif" /><img file="US2022121884A1_D16553.tif" /><img file="US2022121884A1_D16554.tif" /><img file="US2022121884A1_D16555.tif" /><img file="US2022121884A1_D16556.tif" /><img file="US2022121884A1_D16557.tif" /><img file="US2022121884A1_D16558.tif" /><img file="US2022121884A1_D16559.tif" /><img file="US2022121884A1_D16560.tif" /><img file="US2022121884A1_D16561.tif" /><img file="US2022121884A1_D16562.tif" /><img file="US2022121884A1_D16563.tif" /><img file="US2022121884A1_D16564.tif" /><img file="US2022121884A1_D16565.tif" /><img file="US2022121884A1_D16566.tif" /><img file="US2022121884A1_D16567.tif" /><img file="US2022121884A1_D16568.tif" /><img file="US2022121884A1_D16569.tif" /><img file="US2022121884A1_D16570.tif" /><img file="US2022121884A1_D16571.tif" /><img file="US2022121884A1_D16572.tif" /><img file="US2022121884A1_D16573.tif" /><img file="US2022121884A1_D16574.tif" /><img file="US2022121884A1_D16575.tif" /><img file="US2022121884A1_D16576.tif" />
which are generalized constraints of the form
f (r) is B
g(r) i s D.
Applying the extension principle to these expressions, we obtain the expression for D which appears in the basic probability rule.
(f) Bimodal interpolation rule:
The bimodal interpolation rule is a rule which resides in the Probability module of DDB. The symbolic and computational parts of this rule are:
Symbolic parts:
Prob(X is Ai) is Pi
Prob(X is A) is Q
where i=1, . . . , n
Computational parts:
<maths id="MATH-US-00080" num="00080"><math overflow="scroll"><mrow><mrow><msub><mi>μ</mi><mi>Q</mi></msub><mo></mo><mrow><mo>(</mo><mi>v</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><msub><mi>sup</mi><mi>r</mi></msub><mo></mo><mrow><mo>(</mo><mrow><mrow><msub><mi>μ</mi><mrow><mi>P</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>1</mn></mrow></msub><mo></mo><mrow><mo>(</mo><mrow><munder><mover><mo>∫</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mover><mi>U</mi></munder><mo></mo><mrow><mrow><msub><mi>μ</mi><mrow><mi>A</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>1</mn></mrow></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>)</mo></mrow></mrow><mo>⋀</mo><mi>…</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo>⋀</mo><mrow><msub><mi>μ</mi><mi>Pn</mi></msub><mo></mo><mrow><mo>(</mo><mrow><munder><mover><mo>∫</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mover><mi>U</mi></munder><mo></mo><mrow><mrow><msub><mi>μ</mi><mi>An</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>)</mo></mrow></mrow></mrow><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D16577.tif" /><img file="US2022121884A1_D16578.tif" /><img file="US2022121884A1_D16579.tif" /><img file="US2022121884A1_D16580.tif" /><img file="US2022121884A1_D16581.tif" /><img file="US2022121884A1_D16582.tif" /><img file="US2022121884A1_D16583.tif" /><img file="US2022121884A1_D16584.tif" /><img file="US2022121884A1_D16585.tif" /><img file="US2022121884A1_D16586.tif" /><img file="US2022121884A1_D16587.tif" /><img file="US2022121884A1_D16588.tif" /><img file="US2022121884A1_D16589.tif" /><img file="US2022121884A1_D16590.tif" /><img file="US2022121884A1_D16591.tif" /><img file="US2022121884A1_D16592.tif" /><img file="US2022121884A1_D16593.tif" /><img file="US2022121884A1_D16594.tif" /><img file="US2022121884A1_D16595.tif" /><img file="US2022121884A1_D16596.tif" /><img file="US2022121884A1_D16597.tif" /><img file="US2022121884A1_D16598.tif" /><img file="US2022121884A1_D16599.tif" /><img file="US2022121884A1_D16600.tif" /><img file="US2022121884A1_D16601.tif" /><img file="US2022121884A1_D16602.tif" /><img file="US2022121884A1_D16603.tif" /><img file="US2022121884A1_D16604.tif" /><img file="US2022121884A1_D16605.tif" /><img file="US2022121884A1_D16606.tif" /><img file="US2022121884A1_D16607.tif" /><img file="US2022121884A1_D16608.tif" /><img file="US2022121884A1_D16609.tif" /><img file="US2022121884A1_D16610.tif" /><img file="US2022121884A1_D16611.tif" /><img file="US2022121884A1_D16612.tif" /><img file="US2022121884A1_D16613.tif" /><img file="US2022121884A1_D16614.tif" /><img file="US2022121884A1_D16615.tif" /><img file="US2022121884A1_D16616.tif" /><img file="US2022121884A1_D16617.tif" /><img file="US2022121884A1_D16618.tif" /><img file="US2022121884A1_D16619.tif" /><img file="US2022121884A1_D16620.tif" /><img file="US2022121884A1_D16621.tif" /><img file="US2022121884A1_D16622.tif" /><img file="US2022121884A1_D16623.tif" /><img file="US2022121884A1_D16624.tif" /><img file="US2022121884A1_D16625.tif" /><img file="US2022121884A1_D16626.tif" /><img file="US2022121884A1_D16627.tif" /><img file="US2022121884A1_D16628.tif" /><img file="US2022121884A1_D16629.tif" /><img file="US2022121884A1_D16630.tif" /><img file="US2022121884A1_D16631.tif" /><img file="US2022121884A1_D16632.tif" /><img file="US2022121884A1_D16633.tif" /><img file="US2022121884A1_D16634.tif" /><img file="US2022121884A1_D16635.tif" /><img file="US2022121884A1_D16636.tif" /><img file="US2022121884A1_D16637.tif" /><img file="US2022121884A1_D16638.tif" /><img file="US2022121884A1_D16639.tif" /><img file="US2022121884A1_D16640.tif" /><img file="US2022121884A1_D16641.tif" /><img file="US2022121884A1_D16642.tif" /><img file="US2022121884A1_D16643.tif" /><img file="US2022121884A1_D16644.tif" /><img file="US2022121884A1_D16645.tif" /><img file="US2022121884A1_D16646.tif" /><img file="US2022121884A1_D16647.tif" /><img file="US2022121884A1_D16648.tif" /><img file="US2022121884A1_D16649.tif" /><img file="US2022121884A1_D16650.tif" /><img file="US2022121884A1_D16651.tif" /><img file="US2022121884A1_D16652.tif" /><img file="US2022121884A1_D16653.tif" /><img file="US2022121884A1_D16654.tif" /><img file="US2022121884A1_D16655.tif" /><img file="US2022121884A1_D16656.tif" /><img file="US2022121884A1_D16657.tif" /><img file="US2022121884A1_D16658.tif" /><img file="US2022121884A1_D16659.tif" /><img file="US2022121884A1_D16660.tif" /><img file="US2022121884A1_D16661.tif" /><img file="US2022121884A1_D16662.tif" /><img file="US2022121884A1_D16663.tif" /><img file="US2022121884A1_D16664.tif" /><img file="US2022121884A1_D16665.tif" /><img file="US2022121884A1_D16666.tif" /><img file="US2022121884A1_D16667.tif" /><img file="US2022121884A1_D16668.tif" /><img file="US2022121884A1_D16669.tif" /><img file="US2022121884A1_D16670.tif" /><img file="US2022121884A1_D16671.tif" /><img file="US2022121884A1_D16672.tif" /><img file="US2022121884A1_D16673.tif" /><img file="US2022121884A1_D16674.tif" /><img file="US2022121884A1_D16675.tif" /><img file="US2022121884A1_D16676.tif" /><img file="US2022121884A1_D16677.tif" /><img file="US2022121884A1_D16678.tif" /><img file="US2022121884A1_D16679.tif" /><img file="US2022121884A1_D16680.tif" /><img file="US2022121884A1_D16681.tif" /><img file="US2022121884A1_D16682.tif" /><img file="US2022121884A1_D16683.tif" /><img file="US2022121884A1_D16684.tif" /><img file="US2022121884A1_D16685.tif" /><img file="US2022121884A1_D16686.tif" /><img file="US2022121884A1_D16687.tif" /><img file="US2022121884A1_D16688.tif" /><maths id="MATH-US-00080-2" num="00080.2"><math overflow="scroll"><mrow><mi>subject</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>to</mi></mrow></math></maths><img file="US2022121884A1_D16689.tif" /><img file="US2022121884A1_D16690.tif" /><img file="US2022121884A1_D16691.tif" /><img file="US2022121884A1_D16692.tif" /><img file="US2022121884A1_D16693.tif" /><img file="US2022121884A1_D16694.tif" /><img file="US2022121884A1_D16695.tif" /><img file="US2022121884A1_D16696.tif" /><img file="US2022121884A1_D16697.tif" /><img file="US2022121884A1_D16698.tif" /><img file="US2022121884A1_D16699.tif" /><img file="US2022121884A1_D16700.tif" /><img file="US2022121884A1_D16701.tif" /><img file="US2022121884A1_D16702.tif" /><img file="US2022121884A1_D16703.tif" /><img file="US2022121884A1_D16704.tif" /><img file="US2022121884A1_D16705.tif" /><img file="US2022121884A1_D16706.tif" /><img file="US2022121884A1_D16707.tif" /><img file="US2022121884A1_D16708.tif" /><img file="US2022121884A1_D16709.tif" /><img file="US2022121884A1_D16710.tif" /><img file="US2022121884A1_D16711.tif" /><img file="US2022121884A1_D16712.tif" /><img file="US2022121884A1_D16713.tif" /><img file="US2022121884A1_D16714.tif" /><img file="US2022121884A1_D16715.tif" /><img file="US2022121884A1_D16716.tif" /><img file="US2022121884A1_D16717.tif" /><img file="US2022121884A1_D16718.tif" /><img file="US2022121884A1_D16719.tif" /><img file="US2022121884A1_D16720.tif" /><img file="US2022121884A1_D16721.tif" /><img file="US2022121884A1_D16722.tif" /><img file="US2022121884A1_D16723.tif" /><img file="US2022121884A1_D16724.tif" /><img file="US2022121884A1_D16725.tif" /><img file="US2022121884A1_D16726.tif" /><img file="US2022121884A1_D16727.tif" /><img file="US2022121884A1_D16728.tif" /><img file="US2022121884A1_D16729.tif" /><img file="US2022121884A1_D16730.tif" /><img file="US2022121884A1_D16731.tif" /><img file="US2022121884A1_D16732.tif" /><img file="US2022121884A1_D16733.tif" /><img file="US2022121884A1_D16734.tif" /><img file="US2022121884A1_D16735.tif" /><img file="US2022121884A1_D16736.tif" /><img file="US2022121884A1_D16737.tif" /><img file="US2022121884A1_D16738.tif" /><img file="US2022121884A1_D16739.tif" /><img file="US2022121884A1_D16740.tif" /><img file="US2022121884A1_D16741.tif" /><img file="US2022121884A1_D16742.tif" /><img file="US2022121884A1_D16743.tif" /><img file="US2022121884A1_D16744.tif" /><img file="US2022121884A1_D16745.tif" /><img file="US2022121884A1_D16746.tif" /><img file="US2022121884A1_D16747.tif" /><img file="US2022121884A1_D16748.tif" /><img file="US2022121884A1_D16749.tif" /><img file="US2022121884A1_D16750.tif" /><img file="US2022121884A1_D16751.tif" /><img file="US2022121884A1_D16752.tif" /><img file="US2022121884A1_D16753.tif" /><img file="US2022121884A1_D16754.tif" /><img file="US2022121884A1_D16755.tif" /><img file="US2022121884A1_D16756.tif" /><img file="US2022121884A1_D16757.tif" /><img file="US2022121884A1_D16758.tif" /><img file="US2022121884A1_D16759.tif" /><img file="US2022121884A1_D16760.tif" /><img file="US2022121884A1_D16761.tif" /><img file="US2022121884A1_D16762.tif" /><img file="US2022121884A1_D16763.tif" /><img file="US2022121884A1_D16764.tif" /><img file="US2022121884A1_D16765.tif" /><img file="US2022121884A1_D16766.tif" /><img file="US2022121884A1_D16767.tif" /><img file="US2022121884A1_D16768.tif" /><img file="US2022121884A1_D16769.tif" /><img file="US2022121884A1_D16770.tif" /><img file="US2022121884A1_D16771.tif" /><img file="US2022121884A1_D16772.tif" /><img file="US2022121884A1_D16773.tif" /><img file="US2022121884A1_D16774.tif" /><img file="US2022121884A1_D16775.tif" /><img file="US2022121884A1_D16776.tif" /><img file="US2022121884A1_D16777.tif" /><img file="US2022121884A1_D16778.tif" /><img file="US2022121884A1_D16779.tif" /><img file="US2022121884A1_D16780.tif" /><img file="US2022121884A1_D16781.tif" /><img file="US2022121884A1_D16782.tif" /><img file="US2022121884A1_D16783.tif" /><img file="US2022121884A1_D16784.tif" /><img file="US2022121884A1_D16785.tif" /><img file="US2022121884A1_D16786.tif" /><img file="US2022121884A1_D16787.tif" /><img file="US2022121884A1_D16788.tif" /><img file="US2022121884A1_D16789.tif" /><img file="US2022121884A1_D16790.tif" /><img file="US2022121884A1_D16791.tif" /><img file="US2022121884A1_D16792.tif" /><img file="US2022121884A1_D16793.tif" /><img file="US2022121884A1_D16794.tif" /><img file="US2022121884A1_D16795.tif" /><img file="US2022121884A1_D16796.tif" /><img file="US2022121884A1_D16797.tif" /><img file="US2022121884A1_D16798.tif" /><img file="US2022121884A1_D16799.tif" /><img file="US2022121884A1_D16800.tif" /><maths id="MATH-US-00080-3" num="00080.3"><math overflow="scroll"><mrow><mi>v</mi><mo>=</mo><mrow><munder><mover><mo>∫</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mover><mi>U</mi></munder><mo></mo><mrow><mrow><msub><mi>μ</mi><mi>A</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D16801.tif" /><img file="US2022121884A1_D16802.tif" /><img file="US2022121884A1_D16803.tif" /><img file="US2022121884A1_D16804.tif" /><img file="US2022121884A1_D16805.tif" /><img file="US2022121884A1_D16806.tif" /><img file="US2022121884A1_D16807.tif" /><img file="US2022121884A1_D16808.tif" /><img file="US2022121884A1_D16809.tif" /><img file="US2022121884A1_D16810.tif" /><img file="US2022121884A1_D16811.tif" /><img file="US2022121884A1_D16812.tif" /><img file="US2022121884A1_D16813.tif" /><img file="US2022121884A1_D16814.tif" /><img file="US2022121884A1_D16815.tif" /><img file="US2022121884A1_D16816.tif" /><img file="US2022121884A1_D16817.tif" /><img file="US2022121884A1_D16818.tif" /><img file="US2022121884A1_D16819.tif" /><img file="US2022121884A1_D16820.tif" /><img file="US2022121884A1_D16821.tif" /><img file="US2022121884A1_D16822.tif" /><img file="US2022121884A1_D16823.tif" /><img file="US2022121884A1_D16824.tif" /><img file="US2022121884A1_D16825.tif" /><img file="US2022121884A1_D16826.tif" /><img file="US2022121884A1_D16827.tif" /><img file="US2022121884A1_D16828.tif" /><img file="US2022121884A1_D16829.tif" /><img file="US2022121884A1_D16830.tif" /><img file="US2022121884A1_D16831.tif" /><img file="US2022121884A1_D16832.tif" /><img file="US2022121884A1_D16833.tif" /><img file="US2022121884A1_D16834.tif" /><img file="US2022121884A1_D16835.tif" /><img file="US2022121884A1_D16836.tif" /><img file="US2022121884A1_D16837.tif" /><img file="US2022121884A1_D16838.tif" /><img file="US2022121884A1_D16839.tif" /><img file="US2022121884A1_D16840.tif" /><img file="US2022121884A1_D16841.tif" /><img file="US2022121884A1_D16842.tif" /><img file="US2022121884A1_D16843.tif" /><img file="US2022121884A1_D16844.tif" /><img file="US2022121884A1_D16845.tif" /><img file="US2022121884A1_D16846.tif" /><img file="US2022121884A1_D16847.tif" /><img file="US2022121884A1_D16848.tif" /><img file="US2022121884A1_D16849.tif" /><img file="US2022121884A1_D16850.tif" /><img file="US2022121884A1_D16851.tif" /><img file="US2022121884A1_D16852.tif" /><img file="US2022121884A1_D16853.tif" /><img file="US2022121884A1_D16854.tif" /><img file="US2022121884A1_D16855.tif" /><img file="US2022121884A1_D16856.tif" /><img file="US2022121884A1_D16857.tif" /><img file="US2022121884A1_D16858.tif" /><img file="US2022121884A1_D16859.tif" /><img file="US2022121884A1_D16860.tif" /><img file="US2022121884A1_D16861.tif" /><img file="US2022121884A1_D16862.tif" /><img file="US2022121884A1_D16863.tif" /><img file="US2022121884A1_D16864.tif" /><img file="US2022121884A1_D16865.tif" /><img file="US2022121884A1_D16866.tif" /><img file="US2022121884A1_D16867.tif" /><img file="US2022121884A1_D16868.tif" /><img file="US2022121884A1_D16869.tif" /><img file="US2022121884A1_D16870.tif" /><img file="US2022121884A1_D16871.tif" /><img file="US2022121884A1_D16872.tif" /><img file="US2022121884A1_D16873.tif" /><img file="US2022121884A1_D16874.tif" /><img file="US2022121884A1_D16875.tif" /><img file="US2022121884A1_D16876.tif" /><img file="US2022121884A1_D16877.tif" /><img file="US2022121884A1_D16878.tif" /><img file="US2022121884A1_D16879.tif" /><img file="US2022121884A1_D16880.tif" /><img file="US2022121884A1_D16881.tif" /><img file="US2022121884A1_D16882.tif" /><img file="US2022121884A1_D16883.tif" /><img file="US2022121884A1_D16884.tif" /><img file="US2022121884A1_D16885.tif" /><img file="US2022121884A1_D16886.tif" /><img file="US2022121884A1_D16887.tif" /><img file="US2022121884A1_D16888.tif" /><img file="US2022121884A1_D16889.tif" /><img file="US2022121884A1_D16890.tif" /><img file="US2022121884A1_D16891.tif" /><img file="US2022121884A1_D16892.tif" /><img file="US2022121884A1_D16893.tif" /><img file="US2022121884A1_D16894.tif" /><img file="US2022121884A1_D16895.tif" /><img file="US2022121884A1_D16896.tif" /><img file="US2022121884A1_D16897.tif" /><img file="US2022121884A1_D16898.tif" /><img file="US2022121884A1_D16899.tif" /><img file="US2022121884A1_D16900.tif" /><img file="US2022121884A1_D16901.tif" /><img file="US2022121884A1_D16902.tif" /><img file="US2022121884A1_D16903.tif" /><img file="US2022121884A1_D16904.tif" /><img file="US2022121884A1_D16905.tif" /><img file="US2022121884A1_D16906.tif" /><img file="US2022121884A1_D16907.tif" /><img file="US2022121884A1_D16908.tif" /><img file="US2022121884A1_D16909.tif" /><img file="US2022121884A1_D16910.tif" /><img file="US2022121884A1_D16911.tif" /><img file="US2022121884A1_D16912.tif" /><maths id="MATH-US-00080-4" num="00080.4"><math overflow="scroll"><mrow><mrow><munder><mover><mo>∫</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mover><mi>U</mi></munder><mo></mo><mrow><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>=</mo><mn>1</mn></mrow></math></maths><img file="US2022121884A1_D16913.tif" /><img file="US2022121884A1_D16914.tif" /><img file="US2022121884A1_D16915.tif" /><img file="US2022121884A1_D16916.tif" /><img file="US2022121884A1_D16917.tif" /><img file="US2022121884A1_D16918.tif" /><img file="US2022121884A1_D16919.tif" /><img file="US2022121884A1_D16920.tif" /><img file="US2022121884A1_D16921.tif" /><img file="US2022121884A1_D16922.tif" /><img file="US2022121884A1_D16923.tif" /><img file="US2022121884A1_D16924.tif" /><img file="US2022121884A1_D16925.tif" /><img file="US2022121884A1_D16926.tif" /><img file="US2022121884A1_D16927.tif" /><img file="US2022121884A1_D16928.tif" /><img file="US2022121884A1_D16929.tif" /><img file="US2022121884A1_D16930.tif" /><img file="US2022121884A1_D16931.tif" /><img file="US2022121884A1_D16932.tif" /><img file="US2022121884A1_D16933.tif" /><img file="US2022121884A1_D16934.tif" /><img file="US2022121884A1_D16935.tif" /><img file="US2022121884A1_D16936.tif" /><img file="US2022121884A1_D16937.tif" /><img file="US2022121884A1_D16938.tif" /><img file="US2022121884A1_D16939.tif" /><img file="US2022121884A1_D16940.tif" /><img file="US2022121884A1_D16941.tif" /><img file="US2022121884A1_D16942.tif" /><img file="US2022121884A1_D16943.tif" /><img file="US2022121884A1_D16944.tif" /><img file="US2022121884A1_D16945.tif" /><img file="US2022121884A1_D16946.tif" /><img file="US2022121884A1_D16947.tif" /><img file="US2022121884A1_D16948.tif" /><img file="US2022121884A1_D16949.tif" /><img file="US2022121884A1_D16950.tif" /><img file="US2022121884A1_D16951.tif" /><img file="US2022121884A1_D16952.tif" /><img file="US2022121884A1_D16953.tif" /><img file="US2022121884A1_D16954.tif" /><img file="US2022121884A1_D16955.tif" /><img file="US2022121884A1_D16956.tif" /><img file="US2022121884A1_D16957.tif" /><img file="US2022121884A1_D16958.tif" /><img file="US2022121884A1_D16959.tif" /><img file="US2022121884A1_D16960.tif" /><img file="US2022121884A1_D16961.tif" /><img file="US2022121884A1_D16962.tif" /><img file="US2022121884A1_D16963.tif" /><img file="US2022121884A1_D16964.tif" /><img file="US2022121884A1_D16965.tif" /><img file="US2022121884A1_D16966.tif" /><img file="US2022121884A1_D16967.tif" /><img file="US2022121884A1_D16968.tif" /><img file="US2022121884A1_D16969.tif" /><img file="US2022121884A1_D16970.tif" /><img file="US2022121884A1_D16971.tif" /><img file="US2022121884A1_D16972.tif" /><img file="US2022121884A1_D16973.tif" /><img file="US2022121884A1_D16974.tif" /><img file="US2022121884A1_D16975.tif" /><img file="US2022121884A1_D16976.tif" /><img file="US2022121884A1_D16977.tif" /><img file="US2022121884A1_D16978.tif" /><img file="US2022121884A1_D16979.tif" /><img file="US2022121884A1_D16980.tif" /><img file="US2022121884A1_D16981.tif" /><img file="US2022121884A1_D16982.tif" /><img file="US2022121884A1_D16983.tif" /><img file="US2022121884A1_D16984.tif" /><img file="US2022121884A1_D16985.tif" /><img file="US2022121884A1_D16986.tif" /><img file="US2022121884A1_D16987.tif" /><img file="US2022121884A1_D16988.tif" /><img file="US2022121884A1_D16989.tif" /><img file="US2022121884A1_D16990.tif" /><img file="US2022121884A1_D16991.tif" /><img file="US2022121884A1_D16992.tif" /><img file="US2022121884A1_D16993.tif" /><img file="US2022121884A1_D16994.tif" /><img file="US2022121884A1_D16995.tif" /><img file="US2022121884A1_D16996.tif" /><img file="US2022121884A1_D16997.tif" /><img file="US2022121884A1_D16998.tif" /><img file="US2022121884A1_D16999.tif" /><img file="US2022121884A1_D17000.tif" /><img file="US2022121884A1_D17001.tif" /><img file="US2022121884A1_D17002.tif" /><img file="US2022121884A1_D17003.tif" /><img file="US2022121884A1_D17004.tif" /><img file="US2022121884A1_D17005.tif" /><img file="US2022121884A1_D17006.tif" /><img file="US2022121884A1_D17007.tif" /><img file="US2022121884A1_D17008.tif" /><img file="US2022121884A1_D17009.tif" /><img file="US2022121884A1_D17010.tif" /><img file="US2022121884A1_D17011.tif" /><img file="US2022121884A1_D17012.tif" /><img file="US2022121884A1_D17013.tif" /><img file="US2022121884A1_D17014.tif" /><img file="US2022121884A1_D17015.tif" /><img file="US2022121884A1_D17016.tif" /><img file="US2022121884A1_D17017.tif" /><img file="US2022121884A1_D17018.tif" /><img file="US2022121884A1_D17019.tif" /><img file="US2022121884A1_D17020.tif" /><img file="US2022121884A1_D17021.tif" /><img file="US2022121884A1_D17022.tif" /><img file="US2022121884A1_D17023.tif" /><img file="US2022121884A1_D17024.tif" />
In this rule, X is a real-valued random variable; r is the probability density of X; and U is the domain of X.
Note: The probability rule is a special case of the bimodal interpolation rule.
What is the expected value, E(X), of a bimodal distribution? The answer follows through application of the extension principle:
<maths id="MATH-US-00081" num="00081"><math overflow="scroll"><mrow><mrow><msub><mi>μ</mi><mrow><mi>E</mi><mo></mo><mrow><mo>(</mo><mi>X</mi><mo>)</mo></mrow></mrow></msub><mo></mo><mrow><mo>(</mo><mi>v</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><msub><mi>sup</mi><mi>r</mi></msub><mo></mo><mrow><mo>(</mo><mrow><mrow><msub><mi>μ</mi><mrow><mi>P</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>1</mn></mrow></msub><mo></mo><mrow><mo>(</mo><mrow><munder><mover><mo>∫</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mover><mi>U</mi></munder><mo></mo><mrow><mrow><msub><mi>μ</mi><mrow><mi>A</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>1</mn></mrow></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>)</mo></mrow></mrow><mo>⋀</mo><mi>…</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo>⋀</mo><mrow><msub><mi>μ</mi><mi>Pn</mi></msub><mo></mo><mrow><mo>(</mo><mrow><munder><mover><mo>∫</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mover><mi>U</mi></munder><mo></mo><mrow><mrow><msub><mi>μ</mi><mi>An</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>)</mo></mrow></mrow></mrow><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D17025.tif" /><img file="US2022121884A1_D17026.tif" /><img file="US2022121884A1_D17027.tif" /><img file="US2022121884A1_D17028.tif" /><img file="US2022121884A1_D17029.tif" /><img file="US2022121884A1_D17030.tif" /><img file="US2022121884A1_D17031.tif" /><img file="US2022121884A1_D17032.tif" /><img file="US2022121884A1_D17033.tif" /><img file="US2022121884A1_D17034.tif" /><img file="US2022121884A1_D17035.tif" /><img file="US2022121884A1_D17036.tif" /><img file="US2022121884A1_D17037.tif" /><img file="US2022121884A1_D17038.tif" /><img file="US2022121884A1_D17039.tif" /><img file="US2022121884A1_D17040.tif" /><img file="US2022121884A1_D17041.tif" /><img file="US2022121884A1_D17042.tif" /><img file="US2022121884A1_D17043.tif" /><img file="US2022121884A1_D17044.tif" /><img file="US2022121884A1_D17045.tif" /><img file="US2022121884A1_D17046.tif" /><img file="US2022121884A1_D17047.tif" /><img file="US2022121884A1_D17048.tif" /><img file="US2022121884A1_D17049.tif" /><img file="US2022121884A1_D17050.tif" /><img file="US2022121884A1_D17051.tif" /><img file="US2022121884A1_D17052.tif" /><img file="US2022121884A1_D17053.tif" /><img file="US2022121884A1_D17054.tif" /><img file="US2022121884A1_D17055.tif" /><img file="US2022121884A1_D17056.tif" /><img file="US2022121884A1_D17057.tif" /><img file="US2022121884A1_D17058.tif" /><img file="US2022121884A1_D17059.tif" /><img file="US2022121884A1_D17060.tif" /><img file="US2022121884A1_D17061.tif" /><img file="US2022121884A1_D17062.tif" /><img file="US2022121884A1_D17063.tif" /><img file="US2022121884A1_D17064.tif" /><img file="US2022121884A1_D17065.tif" /><img file="US2022121884A1_D17066.tif" /><img file="US2022121884A1_D17067.tif" /><img file="US2022121884A1_D17068.tif" /><img file="US2022121884A1_D17069.tif" /><img file="US2022121884A1_D17070.tif" /><img file="US2022121884A1_D17071.tif" /><img file="US2022121884A1_D17072.tif" /><img file="US2022121884A1_D17073.tif" /><img file="US2022121884A1_D17074.tif" /><img file="US2022121884A1_D17075.tif" /><img file="US2022121884A1_D17076.tif" /><img file="US2022121884A1_D17077.tif" /><img file="US2022121884A1_D17078.tif" /><img file="US2022121884A1_D17079.tif" /><img file="US2022121884A1_D17080.tif" /><img file="US2022121884A1_D17081.tif" /><img file="US2022121884A1_D17082.tif" /><img file="US2022121884A1_D17083.tif" /><img file="US2022121884A1_D17084.tif" /><img file="US2022121884A1_D17085.tif" /><img file="US2022121884A1_D17086.tif" /><img file="US2022121884A1_D17087.tif" /><img file="US2022121884A1_D17088.tif" /><img file="US2022121884A1_D17089.tif" /><img file="US2022121884A1_D17090.tif" /><img file="US2022121884A1_D17091.tif" /><img file="US2022121884A1_D17092.tif" /><img file="US2022121884A1_D17093.tif" /><img file="US2022121884A1_D17094.tif" /><img file="US2022121884A1_D17095.tif" /><img file="US2022121884A1_D17096.tif" /><img file="US2022121884A1_D17097.tif" /><img file="US2022121884A1_D17098.tif" /><img file="US2022121884A1_D17099.tif" /><img file="US2022121884A1_D17100.tif" /><img file="US2022121884A1_D17101.tif" /><img file="US2022121884A1_D17102.tif" /><img file="US2022121884A1_D17103.tif" /><img file="US2022121884A1_D17104.tif" /><img file="US2022121884A1_D17105.tif" /><img file="US2022121884A1_D17106.tif" /><img file="US2022121884A1_D17107.tif" /><img file="US2022121884A1_D17108.tif" /><img file="US2022121884A1_D17109.tif" /><img file="US2022121884A1_D17110.tif" /><img file="US2022121884A1_D17111.tif" /><img file="US2022121884A1_D17112.tif" /><img file="US2022121884A1_D17113.tif" /><img file="US2022121884A1_D17114.tif" /><img file="US2022121884A1_D17115.tif" /><img file="US2022121884A1_D17116.tif" /><img file="US2022121884A1_D17117.tif" /><img file="US2022121884A1_D17118.tif" /><img file="US2022121884A1_D17119.tif" /><img file="US2022121884A1_D17120.tif" /><img file="US2022121884A1_D17121.tif" /><img file="US2022121884A1_D17122.tif" /><img file="US2022121884A1_D17123.tif" /><img file="US2022121884A1_D17124.tif" /><img file="US2022121884A1_D17125.tif" /><img file="US2022121884A1_D17126.tif" /><img file="US2022121884A1_D17127.tif" /><img file="US2022121884A1_D17128.tif" /><img file="US2022121884A1_D17129.tif" /><img file="US2022121884A1_D17130.tif" /><img file="US2022121884A1_D17131.tif" /><img file="US2022121884A1_D17132.tif" /><img file="US2022121884A1_D17133.tif" /><img file="US2022121884A1_D17134.tif" /><img file="US2022121884A1_D17135.tif" /><img file="US2022121884A1_D17136.tif" /><maths id="MATH-US-00081-2" num="00081.2"><math overflow="scroll"><mrow><mstyle><mspace width="4.4em" height="4.4ex" /></mstyle><mo></mo><mrow><mi>subject</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>to</mi></mrow></mrow></math></maths><img file="US2022121884A1_D17137.tif" /><img file="US2022121884A1_D17138.tif" /><img file="US2022121884A1_D17139.tif" /><img file="US2022121884A1_D17140.tif" /><img file="US2022121884A1_D17141.tif" /><img file="US2022121884A1_D17142.tif" /><img file="US2022121884A1_D17143.tif" /><img file="US2022121884A1_D17144.tif" /><img file="US2022121884A1_D17145.tif" /><img file="US2022121884A1_D17146.tif" /><img file="US2022121884A1_D17147.tif" /><img file="US2022121884A1_D17148.tif" /><img file="US2022121884A1_D17149.tif" /><img file="US2022121884A1_D17150.tif" /><img file="US2022121884A1_D17151.tif" /><img file="US2022121884A1_D17152.tif" /><img file="US2022121884A1_D17153.tif" /><img file="US2022121884A1_D17154.tif" /><img file="US2022121884A1_D17155.tif" /><img file="US2022121884A1_D17156.tif" /><img file="US2022121884A1_D17157.tif" /><img file="US2022121884A1_D17158.tif" /><img file="US2022121884A1_D17159.tif" /><img file="US2022121884A1_D17160.tif" /><img file="US2022121884A1_D17161.tif" /><img file="US2022121884A1_D17162.tif" /><img file="US2022121884A1_D17163.tif" /><img file="US2022121884A1_D17164.tif" /><img file="US2022121884A1_D17165.tif" /><img file="US2022121884A1_D17166.tif" /><img file="US2022121884A1_D17167.tif" /><img file="US2022121884A1_D17168.tif" /><img file="US2022121884A1_D17169.tif" /><img file="US2022121884A1_D17170.tif" /><img file="US2022121884A1_D17171.tif" /><img file="US2022121884A1_D17172.tif" /><img file="US2022121884A1_D17173.tif" /><img file="US2022121884A1_D17174.tif" /><img file="US2022121884A1_D17175.tif" /><img file="US2022121884A1_D17176.tif" /><img file="US2022121884A1_D17177.tif" /><img file="US2022121884A1_D17178.tif" /><img file="US2022121884A1_D17179.tif" /><img file="US2022121884A1_D17180.tif" /><img file="US2022121884A1_D17181.tif" /><img file="US2022121884A1_D17182.tif" /><img file="US2022121884A1_D17183.tif" /><img file="US2022121884A1_D17184.tif" /><img file="US2022121884A1_D17185.tif" /><img file="US2022121884A1_D17186.tif" /><img file="US2022121884A1_D17187.tif" /><img file="US2022121884A1_D17188.tif" /><img file="US2022121884A1_D17189.tif" /><img file="US2022121884A1_D17190.tif" /><img file="US2022121884A1_D17191.tif" /><img file="US2022121884A1_D17192.tif" /><img file="US2022121884A1_D17193.tif" /><img file="US2022121884A1_D17194.tif" /><img file="US2022121884A1_D17195.tif" /><img file="US2022121884A1_D17196.tif" /><img file="US2022121884A1_D17197.tif" /><img file="US2022121884A1_D17198.tif" /><img file="US2022121884A1_D17199.tif" /><img file="US2022121884A1_D17200.tif" /><img file="US2022121884A1_D17201.tif" /><img file="US2022121884A1_D17202.tif" /><img file="US2022121884A1_D17203.tif" /><img file="US2022121884A1_D17204.tif" /><img file="US2022121884A1_D17205.tif" /><img file="US2022121884A1_D17206.tif" /><img file="US2022121884A1_D17207.tif" /><img file="US2022121884A1_D17208.tif" /><img file="US2022121884A1_D17209.tif" /><img file="US2022121884A1_D17210.tif" /><img file="US2022121884A1_D17211.tif" /><img file="US2022121884A1_D17212.tif" /><img file="US2022121884A1_D17213.tif" /><img file="US2022121884A1_D17214.tif" /><img file="US2022121884A1_D17215.tif" /><img file="US2022121884A1_D17216.tif" /><img file="US2022121884A1_D17217.tif" /><img file="US2022121884A1_D17218.tif" /><img file="US2022121884A1_D17219.tif" /><img file="US2022121884A1_D17220.tif" /><img file="US2022121884A1_D17221.tif" /><img file="US2022121884A1_D17222.tif" /><img file="US2022121884A1_D17223.tif" /><img file="US2022121884A1_D17224.tif" /><img file="US2022121884A1_D17225.tif" /><img file="US2022121884A1_D17226.tif" /><img file="US2022121884A1_D17227.tif" /><img file="US2022121884A1_D17228.tif" /><img file="US2022121884A1_D17229.tif" /><img file="US2022121884A1_D17230.tif" /><img file="US2022121884A1_D17231.tif" /><img file="US2022121884A1_D17232.tif" /><img file="US2022121884A1_D17233.tif" /><img file="US2022121884A1_D17234.tif" /><img file="US2022121884A1_D17235.tif" /><img file="US2022121884A1_D17236.tif" /><img file="US2022121884A1_D17237.tif" /><img file="US2022121884A1_D17238.tif" /><img file="US2022121884A1_D17239.tif" /><img file="US2022121884A1_D17240.tif" /><img file="US2022121884A1_D17241.tif" /><img file="US2022121884A1_D17242.tif" /><img file="US2022121884A1_D17243.tif" /><img file="US2022121884A1_D17244.tif" /><img file="US2022121884A1_D17245.tif" /><img file="US2022121884A1_D17246.tif" /><img file="US2022121884A1_D17247.tif" /><img file="US2022121884A1_D17248.tif" /><maths id="MATH-US-00081-3" num="00081.3"><math overflow="scroll"><mrow><mstyle><mspace width="4.4em" height="4.4ex" /></mstyle><mo></mo><mrow><mi>v</mi><mo>=</mo><mrow><munder><mover><mo>∫</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mover><mi>U</mi></munder><mo></mo><mrow><mrow><mi>ur</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D17249.tif" /><img file="US2022121884A1_D17250.tif" /><img file="US2022121884A1_D17251.tif" /><img file="US2022121884A1_D17252.tif" /><img file="US2022121884A1_D17253.tif" /><img file="US2022121884A1_D17254.tif" /><img file="US2022121884A1_D17255.tif" /><img file="US2022121884A1_D17256.tif" /><img file="US2022121884A1_D17257.tif" /><img file="US2022121884A1_D17258.tif" /><img file="US2022121884A1_D17259.tif" /><img file="US2022121884A1_D17260.tif" /><img file="US2022121884A1_D17261.tif" /><img file="US2022121884A1_D17262.tif" /><img file="US2022121884A1_D17263.tif" /><img file="US2022121884A1_D17264.tif" /><img file="US2022121884A1_D17265.tif" /><img file="US2022121884A1_D17266.tif" /><img file="US2022121884A1_D17267.tif" /><img file="US2022121884A1_D17268.tif" /><img file="US2022121884A1_D17269.tif" /><img file="US2022121884A1_D17270.tif" /><img file="US2022121884A1_D17271.tif" /><img file="US2022121884A1_D17272.tif" /><img file="US2022121884A1_D17273.tif" /><img file="US2022121884A1_D17274.tif" /><img file="US2022121884A1_D17275.tif" /><img file="US2022121884A1_D17276.tif" /><img file="US2022121884A1_D17277.tif" /><img file="US2022121884A1_D17278.tif" /><img file="US2022121884A1_D17279.tif" /><img file="US2022121884A1_D17280.tif" /><img file="US2022121884A1_D17281.tif" /><img file="US2022121884A1_D17282.tif" /><img file="US2022121884A1_D17283.tif" /><img file="US2022121884A1_D17284.tif" /><img file="US2022121884A1_D17285.tif" /><img file="US2022121884A1_D17286.tif" /><img file="US2022121884A1_D17287.tif" /><img file="US2022121884A1_D17288.tif" /><img file="US2022121884A1_D17289.tif" /><img file="US2022121884A1_D17290.tif" /><img file="US2022121884A1_D17291.tif" /><img file="US2022121884A1_D17292.tif" /><img file="US2022121884A1_D17293.tif" /><img file="US2022121884A1_D17294.tif" /><img file="US2022121884A1_D17295.tif" /><img file="US2022121884A1_D17296.tif" /><img file="US2022121884A1_D17297.tif" /><img file="US2022121884A1_D17298.tif" /><img file="US2022121884A1_D17299.tif" /><img file="US2022121884A1_D17300.tif" /><img file="US2022121884A1_D17301.tif" /><img file="US2022121884A1_D17302.tif" /><img file="US2022121884A1_D17303.tif" /><img file="US2022121884A1_D17304.tif" /><img file="US2022121884A1_D17305.tif" /><img file="US2022121884A1_D17306.tif" /><img file="US2022121884A1_D17307.tif" /><img file="US2022121884A1_D17308.tif" /><img file="US2022121884A1_D17309.tif" /><img file="US2022121884A1_D17310.tif" /><img file="US2022121884A1_D17311.tif" /><img file="US2022121884A1_D17312.tif" /><img file="US2022121884A1_D17313.tif" /><img file="US2022121884A1_D17314.tif" /><img file="US2022121884A1_D17315.tif" /><img file="US2022121884A1_D17316.tif" /><img file="US2022121884A1_D17317.tif" /><img file="US2022121884A1_D17318.tif" /><img file="US2022121884A1_D17319.tif" /><img file="US2022121884A1_D17320.tif" /><img file="US2022121884A1_D17321.tif" /><img file="US2022121884A1_D17322.tif" /><img file="US2022121884A1_D17323.tif" /><img file="US2022121884A1_D17324.tif" /><img file="US2022121884A1_D17325.tif" /><img file="US2022121884A1_D17326.tif" /><img file="US2022121884A1_D17327.tif" /><img file="US2022121884A1_D17328.tif" /><img file="US2022121884A1_D17329.tif" /><img file="US2022121884A1_D17330.tif" /><img file="US2022121884A1_D17331.tif" /><img file="US2022121884A1_D17332.tif" /><img file="US2022121884A1_D17333.tif" /><img file="US2022121884A1_D17334.tif" /><img file="US2022121884A1_D17335.tif" /><img file="US2022121884A1_D17336.tif" /><img file="US2022121884A1_D17337.tif" /><img file="US2022121884A1_D17338.tif" /><img file="US2022121884A1_D17339.tif" /><img file="US2022121884A1_D17340.tif" /><img file="US2022121884A1_D17341.tif" /><img file="US2022121884A1_D17342.tif" /><img file="US2022121884A1_D17343.tif" /><img file="US2022121884A1_D17344.tif" /><img file="US2022121884A1_D17345.tif" /><img file="US2022121884A1_D17346.tif" /><img file="US2022121884A1_D17347.tif" /><img file="US2022121884A1_D17348.tif" /><img file="US2022121884A1_D17349.tif" /><img file="US2022121884A1_D17350.tif" /><img file="US2022121884A1_D17351.tif" /><img file="US2022121884A1_D17352.tif" /><img file="US2022121884A1_D17353.tif" /><img file="US2022121884A1_D17354.tif" /><img file="US2022121884A1_D17355.tif" /><img file="US2022121884A1_D17356.tif" /><img file="US2022121884A1_D17357.tif" /><img file="US2022121884A1_D17358.tif" /><img file="US2022121884A1_D17359.tif" /><img file="US2022121884A1_D17360.tif" /><maths id="MATH-US-00081-4" num="00081.4"><math overflow="scroll"><mrow><mstyle><mspace width="4.4em" height="4.4ex" /></mstyle><mo></mo><mrow><mrow><munder><mover><mo>∫</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mover><mi>U</mi></munder><mo></mo><mrow><mrow><mi>r</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>=</mo><mn>1</mn></mrow></mrow></math></maths><img file="US2022121884A1_D17361.tif" /><img file="US2022121884A1_D17362.tif" /><img file="US2022121884A1_D17363.tif" /><img file="US2022121884A1_D17364.tif" /><img file="US2022121884A1_D17365.tif" /><img file="US2022121884A1_D17366.tif" /><img file="US2022121884A1_D17367.tif" /><img file="US2022121884A1_D17368.tif" /><img file="US2022121884A1_D17369.tif" /><img file="US2022121884A1_D17370.tif" /><img file="US2022121884A1_D17371.tif" /><img file="US2022121884A1_D17372.tif" /><img file="US2022121884A1_D17373.tif" /><img file="US2022121884A1_D17374.tif" /><img file="US2022121884A1_D17375.tif" /><img file="US2022121884A1_D17376.tif" /><img file="US2022121884A1_D17377.tif" /><img file="US2022121884A1_D17378.tif" /><img file="US2022121884A1_D17379.tif" /><img file="US2022121884A1_D17380.tif" /><img file="US2022121884A1_D17381.tif" /><img file="US2022121884A1_D17382.tif" /><img file="US2022121884A1_D17383.tif" /><img file="US2022121884A1_D17384.tif" /><img file="US2022121884A1_D17385.tif" /><img file="US2022121884A1_D17386.tif" /><img file="US2022121884A1_D17387.tif" /><img file="US2022121884A1_D17388.tif" /><img file="US2022121884A1_D17389.tif" /><img file="US2022121884A1_D17390.tif" /><img file="US2022121884A1_D17391.tif" /><img file="US2022121884A1_D17392.tif" /><img file="US2022121884A1_D17393.tif" /><img file="US2022121884A1_D17394.tif" /><img file="US2022121884A1_D17395.tif" /><img file="US2022121884A1_D17396.tif" /><img file="US2022121884A1_D17397.tif" /><img file="US2022121884A1_D17398.tif" /><img file="US2022121884A1_D17399.tif" /><img file="US2022121884A1_D17400.tif" /><img file="US2022121884A1_D17401.tif" /><img file="US2022121884A1_D17402.tif" /><img file="US2022121884A1_D17403.tif" /><img file="US2022121884A1_D17404.tif" /><img file="US2022121884A1_D17405.tif" /><img file="US2022121884A1_D17406.tif" /><img file="US2022121884A1_D17407.tif" /><img file="US2022121884A1_D17408.tif" /><img file="US2022121884A1_D17409.tif" /><img file="US2022121884A1_D17410.tif" /><img file="US2022121884A1_D17411.tif" /><img file="US2022121884A1_D17412.tif" /><img file="US2022121884A1_D17413.tif" /><img file="US2022121884A1_D17414.tif" /><img file="US2022121884A1_D17415.tif" /><img file="US2022121884A1_D17416.tif" /><img file="US2022121884A1_D17417.tif" /><img file="US2022121884A1_D17418.tif" /><img file="US2022121884A1_D17419.tif" /><img file="US2022121884A1_D17420.tif" /><img file="US2022121884A1_D17421.tif" /><img file="US2022121884A1_D17422.tif" /><img file="US2022121884A1_D17423.tif" /><img file="US2022121884A1_D17424.tif" /><img file="US2022121884A1_D17425.tif" /><img file="US2022121884A1_D17426.tif" /><img file="US2022121884A1_D17427.tif" /><img file="US2022121884A1_D17428.tif" /><img file="US2022121884A1_D17429.tif" /><img file="US2022121884A1_D17430.tif" /><img file="US2022121884A1_D17431.tif" /><img file="US2022121884A1_D17432.tif" /><img file="US2022121884A1_D17433.tif" /><img file="US2022121884A1_D17434.tif" /><img file="US2022121884A1_D17435.tif" /><img file="US2022121884A1_D17436.tif" /><img file="US2022121884A1_D17437.tif" /><img file="US2022121884A1_D17438.tif" /><img file="US2022121884A1_D17439.tif" /><img file="US2022121884A1_D17440.tif" /><img file="US2022121884A1_D17441.tif" /><img file="US2022121884A1_D17442.tif" /><img file="US2022121884A1_D17443.tif" /><img file="US2022121884A1_D17444.tif" /><img file="US2022121884A1_D17445.tif" /><img file="US2022121884A1_D17446.tif" /><img file="US2022121884A1_D17447.tif" /><img file="US2022121884A1_D17448.tif" /><img file="US2022121884A1_D17449.tif" /><img file="US2022121884A1_D17450.tif" /><img file="US2022121884A1_D17451.tif" /><img file="US2022121884A1_D17452.tif" /><img file="US2022121884A1_D17453.tif" /><img file="US2022121884A1_D17454.tif" /><img file="US2022121884A1_D17455.tif" /><img file="US2022121884A1_D17456.tif" /><img file="US2022121884A1_D17457.tif" /><img file="US2022121884A1_D17458.tif" /><img file="US2022121884A1_D17459.tif" /><img file="US2022121884A1_D17460.tif" /><img file="US2022121884A1_D17461.tif" /><img file="US2022121884A1_D17462.tif" /><img file="US2022121884A1_D17463.tif" /><img file="US2022121884A1_D17464.tif" /><img file="US2022121884A1_D17465.tif" /><img file="US2022121884A1_D17466.tif" /><img file="US2022121884A1_D17467.tif" /><img file="US2022121884A1_D17468.tif" /><img file="US2022121884A1_D17469.tif" /><img file="US2022121884A1_D17470.tif" /><img file="US2022121884A1_D17471.tif" /><img file="US2022121884A1_D17472.tif" />
Note. E(X) is a fuzzy subset of U.
(g) Fuzzy-graph interpolation rule:
This rule is the most widely used rule in applications of fuzzy logic. We have a function, Y=f (X), which is represented as a fuzzy graph. The question is: What is the value of Y when X is A? The A<sub>i</sub>, B<sub>i </sub>and A are fuzzy sets.
Symbolic part is:
X is A
Y=f (X)
<br />f (X) isfg Σ<sub>i </sub>A<sub>i</sub>×B<sub>i </sub>
Y is C
Computational part is:
C=Σ<sub>i </sub>m<sub>i </sub>{circumflex over ( )} B<sub>i</sub>,
where m<sub>i </sub>is the degree to which A matches A<sub>i </sub>
m<sub>i</sub>=sup<sub>u </sub>(μ<sub>A</sub>(u) {circumflex over ( )} μ<sub>Ai </sub>(u)),
i=1, . . . , n.
When A is a singleton, this rule reduces to
X=a
Y=f (X)
f (X) isfg Σ<sub>i </sub>A<sub>i</sub>×B<sub>i </sub>
Y=Σ<sub>i </sub>μ<sub>Ai </sub>(a) {circumflex over ( )} B.
In this form, the fuzzy-graph interpolation rule coincides with the Mamdani rule—a rule which is widely used in control and related applications.
In the foregoing, we have summarized some of the basic rules in DDB which govern generalized constraint propagation. :A few examples of such rules are the following.
(a) Probabilistic extension principle:
f (X) isp A
g(X) isr ?B
(b) Usuality-qualified extension principle:
f (X) isu A
g(X) isr ?B
(c) Usuality-qualified fuzzy-graph interpolation rule:
X is A
Y=f (X)
f (X) isfg Σ<sub>i </sub>if X is A<sub>i </sub>then Y isu B<sub>i </sub>
Y isr?B
(d) Bimodal extension principle:
X isbm Σ<sub>i </sub>Pi\Ai
Y=f (X)
Y isr ?B
(e) Bimodal, binary extension principle:
X isr R
Y iss S
Z=f (X, Y)
Z ist T
In the instance, bimodality means that X and Y have different modalities, and binary means that f is a function of two variables. An interesting special case is one in which X is R and Y isp S.
The deduction rules which were briefly described in the foregoing are intended to serve as examples:
(a) The Robert example:
p: Usually Robert returns from work at about 6:00 pm. What is the probability that Robert is home at about 6:15 pm?
First, we find the protoforms of the data and the query.
Usually Robert returns from work at about 6:00 pm
→Prob(Time(Return(Robert)) is *6:00 pm) is usually
which in annotated form reads
→Prob(X/Time(Return(Robert)) is A/*6:00 pm) is B/usually.
Likewise, for the query, we have
→Prob(Time(Return(Robert)) is ≤ ∘ *6:15 pm) is ?D
which in annotated form reads
→Prob(X/Time(Return(Robert)) is C/≤ ∘ *6:15 pm) is D/usually
Searching the Deduction Database, we find that the basic probability rule matches the protoforms of the data and the query
Prob(X is A) is B
Prob(X is C) is D
where
<maths id="MATH-US-00082" num="00082"><math overflow="scroll"><mrow><mrow><msub><mi>μ</mi><mi>D</mi></msub><mo></mo><mrow><mo>(</mo><mi>v</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><msub><mi>sup</mi><mi>g</mi></msub><mo></mo><mrow><mo>(</mo><mrow><msub><mi>μ</mi><mi>B</mi></msub><mo></mo><mrow><mo>(</mo><mrow><munder><mover><mo>∫</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mover><mi>U</mi></munder><mo></mo><mrow><mrow><msub><mi>μ</mi><mi>A</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><mi>g</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>)</mo></mrow></mrow><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D17473.tif" /><img file="US2022121884A1_D17474.tif" /><img file="US2022121884A1_D17475.tif" /><img file="US2022121884A1_D17476.tif" /><img file="US2022121884A1_D17477.tif" /><img file="US2022121884A1_D17478.tif" /><img file="US2022121884A1_D17479.tif" /><img file="US2022121884A1_D17480.tif" /><img file="US2022121884A1_D17481.tif" /><img file="US2022121884A1_D17482.tif" /><img file="US2022121884A1_D17483.tif" /><img file="US2022121884A1_D17484.tif" /><img file="US2022121884A1_D17485.tif" /><img file="US2022121884A1_D17486.tif" /><img file="US2022121884A1_D17487.tif" /><img file="US2022121884A1_D17488.tif" /><img file="US2022121884A1_D17489.tif" /><img file="US2022121884A1_D17490.tif" /><img file="US2022121884A1_D17491.tif" /><img file="US2022121884A1_D17492.tif" /><img file="US2022121884A1_D17493.tif" /><img file="US2022121884A1_D17494.tif" /><img file="US2022121884A1_D17495.tif" /><img file="US2022121884A1_D17496.tif" /><img file="US2022121884A1_D17497.tif" /><img file="US2022121884A1_D17498.tif" /><img file="US2022121884A1_D17499.tif" /><img file="US2022121884A1_D17500.tif" /><img file="US2022121884A1_D17501.tif" /><img file="US2022121884A1_D17502.tif" /><img file="US2022121884A1_D17503.tif" /><img file="US2022121884A1_D17504.tif" /><img file="US2022121884A1_D17505.tif" /><img file="US2022121884A1_D17506.tif" /><img file="US2022121884A1_D17507.tif" /><img file="US2022121884A1_D17508.tif" /><img file="US2022121884A1_D17509.tif" /><img file="US2022121884A1_D17510.tif" /><img file="US2022121884A1_D17511.tif" /><img file="US2022121884A1_D17512.tif" /><img file="US2022121884A1_D17513.tif" /><img file="US2022121884A1_D17514.tif" /><img file="US2022121884A1_D17515.tif" /><img file="US2022121884A1_D17516.tif" /><img file="US2022121884A1_D17517.tif" /><img file="US2022121884A1_D17518.tif" /><img file="US2022121884A1_D17519.tif" /><img file="US2022121884A1_D17520.tif" /><img file="US2022121884A1_D17521.tif" /><img file="US2022121884A1_D17522.tif" /><img file="US2022121884A1_D17523.tif" /><img file="US2022121884A1_D17524.tif" /><img file="US2022121884A1_D17525.tif" /><img file="US2022121884A1_D17526.tif" /><img file="US2022121884A1_D17527.tif" /><img file="US2022121884A1_D17528.tif" /><img file="US2022121884A1_D17529.tif" /><img file="US2022121884A1_D17530.tif" /><img file="US2022121884A1_D17531.tif" /><img file="US2022121884A1_D17532.tif" /><img file="US2022121884A1_D17533.tif" /><img file="US2022121884A1_D17534.tif" /><img file="US2022121884A1_D17535.tif" /><img file="US2022121884A1_D17536.tif" /><img file="US2022121884A1_D17537.tif" /><img file="US2022121884A1_D17538.tif" /><img file="US2022121884A1_D17539.tif" /><img file="US2022121884A1_D17540.tif" /><img file="US2022121884A1_D17541.tif" /><img file="US2022121884A1_D17542.tif" /><img file="US2022121884A1_D17543.tif" /><img file="US2022121884A1_D17544.tif" /><img file="US2022121884A1_D17545.tif" /><img file="US2022121884A1_D17546.tif" /><img file="US2022121884A1_D17547.tif" /><img file="US2022121884A1_D17548.tif" /><img file="US2022121884A1_D17549.tif" /><img file="US2022121884A1_D17550.tif" /><img file="US2022121884A1_D17551.tif" /><img file="US2022121884A1_D17552.tif" /><img file="US2022121884A1_D17553.tif" /><img file="US2022121884A1_D17554.tif" /><img file="US2022121884A1_D17555.tif" /><img file="US2022121884A1_D17556.tif" /><img file="US2022121884A1_D17557.tif" /><img file="US2022121884A1_D17558.tif" /><img file="US2022121884A1_D17559.tif" /><img file="US2022121884A1_D17560.tif" /><img file="US2022121884A1_D17561.tif" /><img file="US2022121884A1_D17562.tif" /><img file="US2022121884A1_D17563.tif" /><img file="US2022121884A1_D17564.tif" /><img file="US2022121884A1_D17565.tif" /><img file="US2022121884A1_D17566.tif" /><img file="US2022121884A1_D17567.tif" /><img file="US2022121884A1_D17568.tif" /><img file="US2022121884A1_D17569.tif" /><img file="US2022121884A1_D17570.tif" /><img file="US2022121884A1_D17571.tif" /><img file="US2022121884A1_D17572.tif" /><img file="US2022121884A1_D17573.tif" /><img file="US2022121884A1_D17574.tif" /><img file="US2022121884A1_D17575.tif" /><img file="US2022121884A1_D17576.tif" /><img file="US2022121884A1_D17577.tif" /><img file="US2022121884A1_D17578.tif" /><img file="US2022121884A1_D17579.tif" /><img file="US2022121884A1_D17580.tif" /><img file="US2022121884A1_D17581.tif" /><img file="US2022121884A1_D17582.tif" /><img file="US2022121884A1_D17583.tif" /><img file="US2022121884A1_D17584.tif" /><maths id="MATH-US-00082-2" num="00082.2"><math overflow="scroll"><mrow><mi>subject</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>to</mi></mrow></math></maths><img file="US2022121884A1_D17585.tif" /><img file="US2022121884A1_D17586.tif" /><img file="US2022121884A1_D17587.tif" /><img file="US2022121884A1_D17588.tif" /><img file="US2022121884A1_D17589.tif" /><img file="US2022121884A1_D17590.tif" /><img file="US2022121884A1_D17591.tif" /><img file="US2022121884A1_D17592.tif" /><img file="US2022121884A1_D17593.tif" /><img file="US2022121884A1_D17594.tif" /><img file="US2022121884A1_D17595.tif" /><img file="US2022121884A1_D17596.tif" /><img file="US2022121884A1_D17597.tif" /><img file="US2022121884A1_D17598.tif" /><img file="US2022121884A1_D17599.tif" /><img file="US2022121884A1_D17600.tif" /><img file="US2022121884A1_D17601.tif" /><img file="US2022121884A1_D17602.tif" /><img file="US2022121884A1_D17603.tif" /><img file="US2022121884A1_D17604.tif" /><img file="US2022121884A1_D17605.tif" /><img file="US2022121884A1_D17606.tif" /><img file="US2022121884A1_D17607.tif" /><img file="US2022121884A1_D17608.tif" /><img file="US2022121884A1_D17609.tif" /><img file="US2022121884A1_D17610.tif" /><img file="US2022121884A1_D17611.tif" /><img file="US2022121884A1_D17612.tif" /><img file="US2022121884A1_D17613.tif" /><img file="US2022121884A1_D17614.tif" /><img file="US2022121884A1_D17615.tif" /><img file="US2022121884A1_D17616.tif" /><img file="US2022121884A1_D17617.tif" /><img file="US2022121884A1_D17618.tif" /><img file="US2022121884A1_D17619.tif" /><img file="US2022121884A1_D17620.tif" /><img file="US2022121884A1_D17621.tif" /><img file="US2022121884A1_D17622.tif" /><img file="US2022121884A1_D17623.tif" /><img file="US2022121884A1_D17624.tif" /><img file="US2022121884A1_D17625.tif" /><img file="US2022121884A1_D17626.tif" /><img file="US2022121884A1_D17627.tif" /><img file="US2022121884A1_D17628.tif" /><img file="US2022121884A1_D17629.tif" /><img file="US2022121884A1_D17630.tif" /><img file="US2022121884A1_D17631.tif" /><img file="US2022121884A1_D17632.tif" /><img file="US2022121884A1_D17633.tif" /><img file="US2022121884A1_D17634.tif" /><img file="US2022121884A1_D17635.tif" /><img file="US2022121884A1_D17636.tif" /><img file="US2022121884A1_D17637.tif" /><img file="US2022121884A1_D17638.tif" /><img file="US2022121884A1_D17639.tif" /><img file="US2022121884A1_D17640.tif" /><img file="US2022121884A1_D17641.tif" /><img file="US2022121884A1_D17642.tif" /><img file="US2022121884A1_D17643.tif" /><img file="US2022121884A1_D17644.tif" /><img file="US2022121884A1_D17645.tif" /><img file="US2022121884A1_D17646.tif" /><img file="US2022121884A1_D17647.tif" /><img file="US2022121884A1_D17648.tif" /><img file="US2022121884A1_D17649.tif" /><img file="US2022121884A1_D17650.tif" /><img file="US2022121884A1_D17651.tif" /><img file="US2022121884A1_D17652.tif" /><img file="US2022121884A1_D17653.tif" /><img file="US2022121884A1_D17654.tif" /><img file="US2022121884A1_D17655.tif" /><img file="US2022121884A1_D17656.tif" /><img file="US2022121884A1_D17657.tif" /><img file="US2022121884A1_D17658.tif" /><img file="US2022121884A1_D17659.tif" /><img file="US2022121884A1_D17660.tif" /><img file="US2022121884A1_D17661.tif" /><img file="US2022121884A1_D17662.tif" /><img file="US2022121884A1_D17663.tif" /><img file="US2022121884A1_D17664.tif" /><img file="US2022121884A1_D17665.tif" /><img file="US2022121884A1_D17666.tif" /><img file="US2022121884A1_D17667.tif" /><img file="US2022121884A1_D17668.tif" /><img file="US2022121884A1_D17669.tif" /><img file="US2022121884A1_D17670.tif" /><img file="US2022121884A1_D17671.tif" /><img file="US2022121884A1_D17672.tif" /><img file="US2022121884A1_D17673.tif" /><img file="US2022121884A1_D17674.tif" /><img file="US2022121884A1_D17675.tif" /><img file="US2022121884A1_D17676.tif" /><img file="US2022121884A1_D17677.tif" /><img file="US2022121884A1_D17678.tif" /><img file="US2022121884A1_D17679.tif" /><img file="US2022121884A1_D17680.tif" /><img file="US2022121884A1_D17681.tif" /><img file="US2022121884A1_D17682.tif" /><img file="US2022121884A1_D17683.tif" /><img file="US2022121884A1_D17684.tif" /><img file="US2022121884A1_D17685.tif" /><img file="US2022121884A1_D17686.tif" /><img file="US2022121884A1_D17687.tif" /><img file="US2022121884A1_D17688.tif" /><img file="US2022121884A1_D17689.tif" /><img file="US2022121884A1_D17690.tif" /><img file="US2022121884A1_D17691.tif" /><img file="US2022121884A1_D17692.tif" /><img file="US2022121884A1_D17693.tif" /><img file="US2022121884A1_D17694.tif" /><img file="US2022121884A1_D17695.tif" /><img file="US2022121884A1_D17696.tif" /><maths id="MATH-US-00082-3" num="00082.3"><math overflow="scroll"><mrow><mi>v</mi><mo>=</mo><mrow><munder><mover><mo>∫</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mover><mi>U</mi></munder><mo></mo><mrow><mrow><msub><mi>μ</mi><mi>C</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><mi>g</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D17697.tif" /><img file="US2022121884A1_D17698.tif" /><img file="US2022121884A1_D17699.tif" /><img file="US2022121884A1_D17700.tif" /><img file="US2022121884A1_D17701.tif" /><img file="US2022121884A1_D17702.tif" /><img file="US2022121884A1_D17703.tif" /><img file="US2022121884A1_D17704.tif" /><img file="US2022121884A1_D17705.tif" /><img file="US2022121884A1_D17706.tif" /><img file="US2022121884A1_D17707.tif" /><img file="US2022121884A1_D17708.tif" /><img file="US2022121884A1_D17709.tif" /><img file="US2022121884A1_D17710.tif" /><img file="US2022121884A1_D17711.tif" /><img file="US2022121884A1_D17712.tif" /><img file="US2022121884A1_D17713.tif" /><img file="US2022121884A1_D17714.tif" /><img file="US2022121884A1_D17715.tif" /><img file="US2022121884A1_D17716.tif" /><img file="US2022121884A1_D17717.tif" /><img file="US2022121884A1_D17718.tif" /><img file="US2022121884A1_D17719.tif" /><img file="US2022121884A1_D17720.tif" /><img file="US2022121884A1_D17721.tif" /><img file="US2022121884A1_D17722.tif" /><img file="US2022121884A1_D17723.tif" /><img file="US2022121884A1_D17724.tif" /><img file="US2022121884A1_D17725.tif" /><img file="US2022121884A1_D17726.tif" /><img file="US2022121884A1_D17727.tif" /><img file="US2022121884A1_D17728.tif" /><img file="US2022121884A1_D17729.tif" /><img file="US2022121884A1_D17730.tif" /><img file="US2022121884A1_D17731.tif" /><img file="US2022121884A1_D17732.tif" /><img file="US2022121884A1_D17733.tif" /><img file="US2022121884A1_D17734.tif" /><img file="US2022121884A1_D17735.tif" /><img file="US2022121884A1_D17736.tif" /><img file="US2022121884A1_D17737.tif" /><img file="US2022121884A1_D17738.tif" /><img file="US2022121884A1_D17739.tif" /><img file="US2022121884A1_D17740.tif" /><img file="US2022121884A1_D17741.tif" /><img file="US2022121884A1_D17742.tif" /><img file="US2022121884A1_D17743.tif" /><img file="US2022121884A1_D17744.tif" /><img file="US2022121884A1_D17745.tif" /><img file="US2022121884A1_D17746.tif" /><img file="US2022121884A1_D17747.tif" /><img file="US2022121884A1_D17748.tif" /><img file="US2022121884A1_D17749.tif" /><img file="US2022121884A1_D17750.tif" /><img file="US2022121884A1_D17751.tif" /><img file="US2022121884A1_D17752.tif" /><img file="US2022121884A1_D17753.tif" /><img file="US2022121884A1_D17754.tif" /><img file="US2022121884A1_D17755.tif" /><img file="US2022121884A1_D17756.tif" /><img file="US2022121884A1_D17757.tif" /><img file="US2022121884A1_D17758.tif" /><img file="US2022121884A1_D17759.tif" /><img file="US2022121884A1_D17760.tif" /><img file="US2022121884A1_D17761.tif" /><img file="US2022121884A1_D17762.tif" /><img file="US2022121884A1_D17763.tif" /><img file="US2022121884A1_D17764.tif" /><img file="US2022121884A1_D17765.tif" /><img file="US2022121884A1_D17766.tif" /><img file="US2022121884A1_D17767.tif" /><img file="US2022121884A1_D17768.tif" /><img file="US2022121884A1_D17769.tif" /><img file="US2022121884A1_D17770.tif" /><img file="US2022121884A1_D17771.tif" /><img file="US2022121884A1_D17772.tif" /><img file="US2022121884A1_D17773.tif" /><img file="US2022121884A1_D17774.tif" /><img file="US2022121884A1_D17775.tif" /><img file="US2022121884A1_D17776.tif" /><img file="US2022121884A1_D17777.tif" /><img file="US2022121884A1_D17778.tif" /><img file="US2022121884A1_D17779.tif" /><img file="US2022121884A1_D17780.tif" /><img file="US2022121884A1_D17781.tif" /><img file="US2022121884A1_D17782.tif" /><img file="US2022121884A1_D17783.tif" /><img file="US2022121884A1_D17784.tif" /><img file="US2022121884A1_D17785.tif" /><img file="US2022121884A1_D17786.tif" /><img file="US2022121884A1_D17787.tif" /><img file="US2022121884A1_D17788.tif" /><img file="US2022121884A1_D17789.tif" /><img file="US2022121884A1_D17790.tif" /><img file="US2022121884A1_D17791.tif" /><img file="US2022121884A1_D17792.tif" /><img file="US2022121884A1_D17793.tif" /><img file="US2022121884A1_D17794.tif" /><img file="US2022121884A1_D17795.tif" /><img file="US2022121884A1_D17796.tif" /><img file="US2022121884A1_D17797.tif" /><img file="US2022121884A1_D17798.tif" /><img file="US2022121884A1_D17799.tif" /><img file="US2022121884A1_D17800.tif" /><img file="US2022121884A1_D17801.tif" /><img file="US2022121884A1_D17802.tif" /><img file="US2022121884A1_D17803.tif" /><img file="US2022121884A1_D17804.tif" /><img file="US2022121884A1_D17805.tif" /><img file="US2022121884A1_D17806.tif" /><img file="US2022121884A1_D17807.tif" /><img file="US2022121884A1_D17808.tif" /><maths id="MATH-US-00082-4" num="00082.4"><math overflow="scroll"><mrow><mrow><munder><mover><mo>∫</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mover><mi>U</mi></munder><mo></mo><mrow><mrow><mi>g</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>=</mo><mn>1</mn></mrow></math></maths><img file="US2022121884A1_D17809.tif" /><img file="US2022121884A1_D17810.tif" /><img file="US2022121884A1_D17811.tif" /><img file="US2022121884A1_D17812.tif" /><img file="US2022121884A1_D17813.tif" /><img file="US2022121884A1_D17814.tif" /><img file="US2022121884A1_D17815.tif" /><img file="US2022121884A1_D17816.tif" /><img file="US2022121884A1_D17817.tif" /><img file="US2022121884A1_D17818.tif" /><img file="US2022121884A1_D17819.tif" /><img file="US2022121884A1_D17820.tif" /><img file="US2022121884A1_D17821.tif" /><img file="US2022121884A1_D17822.tif" /><img file="US2022121884A1_D17823.tif" /><img file="US2022121884A1_D17824.tif" /><img file="US2022121884A1_D17825.tif" /><img file="US2022121884A1_D17826.tif" /><img file="US2022121884A1_D17827.tif" /><img file="US2022121884A1_D17828.tif" /><img file="US2022121884A1_D17829.tif" /><img file="US2022121884A1_D17830.tif" /><img file="US2022121884A1_D17831.tif" /><img file="US2022121884A1_D17832.tif" /><img file="US2022121884A1_D17833.tif" /><img file="US2022121884A1_D17834.tif" /><img file="US2022121884A1_D17835.tif" /><img file="US2022121884A1_D17836.tif" /><img file="US2022121884A1_D17837.tif" /><img file="US2022121884A1_D17838.tif" /><img file="US2022121884A1_D17839.tif" /><img file="US2022121884A1_D17840.tif" /><img file="US2022121884A1_D17841.tif" /><img file="US2022121884A1_D17842.tif" /><img file="US2022121884A1_D17843.tif" /><img file="US2022121884A1_D17844.tif" /><img file="US2022121884A1_D17845.tif" /><img file="US2022121884A1_D17846.tif" /><img file="US2022121884A1_D17847.tif" /><img file="US2022121884A1_D17848.tif" /><img file="US2022121884A1_D17849.tif" /><img file="US2022121884A1_D17850.tif" /><img file="US2022121884A1_D17851.tif" /><img file="US2022121884A1_D17852.tif" /><img file="US2022121884A1_D17853.tif" /><img file="US2022121884A1_D17854.tif" /><img file="US2022121884A1_D17855.tif" /><img file="US2022121884A1_D17856.tif" /><img file="US2022121884A1_D17857.tif" /><img file="US2022121884A1_D17858.tif" /><img file="US2022121884A1_D17859.tif" /><img file="US2022121884A1_D17860.tif" /><img file="US2022121884A1_D17861.tif" /><img file="US2022121884A1_D17862.tif" /><img file="US2022121884A1_D17863.tif" /><img file="US2022121884A1_D17864.tif" /><img file="US2022121884A1_D17865.tif" /><img file="US2022121884A1_D17866.tif" /><img file="US2022121884A1_D17867.tif" /><img file="US2022121884A1_D17868.tif" /><img file="US2022121884A1_D17869.tif" /><img file="US2022121884A1_D17870.tif" /><img file="US2022121884A1_D17871.tif" /><img file="US2022121884A1_D17872.tif" /><img file="US2022121884A1_D17873.tif" /><img file="US2022121884A1_D17874.tif" /><img file="US2022121884A1_D17875.tif" /><img file="US2022121884A1_D17876.tif" /><img file="US2022121884A1_D17877.tif" /><img file="US2022121884A1_D17878.tif" /><img file="US2022121884A1_D17879.tif" /><img file="US2022121884A1_D17880.tif" /><img file="US2022121884A1_D17881.tif" /><img file="US2022121884A1_D17882.tif" /><img file="US2022121884A1_D17883.tif" /><img file="US2022121884A1_D17884.tif" /><img file="US2022121884A1_D17885.tif" /><img file="US2022121884A1_D17886.tif" /><img file="US2022121884A1_D17887.tif" /><img file="US2022121884A1_D17888.tif" /><img file="US2022121884A1_D17889.tif" /><img file="US2022121884A1_D17890.tif" /><img file="US2022121884A1_D17891.tif" /><img file="US2022121884A1_D17892.tif" /><img file="US2022121884A1_D17893.tif" /><img file="US2022121884A1_D17894.tif" /><img file="US2022121884A1_D17895.tif" /><img file="US2022121884A1_D17896.tif" /><img file="US2022121884A1_D17897.tif" /><img file="US2022121884A1_D17898.tif" /><img file="US2022121884A1_D17899.tif" /><img file="US2022121884A1_D17900.tif" /><img file="US2022121884A1_D17901.tif" /><img file="US2022121884A1_D17902.tif" /><img file="US2022121884A1_D17903.tif" /><img file="US2022121884A1_D17904.tif" /><img file="US2022121884A1_D17905.tif" /><img file="US2022121884A1_D17906.tif" /><img file="US2022121884A1_D17907.tif" /><img file="US2022121884A1_D17908.tif" /><img file="US2022121884A1_D17909.tif" /><img file="US2022121884A1_D17910.tif" /><img file="US2022121884A1_D17911.tif" /><img file="US2022121884A1_D17912.tif" /><img file="US2022121884A1_D17913.tif" /><img file="US2022121884A1_D17914.tif" /><img file="US2022121884A1_D17915.tif" /><img file="US2022121884A1_D17916.tif" /><img file="US2022121884A1_D17917.tif" /><img file="US2022121884A1_D17918.tif" /><img file="US2022121884A1_D17919.tif" /><img file="US2022121884A1_D17920.tif" />
Instantiating A, B, C, and D, we obtain the answer to the query:
Probability that Robert is home at about 6:15 pm is D, where:
<maths id="MATH-US-00083" num="00083"><math overflow="scroll"><mrow><mrow><msub><mi>μ</mi><mi>D</mi></msub><mo></mo><mrow><mo>(</mo><mi>v</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><msub><mi>sup</mi><mi>g</mi></msub><mo>(</mo><mrow><msub><mi>μ</mi><mi>usually</mi></msub><mo>(</mo><mrow><munder><mover><mo>∫</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mover><mi>U</mi></munder><mo></mo><mrow><mi>μ</mi><mo>*</mo><mn>6</mn><mo></mo><mstyle><mtext>:</mtext></mstyle><mo></mo><mn>00</mn><mo></mo><mstyle><mspace width="0.6em" height="0.6ex" /></mstyle><mo></mo><mrow><mi>pm</mi><mo>(</mo><mi>u</mi><mo>)</mo></mrow><mo></mo><mrow><mi>g</mi><mo>(</mo><mi>u</mi><mo>)</mo></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>)</mo></mrow><mo>)</mo></mrow></mrow></math></maths><img file="US2022121884A1_D17921.tif" /><img file="US2022121884A1_D17922.tif" /><img file="US2022121884A1_D17923.tif" /><img file="US2022121884A1_D17924.tif" /><img file="US2022121884A1_D17925.tif" /><img file="US2022121884A1_D17926.tif" /><img file="US2022121884A1_D17927.tif" /><img file="US2022121884A1_D17928.tif" /><img file="US2022121884A1_D17929.tif" /><img file="US2022121884A1_D17930.tif" /><img file="US2022121884A1_D17931.tif" /><img file="US2022121884A1_D17932.tif" /><img file="US2022121884A1_D17933.tif" /><img file="US2022121884A1_D17934.tif" /><img file="US2022121884A1_D17935.tif" /><img file="US2022121884A1_D17936.tif" /><img file="US2022121884A1_D17937.tif" /><img file="US2022121884A1_D17938.tif" /><img file="US2022121884A1_D17939.tif" /><img file="US2022121884A1_D17940.tif" /><img file="US2022121884A1_D17941.tif" /><img file="US2022121884A1_D17942.tif" /><img file="US2022121884A1_D17943.tif" /><img file="US2022121884A1_D17944.tif" /><img file="US2022121884A1_D17945.tif" /><img file="US2022121884A1_D17946.tif" /><img file="US2022121884A1_D17947.tif" /><img file="US2022121884A1_D17948.tif" /><img file="US2022121884A1_D17949.tif" /><img file="US2022121884A1_D17950.tif" /><img file="US2022121884A1_D17951.tif" /><img file="US2022121884A1_D17952.tif" /><img file="US2022121884A1_D17953.tif" /><img file="US2022121884A1_D17954.tif" /><img file="US2022121884A1_D17955.tif" /><img file="US2022121884A1_D17956.tif" /><img file="US2022121884A1_D17957.tif" /><img file="US2022121884A1_D17958.tif" /><img file="US2022121884A1_D17959.tif" /><img file="US2022121884A1_D17960.tif" /><img file="US2022121884A1_D17961.tif" /><img file="US2022121884A1_D17962.tif" /><img file="US2022121884A1_D17963.tif" /><img file="US2022121884A1_D17964.tif" /><img file="US2022121884A1_D17965.tif" /><img file="US2022121884A1_D17966.tif" /><img file="US2022121884A1_D17967.tif" /><img file="US2022121884A1_D17968.tif" /><img file="US2022121884A1_D17969.tif" /><img file="US2022121884A1_D17970.tif" /><img file="US2022121884A1_D17971.tif" /><img file="US2022121884A1_D17972.tif" /><img file="US2022121884A1_D17973.tif" /><img file="US2022121884A1_D17974.tif" /><img file="US2022121884A1_D17975.tif" /><img file="US2022121884A1_D17976.tif" /><img file="US2022121884A1_D17977.tif" /><img file="US2022121884A1_D17978.tif" /><img file="US2022121884A1_D17979.tif" /><img file="US2022121884A1_D17980.tif" /><img file="US2022121884A1_D17981.tif" /><img file="US2022121884A1_D17982.tif" /><img file="US2022121884A1_D17983.tif" /><img file="US2022121884A1_D17984.tif" /><img file="US2022121884A1_D17985.tif" /><img file="US2022121884A1_D17986.tif" /><img file="US2022121884A1_D17987.tif" /><img file="US2022121884A1_D17988.tif" /><img file="US2022121884A1_D17989.tif" /><img file="US2022121884A1_D17990.tif" /><img file="US2022121884A1_D17991.tif" /><img file="US2022121884A1_D17992.tif" /><img file="US2022121884A1_D17993.tif" /><img file="US2022121884A1_D17994.tif" /><img file="US2022121884A1_D17995.tif" /><img file="US2022121884A1_D17996.tif" /><img file="US2022121884A1_D17997.tif" /><img file="US2022121884A1_D17998.tif" /><img file="US2022121884A1_D17999.tif" /><img file="US2022121884A1_D18000.tif" /><img file="US2022121884A1_D18001.tif" /><img file="US2022121884A1_D18002.tif" /><img file="US2022121884A1_D18003.tif" /><img file="US2022121884A1_D18004.tif" /><img file="US2022121884A1_D18005.tif" /><img file="US2022121884A1_D18006.tif" /><img file="US2022121884A1_D18007.tif" /><img file="US2022121884A1_D18008.tif" /><img file="US2022121884A1_D18009.tif" /><img file="US2022121884A1_D18010.tif" /><img file="US2022121884A1_D18011.tif" /><img file="US2022121884A1_D18012.tif" /><img file="US2022121884A1_D18013.tif" /><img file="US2022121884A1_D18014.tif" /><img file="US2022121884A1_D18015.tif" /><img file="US2022121884A1_D18016.tif" /><img file="US2022121884A1_D18017.tif" /><img file="US2022121884A1_D18018.tif" /><img file="US2022121884A1_D18019.tif" /><img file="US2022121884A1_D18020.tif" /><img file="US2022121884A1_D18021.tif" /><img file="US2022121884A1_D18022.tif" /><img file="US2022121884A1_D18023.tif" /><img file="US2022121884A1_D18024.tif" /><img file="US2022121884A1_D18025.tif" /><img file="US2022121884A1_D18026.tif" /><img file="US2022121884A1_D18027.tif" /><img file="US2022121884A1_D18028.tif" /><img file="US2022121884A1_D18029.tif" /><img file="US2022121884A1_D18030.tif" /><img file="US2022121884A1_D18031.tif" /><img file="US2022121884A1_D18032.tif" /><maths id="MATH-US-00083-2" num="00083.2"><math overflow="scroll"><mrow><mi>subject</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>to</mi></mrow></math></maths><img file="US2022121884A1_D18033.tif" /><img file="US2022121884A1_D18034.tif" /><img file="US2022121884A1_D18035.tif" /><img file="US2022121884A1_D18036.tif" /><img file="US2022121884A1_D18037.tif" /><img file="US2022121884A1_D18038.tif" /><img file="US2022121884A1_D18039.tif" /><img file="US2022121884A1_D18040.tif" /><img file="US2022121884A1_D18041.tif" /><img file="US2022121884A1_D18042.tif" /><img file="US2022121884A1_D18043.tif" /><img file="US2022121884A1_D18044.tif" /><img file="US2022121884A1_D18045.tif" /><img file="US2022121884A1_D18046.tif" /><img file="US2022121884A1_D18047.tif" /><img file="US2022121884A1_D18048.tif" /><img file="US2022121884A1_D18049.tif" /><img file="US2022121884A1_D18050.tif" /><img file="US2022121884A1_D18051.tif" /><img file="US2022121884A1_D18052.tif" /><img file="US2022121884A1_D18053.tif" /><img file="US2022121884A1_D18054.tif" /><img file="US2022121884A1_D18055.tif" /><img file="US2022121884A1_D18056.tif" /><img file="US2022121884A1_D18057.tif" /><img file="US2022121884A1_D18058.tif" /><img file="US2022121884A1_D18059.tif" /><img file="US2022121884A1_D18060.tif" /><img file="US2022121884A1_D18061.tif" /><img file="US2022121884A1_D18062.tif" /><img file="US2022121884A1_D18063.tif" /><img file="US2022121884A1_D18064.tif" /><img file="US2022121884A1_D18065.tif" /><img file="US2022121884A1_D18066.tif" /><img file="US2022121884A1_D18067.tif" /><img file="US2022121884A1_D18068.tif" /><img file="US2022121884A1_D18069.tif" /><img file="US2022121884A1_D18070.tif" /><img file="US2022121884A1_D18071.tif" /><img file="US2022121884A1_D18072.tif" /><img file="US2022121884A1_D18073.tif" /><img file="US2022121884A1_D18074.tif" /><img file="US2022121884A1_D18075.tif" /><img file="US2022121884A1_D18076.tif" /><img file="US2022121884A1_D18077.tif" /><img file="US2022121884A1_D18078.tif" /><img file="US2022121884A1_D18079.tif" /><img file="US2022121884A1_D18080.tif" /><img file="US2022121884A1_D18081.tif" /><img file="US2022121884A1_D18082.tif" /><img file="US2022121884A1_D18083.tif" /><img file="US2022121884A1_D18084.tif" /><img file="US2022121884A1_D18085.tif" /><img file="US2022121884A1_D18086.tif" /><img file="US2022121884A1_D18087.tif" /><img file="US2022121884A1_D18088.tif" /><img file="US2022121884A1_D18089.tif" /><img file="US2022121884A1_D18090.tif" /><img file="US2022121884A1_D18091.tif" /><img file="US2022121884A1_D18092.tif" /><img file="US2022121884A1_D18093.tif" /><img file="US2022121884A1_D18094.tif" /><img file="US2022121884A1_D18095.tif" /><img file="US2022121884A1_D18096.tif" /><img file="US2022121884A1_D18097.tif" /><img file="US2022121884A1_D18098.tif" /><img file="US2022121884A1_D18099.tif" /><img file="US2022121884A1_D18100.tif" /><img file="US2022121884A1_D18101.tif" /><img file="US2022121884A1_D18102.tif" /><img file="US2022121884A1_D18103.tif" /><img file="US2022121884A1_D18104.tif" /><img file="US2022121884A1_D18105.tif" /><img file="US2022121884A1_D18106.tif" /><img file="US2022121884A1_D18107.tif" /><img file="US2022121884A1_D18108.tif" /><img file="US2022121884A1_D18109.tif" /><img file="US2022121884A1_D18110.tif" /><img file="US2022121884A1_D18111.tif" /><img file="US2022121884A1_D18112.tif" /><img file="US2022121884A1_D18113.tif" /><img file="US2022121884A1_D18114.tif" /><img file="US2022121884A1_D18115.tif" /><img file="US2022121884A1_D18116.tif" /><img file="US2022121884A1_D18117.tif" /><img file="US2022121884A1_D18118.tif" /><img file="US2022121884A1_D18119.tif" /><img file="US2022121884A1_D18120.tif" /><img file="US2022121884A1_D18121.tif" /><img file="US2022121884A1_D18122.tif" /><img file="US2022121884A1_D18123.tif" /><img file="US2022121884A1_D18124.tif" /><img file="US2022121884A1_D18125.tif" /><img file="US2022121884A1_D18126.tif" /><img file="US2022121884A1_D18127.tif" /><img file="US2022121884A1_D18128.tif" /><img file="US2022121884A1_D18129.tif" /><img file="US2022121884A1_D18130.tif" /><img file="US2022121884A1_D18131.tif" /><img file="US2022121884A1_D18132.tif" /><img file="US2022121884A1_D18133.tif" /><img file="US2022121884A1_D18134.tif" /><img file="US2022121884A1_D18135.tif" /><img file="US2022121884A1_D18136.tif" /><img file="US2022121884A1_D18137.tif" /><img file="US2022121884A1_D18138.tif" /><img file="US2022121884A1_D18139.tif" /><img file="US2022121884A1_D18140.tif" /><img file="US2022121884A1_D18141.tif" /><img file="US2022121884A1_D18142.tif" /><img file="US2022121884A1_D18143.tif" /><img file="US2022121884A1_D18144.tif" /><maths id="MATH-US-00083-3" num="00083.3"><math overflow="scroll"><mrow><mi>v</mi><mo>=</mo><mrow><mrow><munder><mover><mo>∫</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mover><mi>U</mi></munder><mo></mo><mi>μ</mi></mrow><mo>≤</mo><mrow><mo>∘</mo><mrow><mo>*</mo><mn>6</mn><mo></mo><mstyle><mtext>:</mtext></mstyle><mo></mo><mn>15</mn><mo></mo><mstyle><mspace width="0.6em" height="0.6ex" /></mstyle><mo></mo><mrow><mi>pm</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><mi>g</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D18145.tif" /><img file="US2022121884A1_D18146.tif" /><img file="US2022121884A1_D18147.tif" /><img file="US2022121884A1_D18148.tif" /><img file="US2022121884A1_D18149.tif" /><img file="US2022121884A1_D18150.tif" /><img file="US2022121884A1_D18151.tif" /><img file="US2022121884A1_D18152.tif" /><img file="US2022121884A1_D18153.tif" /><img file="US2022121884A1_D18154.tif" /><img file="US2022121884A1_D18155.tif" /><img file="US2022121884A1_D18156.tif" /><img file="US2022121884A1_D18157.tif" /><img file="US2022121884A1_D18158.tif" /><img file="US2022121884A1_D18159.tif" /><img file="US2022121884A1_D18160.tif" /><img file="US2022121884A1_D18161.tif" /><img file="US2022121884A1_D18162.tif" /><img file="US2022121884A1_D18163.tif" /><img file="US2022121884A1_D18164.tif" /><img file="US2022121884A1_D18165.tif" /><img file="US2022121884A1_D18166.tif" /><img file="US2022121884A1_D18167.tif" /><img file="US2022121884A1_D18168.tif" /><img file="US2022121884A1_D18169.tif" /><img file="US2022121884A1_D18170.tif" /><img file="US2022121884A1_D18171.tif" /><img file="US2022121884A1_D18172.tif" /><img file="US2022121884A1_D18173.tif" /><img file="US2022121884A1_D18174.tif" /><img file="US2022121884A1_D18175.tif" /><img file="US2022121884A1_D18176.tif" /><img file="US2022121884A1_D18177.tif" /><img file="US2022121884A1_D18178.tif" /><img file="US2022121884A1_D18179.tif" /><img file="US2022121884A1_D18180.tif" /><img file="US2022121884A1_D18181.tif" /><img file="US2022121884A1_D18182.tif" /><img file="US2022121884A1_D18183.tif" /><img file="US2022121884A1_D18184.tif" /><img file="US2022121884A1_D18185.tif" /><img file="US2022121884A1_D18186.tif" /><img file="US2022121884A1_D18187.tif" /><img file="US2022121884A1_D18188.tif" /><img file="US2022121884A1_D18189.tif" /><img file="US2022121884A1_D18190.tif" /><img file="US2022121884A1_D18191.tif" /><img file="US2022121884A1_D18192.tif" /><img file="US2022121884A1_D18193.tif" /><img file="US2022121884A1_D18194.tif" /><img file="US2022121884A1_D18195.tif" /><img file="US2022121884A1_D18196.tif" /><img file="US2022121884A1_D18197.tif" /><img file="US2022121884A1_D18198.tif" /><img file="US2022121884A1_D18199.tif" /><img file="US2022121884A1_D18200.tif" /><img file="US2022121884A1_D18201.tif" /><img file="US2022121884A1_D18202.tif" /><img file="US2022121884A1_D18203.tif" /><img file="US2022121884A1_D18204.tif" /><img file="US2022121884A1_D18205.tif" /><img file="US2022121884A1_D18206.tif" /><img file="US2022121884A1_D18207.tif" /><img file="US2022121884A1_D18208.tif" /><img file="US2022121884A1_D18209.tif" /><img file="US2022121884A1_D18210.tif" /><img file="US2022121884A1_D18211.tif" /><img file="US2022121884A1_D18212.tif" /><img file="US2022121884A1_D18213.tif" /><img file="US2022121884A1_D18214.tif" /><img file="US2022121884A1_D18215.tif" /><img file="US2022121884A1_D18216.tif" /><img file="US2022121884A1_D18217.tif" /><img file="US2022121884A1_D18218.tif" /><img file="US2022121884A1_D18219.tif" /><img file="US2022121884A1_D18220.tif" /><img file="US2022121884A1_D18221.tif" /><img file="US2022121884A1_D18222.tif" /><img file="US2022121884A1_D18223.tif" /><img file="US2022121884A1_D18224.tif" /><img file="US2022121884A1_D18225.tif" /><img file="US2022121884A1_D18226.tif" /><img file="US2022121884A1_D18227.tif" /><img file="US2022121884A1_D18228.tif" /><img file="US2022121884A1_D18229.tif" /><img file="US2022121884A1_D18230.tif" /><img file="US2022121884A1_D18231.tif" /><img file="US2022121884A1_D18232.tif" /><img file="US2022121884A1_D18233.tif" /><img file="US2022121884A1_D18234.tif" /><img file="US2022121884A1_D18235.tif" /><img file="US2022121884A1_D18236.tif" /><img file="US2022121884A1_D18237.tif" /><img file="US2022121884A1_D18238.tif" /><img file="US2022121884A1_D18239.tif" /><img file="US2022121884A1_D18240.tif" /><img file="US2022121884A1_D18241.tif" /><img file="US2022121884A1_D18242.tif" /><img file="US2022121884A1_D18243.tif" /><img file="US2022121884A1_D18244.tif" /><img file="US2022121884A1_D18245.tif" /><img file="US2022121884A1_D18246.tif" /><img file="US2022121884A1_D18247.tif" /><img file="US2022121884A1_D18248.tif" /><img file="US2022121884A1_D18249.tif" /><img file="US2022121884A1_D18250.tif" /><img file="US2022121884A1_D18251.tif" /><img file="US2022121884A1_D18252.tif" /><img file="US2022121884A1_D18253.tif" /><img file="US2022121884A1_D18254.tif" /><img file="US2022121884A1_D18255.tif" /><img file="US2022121884A1_D18256.tif" /><maths id="MATH-US-00083-4" num="00083.4"><math overflow="scroll"><mi>and</mi></math></maths><img file="US2022121884A1_D18257.tif" /><img file="US2022121884A1_D18258.tif" /><img file="US2022121884A1_D18259.tif" /><img file="US2022121884A1_D18260.tif" /><img file="US2022121884A1_D18261.tif" /><img file="US2022121884A1_D18262.tif" /><img file="US2022121884A1_D18263.tif" /><img file="US2022121884A1_D18264.tif" /><img file="US2022121884A1_D18265.tif" /><img file="US2022121884A1_D18266.tif" /><img file="US2022121884A1_D18267.tif" /><img file="US2022121884A1_D18268.tif" /><img file="US2022121884A1_D18269.tif" /><img file="US2022121884A1_D18270.tif" /><img file="US2022121884A1_D18271.tif" /><img file="US2022121884A1_D18272.tif" /><img file="US2022121884A1_D18273.tif" /><img file="US2022121884A1_D18274.tif" /><img file="US2022121884A1_D18275.tif" /><img file="US2022121884A1_D18276.tif" /><img file="US2022121884A1_D18277.tif" /><img file="US2022121884A1_D18278.tif" /><img file="US2022121884A1_D18279.tif" /><img file="US2022121884A1_D18280.tif" /><img file="US2022121884A1_D18281.tif" /><img file="US2022121884A1_D18282.tif" /><img file="US2022121884A1_D18283.tif" /><img file="US2022121884A1_D18284.tif" /><img file="US2022121884A1_D18285.tif" /><img file="US2022121884A1_D18286.tif" /><img file="US2022121884A1_D18287.tif" /><img file="US2022121884A1_D18288.tif" /><img file="US2022121884A1_D18289.tif" /><img file="US2022121884A1_D18290.tif" /><img file="US2022121884A1_D18291.tif" /><img file="US2022121884A1_D18292.tif" /><img file="US2022121884A1_D18293.tif" /><img file="US2022121884A1_D18294.tif" /><img file="US2022121884A1_D18295.tif" /><img file="US2022121884A1_D18296.tif" /><img file="US2022121884A1_D18297.tif" /><img file="US2022121884A1_D18298.tif" /><img file="US2022121884A1_D18299.tif" /><img file="US2022121884A1_D18300.tif" /><img file="US2022121884A1_D18301.tif" /><img file="US2022121884A1_D18302.tif" /><img file="US2022121884A1_D18303.tif" /><img file="US2022121884A1_D18304.tif" /><img file="US2022121884A1_D18305.tif" /><img file="US2022121884A1_D18306.tif" /><img file="US2022121884A1_D18307.tif" /><img file="US2022121884A1_D18308.tif" /><img file="US2022121884A1_D18309.tif" /><img file="US2022121884A1_D18310.tif" /><img file="US2022121884A1_D18311.tif" /><img file="US2022121884A1_D18312.tif" /><img file="US2022121884A1_D18313.tif" /><img file="US2022121884A1_D18314.tif" /><img file="US2022121884A1_D18315.tif" /><img file="US2022121884A1_D18316.tif" /><img file="US2022121884A1_D18317.tif" /><img file="US2022121884A1_D18318.tif" /><img file="US2022121884A1_D18319.tif" /><img file="US2022121884A1_D18320.tif" /><img file="US2022121884A1_D18321.tif" /><img file="US2022121884A1_D18322.tif" /><img file="US2022121884A1_D18323.tif" /><img file="US2022121884A1_D18324.tif" /><img file="US2022121884A1_D18325.tif" /><img file="US2022121884A1_D18326.tif" /><img file="US2022121884A1_D18327.tif" /><img file="US2022121884A1_D18328.tif" /><img file="US2022121884A1_D18329.tif" /><img file="US2022121884A1_D18330.tif" /><img file="US2022121884A1_D18331.tif" /><img file="US2022121884A1_D18332.tif" /><img file="US2022121884A1_D18333.tif" /><img file="US2022121884A1_D18334.tif" /><img file="US2022121884A1_D18335.tif" /><img file="US2022121884A1_D18336.tif" /><img file="US2022121884A1_D18337.tif" /><img file="US2022121884A1_D18338.tif" /><img file="US2022121884A1_D18339.tif" /><img file="US2022121884A1_D18340.tif" /><img file="US2022121884A1_D18341.tif" /><img file="US2022121884A1_D18342.tif" /><img file="US2022121884A1_D18343.tif" /><img file="US2022121884A1_D18344.tif" /><img file="US2022121884A1_D18345.tif" /><img file="US2022121884A1_D18346.tif" /><img file="US2022121884A1_D18347.tif" /><img file="US2022121884A1_D18348.tif" /><img file="US2022121884A1_D18349.tif" /><img file="US2022121884A1_D18350.tif" /><img file="US2022121884A1_D18351.tif" /><img file="US2022121884A1_D18352.tif" /><img file="US2022121884A1_D18353.tif" /><img file="US2022121884A1_D18354.tif" /><img file="US2022121884A1_D18355.tif" /><img file="US2022121884A1_D18356.tif" /><img file="US2022121884A1_D18357.tif" /><img file="US2022121884A1_D18358.tif" /><img file="US2022121884A1_D18359.tif" /><img file="US2022121884A1_D18360.tif" /><img file="US2022121884A1_D18361.tif" /><img file="US2022121884A1_D18362.tif" /><img file="US2022121884A1_D18363.tif" /><img file="US2022121884A1_D18364.tif" /><img file="US2022121884A1_D18365.tif" /><img file="US2022121884A1_D18366.tif" /><img file="US2022121884A1_D18367.tif" /><img file="US2022121884A1_D18368.tif" /><maths id="MATH-US-00083-5" num="00083.5"><math overflow="scroll"><mrow><mrow><munder><mover><mo>∫</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mover><mi>U</mi></munder><mo></mo><mrow><mrow><mi>g</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>=</mo><mn>1</mn></mrow></math></maths><img file="US2022121884A1_D18369.tif" /><img file="US2022121884A1_D18370.tif" /><img file="US2022121884A1_D18371.tif" /><img file="US2022121884A1_D18372.tif" /><img file="US2022121884A1_D18373.tif" /><img file="US2022121884A1_D18374.tif" /><img file="US2022121884A1_D18375.tif" /><img file="US2022121884A1_D18376.tif" /><img file="US2022121884A1_D18377.tif" /><img file="US2022121884A1_D18378.tif" /><img file="US2022121884A1_D18379.tif" /><img file="US2022121884A1_D18380.tif" /><img file="US2022121884A1_D18381.tif" /><img file="US2022121884A1_D18382.tif" /><img file="US2022121884A1_D18383.tif" /><img file="US2022121884A1_D18384.tif" /><img file="US2022121884A1_D18385.tif" /><img file="US2022121884A1_D18386.tif" /><img file="US2022121884A1_D18387.tif" /><img file="US2022121884A1_D18388.tif" /><img file="US2022121884A1_D18389.tif" /><img file="US2022121884A1_D18390.tif" /><img file="US2022121884A1_D18391.tif" /><img file="US2022121884A1_D18392.tif" /><img file="US2022121884A1_D18393.tif" /><img file="US2022121884A1_D18394.tif" /><img file="US2022121884A1_D18395.tif" /><img file="US2022121884A1_D18396.tif" /><img file="US2022121884A1_D18397.tif" /><img file="US2022121884A1_D18398.tif" /><img file="US2022121884A1_D18399.tif" /><img file="US2022121884A1_D18400.tif" /><img file="US2022121884A1_D18401.tif" /><img file="US2022121884A1_D18402.tif" /><img file="US2022121884A1_D18403.tif" /><img file="US2022121884A1_D18404.tif" /><img file="US2022121884A1_D18405.tif" /><img file="US2022121884A1_D18406.tif" /><img file="US2022121884A1_D18407.tif" /><img file="US2022121884A1_D18408.tif" /><img file="US2022121884A1_D18409.tif" /><img file="US2022121884A1_D18410.tif" /><img file="US2022121884A1_D18411.tif" /><img file="US2022121884A1_D18412.tif" /><img file="US2022121884A1_D18413.tif" /><img file="US2022121884A1_D18414.tif" /><img file="US2022121884A1_D18415.tif" /><img file="US2022121884A1_D18416.tif" /><img file="US2022121884A1_D18417.tif" /><img file="US2022121884A1_D18418.tif" /><img file="US2022121884A1_D18419.tif" /><img file="US2022121884A1_D18420.tif" /><img file="US2022121884A1_D18421.tif" /><img file="US2022121884A1_D18422.tif" /><img file="US2022121884A1_D18423.tif" /><img file="US2022121884A1_D18424.tif" /><img file="US2022121884A1_D18425.tif" /><img file="US2022121884A1_D18426.tif" /><img file="US2022121884A1_D18427.tif" /><img file="US2022121884A1_D18428.tif" /><img file="US2022121884A1_D18429.tif" /><img file="US2022121884A1_D18430.tif" /><img file="US2022121884A1_D18431.tif" /><img file="US2022121884A1_D18432.tif" /><img file="US2022121884A1_D18433.tif" /><img file="US2022121884A1_D18434.tif" /><img file="US2022121884A1_D18435.tif" /><img file="US2022121884A1_D18436.tif" /><img file="US2022121884A1_D18437.tif" /><img file="US2022121884A1_D18438.tif" /><img file="US2022121884A1_D18439.tif" /><img file="US2022121884A1_D18440.tif" /><img file="US2022121884A1_D18441.tif" /><img file="US2022121884A1_D18442.tif" /><img file="US2022121884A1_D18443.tif" /><img file="US2022121884A1_D18444.tif" /><img file="US2022121884A1_D18445.tif" /><img file="US2022121884A1_D18446.tif" /><img file="US2022121884A1_D18447.tif" /><img file="US2022121884A1_D18448.tif" /><img file="US2022121884A1_D18449.tif" /><img file="US2022121884A1_D18450.tif" /><img file="US2022121884A1_D18451.tif" /><img file="US2022121884A1_D18452.tif" /><img file="US2022121884A1_D18453.tif" /><img file="US2022121884A1_D18454.tif" /><img file="US2022121884A1_D18455.tif" /><img file="US2022121884A1_D18456.tif" /><img file="US2022121884A1_D18457.tif" /><img file="US2022121884A1_D18458.tif" /><img file="US2022121884A1_D18459.tif" /><img file="US2022121884A1_D18460.tif" /><img file="US2022121884A1_D18461.tif" /><img file="US2022121884A1_D18462.tif" /><img file="US2022121884A1_D18463.tif" /><img file="US2022121884A1_D18464.tif" /><img file="US2022121884A1_D18465.tif" /><img file="US2022121884A1_D18466.tif" /><img file="US2022121884A1_D18467.tif" /><img file="US2022121884A1_D18468.tif" /><img file="US2022121884A1_D18469.tif" /><img file="US2022121884A1_D18470.tif" /><img file="US2022121884A1_D18471.tif" /><img file="US2022121884A1_D18472.tif" /><img file="US2022121884A1_D18473.tif" /><img file="US2022121884A1_D18474.tif" /><img file="US2022121884A1_D18475.tif" /><img file="US2022121884A1_D18476.tif" /><img file="US2022121884A1_D18477.tif" /><img file="US2022121884A1_D18478.tif" /><img file="US2022121884A1_D18479.tif" /><img file="US2022121884A1_D18480.tif" />
(b) The tall Swedes problem:
We start with the data.
p: Most Swedes are tall.
Assume that the queries are:
q1: How many Swedes are not tall
q2: How many are short
q3: What is the average height of Swedes
In our earlier discussion of this example, we found that p translates into a generalized constraint on the count density function, h. Thus:
<maths id="MATH-US-00084" num="00084"><math overflow="scroll"><mrow><mrow><mi>p</mi><mo>→</mo><mrow><munder><mover><mo>∫</mo><mi>b</mi></mover><mi>a</mi></munder><mo></mo><mrow><mi>h</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow><mo></mo><mrow><msub><mi>μ</mi><mi>tall</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow></mrow><mo>,</mo></mrow></math></maths><img file="US2022121884A1_D18481.tif" /><img file="US2022121884A1_D18482.tif" /><img file="US2022121884A1_D18483.tif" /><img file="US2022121884A1_D18484.tif" /><img file="US2022121884A1_D18485.tif" /><img file="US2022121884A1_D18486.tif" /><img file="US2022121884A1_D18487.tif" /><img file="US2022121884A1_D18488.tif" /><img file="US2022121884A1_D18489.tif" /><img file="US2022121884A1_D18490.tif" /><img file="US2022121884A1_D18491.tif" /><img file="US2022121884A1_D18492.tif" /><img file="US2022121884A1_D18493.tif" /><img file="US2022121884A1_D18494.tif" /><img file="US2022121884A1_D18495.tif" /><img file="US2022121884A1_D18496.tif" /><img file="US2022121884A1_D18497.tif" /><img file="US2022121884A1_D18498.tif" /><img file="US2022121884A1_D18499.tif" /><img file="US2022121884A1_D18500.tif" /><img file="US2022121884A1_D18501.tif" /><img file="US2022121884A1_D18502.tif" /><img file="US2022121884A1_D18503.tif" /><img file="US2022121884A1_D18504.tif" /><img file="US2022121884A1_D18505.tif" /><img file="US2022121884A1_D18506.tif" /><img file="US2022121884A1_D18507.tif" /><img file="US2022121884A1_D18508.tif" /><img file="US2022121884A1_D18509.tif" /><img file="US2022121884A1_D18510.tif" /><img file="US2022121884A1_D18511.tif" /><img file="US2022121884A1_D18512.tif" /><img file="US2022121884A1_D18513.tif" /><img file="US2022121884A1_D18514.tif" /><img file="US2022121884A1_D18515.tif" /><img file="US2022121884A1_D18516.tif" /><img file="US2022121884A1_D18517.tif" /><img file="US2022121884A1_D18518.tif" /><img file="US2022121884A1_D18519.tif" /><img file="US2022121884A1_D18520.tif" /><img file="US2022121884A1_D18521.tif" /><img file="US2022121884A1_D18522.tif" /><img file="US2022121884A1_D18523.tif" /><img file="US2022121884A1_D18524.tif" /><img file="US2022121884A1_D18525.tif" /><img file="US2022121884A1_D18526.tif" /><img file="US2022121884A1_D18527.tif" /><img file="US2022121884A1_D18528.tif" /><img file="US2022121884A1_D18529.tif" /><img file="US2022121884A1_D18530.tif" /><img file="US2022121884A1_D18531.tif" /><img file="US2022121884A1_D18532.tif" /><img file="US2022121884A1_D18533.tif" /><img file="US2022121884A1_D18534.tif" /><img file="US2022121884A1_D18535.tif" /><img file="US2022121884A1_D18536.tif" /><img file="US2022121884A1_D18537.tif" /><img file="US2022121884A1_D18538.tif" /><img file="US2022121884A1_D18539.tif" /><img file="US2022121884A1_D18540.tif" /><img file="US2022121884A1_D18541.tif" /><img file="US2022121884A1_D18542.tif" /><img file="US2022121884A1_D18543.tif" /><img file="US2022121884A1_D18544.tif" /><img file="US2022121884A1_D18545.tif" /><img file="US2022121884A1_D18546.tif" /><img file="US2022121884A1_D18547.tif" /><img file="US2022121884A1_D18548.tif" /><img file="US2022121884A1_D18549.tif" /><img file="US2022121884A1_D18550.tif" /><img file="US2022121884A1_D18551.tif" /><img file="US2022121884A1_D18552.tif" /><img file="US2022121884A1_D18553.tif" /><img file="US2022121884A1_D18554.tif" /><img file="US2022121884A1_D18555.tif" /><img file="US2022121884A1_D18556.tif" /><img file="US2022121884A1_D18557.tif" /><img file="US2022121884A1_D18558.tif" /><img file="US2022121884A1_D18559.tif" /><img file="US2022121884A1_D18560.tif" /><img file="US2022121884A1_D18561.tif" /><img file="US2022121884A1_D18562.tif" /><img file="US2022121884A1_D18563.tif" /><img file="US2022121884A1_D18564.tif" /><img file="US2022121884A1_D18565.tif" /><img file="US2022121884A1_D18566.tif" /><img file="US2022121884A1_D18567.tif" /><img file="US2022121884A1_D18568.tif" /><img file="US2022121884A1_D18569.tif" /><img file="US2022121884A1_D18570.tif" /><img file="US2022121884A1_D18571.tif" /><img file="US2022121884A1_D18572.tif" /><img file="US2022121884A1_D18573.tif" /><img file="US2022121884A1_D18574.tif" /><img file="US2022121884A1_D18575.tif" /><img file="US2022121884A1_D18576.tif" /><img file="US2022121884A1_D18577.tif" /><img file="US2022121884A1_D18578.tif" /><img file="US2022121884A1_D18579.tif" /><img file="US2022121884A1_D18580.tif" /><img file="US2022121884A1_D18581.tif" /><img file="US2022121884A1_D18582.tif" /><img file="US2022121884A1_D18583.tif" /><img file="US2022121884A1_D18584.tif" /><img file="US2022121884A1_D18585.tif" /><img file="US2022121884A1_D18586.tif" /><img file="US2022121884A1_D18587.tif" /><img file="US2022121884A1_D18588.tif" /><img file="US2022121884A1_D18589.tif" /><img file="US2022121884A1_D18590.tif" /><img file="US2022121884A1_D18591.tif" /><img file="US2022121884A1_D18592.tif" />
is most
Precisiations of q1, q2 and q3 may be expressed as
<maths id="MATH-US-00085" num="00085"><math overflow="scroll"><mrow><mrow><mi>q</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>1</mn><mo></mo><mstyle><mtext>:</mtext></mstyle></mrow><mo>→</mo><mrow><munder><mover><mo>∫</mo><mi>b</mi></mover><mi>a</mi></munder><mo></mo><mrow><mrow><mi>h</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>μ</mi><mrow><mi>not</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo>.</mo><mi>tall</mi></mrow></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D18593.tif" /><img file="US2022121884A1_D18594.tif" /><img file="US2022121884A1_D18595.tif" /><img file="US2022121884A1_D18596.tif" /><img file="US2022121884A1_D18597.tif" /><img file="US2022121884A1_D18598.tif" /><img file="US2022121884A1_D18599.tif" /><img file="US2022121884A1_D18600.tif" /><img file="US2022121884A1_D18601.tif" /><img file="US2022121884A1_D18602.tif" /><img file="US2022121884A1_D18603.tif" /><img file="US2022121884A1_D18604.tif" /><img file="US2022121884A1_D18605.tif" /><img file="US2022121884A1_D18606.tif" /><img file="US2022121884A1_D18607.tif" /><img file="US2022121884A1_D18608.tif" /><img file="US2022121884A1_D18609.tif" /><img file="US2022121884A1_D18610.tif" /><img file="US2022121884A1_D18611.tif" /><img file="US2022121884A1_D18612.tif" /><img file="US2022121884A1_D18613.tif" /><img file="US2022121884A1_D18614.tif" /><img file="US2022121884A1_D18615.tif" /><img file="US2022121884A1_D18616.tif" /><img file="US2022121884A1_D18617.tif" /><img file="US2022121884A1_D18618.tif" /><img file="US2022121884A1_D18619.tif" /><img file="US2022121884A1_D18620.tif" /><img file="US2022121884A1_D18621.tif" /><img file="US2022121884A1_D18622.tif" /><img file="US2022121884A1_D18623.tif" /><img file="US2022121884A1_D18624.tif" /><img file="US2022121884A1_D18625.tif" /><img file="US2022121884A1_D18626.tif" /><img file="US2022121884A1_D18627.tif" /><img file="US2022121884A1_D18628.tif" /><img file="US2022121884A1_D18629.tif" /><img file="US2022121884A1_D18630.tif" /><img file="US2022121884A1_D18631.tif" /><img file="US2022121884A1_D18632.tif" /><img file="US2022121884A1_D18633.tif" /><img file="US2022121884A1_D18634.tif" /><img file="US2022121884A1_D18635.tif" /><img file="US2022121884A1_D18636.tif" /><img file="US2022121884A1_D18637.tif" /><img file="US2022121884A1_D18638.tif" /><img file="US2022121884A1_D18639.tif" /><img file="US2022121884A1_D18640.tif" /><img file="US2022121884A1_D18641.tif" /><img file="US2022121884A1_D18642.tif" /><img file="US2022121884A1_D18643.tif" /><img file="US2022121884A1_D18644.tif" /><img file="US2022121884A1_D18645.tif" /><img file="US2022121884A1_D18646.tif" /><img file="US2022121884A1_D18647.tif" /><img file="US2022121884A1_D18648.tif" /><img file="US2022121884A1_D18649.tif" /><img file="US2022121884A1_D18650.tif" /><img file="US2022121884A1_D18651.tif" /><img file="US2022121884A1_D18652.tif" /><img file="US2022121884A1_D18653.tif" /><img file="US2022121884A1_D18654.tif" /><img file="US2022121884A1_D18655.tif" /><img file="US2022121884A1_D18656.tif" /><img file="US2022121884A1_D18657.tif" /><img file="US2022121884A1_D18658.tif" /><img file="US2022121884A1_D18659.tif" /><img file="US2022121884A1_D18660.tif" /><img file="US2022121884A1_D18661.tif" /><img file="US2022121884A1_D18662.tif" /><img file="US2022121884A1_D18663.tif" /><img file="US2022121884A1_D18664.tif" /><img file="US2022121884A1_D18665.tif" /><img file="US2022121884A1_D18666.tif" /><img file="US2022121884A1_D18667.tif" /><img file="US2022121884A1_D18668.tif" /><img file="US2022121884A1_D18669.tif" /><img file="US2022121884A1_D18670.tif" /><img file="US2022121884A1_D18671.tif" /><img file="US2022121884A1_D18672.tif" /><img file="US2022121884A1_D18673.tif" /><img file="US2022121884A1_D18674.tif" /><img file="US2022121884A1_D18675.tif" /><img file="US2022121884A1_D18676.tif" /><img file="US2022121884A1_D18677.tif" /><img file="US2022121884A1_D18678.tif" /><img file="US2022121884A1_D18679.tif" /><img file="US2022121884A1_D18680.tif" /><img file="US2022121884A1_D18681.tif" /><img file="US2022121884A1_D18682.tif" /><img file="US2022121884A1_D18683.tif" /><img file="US2022121884A1_D18684.tif" /><img file="US2022121884A1_D18685.tif" /><img file="US2022121884A1_D18686.tif" /><img file="US2022121884A1_D18687.tif" /><img file="US2022121884A1_D18688.tif" /><img file="US2022121884A1_D18689.tif" /><img file="US2022121884A1_D18690.tif" /><img file="US2022121884A1_D18691.tif" /><img file="US2022121884A1_D18692.tif" /><img file="US2022121884A1_D18693.tif" /><img file="US2022121884A1_D18694.tif" /><img file="US2022121884A1_D18695.tif" /><img file="US2022121884A1_D18696.tif" /><img file="US2022121884A1_D18697.tif" /><img file="US2022121884A1_D18698.tif" /><img file="US2022121884A1_D18699.tif" /><img file="US2022121884A1_D18700.tif" /><img file="US2022121884A1_D18701.tif" /><img file="US2022121884A1_D18702.tif" /><img file="US2022121884A1_D18703.tif" /><img file="US2022121884A1_D18704.tif" /><maths id="MATH-US-00085-2" num="00085.2"><math overflow="scroll"><mrow><mrow><mi>q</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>2</mn><mo></mo><mstyle><mtext>:</mtext></mstyle></mrow><mo>→</mo><mrow><munder><mover><mo>∫</mo><mi>b</mi></mover><mi>a</mi></munder><mo></mo><mrow><mi>h</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow><mo></mo><mrow><msub><mi>μ</mi><mi>short</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D18705.tif" /><img file="US2022121884A1_D18706.tif" /><img file="US2022121884A1_D18707.tif" /><img file="US2022121884A1_D18708.tif" /><img file="US2022121884A1_D18709.tif" /><img file="US2022121884A1_D18710.tif" /><img file="US2022121884A1_D18711.tif" /><img file="US2022121884A1_D18712.tif" /><img file="US2022121884A1_D18713.tif" /><img file="US2022121884A1_D18714.tif" /><img file="US2022121884A1_D18715.tif" /><img file="US2022121884A1_D18716.tif" /><img file="US2022121884A1_D18717.tif" /><img file="US2022121884A1_D18718.tif" /><img file="US2022121884A1_D18719.tif" /><img file="US2022121884A1_D18720.tif" /><img file="US2022121884A1_D18721.tif" /><img file="US2022121884A1_D18722.tif" /><img file="US2022121884A1_D18723.tif" /><img file="US2022121884A1_D18724.tif" /><img file="US2022121884A1_D18725.tif" /><img file="US2022121884A1_D18726.tif" /><img file="US2022121884A1_D18727.tif" /><img file="US2022121884A1_D18728.tif" /><img file="US2022121884A1_D18729.tif" /><img file="US2022121884A1_D18730.tif" /><img file="US2022121884A1_D18731.tif" /><img file="US2022121884A1_D18732.tif" /><img file="US2022121884A1_D18733.tif" /><img file="US2022121884A1_D18734.tif" /><img file="US2022121884A1_D18735.tif" /><img file="US2022121884A1_D18736.tif" /><img file="US2022121884A1_D18737.tif" /><img file="US2022121884A1_D18738.tif" /><img file="US2022121884A1_D18739.tif" /><img file="US2022121884A1_D18740.tif" /><img file="US2022121884A1_D18741.tif" /><img file="US2022121884A1_D18742.tif" /><img file="US2022121884A1_D18743.tif" /><img file="US2022121884A1_D18744.tif" /><img file="US2022121884A1_D18745.tif" /><img file="US2022121884A1_D18746.tif" /><img file="US2022121884A1_D18747.tif" /><img file="US2022121884A1_D18748.tif" /><img file="US2022121884A1_D18749.tif" /><img file="US2022121884A1_D18750.tif" /><img file="US2022121884A1_D18751.tif" /><img file="US2022121884A1_D18752.tif" /><img file="US2022121884A1_D18753.tif" /><img file="US2022121884A1_D18754.tif" /><img file="US2022121884A1_D18755.tif" /><img file="US2022121884A1_D18756.tif" /><img file="US2022121884A1_D18757.tif" /><img file="US2022121884A1_D18758.tif" /><img file="US2022121884A1_D18759.tif" /><img file="US2022121884A1_D18760.tif" /><img file="US2022121884A1_D18761.tif" /><img file="US2022121884A1_D18762.tif" /><img file="US2022121884A1_D18763.tif" /><img file="US2022121884A1_D18764.tif" /><img file="US2022121884A1_D18765.tif" /><img file="US2022121884A1_D18766.tif" /><img file="US2022121884A1_D18767.tif" /><img file="US2022121884A1_D18768.tif" /><img file="US2022121884A1_D18769.tif" /><img file="US2022121884A1_D18770.tif" /><img file="US2022121884A1_D18771.tif" /><img file="US2022121884A1_D18772.tif" /><img file="US2022121884A1_D18773.tif" /><img file="US2022121884A1_D18774.tif" /><img file="US2022121884A1_D18775.tif" /><img file="US2022121884A1_D18776.tif" /><img file="US2022121884A1_D18777.tif" /><img file="US2022121884A1_D18778.tif" /><img file="US2022121884A1_D18779.tif" /><img file="US2022121884A1_D18780.tif" /><img file="US2022121884A1_D18781.tif" /><img file="US2022121884A1_D18782.tif" /><img file="US2022121884A1_D18783.tif" /><img file="US2022121884A1_D18784.tif" /><img file="US2022121884A1_D18785.tif" /><img file="US2022121884A1_D18786.tif" /><img file="US2022121884A1_D18787.tif" /><img file="US2022121884A1_D18788.tif" /><img file="US2022121884A1_D18789.tif" /><img file="US2022121884A1_D18790.tif" /><img file="US2022121884A1_D18791.tif" /><img file="US2022121884A1_D18792.tif" /><img file="US2022121884A1_D18793.tif" /><img file="US2022121884A1_D18794.tif" /><img file="US2022121884A1_D18795.tif" /><img file="US2022121884A1_D18796.tif" /><img file="US2022121884A1_D18797.tif" /><img file="US2022121884A1_D18798.tif" /><img file="US2022121884A1_D18799.tif" /><img file="US2022121884A1_D18800.tif" /><img file="US2022121884A1_D18801.tif" /><img file="US2022121884A1_D18802.tif" /><img file="US2022121884A1_D18803.tif" /><img file="US2022121884A1_D18804.tif" /><img file="US2022121884A1_D18805.tif" /><img file="US2022121884A1_D18806.tif" /><img file="US2022121884A1_D18807.tif" /><img file="US2022121884A1_D18808.tif" /><img file="US2022121884A1_D18809.tif" /><img file="US2022121884A1_D18810.tif" /><img file="US2022121884A1_D18811.tif" /><img file="US2022121884A1_D18812.tif" /><img file="US2022121884A1_D18813.tif" /><img file="US2022121884A1_D18814.tif" /><img file="US2022121884A1_D18815.tif" /><img file="US2022121884A1_D18816.tif" /><maths id="MATH-US-00085-3" num="00085.3"><math overflow="scroll"><mrow><mrow><mi>q</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>3</mn><mo></mo><mstyle><mtext>:</mtext></mstyle></mrow><mo>→</mo><mrow><munder><mover><mo>∫</mo><mi>b</mi></mover><mi>a</mi></munder><mo></mo><mrow><mrow><mi>uh</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><mi>du</mi><mo>.</mo></mrow></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D18817.tif" /><img file="US2022121884A1_D18818.tif" /><img file="US2022121884A1_D18819.tif" /><img file="US2022121884A1_D18820.tif" /><img file="US2022121884A1_D18821.tif" /><img file="US2022121884A1_D18822.tif" /><img file="US2022121884A1_D18823.tif" /><img file="US2022121884A1_D18824.tif" /><img file="US2022121884A1_D18825.tif" /><img file="US2022121884A1_D18826.tif" /><img file="US2022121884A1_D18827.tif" /><img file="US2022121884A1_D18828.tif" /><img file="US2022121884A1_D18829.tif" /><img file="US2022121884A1_D18830.tif" /><img file="US2022121884A1_D18831.tif" /><img file="US2022121884A1_D18832.tif" /><img file="US2022121884A1_D18833.tif" /><img file="US2022121884A1_D18834.tif" /><img file="US2022121884A1_D18835.tif" /><img file="US2022121884A1_D18836.tif" /><img file="US2022121884A1_D18837.tif" /><img file="US2022121884A1_D18838.tif" /><img file="US2022121884A1_D18839.tif" /><img file="US2022121884A1_D18840.tif" /><img file="US2022121884A1_D18841.tif" /><img file="US2022121884A1_D18842.tif" /><img file="US2022121884A1_D18843.tif" /><img file="US2022121884A1_D18844.tif" /><img file="US2022121884A1_D18845.tif" /><img file="US2022121884A1_D18846.tif" /><img file="US2022121884A1_D18847.tif" /><img file="US2022121884A1_D18848.tif" /><img file="US2022121884A1_D18849.tif" /><img file="US2022121884A1_D18850.tif" /><img file="US2022121884A1_D18851.tif" /><img file="US2022121884A1_D18852.tif" /><img file="US2022121884A1_D18853.tif" /><img file="US2022121884A1_D18854.tif" /><img file="US2022121884A1_D18855.tif" /><img file="US2022121884A1_D18856.tif" /><img file="US2022121884A1_D18857.tif" /><img file="US2022121884A1_D18858.tif" /><img file="US2022121884A1_D18859.tif" /><img file="US2022121884A1_D18860.tif" /><img file="US2022121884A1_D18861.tif" /><img file="US2022121884A1_D18862.tif" /><img file="US2022121884A1_D18863.tif" /><img file="US2022121884A1_D18864.tif" /><img file="US2022121884A1_D18865.tif" /><img file="US2022121884A1_D18866.tif" /><img file="US2022121884A1_D18867.tif" /><img file="US2022121884A1_D18868.tif" /><img file="US2022121884A1_D18869.tif" /><img file="US2022121884A1_D18870.tif" /><img file="US2022121884A1_D18871.tif" /><img file="US2022121884A1_D18872.tif" /><img file="US2022121884A1_D18873.tif" /><img file="US2022121884A1_D18874.tif" /><img file="US2022121884A1_D18875.tif" /><img file="US2022121884A1_D18876.tif" /><img file="US2022121884A1_D18877.tif" /><img file="US2022121884A1_D18878.tif" /><img file="US2022121884A1_D18879.tif" /><img file="US2022121884A1_D18880.tif" /><img file="US2022121884A1_D18881.tif" /><img file="US2022121884A1_D18882.tif" /><img file="US2022121884A1_D18883.tif" /><img file="US2022121884A1_D18884.tif" /><img file="US2022121884A1_D18885.tif" /><img file="US2022121884A1_D18886.tif" /><img file="US2022121884A1_D18887.tif" /><img file="US2022121884A1_D18888.tif" /><img file="US2022121884A1_D18889.tif" /><img file="US2022121884A1_D18890.tif" /><img file="US2022121884A1_D18891.tif" /><img file="US2022121884A1_D18892.tif" /><img file="US2022121884A1_D18893.tif" /><img file="US2022121884A1_D18894.tif" /><img file="US2022121884A1_D18895.tif" /><img file="US2022121884A1_D18896.tif" /><img file="US2022121884A1_D18897.tif" /><img file="US2022121884A1_D18898.tif" /><img file="US2022121884A1_D18899.tif" /><img file="US2022121884A1_D18900.tif" /><img file="US2022121884A1_D18901.tif" /><img file="US2022121884A1_D18902.tif" /><img file="US2022121884A1_D18903.tif" /><img file="US2022121884A1_D18904.tif" /><img file="US2022121884A1_D18905.tif" /><img file="US2022121884A1_D18906.tif" /><img file="US2022121884A1_D18907.tif" /><img file="US2022121884A1_D18908.tif" /><img file="US2022121884A1_D18909.tif" /><img file="US2022121884A1_D18910.tif" /><img file="US2022121884A1_D18911.tif" /><img file="US2022121884A1_D18912.tif" /><img file="US2022121884A1_D18913.tif" /><img file="US2022121884A1_D18914.tif" /><img file="US2022121884A1_D18915.tif" /><img file="US2022121884A1_D18916.tif" /><img file="US2022121884A1_D18917.tif" /><img file="US2022121884A1_D18918.tif" /><img file="US2022121884A1_D18919.tif" /><img file="US2022121884A1_D18920.tif" /><img file="US2022121884A1_D18921.tif" /><img file="US2022121884A1_D18922.tif" /><img file="US2022121884A1_D18923.tif" /><img file="US2022121884A1_D18924.tif" /><img file="US2022121884A1_D18925.tif" /><img file="US2022121884A1_D18926.tif" /><img file="US2022121884A1_D18927.tif" /><img file="US2022121884A1_D18928.tif" />
Considering q1, we note that
μ<sub>not,tall</sub>(u)=1−μ<sub>tall</sub>(u).
Consequently
<maths id="MATH-US-00086" num="00086"><math overflow="scroll"><mrow><mrow><mi>q</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>1</mn><mo></mo><mstyle><mtext>:</mtext></mstyle></mrow><mo>→</mo><mrow><mn>1</mn><mo>-</mo><mrow><munder><mover><mo>∫</mo><mi>b</mi></mover><mi>a</mi></munder><mo></mo><mrow><mrow><mi>h</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>μ</mi><mi>tall</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D18929.tif" /><img file="US2022121884A1_D18930.tif" /><img file="US2022121884A1_D18931.tif" /><img file="US2022121884A1_D18932.tif" /><img file="US2022121884A1_D18933.tif" /><img file="US2022121884A1_D18934.tif" /><img file="US2022121884A1_D18935.tif" /><img file="US2022121884A1_D18936.tif" /><img file="US2022121884A1_D18937.tif" /><img file="US2022121884A1_D18938.tif" /><img file="US2022121884A1_D18939.tif" /><img file="US2022121884A1_D18940.tif" /><img file="US2022121884A1_D18941.tif" /><img file="US2022121884A1_D18942.tif" /><img file="US2022121884A1_D18943.tif" /><img file="US2022121884A1_D18944.tif" /><img file="US2022121884A1_D18945.tif" /><img file="US2022121884A1_D18946.tif" /><img file="US2022121884A1_D18947.tif" /><img file="US2022121884A1_D18948.tif" /><img file="US2022121884A1_D18949.tif" /><img file="US2022121884A1_D18950.tif" /><img file="US2022121884A1_D18951.tif" /><img file="US2022121884A1_D18952.tif" /><img file="US2022121884A1_D18953.tif" /><img file="US2022121884A1_D18954.tif" /><img file="US2022121884A1_D18955.tif" /><img file="US2022121884A1_D18956.tif" /><img file="US2022121884A1_D18957.tif" /><img file="US2022121884A1_D18958.tif" /><img file="US2022121884A1_D18959.tif" /><img file="US2022121884A1_D18960.tif" /><img file="US2022121884A1_D18961.tif" /><img file="US2022121884A1_D18962.tif" /><img file="US2022121884A1_D18963.tif" /><img file="US2022121884A1_D18964.tif" /><img file="US2022121884A1_D18965.tif" /><img file="US2022121884A1_D18966.tif" /><img file="US2022121884A1_D18967.tif" /><img file="US2022121884A1_D18968.tif" /><img file="US2022121884A1_D18969.tif" /><img file="US2022121884A1_D18970.tif" /><img file="US2022121884A1_D18971.tif" /><img file="US2022121884A1_D18972.tif" /><img file="US2022121884A1_D18973.tif" /><img file="US2022121884A1_D18974.tif" /><img file="US2022121884A1_D18975.tif" /><img file="US2022121884A1_D18976.tif" /><img file="US2022121884A1_D18977.tif" /><img file="US2022121884A1_D18978.tif" /><img file="US2022121884A1_D18979.tif" /><img file="US2022121884A1_D18980.tif" /><img file="US2022121884A1_D18981.tif" /><img file="US2022121884A1_D18982.tif" /><img file="US2022121884A1_D18983.tif" /><img file="US2022121884A1_D18984.tif" /><img file="US2022121884A1_D18985.tif" /><img file="US2022121884A1_D18986.tif" /><img file="US2022121884A1_D18987.tif" /><img file="US2022121884A1_D18988.tif" /><img file="US2022121884A1_D18989.tif" /><img file="US2022121884A1_D18990.tif" /><img file="US2022121884A1_D18991.tif" /><img file="US2022121884A1_D18992.tif" /><img file="US2022121884A1_D18993.tif" /><img file="US2022121884A1_D18994.tif" /><img file="US2022121884A1_D18995.tif" /><img file="US2022121884A1_D18996.tif" /><img file="US2022121884A1_D18997.tif" /><img file="US2022121884A1_D18998.tif" /><img file="US2022121884A1_D18999.tif" /><img file="US2022121884A1_D19000.tif" /><img file="US2022121884A1_D19001.tif" /><img file="US2022121884A1_D19002.tif" /><img file="US2022121884A1_D19003.tif" /><img file="US2022121884A1_D19004.tif" /><img file="US2022121884A1_D19005.tif" /><img file="US2022121884A1_D19006.tif" /><img file="US2022121884A1_D19007.tif" /><img file="US2022121884A1_D19008.tif" /><img file="US2022121884A1_D19009.tif" /><img file="US2022121884A1_D19010.tif" /><img file="US2022121884A1_D19011.tif" /><img file="US2022121884A1_D19012.tif" /><img file="US2022121884A1_D19013.tif" /><img file="US2022121884A1_D19014.tif" /><img file="US2022121884A1_D19015.tif" /><img file="US2022121884A1_D19016.tif" /><img file="US2022121884A1_D19017.tif" /><img file="US2022121884A1_D19018.tif" /><img file="US2022121884A1_D19019.tif" /><img file="US2022121884A1_D19020.tif" /><img file="US2022121884A1_D19021.tif" /><img file="US2022121884A1_D19022.tif" /><img file="US2022121884A1_D19023.tif" /><img file="US2022121884A1_D19024.tif" /><img file="US2022121884A1_D19025.tif" /><img file="US2022121884A1_D19026.tif" /><img file="US2022121884A1_D19027.tif" /><img file="US2022121884A1_D19028.tif" /><img file="US2022121884A1_D19029.tif" /><img file="US2022121884A1_D19030.tif" /><img file="US2022121884A1_D19031.tif" /><img file="US2022121884A1_D19032.tif" /><img file="US2022121884A1_D19033.tif" /><img file="US2022121884A1_D19034.tif" /><img file="US2022121884A1_D19035.tif" /><img file="US2022121884A1_D19036.tif" /><img file="US2022121884A1_D19037.tif" /><img file="US2022121884A1_D19038.tif" /><img file="US2022121884A1_D19039.tif" /><img file="US2022121884A1_D19040.tif" />
which may be rewritten as
q2 1→1-most
where 1-most plays the role of the antonym of most.
Considering q2, we have to compute
<maths id="MATH-US-00087" num="00087"><math overflow="scroll"><mrow><mi>A</mi><mo></mo><mstyle><mtext>:</mtext></mstyle><mo></mo><mrow><munder><mover><mo>∫</mo><mi>b</mi></mover><mi>a</mi></munder><mo></mo><mrow><mrow><mi>h</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>μ</mi><mi>short</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D19041.tif" /><img file="US2022121884A1_D19042.tif" /><img file="US2022121884A1_D19043.tif" /><img file="US2022121884A1_D19044.tif" /><img file="US2022121884A1_D19045.tif" /><img file="US2022121884A1_D19046.tif" /><img file="US2022121884A1_D19047.tif" /><img file="US2022121884A1_D19048.tif" /><img file="US2022121884A1_D19049.tif" /><img file="US2022121884A1_D19050.tif" /><img file="US2022121884A1_D19051.tif" /><img file="US2022121884A1_D19052.tif" /><img file="US2022121884A1_D19053.tif" /><img file="US2022121884A1_D19054.tif" /><img file="US2022121884A1_D19055.tif" /><img file="US2022121884A1_D19056.tif" /><img file="US2022121884A1_D19057.tif" /><img file="US2022121884A1_D19058.tif" /><img file="US2022121884A1_D19059.tif" /><img file="US2022121884A1_D19060.tif" /><img file="US2022121884A1_D19061.tif" /><img file="US2022121884A1_D19062.tif" /><img file="US2022121884A1_D19063.tif" /><img file="US2022121884A1_D19064.tif" /><img file="US2022121884A1_D19065.tif" /><img file="US2022121884A1_D19066.tif" /><img file="US2022121884A1_D19067.tif" /><img file="US2022121884A1_D19068.tif" /><img file="US2022121884A1_D19069.tif" /><img file="US2022121884A1_D19070.tif" /><img file="US2022121884A1_D19071.tif" /><img file="US2022121884A1_D19072.tif" /><img file="US2022121884A1_D19073.tif" /><img file="US2022121884A1_D19074.tif" /><img file="US2022121884A1_D19075.tif" /><img file="US2022121884A1_D19076.tif" /><img file="US2022121884A1_D19077.tif" /><img file="US2022121884A1_D19078.tif" /><img file="US2022121884A1_D19079.tif" /><img file="US2022121884A1_D19080.tif" /><img file="US2022121884A1_D19081.tif" /><img file="US2022121884A1_D19082.tif" /><img file="US2022121884A1_D19083.tif" /><img file="US2022121884A1_D19084.tif" /><img file="US2022121884A1_D19085.tif" /><img file="US2022121884A1_D19086.tif" /><img file="US2022121884A1_D19087.tif" /><img file="US2022121884A1_D19088.tif" /><img file="US2022121884A1_D19089.tif" /><img file="US2022121884A1_D19090.tif" /><img file="US2022121884A1_D19091.tif" /><img file="US2022121884A1_D19092.tif" /><img file="US2022121884A1_D19093.tif" /><img file="US2022121884A1_D19094.tif" /><img file="US2022121884A1_D19095.tif" /><img file="US2022121884A1_D19096.tif" /><img file="US2022121884A1_D19097.tif" /><img file="US2022121884A1_D19098.tif" /><img file="US2022121884A1_D19099.tif" /><img file="US2022121884A1_D19100.tif" /><img file="US2022121884A1_D19101.tif" /><img file="US2022121884A1_D19102.tif" /><img file="US2022121884A1_D19103.tif" /><img file="US2022121884A1_D19104.tif" /><img file="US2022121884A1_D19105.tif" /><img file="US2022121884A1_D19106.tif" /><img file="US2022121884A1_D19107.tif" /><img file="US2022121884A1_D19108.tif" /><img file="US2022121884A1_D19109.tif" /><img file="US2022121884A1_D19110.tif" /><img file="US2022121884A1_D19111.tif" /><img file="US2022121884A1_D19112.tif" /><img file="US2022121884A1_D19113.tif" /><img file="US2022121884A1_D19114.tif" /><img file="US2022121884A1_D19115.tif" /><img file="US2022121884A1_D19116.tif" /><img file="US2022121884A1_D19117.tif" /><img file="US2022121884A1_D19118.tif" /><img file="US2022121884A1_D19119.tif" /><img file="US2022121884A1_D19120.tif" /><img file="US2022121884A1_D19121.tif" /><img file="US2022121884A1_D19122.tif" /><img file="US2022121884A1_D19123.tif" /><img file="US2022121884A1_D19124.tif" /><img file="US2022121884A1_D19125.tif" /><img file="US2022121884A1_D19126.tif" /><img file="US2022121884A1_D19127.tif" /><img file="US2022121884A1_D19128.tif" /><img file="US2022121884A1_D19129.tif" /><img file="US2022121884A1_D19130.tif" /><img file="US2022121884A1_D19131.tif" /><img file="US2022121884A1_D19132.tif" /><img file="US2022121884A1_D19133.tif" /><img file="US2022121884A1_D19134.tif" /><img file="US2022121884A1_D19135.tif" /><img file="US2022121884A1_D19136.tif" /><img file="US2022121884A1_D19137.tif" /><img file="US2022121884A1_D19138.tif" /><img file="US2022121884A1_D19139.tif" /><img file="US2022121884A1_D19140.tif" /><img file="US2022121884A1_D19141.tif" /><img file="US2022121884A1_D19142.tif" /><img file="US2022121884A1_D19143.tif" /><img file="US2022121884A1_D19144.tif" /><img file="US2022121884A1_D19145.tif" /><img file="US2022121884A1_D19146.tif" /><img file="US2022121884A1_D19147.tif" /><img file="US2022121884A1_D19148.tif" /><img file="US2022121884A1_D19149.tif" /><img file="US2022121884A1_D19150.tif" /><img file="US2022121884A1_D19151.tif" /><img file="US2022121884A1_D19152.tif" />
given that
<maths id="MATH-US-00088" num="00088"><math overflow="scroll"><mrow><mo>(</mo><mrow><munder><mover><mo>∫</mo><mi>b</mi></mover><mi>a</mi></munder><mo></mo><mrow><mrow><mi>h</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><msub><mi>μ</mi><mi>tall</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>)</mo></mrow></math></maths><img file="US2022121884A1_D19153.tif" /><img file="US2022121884A1_D19154.tif" /><img file="US2022121884A1_D19155.tif" /><img file="US2022121884A1_D19156.tif" /><img file="US2022121884A1_D19157.tif" /><img file="US2022121884A1_D19158.tif" /><img file="US2022121884A1_D19159.tif" /><img file="US2022121884A1_D19160.tif" /><img file="US2022121884A1_D19161.tif" /><img file="US2022121884A1_D19162.tif" /><img file="US2022121884A1_D19163.tif" /><img file="US2022121884A1_D19164.tif" /><img file="US2022121884A1_D19165.tif" /><img file="US2022121884A1_D19166.tif" /><img file="US2022121884A1_D19167.tif" /><img file="US2022121884A1_D19168.tif" /><img file="US2022121884A1_D19169.tif" /><img file="US2022121884A1_D19170.tif" /><img file="US2022121884A1_D19171.tif" /><img file="US2022121884A1_D19172.tif" /><img file="US2022121884A1_D19173.tif" /><img file="US2022121884A1_D19174.tif" /><img file="US2022121884A1_D19175.tif" /><img file="US2022121884A1_D19176.tif" /><img file="US2022121884A1_D19177.tif" /><img file="US2022121884A1_D19178.tif" /><img file="US2022121884A1_D19179.tif" /><img file="US2022121884A1_D19180.tif" /><img file="US2022121884A1_D19181.tif" /><img file="US2022121884A1_D19182.tif" /><img file="US2022121884A1_D19183.tif" /><img file="US2022121884A1_D19184.tif" /><img file="US2022121884A1_D19185.tif" /><img file="US2022121884A1_D19186.tif" /><img file="US2022121884A1_D19187.tif" /><img file="US2022121884A1_D19188.tif" /><img file="US2022121884A1_D19189.tif" /><img file="US2022121884A1_D19190.tif" /><img file="US2022121884A1_D19191.tif" /><img file="US2022121884A1_D19192.tif" /><img file="US2022121884A1_D19193.tif" /><img file="US2022121884A1_D19194.tif" /><img file="US2022121884A1_D19195.tif" /><img file="US2022121884A1_D19196.tif" /><img file="US2022121884A1_D19197.tif" /><img file="US2022121884A1_D19198.tif" /><img file="US2022121884A1_D19199.tif" /><img file="US2022121884A1_D19200.tif" /><img file="US2022121884A1_D19201.tif" /><img file="US2022121884A1_D19202.tif" /><img file="US2022121884A1_D19203.tif" /><img file="US2022121884A1_D19204.tif" /><img file="US2022121884A1_D19205.tif" /><img file="US2022121884A1_D19206.tif" /><img file="US2022121884A1_D19207.tif" /><img file="US2022121884A1_D19208.tif" /><img file="US2022121884A1_D19209.tif" /><img file="US2022121884A1_D19210.tif" /><img file="US2022121884A1_D19211.tif" /><img file="US2022121884A1_D19212.tif" /><img file="US2022121884A1_D19213.tif" /><img file="US2022121884A1_D19214.tif" /><img file="US2022121884A1_D19215.tif" /><img file="US2022121884A1_D19216.tif" /><img file="US2022121884A1_D19217.tif" /><img file="US2022121884A1_D19218.tif" /><img file="US2022121884A1_D19219.tif" /><img file="US2022121884A1_D19220.tif" /><img file="US2022121884A1_D19221.tif" /><img file="US2022121884A1_D19222.tif" /><img file="US2022121884A1_D19223.tif" /><img file="US2022121884A1_D19224.tif" /><img file="US2022121884A1_D19225.tif" /><img file="US2022121884A1_D19226.tif" /><img file="US2022121884A1_D19227.tif" /><img file="US2022121884A1_D19228.tif" /><img file="US2022121884A1_D19229.tif" /><img file="US2022121884A1_D19230.tif" /><img file="US2022121884A1_D19231.tif" /><img file="US2022121884A1_D19232.tif" /><img file="US2022121884A1_D19233.tif" /><img file="US2022121884A1_D19234.tif" /><img file="US2022121884A1_D19235.tif" /><img file="US2022121884A1_D19236.tif" /><img file="US2022121884A1_D19237.tif" /><img file="US2022121884A1_D19238.tif" /><img file="US2022121884A1_D19239.tif" /><img file="US2022121884A1_D19240.tif" /><img file="US2022121884A1_D19241.tif" /><img file="US2022121884A1_D19242.tif" /><img file="US2022121884A1_D19243.tif" /><img file="US2022121884A1_D19244.tif" /><img file="US2022121884A1_D19245.tif" /><img file="US2022121884A1_D19246.tif" /><img file="US2022121884A1_D19247.tif" /><img file="US2022121884A1_D19248.tif" /><img file="US2022121884A1_D19249.tif" /><img file="US2022121884A1_D19250.tif" /><img file="US2022121884A1_D19251.tif" /><img file="US2022121884A1_D19252.tif" /><img file="US2022121884A1_D19253.tif" /><img file="US2022121884A1_D19254.tif" /><img file="US2022121884A1_D19255.tif" /><img file="US2022121884A1_D19256.tif" /><img file="US2022121884A1_D19257.tif" /><img file="US2022121884A1_D19258.tif" /><img file="US2022121884A1_D19259.tif" /><img file="US2022121884A1_D19260.tif" /><img file="US2022121884A1_D19261.tif" /><img file="US2022121884A1_D19262.tif" /><img file="US2022121884A1_D19263.tif" /><img file="US2022121884A1_D19264.tif" />
is most.
Applying the extension principle, we arrive at the desired answer to the query:
<maths id="MATH-US-00089" num="00089"><math overflow="scroll"><mrow><mrow><msub><mi>μ</mi><mi>A</mi></msub><mo></mo><mrow><mo>(</mo><mi>v</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mi>sup</mi><mo></mo><mrow><mo>(</mo><mrow><msub><mi>μ</mi><mi>most</mi></msub><mo></mo><mrow><mo>(</mo><mrow><munder><mover><mo>∫</mo><mi>b</mi></mover><mi>a</mi></munder><mo></mo><mrow><mrow><msub><mi>μ</mi><mi>tall</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><mi>h</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>)</mo></mrow></mrow><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D19265.tif" /><img file="US2022121884A1_D19266.tif" /><img file="US2022121884A1_D19267.tif" /><img file="US2022121884A1_D19268.tif" /><img file="US2022121884A1_D19269.tif" /><img file="US2022121884A1_D19270.tif" /><img file="US2022121884A1_D19271.tif" /><img file="US2022121884A1_D19272.tif" /><img file="US2022121884A1_D19273.tif" /><img file="US2022121884A1_D19274.tif" /><img file="US2022121884A1_D19275.tif" /><img file="US2022121884A1_D19276.tif" /><img file="US2022121884A1_D19277.tif" /><img file="US2022121884A1_D19278.tif" /><img file="US2022121884A1_D19279.tif" /><img file="US2022121884A1_D19280.tif" /><img file="US2022121884A1_D19281.tif" /><img file="US2022121884A1_D19282.tif" /><img file="US2022121884A1_D19283.tif" /><img file="US2022121884A1_D19284.tif" /><img file="US2022121884A1_D19285.tif" /><img file="US2022121884A1_D19286.tif" /><img file="US2022121884A1_D19287.tif" /><img file="US2022121884A1_D19288.tif" /><img file="US2022121884A1_D19289.tif" /><img file="US2022121884A1_D19290.tif" /><img file="US2022121884A1_D19291.tif" /><img file="US2022121884A1_D19292.tif" /><img file="US2022121884A1_D19293.tif" /><img file="US2022121884A1_D19294.tif" /><img file="US2022121884A1_D19295.tif" /><img file="US2022121884A1_D19296.tif" /><img file="US2022121884A1_D19297.tif" /><img file="US2022121884A1_D19298.tif" /><img file="US2022121884A1_D19299.tif" /><img file="US2022121884A1_D19300.tif" /><img file="US2022121884A1_D19301.tif" /><img file="US2022121884A1_D19302.tif" /><img file="US2022121884A1_D19303.tif" /><img file="US2022121884A1_D19304.tif" /><img file="US2022121884A1_D19305.tif" /><img file="US2022121884A1_D19306.tif" /><img file="US2022121884A1_D19307.tif" /><img file="US2022121884A1_D19308.tif" /><img file="US2022121884A1_D19309.tif" /><img file="US2022121884A1_D19310.tif" /><img file="US2022121884A1_D19311.tif" /><img file="US2022121884A1_D19312.tif" /><img file="US2022121884A1_D19313.tif" /><img file="US2022121884A1_D19314.tif" /><img file="US2022121884A1_D19315.tif" /><img file="US2022121884A1_D19316.tif" /><img file="US2022121884A1_D19317.tif" /><img file="US2022121884A1_D19318.tif" /><img file="US2022121884A1_D19319.tif" /><img file="US2022121884A1_D19320.tif" /><img file="US2022121884A1_D19321.tif" /><img file="US2022121884A1_D19322.tif" /><img file="US2022121884A1_D19323.tif" /><img file="US2022121884A1_D19324.tif" /><img file="US2022121884A1_D19325.tif" /><img file="US2022121884A1_D19326.tif" /><img file="US2022121884A1_D19327.tif" /><img file="US2022121884A1_D19328.tif" /><img file="US2022121884A1_D19329.tif" /><img file="US2022121884A1_D19330.tif" /><img file="US2022121884A1_D19331.tif" /><img file="US2022121884A1_D19332.tif" /><img file="US2022121884A1_D19333.tif" /><img file="US2022121884A1_D19334.tif" /><img file="US2022121884A1_D19335.tif" /><img file="US2022121884A1_D19336.tif" /><img file="US2022121884A1_D19337.tif" /><img file="US2022121884A1_D19338.tif" /><img file="US2022121884A1_D19339.tif" /><img file="US2022121884A1_D19340.tif" /><img file="US2022121884A1_D19341.tif" /><img file="US2022121884A1_D19342.tif" /><img file="US2022121884A1_D19343.tif" /><img file="US2022121884A1_D19344.tif" /><img file="US2022121884A1_D19345.tif" /><img file="US2022121884A1_D19346.tif" /><img file="US2022121884A1_D19347.tif" /><img file="US2022121884A1_D19348.tif" /><img file="US2022121884A1_D19349.tif" /><img file="US2022121884A1_D19350.tif" /><img file="US2022121884A1_D19351.tif" /><img file="US2022121884A1_D19352.tif" /><img file="US2022121884A1_D19353.tif" /><img file="US2022121884A1_D19354.tif" /><img file="US2022121884A1_D19355.tif" /><img file="US2022121884A1_D19356.tif" /><img file="US2022121884A1_D19357.tif" /><img file="US2022121884A1_D19358.tif" /><img file="US2022121884A1_D19359.tif" /><img file="US2022121884A1_D19360.tif" /><img file="US2022121884A1_D19361.tif" /><img file="US2022121884A1_D19362.tif" /><img file="US2022121884A1_D19363.tif" /><img file="US2022121884A1_D19364.tif" /><img file="US2022121884A1_D19365.tif" /><img file="US2022121884A1_D19366.tif" /><img file="US2022121884A1_D19367.tif" /><img file="US2022121884A1_D19368.tif" /><img file="US2022121884A1_D19369.tif" /><img file="US2022121884A1_D19370.tif" /><img file="US2022121884A1_D19371.tif" /><img file="US2022121884A1_D19372.tif" /><img file="US2022121884A1_D19373.tif" /><img file="US2022121884A1_D19374.tif" /><img file="US2022121884A1_D19375.tif" /><img file="US2022121884A1_D19376.tif" /><maths id="MATH-US-00089-2" num="00089.2"><math overflow="scroll"><mrow><mi>subject</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>to</mi></mrow></math></maths><img file="US2022121884A1_D19377.tif" /><img file="US2022121884A1_D19378.tif" /><img file="US2022121884A1_D19379.tif" /><img file="US2022121884A1_D19380.tif" /><img file="US2022121884A1_D19381.tif" /><img file="US2022121884A1_D19382.tif" /><img file="US2022121884A1_D19383.tif" /><img file="US2022121884A1_D19384.tif" /><img file="US2022121884A1_D19385.tif" /><img file="US2022121884A1_D19386.tif" /><img file="US2022121884A1_D19387.tif" /><img file="US2022121884A1_D19388.tif" /><img file="US2022121884A1_D19389.tif" /><img file="US2022121884A1_D19390.tif" /><img file="US2022121884A1_D19391.tif" /><img file="US2022121884A1_D19392.tif" /><img file="US2022121884A1_D19393.tif" /><img file="US2022121884A1_D19394.tif" /><img file="US2022121884A1_D19395.tif" /><img file="US2022121884A1_D19396.tif" /><img file="US2022121884A1_D19397.tif" /><img file="US2022121884A1_D19398.tif" /><img file="US2022121884A1_D19399.tif" /><img file="US2022121884A1_D19400.tif" /><img file="US2022121884A1_D19401.tif" /><img file="US2022121884A1_D19402.tif" /><img file="US2022121884A1_D19403.tif" /><img file="US2022121884A1_D19404.tif" /><img file="US2022121884A1_D19405.tif" /><img file="US2022121884A1_D19406.tif" /><img file="US2022121884A1_D19407.tif" /><img file="US2022121884A1_D19408.tif" /><img file="US2022121884A1_D19409.tif" /><img file="US2022121884A1_D19410.tif" /><img file="US2022121884A1_D19411.tif" /><img file="US2022121884A1_D19412.tif" /><img file="US2022121884A1_D19413.tif" /><img file="US2022121884A1_D19414.tif" /><img file="US2022121884A1_D19415.tif" /><img file="US2022121884A1_D19416.tif" /><img file="US2022121884A1_D19417.tif" /><img file="US2022121884A1_D19418.tif" /><img file="US2022121884A1_D19419.tif" /><img file="US2022121884A1_D19420.tif" /><img file="US2022121884A1_D19421.tif" /><img file="US2022121884A1_D19422.tif" /><img file="US2022121884A1_D19423.tif" /><img file="US2022121884A1_D19424.tif" /><img file="US2022121884A1_D19425.tif" /><img file="US2022121884A1_D19426.tif" /><img file="US2022121884A1_D19427.tif" /><img file="US2022121884A1_D19428.tif" /><img file="US2022121884A1_D19429.tif" /><img file="US2022121884A1_D19430.tif" /><img file="US2022121884A1_D19431.tif" /><img file="US2022121884A1_D19432.tif" /><img file="US2022121884A1_D19433.tif" /><img file="US2022121884A1_D19434.tif" /><img file="US2022121884A1_D19435.tif" /><img file="US2022121884A1_D19436.tif" /><img file="US2022121884A1_D19437.tif" /><img file="US2022121884A1_D19438.tif" /><img file="US2022121884A1_D19439.tif" /><img file="US2022121884A1_D19440.tif" /><img file="US2022121884A1_D19441.tif" /><img file="US2022121884A1_D19442.tif" /><img file="US2022121884A1_D19443.tif" /><img file="US2022121884A1_D19444.tif" /><img file="US2022121884A1_D19445.tif" /><img file="US2022121884A1_D19446.tif" /><img file="US2022121884A1_D19447.tif" /><img file="US2022121884A1_D19448.tif" /><img file="US2022121884A1_D19449.tif" /><img file="US2022121884A1_D19450.tif" /><img file="US2022121884A1_D19451.tif" /><img file="US2022121884A1_D19452.tif" /><img file="US2022121884A1_D19453.tif" /><img file="US2022121884A1_D19454.tif" /><img file="US2022121884A1_D19455.tif" /><img file="US2022121884A1_D19456.tif" /><img file="US2022121884A1_D19457.tif" /><img file="US2022121884A1_D19458.tif" /><img file="US2022121884A1_D19459.tif" /><img file="US2022121884A1_D19460.tif" /><img file="US2022121884A1_D19461.tif" /><img file="US2022121884A1_D19462.tif" /><img file="US2022121884A1_D19463.tif" /><img file="US2022121884A1_D19464.tif" /><img file="US2022121884A1_D19465.tif" /><img file="US2022121884A1_D19466.tif" /><img file="US2022121884A1_D19467.tif" /><img file="US2022121884A1_D19468.tif" /><img file="US2022121884A1_D19469.tif" /><img file="US2022121884A1_D19470.tif" /><img file="US2022121884A1_D19471.tif" /><img file="US2022121884A1_D19472.tif" /><img file="US2022121884A1_D19473.tif" /><img file="US2022121884A1_D19474.tif" /><img file="US2022121884A1_D19475.tif" /><img file="US2022121884A1_D19476.tif" /><img file="US2022121884A1_D19477.tif" /><img file="US2022121884A1_D19478.tif" /><img file="US2022121884A1_D19479.tif" /><img file="US2022121884A1_D19480.tif" /><img file="US2022121884A1_D19481.tif" /><img file="US2022121884A1_D19482.tif" /><img file="US2022121884A1_D19483.tif" /><img file="US2022121884A1_D19484.tif" /><img file="US2022121884A1_D19485.tif" /><img file="US2022121884A1_D19486.tif" /><img file="US2022121884A1_D19487.tif" /><img file="US2022121884A1_D19488.tif" /><maths id="MATH-US-00089-3" num="00089.3"><math overflow="scroll"><mrow><mi>v</mi><mo>=</mo><mrow><munder><mover><mo>∫</mo><mi>b</mi></mover><mi>a</mi></munder><mo></mo><mrow><mrow><msub><mi>μ</mi><mi>short</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><mi>h</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D19489.tif" /><img file="US2022121884A1_D19490.tif" /><img file="US2022121884A1_D19491.tif" /><img file="US2022121884A1_D19492.tif" /><img file="US2022121884A1_D19493.tif" /><img file="US2022121884A1_D19494.tif" /><img file="US2022121884A1_D19495.tif" /><img file="US2022121884A1_D19496.tif" /><img file="US2022121884A1_D19497.tif" /><img file="US2022121884A1_D19498.tif" /><img file="US2022121884A1_D19499.tif" /><img file="US2022121884A1_D19500.tif" /><img file="US2022121884A1_D19501.tif" /><img file="US2022121884A1_D19502.tif" /><img file="US2022121884A1_D19503.tif" /><img file="US2022121884A1_D19504.tif" /><img file="US2022121884A1_D19505.tif" /><img file="US2022121884A1_D19506.tif" /><img file="US2022121884A1_D19507.tif" /><img file="US2022121884A1_D19508.tif" /><img file="US2022121884A1_D19509.tif" /><img file="US2022121884A1_D19510.tif" /><img file="US2022121884A1_D19511.tif" /><img file="US2022121884A1_D19512.tif" /><img file="US2022121884A1_D19513.tif" /><img file="US2022121884A1_D19514.tif" /><img file="US2022121884A1_D19515.tif" /><img file="US2022121884A1_D19516.tif" /><img file="US2022121884A1_D19517.tif" /><img file="US2022121884A1_D19518.tif" /><img file="US2022121884A1_D19519.tif" /><img file="US2022121884A1_D19520.tif" /><img file="US2022121884A1_D19521.tif" /><img file="US2022121884A1_D19522.tif" /><img file="US2022121884A1_D19523.tif" /><img file="US2022121884A1_D19524.tif" /><img file="US2022121884A1_D19525.tif" /><img file="US2022121884A1_D19526.tif" /><img file="US2022121884A1_D19527.tif" /><img file="US2022121884A1_D19528.tif" /><img file="US2022121884A1_D19529.tif" /><img file="US2022121884A1_D19530.tif" /><img file="US2022121884A1_D19531.tif" /><img file="US2022121884A1_D19532.tif" /><img file="US2022121884A1_D19533.tif" /><img file="US2022121884A1_D19534.tif" /><img file="US2022121884A1_D19535.tif" /><img file="US2022121884A1_D19536.tif" /><img file="US2022121884A1_D19537.tif" /><img file="US2022121884A1_D19538.tif" /><img file="US2022121884A1_D19539.tif" /><img file="US2022121884A1_D19540.tif" /><img file="US2022121884A1_D19541.tif" /><img file="US2022121884A1_D19542.tif" /><img file="US2022121884A1_D19543.tif" /><img file="US2022121884A1_D19544.tif" /><img file="US2022121884A1_D19545.tif" /><img file="US2022121884A1_D19546.tif" /><img file="US2022121884A1_D19547.tif" /><img file="US2022121884A1_D19548.tif" /><img file="US2022121884A1_D19549.tif" /><img file="US2022121884A1_D19550.tif" /><img file="US2022121884A1_D19551.tif" /><img file="US2022121884A1_D19552.tif" /><img file="US2022121884A1_D19553.tif" /><img file="US2022121884A1_D19554.tif" /><img file="US2022121884A1_D19555.tif" /><img file="US2022121884A1_D19556.tif" /><img file="US2022121884A1_D19557.tif" /><img file="US2022121884A1_D19558.tif" /><img file="US2022121884A1_D19559.tif" /><img file="US2022121884A1_D19560.tif" /><img file="US2022121884A1_D19561.tif" /><img file="US2022121884A1_D19562.tif" /><img file="US2022121884A1_D19563.tif" /><img file="US2022121884A1_D19564.tif" /><img file="US2022121884A1_D19565.tif" /><img file="US2022121884A1_D19566.tif" /><img file="US2022121884A1_D19567.tif" /><img file="US2022121884A1_D19568.tif" /><img file="US2022121884A1_D19569.tif" /><img file="US2022121884A1_D19570.tif" /><img file="US2022121884A1_D19571.tif" /><img file="US2022121884A1_D19572.tif" /><img file="US2022121884A1_D19573.tif" /><img file="US2022121884A1_D19574.tif" /><img file="US2022121884A1_D19575.tif" /><img file="US2022121884A1_D19576.tif" /><img file="US2022121884A1_D19577.tif" /><img file="US2022121884A1_D19578.tif" /><img file="US2022121884A1_D19579.tif" /><img file="US2022121884A1_D19580.tif" /><img file="US2022121884A1_D19581.tif" /><img file="US2022121884A1_D19582.tif" /><img file="US2022121884A1_D19583.tif" /><img file="US2022121884A1_D19584.tif" /><img file="US2022121884A1_D19585.tif" /><img file="US2022121884A1_D19586.tif" /><img file="US2022121884A1_D19587.tif" /><img file="US2022121884A1_D19588.tif" /><img file="US2022121884A1_D19589.tif" /><img file="US2022121884A1_D19590.tif" /><img file="US2022121884A1_D19591.tif" /><img file="US2022121884A1_D19592.tif" /><img file="US2022121884A1_D19593.tif" /><img file="US2022121884A1_D19594.tif" /><img file="US2022121884A1_D19595.tif" /><img file="US2022121884A1_D19596.tif" /><img file="US2022121884A1_D19597.tif" /><img file="US2022121884A1_D19598.tif" /><img file="US2022121884A1_D19599.tif" /><img file="US2022121884A1_D19600.tif" /><maths id="MATH-US-00089-4" num="00089.4"><math overflow="scroll"><mi>and</mi></math></maths><img file="US2022121884A1_D19601.tif" /><img file="US2022121884A1_D19602.tif" /><img file="US2022121884A1_D19603.tif" /><img file="US2022121884A1_D19604.tif" /><img file="US2022121884A1_D19605.tif" /><img file="US2022121884A1_D19606.tif" /><img file="US2022121884A1_D19607.tif" /><img file="US2022121884A1_D19608.tif" /><img file="US2022121884A1_D19609.tif" /><img file="US2022121884A1_D19610.tif" /><img file="US2022121884A1_D19611.tif" /><img file="US2022121884A1_D19612.tif" /><img file="US2022121884A1_D19613.tif" /><img file="US2022121884A1_D19614.tif" /><img file="US2022121884A1_D19615.tif" /><img file="US2022121884A1_D19616.tif" /><img file="US2022121884A1_D19617.tif" /><img file="US2022121884A1_D19618.tif" /><img file="US2022121884A1_D19619.tif" /><img file="US2022121884A1_D19620.tif" /><img file="US2022121884A1_D19621.tif" /><img file="US2022121884A1_D19622.tif" /><img file="US2022121884A1_D19623.tif" /><img file="US2022121884A1_D19624.tif" /><img file="US2022121884A1_D19625.tif" /><img file="US2022121884A1_D19626.tif" /><img file="US2022121884A1_D19627.tif" /><img file="US2022121884A1_D19628.tif" /><img file="US2022121884A1_D19629.tif" /><img file="US2022121884A1_D19630.tif" /><img file="US2022121884A1_D19631.tif" /><img file="US2022121884A1_D19632.tif" /><img file="US2022121884A1_D19633.tif" /><img file="US2022121884A1_D19634.tif" /><img file="US2022121884A1_D19635.tif" /><img file="US2022121884A1_D19636.tif" /><img file="US2022121884A1_D19637.tif" /><img file="US2022121884A1_D19638.tif" /><img file="US2022121884A1_D19639.tif" /><img file="US2022121884A1_D19640.tif" /><img file="US2022121884A1_D19641.tif" /><img file="US2022121884A1_D19642.tif" /><img file="US2022121884A1_D19643.tif" /><img file="US2022121884A1_D19644.tif" /><img file="US2022121884A1_D19645.tif" /><img file="US2022121884A1_D19646.tif" /><img file="US2022121884A1_D19647.tif" /><img file="US2022121884A1_D19648.tif" /><img file="US2022121884A1_D19649.tif" /><img file="US2022121884A1_D19650.tif" /><img file="US2022121884A1_D19651.tif" /><img file="US2022121884A1_D19652.tif" /><img file="US2022121884A1_D19653.tif" /><img file="US2022121884A1_D19654.tif" /><img file="US2022121884A1_D19655.tif" /><img file="US2022121884A1_D19656.tif" /><img file="US2022121884A1_D19657.tif" /><img file="US2022121884A1_D19658.tif" /><img file="US2022121884A1_D19659.tif" /><img file="US2022121884A1_D19660.tif" /><img file="US2022121884A1_D19661.tif" /><img file="US2022121884A1_D19662.tif" /><img file="US2022121884A1_D19663.tif" /><img file="US2022121884A1_D19664.tif" /><img file="US2022121884A1_D19665.tif" /><img file="US2022121884A1_D19666.tif" /><img file="US2022121884A1_D19667.tif" /><img file="US2022121884A1_D19668.tif" /><img file="US2022121884A1_D19669.tif" /><img file="US2022121884A1_D19670.tif" /><img file="US2022121884A1_D19671.tif" /><img file="US2022121884A1_D19672.tif" /><img file="US2022121884A1_D19673.tif" /><img file="US2022121884A1_D19674.tif" /><img file="US2022121884A1_D19675.tif" /><img file="US2022121884A1_D19676.tif" /><img file="US2022121884A1_D19677.tif" /><img file="US2022121884A1_D19678.tif" /><img file="US2022121884A1_D19679.tif" /><img file="US2022121884A1_D19680.tif" /><img file="US2022121884A1_D19681.tif" /><img file="US2022121884A1_D19682.tif" /><img file="US2022121884A1_D19683.tif" /><img file="US2022121884A1_D19684.tif" /><img file="US2022121884A1_D19685.tif" /><img file="US2022121884A1_D19686.tif" /><img file="US2022121884A1_D19687.tif" /><img file="US2022121884A1_D19688.tif" /><img file="US2022121884A1_D19689.tif" /><img file="US2022121884A1_D19690.tif" /><img file="US2022121884A1_D19691.tif" /><img file="US2022121884A1_D19692.tif" /><img file="US2022121884A1_D19693.tif" /><img file="US2022121884A1_D19694.tif" /><img file="US2022121884A1_D19695.tif" /><img file="US2022121884A1_D19696.tif" /><img file="US2022121884A1_D19697.tif" /><img file="US2022121884A1_D19698.tif" /><img file="US2022121884A1_D19699.tif" /><img file="US2022121884A1_D19700.tif" /><img file="US2022121884A1_D19701.tif" /><img file="US2022121884A1_D19702.tif" /><img file="US2022121884A1_D19703.tif" /><img file="US2022121884A1_D19704.tif" /><img file="US2022121884A1_D19705.tif" /><img file="US2022121884A1_D19706.tif" /><img file="US2022121884A1_D19707.tif" /><img file="US2022121884A1_D19708.tif" /><img file="US2022121884A1_D19709.tif" /><img file="US2022121884A1_D19710.tif" /><img file="US2022121884A1_D19711.tif" /><img file="US2022121884A1_D19712.tif" /><maths id="MATH-US-00089-5" num="00089.5"><math overflow="scroll"><mrow><mrow><munder><mover><mo>∫</mo><mi>b</mi></mover><mi>a</mi></munder><mo></mo><mrow><mrow><mi>h</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>=</mo><mn>1.</mn></mrow></math></maths><img file="US2022121884A1_D19713.tif" /><img file="US2022121884A1_D19714.tif" /><img file="US2022121884A1_D19715.tif" /><img file="US2022121884A1_D19716.tif" /><img file="US2022121884A1_D19717.tif" /><img file="US2022121884A1_D19718.tif" /><img file="US2022121884A1_D19719.tif" /><img file="US2022121884A1_D19720.tif" /><img file="US2022121884A1_D19721.tif" /><img file="US2022121884A1_D19722.tif" /><img file="US2022121884A1_D19723.tif" /><img file="US2022121884A1_D19724.tif" /><img file="US2022121884A1_D19725.tif" /><img file="US2022121884A1_D19726.tif" /><img file="US2022121884A1_D19727.tif" /><img file="US2022121884A1_D19728.tif" /><img file="US2022121884A1_D19729.tif" /><img file="US2022121884A1_D19730.tif" /><img file="US2022121884A1_D19731.tif" /><img file="US2022121884A1_D19732.tif" /><img file="US2022121884A1_D19733.tif" /><img file="US2022121884A1_D19734.tif" /><img file="US2022121884A1_D19735.tif" /><img file="US2022121884A1_D19736.tif" /><img file="US2022121884A1_D19737.tif" /><img file="US2022121884A1_D19738.tif" /><img file="US2022121884A1_D19739.tif" /><img file="US2022121884A1_D19740.tif" /><img file="US2022121884A1_D19741.tif" /><img file="US2022121884A1_D19742.tif" /><img file="US2022121884A1_D19743.tif" /><img file="US2022121884A1_D19744.tif" /><img file="US2022121884A1_D19745.tif" /><img file="US2022121884A1_D19746.tif" /><img file="US2022121884A1_D19747.tif" /><img file="US2022121884A1_D19748.tif" /><img file="US2022121884A1_D19749.tif" /><img file="US2022121884A1_D19750.tif" /><img file="US2022121884A1_D19751.tif" /><img file="US2022121884A1_D19752.tif" /><img file="US2022121884A1_D19753.tif" /><img file="US2022121884A1_D19754.tif" /><img file="US2022121884A1_D19755.tif" /><img file="US2022121884A1_D19756.tif" /><img file="US2022121884A1_D19757.tif" /><img file="US2022121884A1_D19758.tif" /><img file="US2022121884A1_D19759.tif" /><img file="US2022121884A1_D19760.tif" /><img file="US2022121884A1_D19761.tif" /><img file="US2022121884A1_D19762.tif" /><img file="US2022121884A1_D19763.tif" /><img file="US2022121884A1_D19764.tif" /><img file="US2022121884A1_D19765.tif" /><img file="US2022121884A1_D19766.tif" /><img file="US2022121884A1_D19767.tif" /><img file="US2022121884A1_D19768.tif" /><img file="US2022121884A1_D19769.tif" /><img file="US2022121884A1_D19770.tif" /><img file="US2022121884A1_D19771.tif" /><img file="US2022121884A1_D19772.tif" /><img file="US2022121884A1_D19773.tif" /><img file="US2022121884A1_D19774.tif" /><img file="US2022121884A1_D19775.tif" /><img file="US2022121884A1_D19776.tif" /><img file="US2022121884A1_D19777.tif" /><img file="US2022121884A1_D19778.tif" /><img file="US2022121884A1_D19779.tif" /><img file="US2022121884A1_D19780.tif" /><img file="US2022121884A1_D19781.tif" /><img file="US2022121884A1_D19782.tif" /><img file="US2022121884A1_D19783.tif" /><img file="US2022121884A1_D19784.tif" /><img file="US2022121884A1_D19785.tif" /><img file="US2022121884A1_D19786.tif" /><img file="US2022121884A1_D19787.tif" /><img file="US2022121884A1_D19788.tif" /><img file="US2022121884A1_D19789.tif" /><img file="US2022121884A1_D19790.tif" /><img file="US2022121884A1_D19791.tif" /><img file="US2022121884A1_D19792.tif" /><img file="US2022121884A1_D19793.tif" /><img file="US2022121884A1_D19794.tif" /><img file="US2022121884A1_D19795.tif" /><img file="US2022121884A1_D19796.tif" /><img file="US2022121884A1_D19797.tif" /><img file="US2022121884A1_D19798.tif" /><img file="US2022121884A1_D19799.tif" /><img file="US2022121884A1_D19800.tif" /><img file="US2022121884A1_D19801.tif" /><img file="US2022121884A1_D19802.tif" /><img file="US2022121884A1_D19803.tif" /><img file="US2022121884A1_D19804.tif" /><img file="US2022121884A1_D19805.tif" /><img file="US2022121884A1_D19806.tif" /><img file="US2022121884A1_D19807.tif" /><img file="US2022121884A1_D19808.tif" /><img file="US2022121884A1_D19809.tif" /><img file="US2022121884A1_D19810.tif" /><img file="US2022121884A1_D19811.tif" /><img file="US2022121884A1_D19812.tif" /><img file="US2022121884A1_D19813.tif" /><img file="US2022121884A1_D19814.tif" /><img file="US2022121884A1_D19815.tif" /><img file="US2022121884A1_D19816.tif" /><img file="US2022121884A1_D19817.tif" /><img file="US2022121884A1_D19818.tif" /><img file="US2022121884A1_D19819.tif" /><img file="US2022121884A1_D19820.tif" /><img file="US2022121884A1_D19821.tif" /><img file="US2022121884A1_D19822.tif" /><img file="US2022121884A1_D19823.tif" /><img file="US2022121884A1_D19824.tif" />
Likewise, for q3 we have as the answer
<maths id="MATH-US-00090" num="00090"><math overflow="scroll"><mrow><mrow><msub><mi>μ</mi><mi>A</mi></msub><mo></mo><mrow><mo>(</mo><mi>v</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><msub><mi>sup</mi><mi>u</mi></msub><mo></mo><mrow><mo>(</mo><mrow><msub><mi>μ</mi><mi>most</mi></msub><mo></mo><mrow><mo>(</mo><mrow><mover><msub><mo>∫</mo><mi>a</mi></msub><mi>b</mi></mover><mo></mo><mrow><mrow><msub><mi>μ</mi><mi>tall</mi></msub><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mrow><mi>h</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>)</mo></mrow></mrow><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D19825.tif" /><img file="US2022121884A1_D19826.tif" /><img file="US2022121884A1_D19827.tif" /><img file="US2022121884A1_D19828.tif" /><img file="US2022121884A1_D19829.tif" /><img file="US2022121884A1_D19830.tif" /><img file="US2022121884A1_D19831.tif" /><img file="US2022121884A1_D19832.tif" /><img file="US2022121884A1_D19833.tif" /><img file="US2022121884A1_D19834.tif" /><img file="US2022121884A1_D19835.tif" /><img file="US2022121884A1_D19836.tif" /><img file="US2022121884A1_D19837.tif" /><img file="US2022121884A1_D19838.tif" /><img file="US2022121884A1_D19839.tif" /><img file="US2022121884A1_D19840.tif" /><img file="US2022121884A1_D19841.tif" /><img file="US2022121884A1_D19842.tif" /><img file="US2022121884A1_D19843.tif" /><img file="US2022121884A1_D19844.tif" /><img file="US2022121884A1_D19845.tif" /><img file="US2022121884A1_D19846.tif" /><img file="US2022121884A1_D19847.tif" /><img file="US2022121884A1_D19848.tif" /><img file="US2022121884A1_D19849.tif" /><img file="US2022121884A1_D19850.tif" /><img file="US2022121884A1_D19851.tif" /><img file="US2022121884A1_D19852.tif" /><img file="US2022121884A1_D19853.tif" /><img file="US2022121884A1_D19854.tif" /><img file="US2022121884A1_D19855.tif" /><img file="US2022121884A1_D19856.tif" /><img file="US2022121884A1_D19857.tif" /><img file="US2022121884A1_D19858.tif" /><img file="US2022121884A1_D19859.tif" /><img file="US2022121884A1_D19860.tif" /><img file="US2022121884A1_D19861.tif" /><img file="US2022121884A1_D19862.tif" /><img file="US2022121884A1_D19863.tif" /><img file="US2022121884A1_D19864.tif" /><img file="US2022121884A1_D19865.tif" /><img file="US2022121884A1_D19866.tif" /><img file="US2022121884A1_D19867.tif" /><img file="US2022121884A1_D19868.tif" /><img file="US2022121884A1_D19869.tif" /><img file="US2022121884A1_D19870.tif" /><img file="US2022121884A1_D19871.tif" /><img file="US2022121884A1_D19872.tif" /><img file="US2022121884A1_D19873.tif" /><img file="US2022121884A1_D19874.tif" /><img file="US2022121884A1_D19875.tif" /><img file="US2022121884A1_D19876.tif" /><img file="US2022121884A1_D19877.tif" /><img file="US2022121884A1_D19878.tif" /><img file="US2022121884A1_D19879.tif" /><img file="US2022121884A1_D19880.tif" /><img file="US2022121884A1_D19881.tif" /><img file="US2022121884A1_D19882.tif" /><img file="US2022121884A1_D19883.tif" /><img file="US2022121884A1_D19884.tif" /><img file="US2022121884A1_D19885.tif" /><img file="US2022121884A1_D19886.tif" /><img file="US2022121884A1_D19887.tif" /><img file="US2022121884A1_D19888.tif" /><img file="US2022121884A1_D19889.tif" /><img file="US2022121884A1_D19890.tif" /><img file="US2022121884A1_D19891.tif" /><img file="US2022121884A1_D19892.tif" /><img file="US2022121884A1_D19893.tif" /><img file="US2022121884A1_D19894.tif" /><img file="US2022121884A1_D19895.tif" /><img file="US2022121884A1_D19896.tif" /><img file="US2022121884A1_D19897.tif" /><img file="US2022121884A1_D19898.tif" /><img file="US2022121884A1_D19899.tif" /><img file="US2022121884A1_D19900.tif" /><img file="US2022121884A1_D19901.tif" /><img file="US2022121884A1_D19902.tif" /><img file="US2022121884A1_D19903.tif" /><img file="US2022121884A1_D19904.tif" /><img file="US2022121884A1_D19905.tif" /><img file="US2022121884A1_D19906.tif" /><img file="US2022121884A1_D19907.tif" /><img file="US2022121884A1_D19908.tif" /><img file="US2022121884A1_D19909.tif" /><img file="US2022121884A1_D19910.tif" /><img file="US2022121884A1_D19911.tif" /><img file="US2022121884A1_D19912.tif" /><img file="US2022121884A1_D19913.tif" /><img file="US2022121884A1_D19914.tif" /><img file="US2022121884A1_D19915.tif" /><img file="US2022121884A1_D19916.tif" /><img file="US2022121884A1_D19917.tif" /><img file="US2022121884A1_D19918.tif" /><img file="US2022121884A1_D19919.tif" /><img file="US2022121884A1_D19920.tif" /><img file="US2022121884A1_D19921.tif" /><img file="US2022121884A1_D19922.tif" /><img file="US2022121884A1_D19923.tif" /><img file="US2022121884A1_D19924.tif" /><img file="US2022121884A1_D19925.tif" /><img file="US2022121884A1_D19926.tif" /><img file="US2022121884A1_D19927.tif" /><img file="US2022121884A1_D19928.tif" /><img file="US2022121884A1_D19929.tif" /><img file="US2022121884A1_D19930.tif" /><img file="US2022121884A1_D19931.tif" /><img file="US2022121884A1_D19932.tif" /><img file="US2022121884A1_D19933.tif" /><img file="US2022121884A1_D19934.tif" /><img file="US2022121884A1_D19935.tif" /><img file="US2022121884A1_D19936.tif" /><maths id="MATH-US-00090-2" num="00090.2"><math overflow="scroll"><mrow><mi>subject</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>to</mi></mrow></math></maths><img file="US2022121884A1_D19937.tif" /><img file="US2022121884A1_D19938.tif" /><img file="US2022121884A1_D19939.tif" /><img file="US2022121884A1_D19940.tif" /><img file="US2022121884A1_D19941.tif" /><img file="US2022121884A1_D19942.tif" /><img file="US2022121884A1_D19943.tif" /><img file="US2022121884A1_D19944.tif" /><img file="US2022121884A1_D19945.tif" /><img file="US2022121884A1_D19946.tif" /><img file="US2022121884A1_D19947.tif" /><img file="US2022121884A1_D19948.tif" /><img file="US2022121884A1_D19949.tif" /><img file="US2022121884A1_D19950.tif" /><img file="US2022121884A1_D19951.tif" /><img file="US2022121884A1_D19952.tif" /><img file="US2022121884A1_D19953.tif" /><img file="US2022121884A1_D19954.tif" /><img file="US2022121884A1_D19955.tif" /><img file="US2022121884A1_D19956.tif" /><img file="US2022121884A1_D19957.tif" /><img file="US2022121884A1_D19958.tif" /><img file="US2022121884A1_D19959.tif" /><img file="US2022121884A1_D19960.tif" /><img file="US2022121884A1_D19961.tif" /><img file="US2022121884A1_D19962.tif" /><img file="US2022121884A1_D19963.tif" /><img file="US2022121884A1_D19964.tif" /><img file="US2022121884A1_D19965.tif" /><img file="US2022121884A1_D19966.tif" /><img file="US2022121884A1_D19967.tif" /><img file="US2022121884A1_D19968.tif" /><img file="US2022121884A1_D19969.tif" /><img file="US2022121884A1_D19970.tif" /><img file="US2022121884A1_D19971.tif" /><img file="US2022121884A1_D19972.tif" /><img file="US2022121884A1_D19973.tif" /><img file="US2022121884A1_D19974.tif" /><img file="US2022121884A1_D19975.tif" /><img file="US2022121884A1_D19976.tif" /><img file="US2022121884A1_D19977.tif" /><img file="US2022121884A1_D19978.tif" /><img file="US2022121884A1_D19979.tif" /><img file="US2022121884A1_D19980.tif" /><img file="US2022121884A1_D19981.tif" /><img file="US2022121884A1_D19982.tif" /><img file="US2022121884A1_D19983.tif" /><img file="US2022121884A1_D19984.tif" /><img file="US2022121884A1_D19985.tif" /><img file="US2022121884A1_D19986.tif" /><img file="US2022121884A1_D19987.tif" /><img file="US2022121884A1_D19988.tif" /><img file="US2022121884A1_D19989.tif" /><img file="US2022121884A1_D19990.tif" /><img file="US2022121884A1_D19991.tif" /><img file="US2022121884A1_D19992.tif" /><img file="US2022121884A1_D19993.tif" /><img file="US2022121884A1_D19994.tif" /><img file="US2022121884A1_D19995.tif" /><img file="US2022121884A1_D19996.tif" /><img file="US2022121884A1_D19997.tif" /><img file="US2022121884A1_D19998.tif" /><img file="US2022121884A1_D19999.tif" /><img file="US2022121884A1_D20000.tif" /><img file="US2022121884A1_D20001.tif" /><img file="US2022121884A1_D20002.tif" /><img file="US2022121884A1_D20003.tif" /><img file="US2022121884A1_D20004.tif" /><img file="US2022121884A1_D20005.tif" /><img file="US2022121884A1_D20006.tif" /><img file="US2022121884A1_D20007.tif" /><img file="US2022121884A1_D20008.tif" /><img file="US2022121884A1_D20009.tif" /><img file="US2022121884A1_D20010.tif" /><img file="US2022121884A1_D20011.tif" /><img file="US2022121884A1_D20012.tif" /><img file="US2022121884A1_D20013.tif" /><img file="US2022121884A1_D20014.tif" /><img file="US2022121884A1_D20015.tif" /><img file="US2022121884A1_D20016.tif" /><img file="US2022121884A1_D20017.tif" /><img file="US2022121884A1_D20018.tif" /><img file="US2022121884A1_D20019.tif" /><img file="US2022121884A1_D20020.tif" /><img file="US2022121884A1_D20021.tif" /><img file="US2022121884A1_D20022.tif" /><img file="US2022121884A1_D20023.tif" /><img file="US2022121884A1_D20024.tif" /><img file="US2022121884A1_D20025.tif" /><img file="US2022121884A1_D20026.tif" /><img file="US2022121884A1_D20027.tif" /><img file="US2022121884A1_D20028.tif" /><img file="US2022121884A1_D20029.tif" /><img file="US2022121884A1_D20030.tif" /><img file="US2022121884A1_D20031.tif" /><img file="US2022121884A1_D20032.tif" /><img file="US2022121884A1_D20033.tif" /><img file="US2022121884A1_D20034.tif" /><img file="US2022121884A1_D20035.tif" /><img file="US2022121884A1_D20036.tif" /><img file="US2022121884A1_D20037.tif" /><img file="US2022121884A1_D20038.tif" /><img file="US2022121884A1_D20039.tif" /><img file="US2022121884A1_D20040.tif" /><img file="US2022121884A1_D20041.tif" /><img file="US2022121884A1_D20042.tif" /><img file="US2022121884A1_D20043.tif" /><img file="US2022121884A1_D20044.tif" /><img file="US2022121884A1_D20045.tif" /><img file="US2022121884A1_D20046.tif" /><img file="US2022121884A1_D20047.tif" /><img file="US2022121884A1_D20048.tif" /><maths id="MATH-US-00090-3" num="00090.3"><math overflow="scroll"><mrow><mi>v</mi><mo>=</mo><mrow><mover><msub><mo>∫</mo><mi>a</mi></msub><mi>b</mi></mover><mo></mo><mrow><mrow><mi>uh</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D20049.tif" /><img file="US2022121884A1_D20050.tif" /><img file="US2022121884A1_D20051.tif" /><img file="US2022121884A1_D20052.tif" /><img file="US2022121884A1_D20053.tif" /><img file="US2022121884A1_D20054.tif" /><img file="US2022121884A1_D20055.tif" /><img file="US2022121884A1_D20056.tif" /><img file="US2022121884A1_D20057.tif" /><img file="US2022121884A1_D20058.tif" /><img file="US2022121884A1_D20059.tif" /><img file="US2022121884A1_D20060.tif" /><img file="US2022121884A1_D20061.tif" /><img file="US2022121884A1_D20062.tif" /><img file="US2022121884A1_D20063.tif" /><img file="US2022121884A1_D20064.tif" /><img file="US2022121884A1_D20065.tif" /><img file="US2022121884A1_D20066.tif" /><img file="US2022121884A1_D20067.tif" /><img file="US2022121884A1_D20068.tif" /><img file="US2022121884A1_D20069.tif" /><img file="US2022121884A1_D20070.tif" /><img file="US2022121884A1_D20071.tif" /><img file="US2022121884A1_D20072.tif" /><img file="US2022121884A1_D20073.tif" /><img file="US2022121884A1_D20074.tif" /><img file="US2022121884A1_D20075.tif" /><img file="US2022121884A1_D20076.tif" /><img file="US2022121884A1_D20077.tif" /><img file="US2022121884A1_D20078.tif" /><img file="US2022121884A1_D20079.tif" /><img file="US2022121884A1_D20080.tif" /><img file="US2022121884A1_D20081.tif" /><img file="US2022121884A1_D20082.tif" /><img file="US2022121884A1_D20083.tif" /><img file="US2022121884A1_D20084.tif" /><img file="US2022121884A1_D20085.tif" /><img file="US2022121884A1_D20086.tif" /><img file="US2022121884A1_D20087.tif" /><img file="US2022121884A1_D20088.tif" /><img file="US2022121884A1_D20089.tif" /><img file="US2022121884A1_D20090.tif" /><img file="US2022121884A1_D20091.tif" /><img file="US2022121884A1_D20092.tif" /><img file="US2022121884A1_D20093.tif" /><img file="US2022121884A1_D20094.tif" /><img file="US2022121884A1_D20095.tif" /><img file="US2022121884A1_D20096.tif" /><img file="US2022121884A1_D20097.tif" /><img file="US2022121884A1_D20098.tif" /><img file="US2022121884A1_D20099.tif" /><img file="US2022121884A1_D20100.tif" /><img file="US2022121884A1_D20101.tif" /><img file="US2022121884A1_D20102.tif" /><img file="US2022121884A1_D20103.tif" /><img file="US2022121884A1_D20104.tif" /><img file="US2022121884A1_D20105.tif" /><img file="US2022121884A1_D20106.tif" /><img file="US2022121884A1_D20107.tif" /><img file="US2022121884A1_D20108.tif" /><img file="US2022121884A1_D20109.tif" /><img file="US2022121884A1_D20110.tif" /><img file="US2022121884A1_D20111.tif" /><img file="US2022121884A1_D20112.tif" /><img file="US2022121884A1_D20113.tif" /><img file="US2022121884A1_D20114.tif" /><img file="US2022121884A1_D20115.tif" /><img file="US2022121884A1_D20116.tif" /><img file="US2022121884A1_D20117.tif" /><img file="US2022121884A1_D20118.tif" /><img file="US2022121884A1_D20119.tif" /><img file="US2022121884A1_D20120.tif" /><img file="US2022121884A1_D20121.tif" /><img file="US2022121884A1_D20122.tif" /><img file="US2022121884A1_D20123.tif" /><img file="US2022121884A1_D20124.tif" /><img file="US2022121884A1_D20125.tif" /><img file="US2022121884A1_D20126.tif" /><img file="US2022121884A1_D20127.tif" /><img file="US2022121884A1_D20128.tif" /><img file="US2022121884A1_D20129.tif" /><img file="US2022121884A1_D20130.tif" /><img file="US2022121884A1_D20131.tif" /><img file="US2022121884A1_D20132.tif" /><img file="US2022121884A1_D20133.tif" /><img file="US2022121884A1_D20134.tif" /><img file="US2022121884A1_D20135.tif" /><img file="US2022121884A1_D20136.tif" /><img file="US2022121884A1_D20137.tif" /><img file="US2022121884A1_D20138.tif" /><img file="US2022121884A1_D20139.tif" /><img file="US2022121884A1_D20140.tif" /><img file="US2022121884A1_D20141.tif" /><img file="US2022121884A1_D20142.tif" /><img file="US2022121884A1_D20143.tif" /><img file="US2022121884A1_D20144.tif" /><img file="US2022121884A1_D20145.tif" /><img file="US2022121884A1_D20146.tif" /><img file="US2022121884A1_D20147.tif" /><img file="US2022121884A1_D20148.tif" /><img file="US2022121884A1_D20149.tif" /><img file="US2022121884A1_D20150.tif" /><img file="US2022121884A1_D20151.tif" /><img file="US2022121884A1_D20152.tif" /><img file="US2022121884A1_D20153.tif" /><img file="US2022121884A1_D20154.tif" /><img file="US2022121884A1_D20155.tif" /><img file="US2022121884A1_D20156.tif" /><img file="US2022121884A1_D20157.tif" /><img file="US2022121884A1_D20158.tif" /><img file="US2022121884A1_D20159.tif" /><img file="US2022121884A1_D20160.tif" /><maths id="MATH-US-00090-4" num="00090.4"><math overflow="scroll"><mi>and</mi></math></maths><img file="US2022121884A1_D20161.tif" /><img file="US2022121884A1_D20162.tif" /><img file="US2022121884A1_D20163.tif" /><img file="US2022121884A1_D20164.tif" /><img file="US2022121884A1_D20165.tif" /><img file="US2022121884A1_D20166.tif" /><img file="US2022121884A1_D20167.tif" /><img file="US2022121884A1_D20168.tif" /><img file="US2022121884A1_D20169.tif" /><img file="US2022121884A1_D20170.tif" /><img file="US2022121884A1_D20171.tif" /><img file="US2022121884A1_D20172.tif" /><img file="US2022121884A1_D20173.tif" /><img file="US2022121884A1_D20174.tif" /><img file="US2022121884A1_D20175.tif" /><img file="US2022121884A1_D20176.tif" /><img file="US2022121884A1_D20177.tif" /><img file="US2022121884A1_D20178.tif" /><img file="US2022121884A1_D20179.tif" /><img file="US2022121884A1_D20180.tif" /><img file="US2022121884A1_D20181.tif" /><img file="US2022121884A1_D20182.tif" /><img file="US2022121884A1_D20183.tif" /><img file="US2022121884A1_D20184.tif" /><img file="US2022121884A1_D20185.tif" /><img file="US2022121884A1_D20186.tif" /><img file="US2022121884A1_D20187.tif" /><img file="US2022121884A1_D20188.tif" /><img file="US2022121884A1_D20189.tif" /><img file="US2022121884A1_D20190.tif" /><img file="US2022121884A1_D20191.tif" /><img file="US2022121884A1_D20192.tif" /><img file="US2022121884A1_D20193.tif" /><img file="US2022121884A1_D20194.tif" /><img file="US2022121884A1_D20195.tif" /><img file="US2022121884A1_D20196.tif" /><img file="US2022121884A1_D20197.tif" /><img file="US2022121884A1_D20198.tif" /><img file="US2022121884A1_D20199.tif" /><img file="US2022121884A1_D20200.tif" /><img file="US2022121884A1_D20201.tif" /><img file="US2022121884A1_D20202.tif" /><img file="US2022121884A1_D20203.tif" /><img file="US2022121884A1_D20204.tif" /><img file="US2022121884A1_D20205.tif" /><img file="US2022121884A1_D20206.tif" /><img file="US2022121884A1_D20207.tif" /><img file="US2022121884A1_D20208.tif" /><img file="US2022121884A1_D20209.tif" /><img file="US2022121884A1_D20210.tif" /><img file="US2022121884A1_D20211.tif" /><img file="US2022121884A1_D20212.tif" /><img file="US2022121884A1_D20213.tif" /><img file="US2022121884A1_D20214.tif" /><img file="US2022121884A1_D20215.tif" /><img file="US2022121884A1_D20216.tif" /><img file="US2022121884A1_D20217.tif" /><img file="US2022121884A1_D20218.tif" /><img file="US2022121884A1_D20219.tif" /><img file="US2022121884A1_D20220.tif" /><img file="US2022121884A1_D20221.tif" /><img file="US2022121884A1_D20222.tif" /><img file="US2022121884A1_D20223.tif" /><img file="US2022121884A1_D20224.tif" /><img file="US2022121884A1_D20225.tif" /><img file="US2022121884A1_D20226.tif" /><img file="US2022121884A1_D20227.tif" /><img file="US2022121884A1_D20228.tif" /><img file="US2022121884A1_D20229.tif" /><img file="US2022121884A1_D20230.tif" /><img file="US2022121884A1_D20231.tif" /><img file="US2022121884A1_D20232.tif" /><img file="US2022121884A1_D20233.tif" /><img file="US2022121884A1_D20234.tif" /><img file="US2022121884A1_D20235.tif" /><img file="US2022121884A1_D20236.tif" /><img file="US2022121884A1_D20237.tif" /><img file="US2022121884A1_D20238.tif" /><img file="US2022121884A1_D20239.tif" /><img file="US2022121884A1_D20240.tif" /><img file="US2022121884A1_D20241.tif" /><img file="US2022121884A1_D20242.tif" /><img file="US2022121884A1_D20243.tif" /><img file="US2022121884A1_D20244.tif" /><img file="US2022121884A1_D20245.tif" /><img file="US2022121884A1_D20246.tif" /><img file="US2022121884A1_D20247.tif" /><img file="US2022121884A1_D20248.tif" /><img file="US2022121884A1_D20249.tif" /><img file="US2022121884A1_D20250.tif" /><img file="US2022121884A1_D20251.tif" /><img file="US2022121884A1_D20252.tif" /><img file="US2022121884A1_D20253.tif" /><img file="US2022121884A1_D20254.tif" /><img file="US2022121884A1_D20255.tif" /><img file="US2022121884A1_D20256.tif" /><img file="US2022121884A1_D20257.tif" /><img file="US2022121884A1_D20258.tif" /><img file="US2022121884A1_D20259.tif" /><img file="US2022121884A1_D20260.tif" /><img file="US2022121884A1_D20261.tif" /><img file="US2022121884A1_D20262.tif" /><img file="US2022121884A1_D20263.tif" /><img file="US2022121884A1_D20264.tif" /><img file="US2022121884A1_D20265.tif" /><img file="US2022121884A1_D20266.tif" /><img file="US2022121884A1_D20267.tif" /><img file="US2022121884A1_D20268.tif" /><img file="US2022121884A1_D20269.tif" /><img file="US2022121884A1_D20270.tif" /><img file="US2022121884A1_D20271.tif" /><img file="US2022121884A1_D20272.tif" /><maths id="MATH-US-00090-5" num="00090.5"><math overflow="scroll"><mrow><mrow><mover><msub><mo>∫</mo><mi>a</mi></msub><mi>b</mi></mover><mo></mo><mrow><mrow><mi>h</mi><mo></mo><mrow><mo>(</mo><mi>u</mi><mo>)</mo></mrow></mrow><mo></mo><mi>du</mi></mrow></mrow><mo>=</mo><mn>1.</mn></mrow></math></maths><img file="US2022121884A1_D20273.tif" /><img file="US2022121884A1_D20274.tif" /><img file="US2022121884A1_D20275.tif" /><img file="US2022121884A1_D20276.tif" /><img file="US2022121884A1_D20277.tif" /><img file="US2022121884A1_D20278.tif" /><img file="US2022121884A1_D20279.tif" /><img file="US2022121884A1_D20280.tif" /><img file="US2022121884A1_D20281.tif" /><img file="US2022121884A1_D20282.tif" /><img file="US2022121884A1_D20283.tif" /><img file="US2022121884A1_D20284.tif" /><img file="US2022121884A1_D20285.tif" /><img file="US2022121884A1_D20286.tif" /><img file="US2022121884A1_D20287.tif" /><img file="US2022121884A1_D20288.tif" /><img file="US2022121884A1_D20289.tif" /><img file="US2022121884A1_D20290.tif" /><img file="US2022121884A1_D20291.tif" /><img file="US2022121884A1_D20292.tif" /><img file="US2022121884A1_D20293.tif" /><img file="US2022121884A1_D20294.tif" /><img file="US2022121884A1_D20295.tif" /><img file="US2022121884A1_D20296.tif" /><img file="US2022121884A1_D20297.tif" /><img file="US2022121884A1_D20298.tif" /><img file="US2022121884A1_D20299.tif" /><img file="US2022121884A1_D20300.tif" /><img file="US2022121884A1_D20301.tif" /><img file="US2022121884A1_D20302.tif" /><img file="US2022121884A1_D20303.tif" /><img file="US2022121884A1_D20304.tif" /><img file="US2022121884A1_D20305.tif" /><img file="US2022121884A1_D20306.tif" /><img file="US2022121884A1_D20307.tif" /><img file="US2022121884A1_D20308.tif" /><img file="US2022121884A1_D20309.tif" /><img file="US2022121884A1_D20310.tif" /><img file="US2022121884A1_D20311.tif" /><img file="US2022121884A1_D20312.tif" /><img file="US2022121884A1_D20313.tif" /><img file="US2022121884A1_D20314.tif" /><img file="US2022121884A1_D20315.tif" /><img file="US2022121884A1_D20316.tif" /><img file="US2022121884A1_D20317.tif" /><img file="US2022121884A1_D20318.tif" /><img file="US2022121884A1_D20319.tif" /><img file="US2022121884A1_D20320.tif" /><img file="US2022121884A1_D20321.tif" /><img file="US2022121884A1_D20322.tif" /><img file="US2022121884A1_D20323.tif" /><img file="US2022121884A1_D20324.tif" /><img file="US2022121884A1_D20325.tif" /><img file="US2022121884A1_D20326.tif" /><img file="US2022121884A1_D20327.tif" /><img file="US2022121884A1_D20328.tif" /><img file="US2022121884A1_D20329.tif" /><img file="US2022121884A1_D20330.tif" /><img file="US2022121884A1_D20331.tif" /><img file="US2022121884A1_D20332.tif" /><img file="US2022121884A1_D20333.tif" /><img file="US2022121884A1_D20334.tif" /><img file="US2022121884A1_D20335.tif" /><img file="US2022121884A1_D20336.tif" /><img file="US2022121884A1_D20337.tif" /><img file="US2022121884A1_D20338.tif" /><img file="US2022121884A1_D20339.tif" /><img file="US2022121884A1_D20340.tif" /><img file="US2022121884A1_D20341.tif" /><img file="US2022121884A1_D20342.tif" /><img file="US2022121884A1_D20343.tif" /><img file="US2022121884A1_D20344.tif" /><img file="US2022121884A1_D20345.tif" /><img file="US2022121884A1_D20346.tif" /><img file="US2022121884A1_D20347.tif" /><img file="US2022121884A1_D20348.tif" /><img file="US2022121884A1_D20349.tif" /><img file="US2022121884A1_D20350.tif" /><img file="US2022121884A1_D20351.tif" /><img file="US2022121884A1_D20352.tif" /><img file="US2022121884A1_D20353.tif" /><img file="US2022121884A1_D20354.tif" /><img file="US2022121884A1_D20355.tif" /><img file="US2022121884A1_D20356.tif" /><img file="US2022121884A1_D20357.tif" /><img file="US2022121884A1_D20358.tif" /><img file="US2022121884A1_D20359.tif" /><img file="US2022121884A1_D20360.tif" /><img file="US2022121884A1_D20361.tif" /><img file="US2022121884A1_D20362.tif" /><img file="US2022121884A1_D20363.tif" /><img file="US2022121884A1_D20364.tif" /><img file="US2022121884A1_D20365.tif" /><img file="US2022121884A1_D20366.tif" /><img file="US2022121884A1_D20367.tif" /><img file="US2022121884A1_D20368.tif" /><img file="US2022121884A1_D20369.tif" /><img file="US2022121884A1_D20370.tif" /><img file="US2022121884A1_D20371.tif" /><img file="US2022121884A1_D20372.tif" /><img file="US2022121884A1_D20373.tif" /><img file="US2022121884A1_D20374.tif" /><img file="US2022121884A1_D20375.tif" /><img file="US2022121884A1_D20376.tif" /><img file="US2022121884A1_D20377.tif" /><img file="US2022121884A1_D20378.tif" /><img file="US2022121884A1_D20379.tif" /><img file="US2022121884A1_D20380.tif" /><img file="US2022121884A1_D20381.tif" /><img file="US2022121884A1_D20382.tif" /><img file="US2022121884A1_D20383.tif" /><img file="US2022121884A1_D20384.tif" />
As an illustration of application of protoformal deduction to an instance of his example, consider:
p: Most Swedes are tall
q: How many Swedes are short?
We start with the protoforms of p and q (see earlier example):
Most Swedes are tall→1/n Σ Count(G[A is R]) is Q
?T Swedes are short→1/n Σ Count(G[A is S]) is T,
where
G[A]=Σ<sub>i </sub>Name<sub>i</sub>/A<sub>i</sub>, i=1, . . . , n.
An applicable deduction rule in symbolic form is:
1/n Σ Count(G[A is R]) is Q
1/n Σ Count(G[A is S]) is T
The computational part of the rule is expressed as
1/n Σ<sub>i </sub>μ<sub>R</sub>(A<sub>i</sub>) is Q
1/n Σ<sub>i </sub>μ<sub>S</sub>(A<sub>i</sub>) is T
where
μ<sub>T </sub>(v)=sup A<sub>i</sub>, . . . , A<sub>n </sub>μ<sub>Q </sub>(Σ<sub>i </sub>μ<sub>R</sub>(A<sub>i</sub>))
subject to
v=Σ<sub>i </sub>μ<sub>S</sub>(A<sub>i</sub>).
What we see is that computation of the answer to the query, q, reduces to the solution of a variational problem, as it does in the earlier discussion of this example in which protoformal deduction was not employed.
The foregoing examples are merely elementary instances of reasoning through the use of generalized constraint propagation. What should be noted is that the chains of reasoning in these examples are very short, More generally, what is important to recognize is that shortness of chains of reasoning is an intrinsic characteristic of reasoning processes which take place in an environment of substantive imprecision and uncertainty. What this implies is that, in such environments, a conclusion arrived at the end of a long chain of reasoning is likely to be vacuous or of questionable validity.
Deduction (Extension) Principle:
Underlying almost all examples involving computation of an answer to a question, is a basic principle which may be referred to as the Deduction Principle. This principle is closely related to the extension principle of fuzzy logic.
Assume that we have a database, D, and database variables X1, . . . , Xn, with u<sub>i </sub>being a generic value of X<sub>i</sub>, (i=1, . . . , n).
Suppose that q is a given question and that the answer to q, Ans(q), is a function of the u<sub>i </sub>
Ans(q)=g(u<sub>1</sub>, . . . , u<sub>n</sub>), u=(u<sub>1</sub>, . . . , u<sub>n</sub>).
I do not know the exact values of the u<sub>i</sub>. My information about the u<sub>i</sub>, I (u1, . . . , un), is a generalized constraint on the u<sub>i</sub>. The constraint is defined by its test-score function
ts(u)=f, (u<sub>1</sub>, . . . , u<sub>n</sub>).
At this point, the problem is that of constraint propagation from ts(u) to g(u). Employing the extension principle, we are led to the membership function of the answer to q. More specifically,
<br />μ<sub>Ans(q) </sub>(<i>v</i>)=sup<sub>u </sub>(<i>ts</i>(<i>u</i>))
subject to
V=g(u)
This, in brief, is the substance of the Deduction Principle.
As a simple illustration, let us consider an example that was discussed earlier. Suppose that q: What is the average height of Swedes. Assume that D consists of information about the heights of a population of Swedes, Swede<sub>1</sub>, . . . , Swede<sub>n</sub>, with height of i-th Swede being h<sub>i</sub>i=1, . . . , n. Thus, average height may be expressed as
<br />Ave(<i>h</i>)=(1<i>/n</i>) (<i>h</i><sub>1</sub><i>+. . . . +h</i><sub>n</sub>).
Now, I do not know the h<sub>i</sub>. What I am given is the datum d: Most Swedes are tall. This datum constrains the h<sub>i</sub>. The test-score of this constraint is
<br /><i>ts</i>(<i>h</i>)=μ<sub>most </sub>((1<i>/n</i>) (Σ μ<sub>tall</sub>(<i>h</i><sub>i</sub>) )),
<br /><i>h</i>=(<i>h</i><sub>1</sub><i>, . . . , h</i><sub>n</sub>).
The generalized constraint on the h<sub>i </sub>induces a generalized constraint on Ave(h). Thus:
<br />μ<sub>Ave(h) </sub>(<i>v</i>)=sup (μ<sub>most </sub>((1<i>/n</i>) (Σ<sub>i </sub>μ<sub>tall</sub>(<i>h</i><sub>i</sub>) )) ),
<br /><i>h</i>=(<i>h</i><sub>1</sub><i>, . . . , h</i><sub>n</sub>), subject to:
<br /><i>v</i>=((1<i>/n</i>) (Σ<sub>i </sub><i>h</i><sub>i</sub>)).
More Search Engine Examples:
Let's consider a search engine query in which a person age is desired. For example, the question is: “What is the age of Mary?” or “How old is Mary?” or “What is Mary's age?”
Templates:
This question can be scanned or parsed, to extract its components, as (for example) in the following shorthand notation or format: “Mary/Age?” The parsing is done using many templates for recognition of the pattern or grammar for a specific language (e.g. American English), dialect, topic (e.g. political topic), or method and type of speech (e.g. written, as opposed to spoken information or question). The templates are stored and designed by linguists or experts, in special databases beforehand, to be able to dissect the sentences into its components automatically later on, and extract the relevant and important words and information. The degree of matching to a specific template (e.g. for English grammar), to find (for example) the subject and the verb in the sentence, is done by fuzzy membership function and other fuzzy concepts described elsewhere in this disclosure.
One example for the template is that the symbol “?” at the end of an English sentence “usually” indicates a “question” type sentence. (The concept of “usually” (or similar concepts) is addressed elsewhere in this disclosure.)
For question-type sentences, one can have the following template (as a simple example) for the question “How old is Mary?”:
(how old?/verb (to be)/noun (person's name))
That simplifies to: (how old?/person's name)
Or, equivalently, one can get this template: (age?/person's name)
Or, equivalently, one can get this template: (Mary K. Jones/human/Age?)
For a regular sentence of “Mary is 40 years old.”, we will have the following template, as an example: (Noun (person's name:)/verb (to be)/number/years/age)
Using the keywords or flag words (e.g. the usage of verb “is”), that simplifies to:
(person's age/number/years)
Or, equivalently, one can get this template: (Mary K. Jones/Age/40/years)
Or, equivalently, one can get this template: (Mary K. Jones/Age/40 years)
Obviously, many other choices of templates and grammar also work here, as long as there is consistency and brevity in the definitions and templates, to reduce the size and get the common features for batch processing, faster search, faster data extraction, better data presentation, and more efficient data storage. The good thing about templates is that it makes the translation between different human languages (or translation between speech and computer commands) much easier, as they tend to carry only pure necessary (bare bone) information, without extra words, in a predetermined order or format, for fast and efficient access, search, and comparison.
Removal of Ambiguities:
First of all, there is an ambiguity as which Mary we are talking about. If the prior conversation or context of the conversation makes it clear that we are talking about a specific Mary or person, e.g. “Mary Jones”, then the search does not have to get the age of all people with that name or nickname that it can find, and the search will be limited (in scope) to the age of Mary Jones, only. Of course, if there are more than one persons with the name of “Mary Jones”, one has to search for other identifiers or distinguishing parameters, such as her middle name, middle initial, age, social security number, address, father's name, husband's name, neighbor's name, friend's name, graduation date from high school, name of high school, nickname, pictures, tags on pictures, voice sample, fingerprint chart, other biometrics, or employee ID number, to remove the ambiguity, if possible.
Another information from context or background base knowledge is that Mary is a human, and not the name of a pet or doll, in which case the search would be diverted to another domain of age determination (e.g. for pets or dolls). Now, let's assume, for this example, that the context of the conversation or background knowledge (database) dictates or indicates that Mary is the name of a person, and furthermore, we are talking about Mary K. Jones, specifically. Thus, the question becomes: “Mary K. Jones/human/Age?”
In addition, for humans, one can distinguish male names from female names for majority of the names, stored in corresponding female and male (or human) name databases. Thus, we will have the following question: “Mary K. Jones/human/female/Age?” This is such a common question that we have a template in our template database for this type of questions: “human/female/Age?” or “human/Age?” Let's now consider the template “human/female/Age?” for this example. For our question template “human/female/Age?”, we will have relevant data and relevant questions, associated with such a template, designed or input previously by humans, community users, search engine company, or the computer (automatically, based on the prior results and training or learning from the past associations in similar situations or relationships), into the template relational database(s).
The relevancy and reliability of sources of information (or information itself) are discussed elsewhere in this invention disclosure, using fuzzy systems (and Z-numbers). So, we will not repeat those formulations here again.
Relevant Questions:
The examples of relevant questions are shown below. These are linked to the template “human/female/Age'?”, by linguists, or machine/computers trained for this purpose, using neural networks and fuzzy logic system combination, forming relational databases, that grows in size by experience and time/training, manually, automatically, or both. <ul id="ul0047" list-style="none"><li id="ul0047-0001" num="0000"><ul id="ul0048" list-style="none"><li id="ul0048-0001" num="1388">“What is the age of the person's kid(s)?” or “What is the age of the person's oldest kid?” (Because, usually, one has kids within some age range. For female humans (in today's standard) (living in US), for non-adopted kids, mother's age is usually in the range of 18 to 45 years old, with a membership function that is not flat, more or less in trapezoidal shape. Thus, the oldest kid's age is a very relevant question or piece of information)</li><li id="ul0048-0002" num="1389">“What year did the person graduate from high school (or college)?” (Because people in US normally graduate from high school around the ages of 17-19, with a corresponding membership function.)</li><li id="ul0048-0003" num="1390">“When did the person buy a house (or his or her first house)?” (Because a female person in US (or at different regions of US, or in certain city, or within a certain income bracket or job classification) buys her first house at a certain age, say, for example, around the ages 25-35, with a corresponding membership function.)</li><li id="ul0048-0004" num="1391">“How old is the person's best friend?” (Because, “generally”, each person is about the same age as her/his best friend, with a corresponding membership function.) (Please note that the concept of “generally” (or similar concepts) is addressed elsewhere in this disclosure.)</li><li id="ul0048-0005" num="1392">“How old is the person's pet?” (Because, usually, one's pet is younger than himself or herself, with a corresponding membership function.)</li><li id="ul0048-0006" num="1393">“How old are the person's parents?” (Because, usually, one is younger than his or her parents by about 20 to 45 years, with a corresponding membership function.)</li></ul></li></ul>
Combining all the questions above (and their answers or similar information), one can get a good estimate of the person's age, using fuzzy concepts shown in this disclosure. In addition, using a relevance scoring system, one can filter and find all or most relevant questions. Each relevant question can in turn refer to another relevant question or information, as a cascade and chain, bringing or suggesting more questions and information for the user. The history of the user or history of the users or history of similar or same questions) can be stored in some relational databases with relevance scoring, for future filtering and usage, based on a threshold. The system is adaptive and dynamic, as well as having learning/training mode, because as the time passes, with more experience and history, the database gets more accurate and larger in size, to fit or find the questions or relevant information better and faster.
Similarly, for answers or information available, one can find relevant information, using a membership function for relevance degree. Some examples for answers or information are: <ul id="ul0049" list-style="none"><li id="ul0049-0001" num="0000"><ul id="ul0050" list-style="none"><li id="ul0050-0001" num="1396">“The age of Mary K, Jones's oldest child (or kid) is 15.”</li><li id="ul0050-0002" num="1397">“Mary K. Jones graduated from high school in 1989.”</li><li id="ul0050-0003" num="1398">“Mary K. Jones bought her first house in about 1996.”</li><li id="ul0050-0004" num="1399">“Mary K. Jones's best friend is most likely 35 years old.”</li><li id="ul0050-0005" num="1400">“Mary K. Jones's dog is roughly 10 years old,”</li><li id="ul0050-0006" num="1401">“Mary K. Jones's mother is about 70 years old.”</li></ul></li></ul>
Sometimes, one gets the age of Mary K. Jones indirectly, through the information about her best friend's parent's age, which typically has less relevance and less credibility, in the chain of connected information. However, in this disclosure, we have shown the tools to treat and analyze/process all of those situations and information, with different degrees of relevance and credibility, using fuzzy concepts, such as membership functions for corresponding parameters.
Note that to search information and questions, one can use the following templates for the following sentences, as examples: <ul id="ul0051" list-style="none"><li id="ul0051-0001" num="0000"><ul id="ul0052" list-style="none"><li id="ul0052-0001" num="1404">“Mary K. Jones's dog is roughly 10 years old.” is converted to the template: (person/person's pet/pet's age/roughly/10 years), which is stored in relational databases, which can be queried, compared, aggregated, edited, combined, re-named, indexed, or re-ordered.</li><li id="ul0052-0002" num="1405">“How old is the person's pet?” is converted to the template: (person/person's pet'pet's age?), which is stored in relational database(s) or template storage.</li></ul></li></ul>
<figref idref="DRAWINGS">FIG. 64</figref> is a system for the search engine explained above. The fuzzy analysis engine is used to find Mary's age from all the received information. The scores, thresholds, and membership functions are used in the fuzzy analysis engine, as explained elsewhere in this disclosure.
Another example for the search engine is an inquiry about Mary's house: “How much is the price of Mary's house?” To analyze this question, a process and system similar to the one given above is followed. However, in this case, in addition, we have some predetermined templates for links to relevant web sites or government information repositories. For example, for price of the house, the average price of the houses (the trend) for US, city, region, county, and specific street or neighborhood become relevant, as well as, inflation, housing indices reported by Wall Street Journal or the US Government (e.g. the new permits issued for the last quarter or the current inventory of the new or old houses), and the size and details of Mary's house (such as the number of floors, number of garages, number of bedrooms, age of the house, and square feet of the land and living area), plus the recent real estate activities in the same area for similar size houses (from real estate repositories or county records for recent transactions). The prior sale prices of Mary's house, if any, with corresponding dates, are also relevant information.
Therefore, one needs some indices and data from newspapers, US Government, local government, county records, and real estate databases. These data are usually directly or indirectly available for search engines (assuming they are not protected by password or only available on subscription basis, which may need human intervention and input). The indirect ones may require proper question or another relevant data (or intermediary information) to link with the final answer. Thus, at the beginning, the people experts in economy and real estate are needed to design and set the links and relationships (or mathematics formulas and fuzzy rules or relationships between different parameters), as the initialization step. However, if similar concepts already exist in the rules and patterns or templates, the machines can initialize the new search links and populate the relationships, automatically, without any human intervention or input. The updates for the links or feedbacks can be done periodically by humans or users, or automatically by machines, e.g. by feedback from the history using a learning machine (e.g. using neural networks, trained to update the links or improve them, gradually, based on prior scores and past performances).
In the above example, the most important piece of information is probably the address of the house. A system for this example is shown in <figref idref="DRAWINGS">FIG. 66</figref> (with the template (Mary/house/price?), which is a question about the price of Mary's house). So, after finding which Mary we are talking about, we need to find the address of the house, or remove the ambiguities as much as possible, to narrow down the possibilities for the addresses, which can be expressed by the membership functions, e.g. in discrete mode, as a discrete function. Most databases and data mentioned above are expressed in terms of the house address and zip code, as shown in <figref idref="DRAWINGS">FIG. 66</figref>, where the search for the parameter “address” is helping the searches related to the other parameters, e.g. as an intermediate parameter to get to the other parameters.
So, after finding the address(es), the search engine is focused on any relevant information related to the found address, especially targeting the focused web sites and predetermined repositories that probably contain relevant and reliable information, as mentioned above. In case of multiple addresses, if we cannot resolve the real address among the multiple possible addresses (or if Mary may actually own multiple houses), we end up having a list of (multiple) possible addresses and their corresponding prices, with some certainty (or confidence) value or membership function, associated with each found address (and its corresponding price). The additional system components in this example are captured in <figref idref="DRAWINGS">FIG. 65</figref> (in addition to our teachings of <figref idref="DRAWINGS">FIG. 64</figref>).
Another example for the search engine is an inquiry about the price of a car: “How much is the price of a low mileage 1991 Ford Mustang?” or “How much does a 1991 Ford Mustang (in a good condition) worth?” To analyze this question, a process and system similar to the one given above is followed. However, in this case, in addition, we have some predetermined templates for links to relevant web sites or commercial (or standard) information repositories, such as E-Bay web site, auction web sites, used car dealers, car advertisement or newspapers' web sites, car collectors' web sites, car magazines' web sites, reliable car blogs, car experts' web sites, or Blue Book values for cars.
In addition, the mileage on the car, car condition, and details of the car are also relevant. In this case, we know that the car has a low mileage (or is in good condition), which is a fuzzy statement, with its corresponding membership values and function regarding mileage (and/or condition) of the car. The fuzzy analysis is discussed elsewhere in this disclosure. We do not know the exact details of the car, for example, the options or extra features on the car. Thus, we probably get a range of values for the car (to include various options or features).
Updating Information:
History and the results of the same or similar questions asked or searched earlier by others can be stored by the search engine company (or others) on different repositories for fast retrieval or updates. Some questions have answers which are time-dependent, such as the value of a dollar with respect to Euro's, which changes every day or every hour. Sonic answers do not change that much (or not at all). For example, the capital of France is Paris, and it probably does not change very often or very soon. Or, (2+2) is always 4 (in conventional mathematics). So, one can separate these questions into at least 7 categories (which is a fuzzy concept by itself, with assigned percentages being approximate fuzzy ranges of numbers, as well). It can also be defined as a crisp range. One example is: <ul id="ul0053" list-style="none"><li id="ul0053-0001" num="0000"><ul id="ul0054" list-style="none"><li id="ul0054-0001" num="1414">Things that never change. (about 0%)</li><li id="ul0054-0002" num="1415">Things that rarely change. (about 1-10 percent)</li><li id="ul0054-0003" num="1416">Things that seldom change. (about 10-25 percent)</li><li id="ul0054-0004" num="1417">Things that sometimes change. (about 25-75 percent)</li><li id="ul0054-0005" num="1418">Things that often change. (about 75-90 percent)</li><li id="ul0054-0006" num="1419">Things that usually change. (about 90-99 percent)</li><li id="ul0054-0007" num="1420">Things that always change. (about 100 percent)</li></ul></li></ul>
The classification above is shown in system of <figref idref="DRAWINGS">FIG. 67</figref>, using a classifier module with fuzzy rules, and then updating (and looping back) the information and the assignment of the storages (to put the new data into different repositories, if applicable), for faster future search and access. In the figure, we have N temporary storage classes and one permanent storage class, based on how often they are changing, based on the corresponding fuzzy rules and predictions. The N temporary storage classes have different access time and delays (and different priorities for access), based on how often they are changing or accessed. For example, generally, temporary storages of class-1-type in the figure have the fastest access, search, and retrieval times (if all other things being equal).
For example, in one embodiment, one can store the corresponding history and past answers in repositories which have different purposes, such as “long term repository” or “daily repository”. The “daily repository” is updated on a daily basis or very often. In addition, an unreliable otherwise “long term” answer (with low score or low membership value, in terms of reliability) will still be stored in a “daily repository”, because it should probably be changed or updated soon. Thus, fuzzy concepts determine where we put or access the prior results or history of prior searches. In addition, generally, all things being equal, a “daily repository” has a faster access or update time, because it is used more often by the search engine, as the short term repository or database.
In addition, as an off-line mode, one can do batch processing in advance on future anticipated searches that are common or possible, based on some “possibility” degree (which is fuzzy value by itself), to store the information in repositories for future fast access, without too much (or not at all) processing delay. The repositories are classified based on topics they carry information for (on a fuzzy set basis). See <figref idref="DRAWINGS">FIG. 84</figref> for a diagram of such system.
Also, there are some dynamic assignment and updates as to where information is stored (or be restored), for faster access, because some topics or subjects may become very much searched for in a specific period of time or on a temporary basis (e.g. political candidates' names are generally searched very often just before the elections, and the search will go down drastically tight after the election). The predictor engine (which predicts or stores such trends or patterns) and assignor engine or module (which assigns or re-assigns the storage location) periodically re-evaluate and re-assign the repository locations for various subjects and topics, to be more efficient, for search and access the data. The prediction, assignment, and topics themselves are all based on fuzzy concepts and fuzzy sets. See <figref idref="DRAWINGS">FIG. 84</figref> for a diagram of such system.
Furthermore, some repositories are assigned as intermediary repository, as a hierarchical structure or tree configuration, to access certain data faster. Alternatively, the data can be split up and stored in pieces for faster search or access, in a distributed fashion, due to the size of the files or the purpose of the files. For example, title, text, video, and sound related to a movie can be split and stored separately, in separate databases, servers, or repositories, where just the titles are stored in a specific server for fast access and search (by title only). Then, after the title searches are complete (with low overhead) and a specific title is selected, the pieces or components of the movie can be retrieved from various locations. For some applications, this increases the efficiency of the search engine. The classification of purposes or tasks to assign various repositories (by itself) is a fuzzy concept, with fuzzy set(s) and membership function(s), (These were addressed elsewhere in this disclosure.) See <figref idref="DRAWINGS">FIG. 84</figref> for a diagram of such system.
In one embodiment, to answer the question “What is the price of Mary's house?”, one tries to start from “Mary” and get to “her (Mary's) house price”. But, one does not know at the beginning that which subjects are relevant and how relevant they are. For example, is the price of her car relevant? Or, is the price of her dad's house relevant information? Or, is the address of her dad's house relevant information? What is the relevancy and to what degree? Is there any general rule or relationship connecting the 2 concepts? Is there any specific rule or relationship (just for Mary) connecting the 2 concepts? If so, what is the rule or relationship connecting the 2 concepts? Should we search for the other concepts and at what length or at what expense? Now, we address the above questions.
The computational expense is generally in terms of search time and computing expenses, e.g. using total CPU power by many servers or a server farm (e.g. using the unit FLOPS (or flops or flop/s) for floating-point operations per second, as a measure of a computer's performance), to justify or gauge how far we should search for a concept, as a fuzzy limit or threshold, to stop or limit the searches. Generally, the more relevant the subject (which is a fuzzy parameter by itself), the more computational expense or time is justified, allowed, or allocated for searching that subject or topic (i.e. the threshold for how long we can search for that subject is higher).
The relevance is generally not known at the beginning. So, the system guesses the best it can, and if during the search steps is proven otherwise, the relevance factor is re-adjusted accordingly (going up and down, based on the observations, performances, and satisfaction of the goals or scores, on the first search cycle). For example, the system may guess a few subjects that may be somewhat relevant to Mary's house price, but it is not sure about them. Based on the specific initial knowledge base from Mary and the general knowledge base from the Universe (all other available data), the system prioritizes those guesses and assigns some scores to those possible subjects (so that the relative or absolute computational times are determined and limited for those subjects or topics), using fuzzy rules for relevance scoring, described elsewhere in this disclosure.
Let's assume for this example that “the address of Mary's dad's house” is set as relevant (with a high degree of relevance, which is a fuzzy parameter). Then, the system tries to step forward from both sides to reach each other. This approach is similar to digging a tunnel in a big mountain, from both sides of the mountain, but without the exact GPS information, trying to get to the other side, simultaneously digging and stepping forward from both sides, using the best guesses and knowledge available for the best direction for digging (which is the same as guessing the relevance of the next step or subject, and choosing the most relevant subject(s), in the chain of relevancy, as accurate as possible, with the current knowledge we have so far, to minimize the computational power needed to get to the result (to the other side of the tunnel)). For example, now, we have “the address of Mary's dad's house”, and from that, we want to get to “Mary's house price”. In the next step, if we assume that “Mary's house address” is relevant to the context of this problem, then we have the following situation:
We now have “Mary's house address”, and from that, we want to get to “the address of Mary's dad's house”. Now, we look at the rules in our universe of rules storage, and we find that there is a strong correlation (which is another fuzzy parameter) between the address of a person and her parents, in terms of street address proximity, neighborhood, city, or zip code. So, we now can connect the two sides. That is, we can connect “Mary's house address” with “the address of Mary's dad's house”. That is, from the address of her dad, we can choose the best address(es) for her house, from all possible choices so far, that “fits the best” with her dad's address (with a higher correlation factor). So, we can narrow down or pinpoint her address(es) (or choices of her addresses).
In addition, if we are dealing with 2 or more topics or subjects simultaneously, we can get to her address from 2 or more directions, adding more confidence to the final result (of her address). For example, using “her income” to get to “her address”, in addition to the above, we will probably get more confidence on her address, at the end.
The system described above is shown in <figref idref="DRAWINGS">FIG. 68</figref>, with numbers 1, 2, 3, and 4 indicating the sequence of steps of getting the 2 sides (i.e. the subjects “Mary's name” and “the price of Mary's house”) approaching each other gradually, by finding the relevant information in-between in the next step, by using fuzzy analysis. Of course, in some other examples, we may need more steps in-between to connect the 2 sides together (which translates to more computing expense and power). The “Mary's income” also helps to find or ascertain the right address for Mary's home (number 5 in 68). Then, the final result for Mary's home address is fed into the search engine again, to find the price of her house (as her address is the most relevant information for indicating her house value) (number 6 in <figref idref="DRAWINGS">FIG. 68</figref>). Then, the result of the search engine would be the value of her house.
In one embodiment, to answer the question “How old is Mary?”, we are looking for relevant answers (or information, subjects, or topics) and relevant questions. If the relevant information is not readily obvious or available, we can generalize and expand the scope of the topics, to try to fish or search for new topics under the larger new scope. For example, here, we have: (Mary/age?), which can be generalized to a larger scope as: (human/age?), which (in turn) relates to (human/country of residence) & (human/gender) & (human/type of job). Therefore, we have increased our choices of relevant topics or subjects to: “country of residence”, “gender”, and “type of job”, which were not obvious at the beginning of the analysis. Thus, we can follow those leads, for topics for the search engine, to find the possible ages (or range of ages) for Mary. This is shown in <figref idref="DRAWINGS">FIG. 69</figref>, where topic generalization is used to increase the scope, to find leads to better topics for the next cycle of search engine, to have a more accurate search result for the original topic or query.
In one embodiment, one gets to the answer's) by following multiple paths, starting from the question template, working toward the possible answer(s). In one embodiment, users can give feedback or score answers or paths traversed, for better future path selections. See <figref idref="DRAWINGS">FIG. 83</figref> for a diagram of such system.
In one embodiment, the relationships stay the same, but the inputs may constantly change, resulting in a dynamic (constantly-changing) output. For example, Gross Domestic Product (GDP) of a country and the population of a country (the inputs) constantly change. So, GDP per capita (the output) also constantly changes, but the relationship between GDP, population of the country, and GDP per capita of the country (the relationship between inputs and output) never changes. Therefore, the relationships or parameters that remain constant are stored in different repositories (compared to those of the dynamic parameters), and are accessed without any updating or verification in the future. For example, the formula for GDP per capita is always the same, for the same country or other countries, and it does not have to he updated or reviewed again, making access to that parameter or relationship much faster and less costly for the search engine. The most common or most used parameters, relationships, definitions, or topics are stored in separate repositories, which are grouped and sub-grouped in different classes and categories according to their topics, in a tree-structure or hierarchical form, for faster and easier access by the search engine. In one embodiment, the grouping is done based on fuzzy definitions and sets/subsets. See <figref idref="DRAWINGS">FIG. 82</figref> for a diagram of such system.
In one embodiment, the same information may have various representations with different levels of details: L<sub>1</sub>, L<sub>2</sub>, . . . L<sub>N</sub>, where L<sub>1</sub><L<sub>2</sub><. . . <L<sub>N</sub>, in term of “level of details”. So, we can store them in different repositories, available for different searches. Search and access to L<sub>1 </sub>is much faster than those of L<sub>N </sub>(which carries more details). Based on the application, if it is determined that there is no need for details of L<sub>N</sub>, one can choose a version with lower amount of details, such as L<sub>1 </sub>or L<sub>2</sub>. An example for this situation is when an image or picture is stored at different resolutions (with different sizes) at different repositories. Or, another example is when a table (or spreadsheet or database) is stored, with various sections or columns are hidden or disabled (and not stored), so that different versions of the table (with different sizes and details) are stored in different locations or repositories, and each version of the table may fit or serve different types of user, application, need, search, or query. The level of details can be expressed (by the user) as a fuzzy parameter, for the original file or data. See <figref idref="DRAWINGS">FIG. 81</figref> for a diagram of such system.
In one embodiment, there are 2 types of information (static and dynamic) which yield the same result(s). For example, for Mary's age, one can store the information as “39 years old” (dynamic information, which changes every year). Or alternatively, one can store that same information as her exact birth date, as an equivalent data, which is always static (not changing). The second method or type (static information)) is more useful for the future referrals. For example, once the today's date is known, the birth date is always useful (and complete information) to calculate the age of a person, whereas the age number or value (from an unknown number of years ago) (by itself) is much less useful (and less complete, to calculate the age of the person). Thus, one can store the static information separate from the dynamic information, as they are accessed differently, with different priorities, access frequencies, and degree of “usefulness” (which can be expressed by fuzzy concepts), to optimize the search engine, especially for future searches on similar topics. See <figref idref="DRAWINGS">FIG. 81</figref> for a diagram of such system.
Familiar or Famous Names or Titles:
In one embodiment, famous names and titles are stored and indexed or ranked separately, for fast and efficient access, e.g. Eiffel Tower, Clinton (referring to the former US President Clinton), Paris (referring to Paris, France), or The US President. There are 2 types of famous names and titles. The first type has a single choice only, with no ambiguity (e.g. Eiffel Tower), but the second type has more than 1 choices, with some degree of ambiguity (or membership value). For example, we have more than one city in the world called Paris, and Paris is also the name of a person, as well as the name of a Las Vegas hotel and casino. However, “Paris” by itself (without any context) most likely means “Paris, the capital city in France”, as our first choice. Other choices can be ranked as a list (with some membership value), but the ranking can be changed based on the context, e.g. prior sentences, history, background, speaker, audience, or the location of the conversation. In addition, in one embodiment, the 1<sup>st </sup>and 2<sup>nd </sup>types are separately stored and listed, to streamline the process, for more efficient search engine access. See <figref idref="DRAWINGS">FIG. 80</figref> for a diagram of such system.
In one embodiment, some titles are placeholders, e.g. The President of the United States, which is expected to have possibly different values every few years, which should be checked and updated, according to that time periodicity, e.g. every 4 years, starting from an election year in US. This means that some repositories are tagged and treated that way, for optimum performance, e.g. more accuracy and less frequency of updating of the data (or less required computing power or expense). See 80 for a diagram of such system.
In one embodiment, there are the accuracy factor and reliability factor involved in the search engine, in addition to the cost factor for computing power (used so far, for the search engine). That is, there is a threshold as to how much accuracy we need for the result (which could be a fuzzy parameter itself). As an example, we may need to find (and search for) the diameter of the planet Earth to 10 km accuracy (rather than 100 km accuracy). Thus, we generally have to do more search to get that much confidence or accuracy (with enough reliability) (i.e. for 10 km accuracy (rather than 100 km accuracy)). Another example is to find the value of real number “e” to 5 decimal point accuracy (rather than, for example, 2 decimal point accuracy). There is also a threshold as to how much computing time or money we want to spend on this search, which means that how bad we want the answer, and how long we are willing to (or allowed to) spend on this search. Thus, accuracy, reliability, confidence, and cost are some of the factors that determine the scope and depth of each search. All of these factors can be expressed as the fuzzy concepts, as explained elsewhere in this disclosure. See <figref idref="DRAWINGS">FIG. 80</figref> for a diagram of such system.
In one embodiment, storing the prior results or calculations (or intermediate results), especially when they are requested multiple times or very often by other users or the same user, increases the efficiency of searching same or similar terms or topics in the future, similar to the way humans gain experience, learn, and store information, for future recollection. The storage and recollection of the prior information is done in multiple steps. First, the information is scanned or parsed (e.g. a birthday event for a person) for its parameters and characteristics (e.g. cake shape, cake taste, birthday song, colorful hat, friends present, and gifts received). Then, it is tagged or indexed based on those parameters and characteristics (e.g. song, cake, taste, shape, hat, gift, friend, human, and food). Then, it is stored based on the tags or indexes in proper repositories. There are multiple classes of repositories, e.g. in terms of short-term and long-term, e.g. for frequency of access or access speed for retrieval (or access speed for editing and updating information already stored). So, there is a processor or controller which makes that classification (which can be fuzzy, as well), for proper storage. See <figref idref="DRAWINGS">FIG. 79</figref> for a diagram of such system.
Then, there is an association tag or pointer that points the subject to another similar subject (e.g. with a similarity degree, being expressed as a fuzzy concept, as well). For example, the taste of the cake (being a chocolate cake) is a reminder of the other subjects or topics, e.g. “chocolate” or “hot cocoa”. Thus, it would point to “chocolate” or “hot cocoa”, or both, with a pointer(s). In one embodiment, the association pointers can point to other subject pointers, as N cascaded or chain of pointers in series (or combination of series and parallel configurations), where N is an integer bigger or equal to one. In one embodiment, the links in the chain have different (non-uniform) strength, indicating the different degrees of associations between pair of chained subjects. In one embodiment, the association is among M subjects, where M is bigger than 2, e.g. 3 subjects, which are all related to each other. See <figref idref="DRAWINGS">FIG. 78</figref> for a diagram of such system.
In one embodiment, the association can be with an event, such as “cake dropping on the curtain”. Thus, it points to the subject “curtain” or “stain” (which in turn points to “circular marking” and “circle”). One way for recollection is to store the links or end of the links (or pointers or pointed subjects), and follow the chain or link backward or forward to get the result from either sides, or even start from the middle of the chain and continue in one direction, to recover or find the original subject. So, each subject can trigger another one through the chain sequence. See <figref idref="DRAWINGS">FIG. 78</figref> for a diagram of such system.
In one embodiment, for long term storage, one puts the information or chain of associations as a whole (or broken into some components or parts, or even sampled e.g. every other subject in the chain, to store less data, as a lossy storage, to save storage space) into long tern) repositories (for not-frequent access or not-in-near-future access). Note that for the recollection of the broken data or lossy storages, one requires some computing power to reconstruct the lost links later on (by associating pointers), to reassemble the jigsaw puzzle, as the original chain. See <figref idref="DRAWINGS">FIG. 78</figref> for a diagram of such system.
In one embodiment, when parsing sentences using our methods described here in this disclosure, to search for a more accurate meaning, among possible meanings, especially in a specific context, we can narrow down the choices or targets, as a whole sentence, because the possibility of adjacent two or more words to have a coherent meaning or consistent interpretation eliminates most of the initial individual possibilities for a single word, when presented as a sequence of words in a specific order (or chain of pointers between words).
Note that a human brain carries information and memories as encoded patterns of neural firings.
In one embodiment, the system (of our invention) stores the information for our search engine in the distributed memory repositories. In one embodiment, the links or pointers between subjects get deleted, by the system, if the pointers or links are not used for a long time, to recycle the released memory, as available, for future use. For example, periodically, the system checks for unused links that are idle for a long time (a fuzzy variable), to release the memory location (and break the link or pointer), if applicable.
In one embodiment, the links or pointers between subjects have various weights. That is, the links are not uniform in strength. Or, the link between two subjects is not binary (e.g. “linked” or “not-linked”). For example, the link strength can be expressed as a real number between 0 and 1. The higher the value of the link strength, the more correlation exists (or more correspondence) between the two subjects. Variable strength link between two subjects can also be expressed in the fuzzy domain, e.g. as: very strong link, strong link, medium link, and weak link, as shown in <figref idref="DRAWINGS">FIG. 71</figref>, for link strength membership function. The value of link strength helps the search engine follows the right direction (or link or pointer), in terms of finding the best solution or answer.
In one embodiment, social network sites provide feedback of the users and connectivity between users as an indication of the trend or pattern of society, groups, or individuals, with respect to different subjects, such as taste in music, marketing directions, or political opinions. Thus, they are good databases for data mining. Tweeted subjects (on Tweeter feed traffic monitoring module) can also be studied and classified to find patterns and extract data, for marketing and political purposes, e.g. as to who may become the next president of the United States, e.g. by counting or getting the frequency of a name or subject at a specific time. See <figref idref="DRAWINGS">FIG. 77</figref> for a diagram of such system.
In one embodiment, one can use the search engine to predict the price of airline ticket for next vacation for next month, or find the current best price or option available (or best travel plan), considering the travel constraints or rules that we impose. In one embodiment, the search engine can also be used to find the best route to drive home from airport, considering the rules and conditions, with traffic constraints or how much gas we have, to minimize the driving time (as an example). In one embodiment, the price of a company's stock or average group of stocks is predicted for next month, or the best stock value is distinguished, among many companies, based on the rules and constraints about their products and the industry, using fuzzy analysis, explained elsewhere in this disclosure. See <figref idref="DRAWINGS">FIG. 76</figref> for a diagram of such system.
In one embodiment, the search engine displays the source of the information for the user, e.g. “Wall Street Journal”, as the added value for the search result, which accompanies the credibility of the source, e.g. as a fuzzy parameter. In one embodiment, the search engine focuses on web sites to return personalized results, based on previous browsing habits of the user. In one embodiment, the user inputs personal information to customize the search results or help the search engine go to the right or more relevant direction, with respect to the user's preferences, taste, or parameters. For example, knowing that the user lives in San Francisco or vicinity area (in Calif., USA) (as her resident address, as one input by the user, through the user interface module), the search for “football team” yields “The San Francisco 49ers” (which is a professional American football team based in San Francisco, Calif.), and this result has a higher ranking or score than another American football team in another city, and this result also has a higher ranking or score than a soccer team in San Francisco, Calif. (because “football” (generally, in US) refers to the “American football”, not “soccer”). This means that the meanings of the words are clarified and set based on the context and background information, e.g. user's information or preferences, such as address, zip code, ethnicity, religious, weight, height, age, gender, job, income, political affiliations, college degree, food preferences, health information, marriage status, type of car, or the like. See <figref idref="DRAWINGS">FIG. 75</figref> for a diagram of such system.
Similarly, in one embodiment, the prior queries help customize the search result for future queries. Other factors can be how many times or how often a user (for example) searches for food or nutritional facts, and how long the users spend on a web site related to the food. This interest in food-related subjects makes “food” a more relevant subject for that user for future, to be a factor for relevance determination of other subjects in the search. In one embodiment, the user allows that the search engine tracks her usage and habits or patterns, from the user-input module, e.g. through the menu on screen, for privacy level settings, which can also be another fuzzy parameter. See <figref idref="DRAWINGS">FIG. 75</figref> for a diagram of such system.
In one embodiment, the search engine tracks the music, books, movies, and videos that the user downloads, buys, rents, listens, watches, or looks at. In one embodiment, the search engine tracks the user's emails and the patterns related to the emails or SMS, e.g. the recipients, how often sent, what time of day sent or received, any attachments to the email, what type of attachments to the email (type of file, e.g. PEG or PDF), size of the file of the attachment or the email, or the like. All of the above parameters indicating the degrees or quality can also be expressed as fuzzy parameters. In one embodiment, the search engine has a user-interface or GUI (graphical user interface) for the user inputs, with scaling or sliding bars, knobs, or selectors. See <figref idref="DRAWINGS">FIG. 75</figref> for a diagram of such system.
In one embodiment, the search engine or a software agent/bot goes into email list or friends list, and find who may be, e.g., Chinese, from the possible cultural signatures or names or last names or other tags or info about that person, to guess the origin of that person, to gather all of those people automatically under one group name (which alternatively can be tagged manually), where it can use the compiled list to invite all of those friends automatically for the Chinese New Year party, by calendar date trigger automatically, one week before the event, as an example, or send an email to all of those to congratulate/send good wishes for the Chinese New Year, or do a voice mail or do a jingle or slogan or music or poem or short message, by sound, text, video, multimedia, video, image, or the like.
In one embodiment, the search engine connects to the modules for controlling ads, coupons, discounts, gifts, or filters for web sites (e.g. filters deleting specific web sites for children, from the search results). In one embodiment, the search engine rewards the user on points for discounts for purchases or coupons, in exchange for giving up some privacy, for personal information input by the user. In one embodiment, the search engine is self-customized engine or module that can be embedded on a web site. In one embodiment, the search engine helps the ads targeting a user, based on personal information, such as birth date, e.g. for gift suggestions, or statistics or biometric-driven, such as user's height or user's household's income percentage, with respect to those of national average or median. See <figref idref="DRAWINGS">FIG. 75</figref> for a diagram of such system.
In one embodiment, the user specifies her purpose of the search, e.g. medical, business, personal, or the like. For example, searching for a hotel yields different results for a business trip (near convention center or downtown), versus for a vacation trip (near the beach or amusement park). In addition, for example, specifying the accompanying persons can modify the search results. For example, having kids with the user during a vacation trip tilts or focuses the search results toward the vacations, hotels, or cruises that are tailored to families and kids (family-friendly or oriented), whose information can be extracted from the tags or scores supplied by the hotel itself or its web site, e.g. meta-tags or metadata, or from the tags or scores supplied by other users, or from the text comments or feedback by other users about their experiences with that hotel. See <figref idref="DRAWINGS">FIG. 74</figref> for a diagram of such system.
In one embodiment, the user asks a question, and the search engine first determines the language of the question (e.g. by parsing the sentence or question), or the user herself supplies the information about the language, e.g. French. The search can be focused on web sites in French language (e.g. using the metadata or flags from the web site), or search any web site, depending on the user's or default settings for the search engine. In one embodiment, the search is on one or more of the following formats (and the search results are also in one or more of the following formats): text, web sites, links, email s, video, images, line drawings, paintings, satellite images, camera images, pictures, human pictures, music, blogs, HTML, PDF, sound, multimedia, movies, databases, spread sheets, structured data, slides, or the like (or a combination of the above), per user's setting or default. See <figref idref="DRAWINGS">FIG. 74</figref> for a diagram of such system.
In one embodiment, the search engine is queryless, i.e. with no questions at all, but the search engine provides or suggests some subjects or topics automatically, sua sponte, based on the history and user's preferences or prior user's feedback. In one embodiment, the tagging, scoring, and feedback can also come from friends, social network, other users, similar users, club members, or co-workers, e.g. using bookmarks, links, and shared searches, presented, displayed, or forwarded to others. In one embodiment, there is a biometrics or security module associated with the circle of friends or social network, to protect the shared information, against unauthorized or free access or hacking. See <figref idref="DRAWINGS">FIG. 74</figref> for a diagram of such system.
In one embodiment, the search engine and corresponding natural language parsing and processing are tailored toward the specific application or industry, e.g. telecommunication, stock trading, economy, medical diagnosis, IP (intellectual property), patent, or claim analysis or valuation, company valuation, medical knowledge, and the like. For example, a lot of abbreviations and words have very specific meanings in a specific technology, context, or industry, which may be very different in other contexts or environments, causing uncertainty or misleading search results or language construction or interpretations. For example, “IP” means “Internet protocol” in telecom industry, but it means “intellectual property” in patent-related businesses. To minimize those negative effects, the user specifies the industry from the beginning. The modules can be trained for various industries, and they can be separately sold or accessed as a service for specific industry. See <figref idref="DRAWINGS">FIG. 73</figref> for a diagram of such system.
In one embodiment, using common rules for grammar and syntax for a specific language for sentence structure (and corresponding exceptions to those rules), the search engine parses and dissects the sentence (as explained elsewhere in this disclosure) and applies dictionaries (in different categories, such as medical dictionaries) and thesaurus (or phrase books or glossaries or idiom or phrase or dialect listings) to find or interpret the meaning of the words, phrases, and sentences, e.g. to convert them into codes, templates, abbreviations, machine codes, instructions, text, printout, voice, sound, translation, script, or computer commands, to process further, if needed. See <figref idref="DRAWINGS">FIG. 72</figref> for a diagram of such system.
In one embodiment, the synonyms module, spell check module, antonyms module, and variation or equivalent word module are all part of a search engine, to help find similar words and concepts, or parse the sentences. In one embodiment, for analytics, the search engine includes summarization module and clustering module, to group the data in sets for systematic analysis, such as based on N-dimensional feature space for components of a word or phrase, based on all the possibilities for basic components, partial words, or letters in a given language (as a dictionary for all possible basic word components in a given language, with all connecting possibilities with other neighboring components, which is held in a database(s) or relational databases, and can be updated and improved by users periodically as feedback, or by machine or processor, automatically, with a training module, such as a neural network). <figref idref="DRAWINGS">FIG. 111</figref> is an example of a system described above.
In one embodiment, social bookmarking, tagging, page ranks, number of visitors per month, number of unique visitors per month, number of repeat visitors per month, number of new visitors per month, frequency and length of visits for a given web site or web page, number of “likes” or “dislikes” feedback for a site or topic from users, and number of links actually requested or existing for a web site, as absolute or relative numbers, or as a rate of change (first derivative) of the parameter, are all parts of the search engine analytics, for finding the more relevant search results, with respect to a specific user or general public users. In one embodiment, tagging and user comments are done as an annotation to search results, as an extra layer. In one embodiment, what other people, users, or friends have done is displayed or suggested to the user, e.g. actions performed or web sites visited or items purchased. <figref idref="DRAWINGS">FIG. 111</figref> is an example of a system described above.
In one embodiment, a search is personalized or customized using the position or role of a person in an organization, e.g. CEO of a company, with her parameters pre-set as a generic CEO, and can be further defined based on specific personality of the CEO, by herself, in such a way that a new CEO does not have to change the pre-set generic or basic part of the profile, making the transitions much smoother for a new CEO. The role-based model can be combined with the concept of inherency, so that a class of roles or positions can be defined categorically (only once, in a very efficient way), and then, subclasses may have extra features, conditions, or constraints on top of those of the corresponding class. <figref idref="DRAWINGS">FIG. 111</figref> is an example of a system described above.
In one embodiment, live search is conducted using human experts as helpers, to guide the searches in a general direction by input phrases or feedbacks, in a limited scope, interactively with machine or computer. This is useful for a new field, in which not much information is accumulated in the databases, and most of the information is in the head of the human experts at this early stage. In addition, the user base and number of queries are manageable (small enough) with a few experts on line. This is not scalable or cost effective for large user base or databases, with too many queries to handle by human interventions. <figref idref="DRAWINGS">FIG. 111</figref> is an example of a system described above.
Pattern Recognition:
In one embodiment, the images are searched for specific color or patterns or shapes, e.g. for houses or clothing, to match a target or find one similar to a target, based on the features defined in feature space, such as stripes patterns, color red, circles, dot patterns, trapezoid shape, or the like, as a pattern recognition module, looking for degree of similarity, e.g. as a fuzzy parameter, for real estate agents to search databases and sell houses or for department stores or store web sites to sell clothing to potential customers. This is also useful for analyzing and classifying Facebook® and photo album sites, e.g. for face or iris recognition, e.g. to identify, track, or classify people or objects. This is also useful for the security purposes on Internet or by cameras at the airports or buildings. <figref idref="DRAWINGS">FIG. 112</figref> is an example of a system described above.
In one embodiment, the video is searched, using still images, motion vectors, and difference frames, e.g. to find a car or face in the video, to find the speed of the car from the location of the car in different frames, or to recognize a person in the video, using face, iris, or eye recognition (or other biometrics), or target tracking objects in video frames to get other identification parameters or features from the video. This is also useful for analyzing and classifying YouTube or movie repositories or music videos, e.g. to find or track people, subjects, objects, topics, or songs. <figref idref="DRAWINGS">FIG. 112</figref> is an example of a system described above.
In one embodiment, the video track and sound track from a movie can be separately analyzed, for various sound and video recognitions, such as spotting some sound signatures or sequence of notes, indicating an event or music, or using voice or speaker recognition (as explained elsewhere in this disclosure), to find or recognize a person and tag or classify the track or movie. In one embodiment, the recognition engines or search engines from different tracks are combined or compared with each other, to get a better result, with more confidence, faster. <figref idref="DRAWINGS">FIG. 112</figref> is an example of a system described above.
In one embodiment, the maps or road maps are scanned and analyzed to get (for example) geographical or residential information, for civilian or military purposes, e.g. for market search or business intelligence gathering. Markings, captions, scales, symbols, and names on the maps are recognized by OCR or pattern recognition module, to interpret the maps and find people and locations of interest. For satellite images, the objects have to be recognized, first (by object or pattern recognition module), as what they are, and then they can be categorized or classified (by tags or flags), with comments, text, or identifiers superimposed or attached to the image file. Object recognition with possibility of choices is expressed in fuzzy system, with membership values, e.g. recognizing an object as a bus or truck in a satellite image.
In one embodiment, Wikipedia and other encyclopedia or informational sites are referred to by the search engine for search on the topics they carry. In one embodiment, the search engine categorizes as how often a web site should be reviewed or searched based on how often it gets updated (in average), how relevant is the web site for our topic of search, and how reliable is the source of the web site. For example, the more often it gets updated and the more relevant and reliable the web site, the more often the search engine would check the web site for updates and new information, to search and extract data. In one embodiment, the search engine tracks and analyzes the web site traffic, for patterns and information about the web site, including for the web site reliability analysis. <figref idref="DRAWINGS">FIG. 113</figref> is an example of a system described above.
In one embodiment, all the units of weight, length, and the like, with the corresponding conversion factors are stored in a database, for example, to convert “meter” to “foot”, for unit of length. The physical constants and physical, chemical, or mathematical formulas or facts (e.g. as relationships or numbers), such as speed of light or formula for velocity in terms of distance and time, are also stored in corresponding databases or tables, for easy and fast access for the search engine, e.g. with a hierarchical indexing structure or relational database(s). Alternatively, the search engine can refer to reliable web sites with similar information, for search and extraction of data.
In one embodiment, the components (such as text, video, and sound track in a movie data) are separated and searched separately, on an optimized and dedicated search engine for that format of data. See <figref idref="DRAWINGS">FIG. 84</figref> for such a system. In one embodiment, all the components are searched using the same (or generic) search engine (not optimized for any specific data format). In one embodiment, the results of all components are combined to make a better overall result. In one embodiment, the results for each component are reported separately. In one embodiment, the processors are processing the results in parallel. In one embodiment, the processors are processing the results in series.
In one embodiment, the system uses the tags or comments written by various users, or searches and parses those comments to dissect or convert them to the individual tags. (The example or method of parsing of a sentence or phrase is given in another part of the current disclosure.) This way, the collection of knowledge or intelligence of many users and people are combined to find a better or faster match(es) for the search. One example is the pictures tagged by the users, which are searchable in different databases, to find a correspondences or likelihood of relationship between one name and multiple pictures. <figref idref="DRAWINGS">FIG. 114</figref> is an example of a system described above.
On the first cycle, the fuzzy classifier module or device classifies or separates different pictures into clusters or groups in N-dimensional feature space. For example, it uses facial features and parameters or biometrics, e.g. the approximate length of the nose, or ratio of width of the nose to length of the nose (as a dimensionless number or normalized parameter), or other features related to iris or eye recognition. This corresponds to multiple individuals having the same exact or similar name. Please note that “similar name” is a fuzzy concept, by itself, with its own membership function value. <figref idref="DRAWINGS">FIG. 114</figref> is an example of a system described above.
On the second cycle, it further distinguishes between or finds pictures of the same person in different ages or in different forms or settings (such as with dark eyeglasses, or wearing fake or real beard or mustache, or wearing scarf), which as the first filtering pass or cycle, it may look or get classified as a different person. One way to find the right person is the use of biometrics parameters, such as eye and nose, that “usually” do not change by age “that much” for the same person. Please note that “usually” and “that much” are also fuzzy parameters and concepts, by themselves. The other way is the correspondence of the date that the picture was tagged or posted, which may correspond to the date of the original picture, or equivalently, to the age of the person in the picture (or the year the picture was originally taken or captured). The other way is the comments or text or tags by the users that accompany the pictures, which collectively give probability or correlation for the identification of such person. The other way is the correspondence of the item of clothing (or attached objects, external items, context, environment, or surrounding), e.g. wearing the same or “similar” shirt or neck tie in 2 different pictures. Note that “similar” is another fuzzy parameter here. <figref idref="DRAWINGS">FIG. 114</figref> is an example of a system described above.
Even, more general is the correspondence of the preferences or characteristics of the person, as a collection or set of parameters. For example, for a person living near the beach in Florida (e.g. a Miami Beach address as residential address), the system expects higher probability of casual dressing, bathing suit, sun glasses, and tropical trees appearing in the picture. So, those features appearing in a picture (e.g. casual dressing, bathing suit, sun glasses, and tropical trees) favors or increases the probability of a person with Miami zip code or address (or a person on vacation near beach), for identification purposes of a person in a picture, instead of a person with an Alaska address (or a person with no travel habits or history in tropical or beach areas). <figref idref="DRAWINGS">FIG. 114</figref> is an example of a system described above.
Another example is that if a lady has many pictures with a red dress (or striped T-shirt or particular hat or design or designer or signature or pattern or style or brand or trademark or logo or symbol, e.g. a Polo shirt with its logo on it), the system can assume that the person has a lot of red dresses or prefer the color red for dress or shoes or car. Or, the red color preference is obtained from the user herself or her friends' input, as preference or history files (or based on a detective work file, by a third party, or by a software agent searching all over Internet for a person's personal data, or by marketing databases from a Ma.cy's department store, based on past behavior or purchases, as her file history). Thus, if a person is sitting in a red car or wearing red shoes, in a picture or a video, it has a higher probability to be the person in question, based on her past or characteristic files, for identification or recognition purposes, e.g. for searching through Internet or databases to find all pictures or videos related to a name or a person. <figref idref="DRAWINGS">FIG. 114</figref> is an example of a system described above.
The recognition of a pattern, color, person, face, logo, and text, including OCR (optical character recognition), is generally done by dissecting the image or video into pieces and components (including motion vectors for video, to track the objects, between the frames, as the difference between the neighboring frames) to find features or objects, and from the parameters associated with those features and objects, e.g. geometrical lengths or ratios or angles, the system finds or guesses the identity of those features or objects, based on some certainty factor or membership value (which is a fuzzy parameter). For an object with images captured from multiple angles, the data can be more useful, as it gives the information on 3-D (dimensional) object or depth, for better recognition.
For a pattern recognition module, we have an image analyzing system, e.g. as shown in <figref idref="DRAWINGS">FIG. 85</figref>, with image acquisition and preprocessing modules, followed by segmentation module and description module, and ended with interpretation and recognition modules, with all modules interacting with the knowledge base databases. To recognize pattern or pattern class, using features or descriptors, based on pattern vectors, strings, or trees, the system measures the parameters (e.g. length of nose, ratio of iris width to the nose length, or angle between two curves or strikes in a letter of handwriting or signature, e.g. using the pixels of an image), and plots them as points in the N-dimensional feature space. Clusters of points around or close to letter “a” specification and parameters, as an example, are recognized as potential candidates for letter “a”. For example, a letter may be recognized as 0.80 “a” and 0.05 “e”. This can be expressed as membership values, as well, which is a fuzzy parameter.
In one embodiment, a decision or discriminant function (an N-dimensional pattern vector) is used, to find the pattern class memberships and the fuzzy decision boundaries between different classes. For matching, in one embodiment, the system uses a minimum distance classifier, with each pattern class being represented by a prototype or mean vector, P:
<br />P=(1/N) Σ X<sub>i </sub>
where N is the number of pattern vectors, and X is a pattern vector.
Then, the Euclidean distance to determine the closeness is determined as, D:
<br /><i>D=∥ X</i><sub>i</sub><i>−P∥</i>
where
<br />∥<i>K</i>∥=(<i>K</i><sup>T</sup><i>K</i>)<sup>0.5 </sup>(It is the Euclidean Norm.)
The matching can be done by correlation, C, as well, between A and B, in another embodiment:
<br /><i>C </i>(<i>x, y</i>)=Σ<sub>g </sub>Σ<sub>h </sub><i>A </i>(<i>g, h</i>) <i>B</i>(<i>g</i>-<i>x, h</i>-<i>y</i>)
The correlation function may be normalized for amplitude, using correlation coefficient (e.g. for changes in size or rotation).
In one embodiment, an optimum statistical classifier is used. In one embodiment, a Bayes classifier is used, to minimize the total average loss (due to incorrect decisions), e.g. for the ones used for Gaussian pattern classes. In one embodiment, a perceptron for 2-pattern classes is used. In one embodiment, the least mean square (LMS) delta rule for training perceptrons is used, to minimize the error between the actual response and the desired response (for the training purposes). <figref idref="DRAWINGS">FIG. 115</figref> is an example of a system described above.
In one embodiment, a multi-layer feed-forward neural network is used. In one embodiment, the training is done by back propagation, using the total squared error between the actual responses and desired responses for the nodes in the output layer. In one embodiment, the decision surfaces consisting of intersecting hyperplanes are implemented using a 3-layer network. <figref idref="DRAWINGS">FIG. 115</figref> is an example of a system described above.
In one embodiment, for pattern recognition, the system uses the structural methods, to find the structural and geometrical relationship for a pattern shape, using a degree of similarity, which is associated with a membership value, which is a fuzzy parameter. In one embodiment, a shape number is defined for the degree of similarity. In one embodiment, a four-directional chain code is used to describe the shape. The distance between 2. shapes is expressed as the inverse of their degree of similarity. So, for the identical shapes, the distance between the shapes is zero, and their degree of similarity is infinite. In one embodiment, for shapes, the system uses similarity tree and similarity matrix to evaluate the degree of similarity, which can be expressed as a membership function, which is a fuzzy parameter. <figref idref="DRAWINGS">FIG. 115</figref> is an example of a system described above.
In one embodiment, for shapes, the region boundaries is coded as strings, with the number of symbols matching as an indication of the degree of similarity. In one embodiment, for shapes, polygonal approximations are used to define different object classes. In one embodiment, a syntactic method is used to recognize the patterns. The system uses a set of pattern primitives, a set of rules (grammar) for their interconnections, and a recognizer with the structure defined by the grammar. The regions and objects are expressed based on strings, using primitive elements. The grammar is a set of rules of syntax, which governs the generation of sentences from the symbols of the alphabets. The set of sentences produces a language, which represents pattern classes. <figref idref="DRAWINGS">FIG. 115</figref> is an example of a system described above.
In one embodiment, we represent the string grammar as a 4-tuple, (A, B, C, D), for the strings, with e.g. A, B, C, and D representing non-terminals (a set of variables), terminals (a set of constants), the starting symbol, and a set of rules, respectively. Then, objects or shapes can be expressed mathematically, by first conversion into its skeleton (using image processing on pixel level, for example, to thin down the image to get the line structure shape), followed by primitive representation (for example, basic structure or geometrical shapes, from database, to replace the skeleton), followed by structure generated by regular string grammar (to resemble the original shape, region, or figure). String recognizers can be represented using nodes and arrow connectors between the nodes in a graphical manner, similar to a state diagram. <figref idref="DRAWINGS">FIG. 116</figref> is an example of a system described above.
In one embodiment, the string grammar can be extended or generalized into the tree grammar, for syntactic recognition of the trees, using a 5-tuple, (A, B, C, D, E), with E representing a ranking function to represent the number of direct descendants of a node with a label which is terminal in the grammar. Again, objects or shapes can be expressed mathematically, by first conversion into its skeleton (using image processing on pixel level, for example, to thin down the image to get the line structure shape), followed by primitive representation, using a tree grammar, to resemble the original shape, region, or figure. Selection of the primitives in this case is based on the membership values, and thus, it is a fuzzy parameter.
For recognition, the system deals with various knowledge base databases: procedural knowledge (e.g. for selection of parameters and procedures), visual knowledge (e.g. angle of illumination, producing shadow and other visual effects), and world knowledge (for relationships between objects, e.g. in an image of a car, the system expects to find or detect one or more tires under the car, if it is visible in that perspective), which sets the expectation in an image for higher validation, consistency, and accuracy. For example, for the world knowledge, the fact that “Cars usually have 4 tires.” can be expressed as follows:
[OWNERSHIP (car, tire, 4), USUALLY]
Or, it can be rewritten as:
OWNERSHIP (car, tire, at least 1)
Or, it can be expressed as: (“For all” cars, “there exists” one tire):
OWNERSHIP (∀ car, ∃ tire)
These statements can be combined with others using logical or relationship operators, e.g. AND, OR, NOT, XOR, and IF-THEN statement (rules). Using the rules and relations, the system performs inference or deduction, using an inference module or deduction engine or device. The term USUALLY adds the Z-number to the statement of the world knowledge. Thus, if the system detects an oval or circular object in the image under the body of the car structure image object, then that may be a tire of the car. The tire detection can be expressed based on membership values, which is a fuzzy parameter.
In one embodiment, semantic networks are used, with nodes representing objects and the arrows representing the relationships between the objects. For example, for the example given above regarding “a car having a tire”, one node is CAR, and the second node is TIRE, with an arrow connecting the node CAR to the node TIRE, representing OWNERSHIP relationship between the 2 nodes.
Another example is the application of the position of two objects with respect to each other. For example, for a statement of “a car located above a tire”, one node is CAR, and the second node is TIRE, with an arrow connecting the node CAR to the node TIRE, representing ABOVE (positional) relationship between the 2 nodes, representing the 2 objects CAR and TIRE. The knowledge of the possibility of the existence and position of a tire in the image of a car helps the identification of the objects in the image (more accurately and faster). In addition, if the system is given another fact or statement that “A tire has a star-shaped rim.”, then if a star-shaped object is detected in the middle of the object of TIRE in the car image, then that star-shaped object may be the rim for the tire of the car. <figref idref="DRAWINGS">FIG. 86</figref> shows such an example. Thus, the relationship between the objects can be cascaded and expanded this way, so that the detection of the objects gets easier or better, especially if one object is detected already, or if the detection of the first object has to be confirmed or verified by other objects in the image.
The above example also works for facial features, e.g. for iris, face, or identity of a person recognition, in which there is a relationship between relative size and position of different components of eye or face of a human. The above example also works for spelling or word recognition (e.g. OCR) and voice recognition, in which there is a relationship between different sounds or letters that make up a word or sentence, for a given grammar and language, e.g. American English, in terms of sequence of the letters that make up a word or phrase or written sentence, or sequence of sound bites or tones or notes or frequencies that make up a speech or voice or spoken sentence. So, for all of the above, the relationship or relative position of one object or feature with respect to another is known, which helps the detection and recognition (or verification and confirmation) of all features and patterns in the image or in any other media.
In one example, if the comment or tag for a picture refers to “The last 4 of July with Clinton in the office”. After dissecting, parsing, and analyzing the statement (as described elsewhere in this disclosure), for a user in the United States of America (context-specific for the user), the phrases “4<sup>th </sup>of July” and “Clinton in the office” is probably a reference to “the former President Bill Clinton, of the United States of America” (based on the correlation of the words or concepts, or combination of the words, or order of the words in a phrase). The last 4<sup>1 </sup>of July of President Bill Clinton's presidency (from the historical facts and databases, available to the search engine) is Jul. 4, 2000. Thus, the picture is tagged by a statement which refers to the date of Jul. 4, 2000. Having a date associated with a picture or piece of data usually helps to find the owner of the picture or identity of the objects in the picture or things associated with the picture (based on correlation, association, or probability), e.g. the identity of the person(s) in the picture. Note that the dates associated with a picture may generally be multi-valued, fuzzy, a range, or approximation date(s). <figref idref="DRAWINGS">FIG. 110</figref> is an example of a system described above.
Note that in the example above, “Clinton” (extracted from the sentence and distinguished as a possible given name or family name) is already stored in a database for the famous names or people, with the following ranking order: (1) President Bill Clinton (as the more probable candidate); (2) Secretary of State Hillary Clinton; and so on. If there is no other supporting information available, the system tries the choices from the highest to the lowest. For the first choice (President Clinton), the “office” refers to the “White House” or “presidency”. In fact, the generic or common words in a language may have a specific meaning or different meaning, once it gets associated with another word, concept, context, or environment (e.g. politics, versus medical field). Thus, once a context is set or determined (such as politics or politicians), the specific database(s) for that specific context is activated or referred to, instead of the general or generic databases, to find the more exact or better meaning of the words or phrases. This is shown in <figref idref="DRAWINGS">FIG. 87</figref>, as an example.
In an example, one name is very similar to another name in spelling or sound. Thus, during typing or conversion from sound to the text, the spelling may come out differently. In addition, names in different scripts such as Arabic, Persian, or Chinese may end up differently during conversion to the English or Latin script or alphabets. This uncertainty of the sound or spelling is captured in a database for a variation of a name or word, as possible candidates with different membership values, which is a fuzzy parameter. The database can be filled up and corrected by the users in a community of users. Another way is to have candidates for a partial word or sound, e.g. as the most common mistakes or errors, e.g. to find the final word with the correlation analysis, e.g. based on the scoring the combinations, and maximizing the score of the combination for all candidates. In an example, the partial word candidates are stored separately. <figref idref="DRAWINGS">FIG. 117</figref> is an example of a system described above.
One example of the common mistakes is from the proximity of the letters on the typical keyboard, e.g. Qwerty keyboard, e.g. with R and T in the close proximity, making it likely for a person to type R, instead of T, e.g. typing RANK, instead of TANK (or typing TTANK, instead of TANK). In the cases that the mistaken word has a meaning, the mistake cannot be found by the spell check alone, and it can only be found through context analysis, e.g. for the phrase “water tank on the roof”, it would be understood by the system that the phrase “water rank on the roof” is just a typo or misspell, because the second phrase does not have a proper meaning. <figref idref="DRAWINGS">FIG. 117</figref> is an example of a system described above.
Once the flag is raised about the improper meaning or misspell in the recognition system, one of the tests that the system does is to try and test similar words or phrases with similar sound or spelling, e.g. testing neighboring keys on the keyboard for possible mistakes, by replacing them in the suspected word, to see if any of the results has a proper meaning. Then, the system ranks the results, and it marks the result that has the highest score in the context of the phrase or sentence, for possible candidate for the original (correct) word. <figref idref="DRAWINGS">FIG. 88</figref> shows an example of such system. The databases of similar spellings and sounds are routinely updated by the feedback from the users' community or group or by the administrator.
To analyze a phrase or sentence, in one embodiment, the system looks at adjectives or related words, e.g. “water tank”. For example, for “tank”, when used as a word equivalent to a “container” (which can be extracted from the context, from neighboring words or paragraphs), it logically can hold some objects, especially fluids, e.g. gas, liquid, water, nitrogen, and liquid nitrogen. Thus, one can combine them this way, as a template:
[FLUID+tank]
Or:
[tank of +FLUID]
One can store these templates (and any exception to the templates) in multiple databases, which can be categorized and separated based on their topics and usages, in a hierarchical or tree or pyramid structure, with inherency property, e.g. parent nodes and children nodes.
This can be done with adjectives, as well, for example, “big” in the phrase “big tank”, which is expressed as a template:
[ADJECTIVE+tank]
Now, when we are scanning the sentences or phrases, we are using (searching for) the stored or pre-recorded templates in databases or storages, to find the patterns mandated by a template. Once a template is found (to match the pattern of a given sentence or phrase), the system can understand the meaning of that section of the text, phrase, or sentence. Then, it can understand the meaning of the whole sentence or phrase through the combinations or series of templates that construct those phrases and sentences (for a given language, based on the collection of the grammar templates (along with their exceptions or special usages)).
For another example of “a tank on the roof”, the system will have the following template:
[tank+roof+RELATIONSHIP]
Or:
[tank+roof+POSITION WITH RESPECT TO THE OTHER OBJECT]
Or:
[tank+roof+on]
Again, the above templates are categorized and stored accordingly, in various (e.g. tagged) hierarchical storages, files, and databases, for future use by the search engine, to dissect, recognize the patterns and templates, and understand the meaning of the sentence or phrase.
In one embodiment, the range of numbers or values or approximate values or measurement accuracies (e.g. length of the table=(5 meter ±2 centimeter)) are expressed based on fuzzy values. In one embodiment, the dimensions in the image (for recognition purposes) are based on approximation, based on fuzzy values.
In one embodiment, the relationships and templates are based on fuzzy terms, with membership values. In one embodiment, the relationships and templates (or grammar) are based on Z-numbers, with terms such as “USUALLY”, expressing concepts such as certainty for the relationships, templates, and grammar.
Multi-Step Recognition:
In one embodiment, the recognition (such as image recognition) is done in multiple steps. For example, for signature recognition, in one embodiment, first, we have a coarse recognition. Then, if the first step of the recognition shows a match possibility, then the system performs the second step of medium recognition. Then, if the second step of the recognition shows a match possibility, then the system performs the third step of fine recognition. Then, if the third step of the recognition shows a match possibility, then the system indicates a match, with corresponding membership value, which is a fuzzy concept. This is a much more efficient method of recognition for most samples and environments (instead of a one-step recognition method). See <figref idref="DRAWINGS">FIG. 89</figref> for such a system.
For example, for the signature recognition, the first step is the envelop analysis, which is the step of finding the general shape of the signature, and doing the first comparison, to obtain a first degree of match, which is a coarse analysis, as shown in <figref idref="DRAWINGS">FIG. 90</figref>. Then, the second step, the medium recognition, is to find the center of mass for the signature, based on the pixel values and pixel density on the image, to use a weighted average of the pixels, to calculate the center of the mass (coordinate) for the signature (as an object), denoted as (X<sub>c</sub>, Y<sub>c</sub>), on both X-Y axes, for horizontal and vertical axes, for 2-dimensional image coordinates, with X and Y coordinates (as shown in <figref idref="DRAWINGS">FIG. 91</figref>):
<br /><i>X</i><sub>c</sub>=(Σ<sub>i</sub><i>K</i><sub>i</sub><i>X</i><sub>i</sub>)/(<i>N</i>(Σ<sub>i</sub><i>K</i><sub>i</sub>))
where K<sub>i </sub>is the weight, value, or intensity for the pixel or image element, and N is an integer denoting the number of pixels, with i as a running variable (an integer, for the summation).
Similarly, for the Y coordinate, we have:
<br /><i>Y</i><sub>c</sub>=(Σ<sub>i</sub><i>K</i><sub>i</sub><i>Y</i><sub>i</sub>)/(<i>N</i>(Σ<sub>i</sub><i>K</i><sub>i</sub>))
This is followed by a second comparison, to obtain a second degree of match, which is a medium degree analysis. Then, the third step, the fine recognition, is to find and compare all pieces of curves and concave and convex shapes in the signature, and map them to an alphabet or dictionary of all typical pieces of curves (cusps or arcs in various shapes, with various angles, ratios, and. lengths, and various number of curve or line crossings or loops) and concave and convex shapes (stored in a databases or storage), to convert them in the new language of codes or symbols whose sequence resembles the signature form and shape (as shown in <figref idref="DRAWINGS">FIG. 92</figref>), as much as possible, with corresponding membership values for matching degrees, which is a fuzzy parameter. Once two shapes are in the symbolic or coded form, the comparison and degree of similarity can be done mathematically, based on the number of symbolic matches and degree of symbolic matches.
In one embodiment, a statement describes an event or object, such as a signature's shape, with a qualification of e.g. USUALLY, in the statement, which is a Z-number parameter. Thus, a signature is expressed based on the Z-number.
Context:
The context, for example, can be tagged by the user, or voted by community, or based on history, habit of the user, use of other words, keywords as a flag, or proximity of the words, or any combination of the above. The context (as an attribute) is also a fuzzy parameter, with membership values. One method of measuring the context (C) is based on the word or letter distance (e.g. number of words or letters or paragraphs or pages or chapters or minutes or seconds, as physical distance in between 2 specific words or as the temporal distance or frequency or period between the usage of 2 specific words), or D, which can be expressed, for example, as:
<br /><i>C</i>=1<i>/D </i>
This means that the closer or shorter the distance, the higher the degree of context or related concept between 2 words or phrases or concepts. Or, in general, it can be written as some dimensionless numbers:
<br /><i>C</i>=(<i>K</i><sub>1</sub><i>/D</i>)+<i>K</i><sub>2 </sub>
where K<sub>1 </sub>and K<sub>2 </sub>are some constants or coefficients.
Or, in another embodiment, we have:
<br /><i>C</i>=exp (−<i>D/D</i><sub>0</sub>)
where D<sub>0 </sub>is some constant or coefficient.
In one embodiment, one adds a constant D<sub>1 </sub>to the equation above:
<br /><i>C</i>=exp (−<i>D/D</i><sub>0</sub>)+<i>D</i><sub>1 </sub>
The context helps us understand that, for example, the word TANK in an article about military budget (as context) refers to a military hardware with engine (that moves on the ground during the war or military exercise). However, in a plumbing magazine, the word TANK refers to a water or fluid tank, as a container. The frequency counter or histogram (e.g. how many times the word MILITARY appears in the article or magazine) and other similar parameters are attached or tagged to the article or file, as a property or attribute.
Contrast:
In one embodiment, the recognition is based on the parameters representing contrast. For example, in an image, a black line in a drawing is detected based on the contrast between neighboring pixels, e.g. black pixels on a line in a white background. For example, the contrast is described as the difference between intensities or grey scale values or values from 2 neighboring pixels, image units, or data units (e.g. in a sequence of data) (or any other form similar to that):
<br />Contrast=Δ<i>X/X</i>=((<i>X</i><sub>2</sub><i>X</i><sub>1</sub>)/((<i>X</i><sub>2</sub><i>+X</i><sub>1</sub>)/2))
Thus, the system analyzes the contrast, as a method of the detection of patterns and features, for recognition of objects or features, e.g. face recognition or voice recognition, which uses pixel intensity contrast or sound frequency (and amplitude) contrast, respectively.
In one embodiment, the search engine works on music or sound or speech or talking pieces or notes, to find or match or compare, for taped e-books, text-to-voice conversions, people's speech, notes, music, sound effects, sound sources, ring tones, movie's music, or the like, e.g. to find a specific corresponding music title or movie title, by just humming or whistling the sound (or imitate the music or notes by mouth, or tapping or beating the table with band), as the input. The output is all the similar sounds or sequence of notes that resemble the input, extracted and searched from Internet or a music or sound repository. See <figref idref="DRAWINGS">FIG. 107</figref> for such a system, with a conversion or normalization of a music piece to a sound bite, based on a dictionary or library, e.g. a piece such as “BE-BE-BA-BO BE-BE-BA-BO”, with each of BE, BA, and BO representing a sound unit or symbol or alphabet or note or frequency or pitch in the dictionary, and each “-” representing a unit of time or time delay or pause between different notes or sound pieces or sound units.
In one embodiment, the text or speech has content with more than one language. Thus, it has to be distinguished and separated into pieces, first, before it can be further processed for each language separately, as described elsewhere in this disclosure. <figref idref="DRAWINGS">FIG. 118</figref> is an example of a system described above.
Body Language, Expressions, or Emotions:
In one embodiment, the patterns or sequences of sign language or hand movements or eye or lip or facial or foot or body expressions can be recognized, for emotion recognition or translated or converted to text expressions. In one embodiment, the sensors or tags are attached to the body of the user (e.g. the hand of a user), to record movements and positions of a hand with respect to multiple fixed points or coordinates (with beacons or detectors or signal sources) in the room, so that the movements can be recorded and then later interpreted as emotions (e.g. anger) or expressions, such as sentences, data, commands, sequence of information, or signal, e.g. to be converted. to text or voice or computer code or instructions, for a person or computer to receive. <figref idref="DRAWINGS">FIG. 118</figref> is an example of a system described above.
For example, this can be used for hands-free navigation of an aircraft by a pilot, using commands, translated based on her body or facial movements or gestures or shapes, e.g. capturing position of facial features, tracking the features, and speed of movements, based on the typical templates of a face or a hand, in a database, to interpret hand signals (e.g. position of fingers with respect to each other, e.g. to indicate that “The package was received.”) or facial definitions or expressions or signals (e.g. position or angle of nose, lips, eye lid, eye, and eye brows, e.g. indicating anger or smile), or based on templates from a specific user for hand or facial gestures. The commands or codes or transcripts or instructions can be fed into a computer or device for a specific action or result. The pattern recognition (described elsewhere in this disclosure) is used to find or interpret the hand or facial signals or data. The interpretations may be not-definite and has a membership value, which is a fuzzy parameter. <figref idref="DRAWINGS">FIG. 118</figref> is an example of a system described above.
In one embodiment, the search is done on multimedia or movies or videos, with text, tags, and sound track associated with it, which can correlate each findings or recognitions from different components of the multimedia, for more accurate overall combined recognition process. In one embodiment, if a piece of a video or the whole video is repeated, similar, or exact copy, to save the storage space (e.g. for video archiving or referencing purposes), depending on the degree of similarity and degree of importance of the video for the user, which are fuzzy parameters, the system may eliminate full or partial data from the video storage(s). For example, for a video with the subject classified as “not-important”, a second video with the same exact data can be deleted, by the policy enforcer module or device, as there is no need for a backup data, based on the pre-set policy in a database, with thresholds and fuzzy parameters or rules, as explained elsewhere in this disclosure.
This method can be used, for example, for minimizing the size of repository needed for video storage web sites (e.g. YouTube.com), or similarly, for emails or attachments carrying the same or similar content or information, e.g. to open up space and delete the duplicative data or files, on a computer or hard drive or server or memory device(s), for faster data management or faster search through that data.
Rules Engine, Filter/Test and Join Networks:
An embodiment implements a rules engine based using Z-valuation or fuzzy maps. In one embodiment, a set of rules are analyzed and the constituents of the antecedent part of the rules are determined, in order to determine pattern in the antecedent parts among rules. This approach helps dealing with many rules in a system where similar antecedent parts appear within different rules. In this approach, the redundancy in evaluating antecedent parts is eliminated/reduced and the temporal issues and inconsistent evaluations of the same parts in different rules are prevented. In one embodiment, a pattern network nodes based on rules' antecedents is setup, e.g., by filtering the variable attributes used in rules' antecedents. In one embodiment, multiple fact patterns satisfy/trigger/fire the same rule. In one embodiment, the facts or propositions are propagated through a pattern network, and a link or a copy of the fact/proposition (or a part thereof) is associated to a pattern node (or added to an associated list/table) along with a truth value indicating how well the fact satisfies the patter/test/filter associated with the pattern node. For example, if a pattern associated with a pattern node is (X is A) and the fact propagated is (X is B), then the truth value is determined, for example, based on max-min approach (i.e., maximum, for all x, of minimum of μ<sub>A</sub>(x) and μ<sub>B</sub>(x)). In one embodiment, a join network comprises of join nodes based on antecedents of rules to determine the fact patterns satisfying the antecedents. In one embodiment, the list of facts/working memory from pattern network nodes are joined with other lists of facts/working memory from nodes of pattern network of join network, in order to build up the antecedent or parts of antecedent of each rule, at each node of join network. In one embodiment, the joining is performed via a binding variable in both lists being joined. In one embodiment, the truth value associated with the joined record is determined by the truth values of the joining records and the type of the join. For example, in a conjunctive join the truth value of the joined record is determined as minimum of the truth values of the joining records. In one embodiment, the truth value associated with the joined record is also based on the binding variable matching from records of the lists being joined. For example, in one embodiment, where the binding variable has a fuzzy value in one or both lists, the threshold for binding records from the lists (e.g., in equality test of binding variable) or associated truth value based on the binding is determined based on a max-min approach. For example, if the binding variable has fuzzy values A and B in two lists being joined, then the threshold or binding truth value is determined by maximum, for all x, of minimum of μ<sub>A</sub>(x) and μ<sub>B</sub>(x). For example, if the binding variable has fuzzy values A and crisp value b in two lists being joined, then the threshold or binding truth value is similarly determined as μ<sub>A</sub>(b).
To illustrate an embodiment, suppose the following example of facts provided to the rules engine or inference engine.
Rob is Vera's son.
Alice is Vera's daughter.
Vera is a woman.
Rob's age is mid twenties.
Alice's age is mid thirties.
Alice is young (with low confidence in accuracy of speaker).
Also, suppose there is a rule indicating:
If a woman is middle-age then <some consequent>. The facts are presented in a protoform and relationships are setup (e.g., in database or linked memory), as for example, depicted in <figref idref="DRAWINGS">FIG. 120(<i>a</i>)</figref>:
Son(Vera) is Rob.
Daughter(Vera) is Alice.
Gender Vera is female.
Age(Rob) is *25.
Age(Alice) is *35.
With the rule antecedent being:
(Age(<var1>) is middle-age) and (Gender(<var1>) is female).
In one embodiment, based on the existing attributes and relationships (e.g., age, son, daughter) other attributes and relationships are extracted from an attribute/relationship database based on context and existing attributes. For example, a reciprocity relationship is queried and results are used to expand the relationship between the objects or records. For example, relationships “son” and “daughter” result in the reciprocal relationships “parent” or “mother” or “father” (depending the gender of the parent). In one embodiment, the reciprocal relationships per object/record relationship is further filtered based on the existing attributes of the object/'records. For example, reciprocal relationship “father” is filtered, while reciprocal relationship “mother” is kept, based on the value of the gender attribute of object/record “Vera” where the queried relationships “son” and “daughter” are based. In one embodiment, consequential attributes are determined, e.g., by querying an attribute/relationship database. For example, the consequential attribute query of “son” (to “Rob”) results in consequential attribute for “Gender” with value of “male” to object/record “Rob”. Similarly, the consequential attribute query for “daughter” (to “Alice”) results in consequential attribute of “Gender” with value of “female” to object/record “Alice”.
In one embodiment, synonym/linked attributes are queried, and the results are instantiated as supplemental relationships between the objects/records. For example, a query for “son” or “daughter” results in relationship “child”, and in an embodiment, a supplemental “child” relationship between the records “Vera” and “Alice” is instantiated. Similarly, in one embodiment, “parent” relationship from between “Rob” (or “Alice”) to “Vera” is instantiated (not shown in figures), based on equivalence/superset to the corresponding “mother” relationship/attribute.
In one embodiment, additional relationships (e.g., “brother” and “sister” between “Alice” and “Rob” (not depicted in figures)), are determined from knowledge base, by matching a set of related object/attributes to a set of general rule(s) for expanding relations/attributes. For example, in one embodiment, the following rules in knowledge base
parent(<var1>) EQUAL parent(<var2>) <ul id="ul0055" list-style="none"><li id="ul0055-0001" num="0000"><ul id="ul0056" list-style="none"><li id="ul0056-0001" num="1565">THEN Bi_Direction_Relation(<var1>, <var2>, Sibling);</li></ul></li></ul>
IF Sibling(<var1>, <var2>) AND Gender((<var1>) is Male <ul id="ul0057" list-style="none"><li id="ul0057-0001" num="0000"><ul id="ul0058" list-style="none"><li id="ul0058-0001" num="1567">THEN Relation_To(<var2>, <var1>, Brother)</li></ul></li></ul>
IF Sibling(<var1>, <var2>) AND Gender((<var1>) is Female <ul id="ul0059" list-style="none"><li id="ul0059-0001" num="0000"><ul id="ul0060" list-style="none"><li id="ul0060-0001" num="1569">THEN Relation_To(<var2>, <var1>, Sister);</li></ul></li></ul>
when binding with object/records “Alice” and “Rob”, results in bi-directional Sibling attribute/relationship between “Rob” and “Alice”, directional “Sister” and “Brother” attribute/relationship and/or protoforms.
In one embodiment, parallel/suggestive attributes are queried, e.g., from an attribute/relationship database. For example, a parallel/suggestive query for “Age” attribute, results in attribute “Birth”. In one embodiment, a template set of attributes/relationship is determined based on the result of such query. For example, along with attribute event “Birth”, other related attributes, e.g., “Time” and “Place” related to “Birth” are returned as set/template for application and instantiation. For example, such template is applied to objects/records “Vera”, “Rob”, and “Alice”, e.g., based on their existing attribute “Age”. In one embodiment, the instantiation of template results in separate records and relationships for each instance. A template may include a class level attribute with instantiation at the class level. In one embodiment, the expanded attributes/relationships are supplemented to the relationships and records, e.g., in database. In one embodiment, a protoform of the existing attributes/relationships are instantiated and/or linked to the objects/records, as for example, depicted in <figref idref="DRAWINGS">FIG. 120(<i>b</i>)</figref> (in dotted lines):
Mother(Rob) is Vera.
Mother(Alice) is Vera.
Child(Vera) is Rob.
Child(Vera) is Alice.
Gender(Rob) is male.
Gender(Alice) is female.
In one embodiment, placeholder objects/records or protoform fragments are instantiated, Birth(Alice), Time(Birth(Alice)), Place(Birth(Alice)), Birth(Rob), Time(Birth(Rob)), Place(Birth(Rob)), Birth(Vera), Time(Birth(Vera)), and Place(Birth(Vera)). In one embodiment, such fragments or placeholder/records/objects are used to further discover relationships and potential joins.
In one embodiment, a query (e.g., an iterative query) is made to expand the facts and related rules from the knowledgebase. For example, a query into the attributes and records results in the following attributes (as depicted in <figref idref="DRAWINGS">FIG. 120(<i>c</i>)</figref>): “Age”, “Mother”, “Birth”, “Time”, etc. In one embodiment, a query using the attributes in a knowledgebase (e.g., database) results in related (e.g., via tags or relevance factors) general facts or relationship, e.g., in Z-valuation form. For example, as depicted in <figref idref="DRAWINGS">FIG. 120(<i>c</i>)</figref>, a general fact is returned indicating “Most likely, the age of mothers when giving birth is between about twenty to about forty years old.” Or in a protoform, such statement/fact may appear as:
G1: Age(Mother(<var1>), at time(birth(<var1>))) is range[*20, *40], most likely.
In this example, <var1.>is indicative of instantiation point or join potential.
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 120(<i>c</i>)</figref>, a query (e.g., contextual) is made in a knowledge base, e.g., to extract general relationship used to extend the existing facts and relationship and/or provide relationships (e.g., aggregate functions) between related entities or classes of objects/record types. For example, as depicted in <figref idref="DRAWINGS">FIG. 120(<i>c</i>)</figref>, the following facts/'functions/'piles resulted from query:
F1: Age(<var1>, at present (DEFAULT)) is <ul id="ul0061" list-style="none"><li id="ul0061-0001" num="0000"><ul id="ul0062" list-style="none"><li id="ul0062-0001" num="1584">Age(<var1>, at time(<var2>))+Elapsed(time(<var2>), present (DEFAULT));</li></ul></li></ul>
F2: Age(<var1>, at time(birth(<var1>))) is 0;
F3: IF time(<var2>) is before(time(birth(<var1>))) <ul id="ul0063" list-style="none"><li id="ul0063-0001" num="0000"><ul id="ul0064" list-style="none"><li id="ul0064-0001" num="1587">THEN (Age((var1>, at time(<var2>)) is UNDEFINED;</li></ul></li></ul>
F4: IF time(<var2>) is after(time(death(<var1.>))) <ul id="ul0065" list-style="none"><li id="ul0065-0001" num="0000"><ul id="ul0066" list-style="none"><li id="ul0066-0001" num="1589">THEN (Age(<var1>, at time(<var2>)) is UNDEFINED;</li></ul></li></ul>
In one embodiment, the contextual facts/functions are provided as template/set to supplement via instantiation and/or used in bind/join operation. In one embodiment, such instantiation further extends the attributes related to records/objects, as for example depicted in <figref idref="DRAWINGS">FIG. 120(<i>d</i>)</figref> in dotted lines, expanding “Elapsed” attribute/function on “Time” attribute, i.e., on “Time(Birth(Vera))”, “Time(Birth(Rob))”, and “Time(Birth(Alice))”.
In one embodiment, to efficiently match the facts and rules, a network (e.g., linked) of objects/attributes/filters and a network of join lists are setup. For example, based on the protoform and attributes list of objects/working memory elements are determined and associated with such attributes or protoforms. For example, protoform “Age(Mother(<var1>))” in G1 has a potential match with “Rob” or “Alice” when binding to <var1>, where as “Time(Birth(<var1>))” has potential match with “Rob”, “Alice”, or “Vera”, based on existing records/objects. Joining based on the common value, i.e., by enforcing the consistency of <var1>(e.g., via a database join operation with WHERE clause of JOIN or SELECT statement), results in joining on records “Rob” and “Alice”. In one embodiment, the instantiations of general facts/functions result in additional elements or attributes (e.g., as described above for “Elapse”), in a backward chaining method. For example, in one embodiment, the following function/record/relationship is instantiated, based on F 1, via binding of <var1> with “Vera” (having an attribute “Age”) and binding of <var2>with “Birth(Rob)” event/record (having an attribute “time”):
Age(Vera) is Age(Vera, at time(Birth(Rob))) +Elapsed e(Birth(Rob)));
Similarly, the following is instantiated, in an example:
Age(Vera) is Age(Vera, at time(Birth(Alice))) Elapsed(time(Birth(Alice)));
In one embodiment, an instantiation results in further supplement of attributes for objects/records, e.g., by scanning the form of the template with binding values and linking to the existing object if it already exists (e.g., Age(Vera)) or instantiating additional attribute/object if not existing (e.g., Elapsed(time(Birth(Rob))) or Elapsed(time(Birth(Alice)))) as for example, depicted in <figref idref="DRAWINGS">FIG. 120(<i>d</i>)</figref> (in dotted lines).
In one embodiment, the instantiation of the general facts or functions result in further facts that act as functions or facts bridging or aggregating other facts. For example, instantiation of G1, based in binding <var1> with “Rob” and “Alice” due to matching/filtering protoforms (“Age(Mother( ))” and “time(birth( ))”) and joining the result consistent with <var1>, results in
Age(Mother(Ripb), at time(birth(Rob))) is range[*20, *40], most likely.
Age(Mother(Alice), at time(birth(Alice))) is range[*20, *40], most likely.
In one embodiment, protoforms are resolved based on one-to-one or many-to-one type relationships. For example, Mother(Rob) is resolved to Vera or refers to the same record/object. Similarly, Mother(Alice) is resolved to Vera:
Age(Vera, at time(birth(Ripb))) is range[*20, *40], most likely.
Age(Vera, at time(birth(Alice))) is range[*20, 40], most likely.
Note that the instantiation of Fl results in additional combinations when joining the list based on common attributes/protoforms. For example, binding of <var1> with “Vera”, “Alice”, and “Rob” (having an attribute “Age”) and binding of <var2>with “Birth(Vera)”, “Birth(Alice)”, and “Birth(Rob)” event/record (having an attribute “time”), creates 9 Cartesian combinations (two mentioned above), e.g.:
Age(Vera) is Age(Vera, at time(Birth(Vera.)))+Elapsed(time(Birth(Vera)),
Age(Vera) is Age(Vera, at time(Birth(Alice)))+Elapsed(time(Birth(Alice));
Age(Vera) is Age(Vera, at time(Birth(Rob)))+Elapsed(time(Birth(Rob));
Age(Alice) is Age(Alice, at time(Birth(Vera)))+.Elapsed(time(Birth(Vera));
Age(Alice) is Age(Alice, at time(Birth(Alice)))+Elapsed(time(Birth(Alice));
Age(Alice) is Age(Alice, at time(Birth(Rob)))+Elapsed(time(Birth(Rob));
Age(Rob) is Age(Rob, at time(Birth(Vera)))+Elapsed(time(Birth(Vera));
Age(Rob) is Age(Rob, at time(Birth(Alice)))+Elapsed(time(Birth(Alice));
Age(Rob) is Age(Rob, at time(Birth(Rob)))+Elapsed(time(Birth(Rob));
In one embodiment, the instantiation of other general facts/rules is used to simplify or evaluate the other facts or relations, e.g., by evaluating or substituting the prototype fragments. For example, instantiating F2 by binding <var1> with “Vera”, “Alice”, and “Rob” (having an attributes “Age” and “time(birth( ))”) results in the followings:
Age(Vera, at time(birth(Vera))) is 0;
Age(Alice, at time(birth(Alice))) is 0;
Age(Rob, at time(birth(Rob))) is 0;
In one embodiment, the relationships are partially or iteratively evaluated, e.g., by simplifying the protoforms by substitution or by creating relationships. For example, based on instantiation of F2, several of F1 instances become:
Age(Vera) is Elapsed(time(Birth(Vera));
Age(Alice) is Elapsed(time(Birth(Alice));
Age(Rob) is Elapsed(time(Birth(Rob));
In an embodiment, additional relationships/attributes are made between records/objects based on the evaluations. For example, as depicted in <figref idref="DRAWINGS">FIG. 120(<i>e</i>)</figref> in dotted lines, “identity”/“same” type relationship is made between Elapsed(time(Birth(Rob)) and Age(Rob) records/objects.
In one embodiment, such simplification is done at the template/class/general functions/rule level. For example, in one embodiment, general facts are joined via binding variables having common attributes. For example, general facts F1 and F2 are joined based on F1:<var2>and F2:birth(<var1>) both having “time( )” attribute, resulting in a general fact that:
F1′: Age(<var1>, at present (default)) is Elapsed(time(birth(<var1>)), present (default));
In one embodiment, additional general facts are derived based on other facts via a background process. In one embodiment, the additional facts are tested against specific test scenarios for scoring and validations. In one embodiment, additional facts are promoted/tagged as general facts after a validation process and/or passing a validation threshold.
In one embodiment, the instantiation of other general facts/rules is used to filter and trim inapplicable combinations. For example, the instantiation of F3 with binding of <var1> with “Vera”, “Alice”, and “Rob” (having an attribute “time(birth( ))”) and binding of <var2>with “Birth(Vera)”, “Birth(Alice)”, and “Birth(Rob)” event/record (having an attribute “time”), creates 9 Cartesian combinations, including, e.g., “Birth(Vera)” for <var2>and “Rob” for <var1>:
IF time(Birth(Vera)) is before(time(birth(Rob))) <ul id="ul0067" list-style="none"><li id="ul0067-0001" num="0000"><ul id="ul0068" list-style="none"><li id="ul0068-0001" num="1626">THEN (Age(Rob, at time(Birth(Vera))) is UNDEFINED;</li></ul></li></ul>
For example, further evaluation (e.g., in a subsequent cycle or during a instantiation of a general fact by feeding the instance through a filter/test network) of this instance (e.g., using other generalized facts/functions), trims and nullifies the following G1 instance:
Age(Rob) is Age(Rob, at time(Birth(Vera)))+Elapsed(time(Birth(Vera));
given that Age(Rob, at time(Birth(Vera))) is evaluated as UNDEFINED.
Other instances of F1, for example, are further simplified/substituted or used to build further relationships (based on other instantiations of F1), e.g.:
Age(Vera) is Age(Vera, at time(Birth(Alice)))+Age(Alice);
Age(Vera) is Age(Vera, at time(Birth(Rob)))+Age (Rob);
In one embodiment, a candidate generalized fact is generated (e.g., in protoform) based on instantiated/modified facts, e.g., by resolving multiple object references to the same object. For example, in one embodiment, from the above statements, one or more of the following candidate generalized facts are Obtained:
Age(<var1>) is Age(<var1>, at time(Birth(child<var1>)))+Age(child<var1>);
Age(mother(<var1>)) is Age(mother(<var1>), at time(Birth(<var1>)))+Age (<var1>);
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 120(<i>f</i>)</figref>, the valuation of Age(Vera, at time(Birth(Alice))) and Age(Vera, at time(Birth(Alice))) objects/records is of Z-valuation type. An instantiation of such valuation, in one embodiment, sets up a candidate probability or statistical distributions, pi(x) and their corresponding test scores ts<sub>i</sub>. In one embodiment, additional valuations for Age(Vera) is obtained by further valuations of matching instantiated facts/aggregate functions/rules. For example, Age(Vera), in one embodiment, is given two more valuations, Z1 and Z2, based on valuation of above instantiated/simplified statements/aggregate functions. In one embodiment, an aggregate valuation of an object/record (e.g., Age(Vera)) is obtained by further aggregating its multiple valuation (e.g., Z1, Z2, and (Young, Low)). For example, as depicted in <figref idref="DRAWINGS">FIG. 120(<i>g</i>)</figref>, Z1 is obtained by adding Z-valuation (range[*20, *40], most likely) and (mid twenties), and Z2 is obtained by adding Z-valuation (range[*20, *40], most likely) and (mid thirties). In one embodiment, the membership functions of various fuzzy sets/values are determined using knowledge base (e.g., by querying contextual tables/database with records identifying fuzzy sets and modifiers (e.g., “mid-twenties”, “mid-thirties”, “young”, “about”, etc.) and their corresponding attributes such as their membership functions, e.g., in a piecewise format). As depicted for example in <figref idref="DRAWINGS">FIG. 120(<i>g</i>)</figref>, Z1 (A<sub>1</sub>, B<sub>1</sub>) has a membership function for A<sub>1</sub>, obtained, for example, via extension principle or alphα-cuts from the membership functions of μ<sub>Mid-20s </sub>and μ<sub>Ax </sub>(where Ax denotes the fuzzy range [*20, *40]). Similarly, in Z2 (A<sub>2</sub>, B<sub>2</sub>), a membership function for A2 is determined, in one embodiment, from μ<sub>Mid-30s </sub>and μ<sub>Ax</sub>, as depicted in <figref idref="DRAWINGS">FIG. 120(<i>g</i>)</figref>. In one embodiment, the valuation of (Young, Low) is of a fuzzy map A<sub>3</sub>*, given the Low confidence level, e.g., applies to the speaker's confidence/reliability. In one embodiment, the probability distribution test scores are imposed from B<sub>x </sub>to B<sub>1 </sub>and B<sub>2</sub>, for example, B<sub>1 </sub>and B<sub>2 </sub>take on the value of B<sub>x</sub>.
In one embodiment, multiple valuation of a record/object (e.g., Age(Vera)) is aggregated by aggregating test scores related to the valuations. (For example, see more detail in section Scoring with Fuzzy Map and <figref idref="DRAWINGS">FIGS. 125(<i>a</i>)-(<i>b</i>)</figref>). In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 120(<i>h</i>)</figref>, multiple valuations for a record/object (e.g., Z1, Z2, and A3*(valuations of Age(Vera))) are used to determine (an aggregate) test scores or restriction (membership function) for (candidate) probability distribution of the variable representing the record/object (e.g., Vera_Age).
In one embodiment, a set of candidate probability/statistical distribution is instantiated per object/record having Z-valuation, e.g., Age(Vera, at time(Birth(Rob))) and Age(Vera, at time(Birth(Alice))) both valued to (range[*20, *40], most likely), are associated each to a set of probability/statistical distribution candidates. In one embodiment, a set of test scores are associated instantiated per object/record having Z-valuation. In one embodiment, the candidate probability distributions are scored based on facts/rules/functions related to a specific record/object with the resulting test scores associated to the specific corresponding record/object. In one embodiment, the candidate probability distributions are shared by same Z-valuations, while the corresponding test scores are associated to specific records/objects based on the facts/rules/functions related to those specific records/objects. For example, in applying the following fact/function
Age (<var1>) is Age(mother(<var1>))−Age(mother(<var1>), at time(Birth(<var1>)));
to “Rob” and “Alice” by binding to <var1>, aggregate functions affecting Age(Rob) and Age(Alice) are obtained, for example:
Age (Rob) is Age(Vera)−Age(Vera, at time(Birth(Rob)));
Age (Alice) is Age(Vera)−Age(Vera, at time(Birth(Alice)));
For example, in one embodiment, a set of probability distribution candidates are set up for variable representing Age (Rob), and test scores are determined, for example, via Z-valuations imposed via Age(Vera, at time(Birth(Rob))) (i.e., range[20, *40], most likely). Such test scores alone are expected to be the same as those for a set of probability distribution candidates set up for variable representing Age (Alice). However, the application of other facts to the scoring of the probability distributions, in one embodiment, results in different scoring (aggregate) per record/object/variable. For example, facts (Age(Rob) is min-twenties) and (Age(Alice) is mid-thirties) produce different scores for the same set of probability distributions (p<sub>i</sub>), i.e., (p<sub>i</sub>·μ<sub>Mid-20s</sub>) score is in general different from (p<sub>i</sub>·μ<sub>Mid-30s</sub>) score. In one embodiment, the resulting aggregate test scores associated with the candidate probability distributions of the same Z-valuations are different and are associated with specific records/objects Age(Rob) and Age(Alice)).
In one embodiment, as mentioned above, supplemental facts (specific or general) are determined by applying a template for equivalent transformation (e.g., including substitutions) to recognized protoforms. For example, in one embodiment, querying form (A is B+C) in a knowledge database results in a set of equivalent templates including (B is A−C) or (C is A−B). Applying the equivalent forms, for example, by parsing and substitution or reference to objects, generates and expands the facts base or aggregate function sets.
Join Operation:
In one embodiment, the joining of the lists is optimized by using the ordering or indexing on the lists. In one embodiment, the crisp and fuzzy values of X in a list are ordered based on partial ordering [R, ≤], e.g., based on alpha cuts and interval comparison. In one embodiment, as shown in <figref idref="DRAWINGS">FIG. 121(<i>a</i>)</figref>, values of attribute A (column) in a list includes one or more of crisp and/or fuzzy numbers. In one embodiment, the values are identified via an identifier (e.g., a unique ID such as a primary key (PK)) as depicted in <figref idref="DRAWINGS">FIG. 121(<i>a</i>)</figref>, for example, as A<sub>1</sub>, . . . , A<sub>9</sub>. In one embodiment, the ID is a hash key or a sequential counter or an internal counter/ID, e.g., assigned by a database management system (DBMS). In this example, as depicted in <figref idref="DRAWINGS">FIG. 121(<i>a</i>)</figref>, TF (X<sub>1</sub><sub><sub2>s</sub2></sub><sub>,A1</sub>, X<sub>1</sub><sub><sub2>c</sub2></sub><sub>,A1</sub>, X<sub>rc,A1</sub>, X<sub>rs,A1</sub>) represents a trapezoid fuzzy set defined by the left (l) and right (r) of its support (s), and core (c) on x-axis, for fuzzy set identified by A<sub>1</sub>. Similarly, x<sub>A3</sub>, is a value identified by A<sub>3 </sub>for column/attribute A in the list. In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 121(<i>a</i>)</figref>, an index or a sorted list is setup by sorting x values of the crisp number/intervals and corner points of fuzzy sets (e.g., the support and/or core locations). In one embodiment, the sorted list includes a type attribute to indicate the type of the sorted record, e.g., precise value (P), left-support (LS), right-core (RC), etc. as depicted in <figref idref="DRAWINGS">FIG. 121(<i>a</i>)</figref>. In one embodiment, the sorted list has a column/attribute identifying the record ED of the main list, e.g., as a foreign key (FK). In one embodiment, alpha cuts (e.g., at membership function values of 0<sup>+</sup>, 0.5, and 1) are used to get the intervals of the fuzzy sets (e.g., A1 and A2) at those cuts. In one embodiment, the x values of such intervals are sorted in the sorted list. In one embodiment, the type for such x values is indicated as alpha cut and/by its alpha. cut level/indicator, e.g., as an attribute in the sorted list. In one embodiment, left/right points of the cut interval is identified by an attribute, e.g., in the sorted list. In above example, S (support) and C (core) are indicators for special case of alpha cuts at 0<sup>+</sup> and 1. In various embodiments, the indicators may be in one or more attributes/columns and in various forms (such as characters/numbers).
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 121(<i>b</i>)</figref>, two or more lists/tables (e.g., 12105 and 12110) are joined on one or more attributes/variables (e.g., joining on attribute A from 12105 and attribute B from 12110). In one embodiment, a sorted list/index on attribute A (12115) and a sorted list/index on attribute B (12120) are used to make joining the lists more efficient by avoiding full table scan of for one attribute for every record of the other attribute. In this example, the x values (e.g., x<sub>i</sub>, x<sub>j</sub>, x<sub>k</sub>, and x<sub>m</sub>) and y values (e.g., y<sub>a</sub>, y<sub>b</sub>, y<sub>c</sub>, and y<sub>n</sub>) are in same variable domain in which the lists are being joined. To illustration purposes, as depicted in <figref idref="DRAWINGS">FIG. 121(<i>b</i>)</figref>, let's assume the following order in x and y values: x<sub>i </sub><y<sub>a </sub><x<sub>j </sub><y<sub>b </sub><x<sub>k </sub><y<sub>c </sub><x<sub>m </sub><y<sub>n</sub>. In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 121(<i>b</i>)</figref>, the sorted lists/indexes include or are associated with one or more attributes indicating the identification of the records in original list (e.g., A<sub>7</sub>, A<sub>2</sub>, A<sub>4</sub>, A<sub>2</sub>, B<sub>3</sub>, B<sub>1</sub>, B<sub>9</sub>, and B<sub>1</sub>) and/or the type of x or y values (e.g., P for precise, FS for fuzzy start or support start, FE for fuzzy end or support end). In one embodiment, the sorted lists or indexes are scanned together, e.g., using a running counters (2117 and 12122) (e.g., in ascending direction), instead of performing a full Cartesian product search between the records. Assume for example, the counters are at some point advancing from x<sub>i </sub>from 12115 and y<sub>a </sub>from 12120. In one embodiment, an index for which the current value is smaller is advanced, i.e., given for example x<sub>i </sub><y<sub>a</sub>, index/counter 12117 is advanced to x<sub>j </sub>(shown by annotation 1 in <figref idref="DRAWINGS">FIG. 121(<i>b</i>)</figref>). In one embodiment, when an index counter moves to a record indicating a fuzzy value/set association (e.g., FS for fuzzy start), the potential joins may be forthcoming from the other list as other index(es)/counter(s) advance. In one embodiment, the record is marked or an attribute (e.g., the identifier and/or its sorted value) or a copy of the record is moved into an auxiliary queue/list/table (es., 12125) associated with the original (e.g., 12105) or sorted list (e.g., 12115) as shown by annotation 2 in <figref idref="DRAWINGS">FIG. 121(<i>b</i>)</figref>. In one embodiment, the join based on fuzzy A<sub>2 </sub>starting at x and crisp B<sub>3 </sub>at y<sub>a </sub>(currently pointed by index/counter 12122) is tested. If, as in this example, x<sub>j </sub>is more than y<sub>a</sub>, there is no join possibility (i.e., based on equality join). In one embodiment, A<sub>2 </sub>is tested against records in an auxiliary queue/list/table (e.g., 12130) associated with other list (12110 or 12120) for potential join(s). In one embodiment, after testing potential joins with items of auxiliary list, index/counter is advanced, e.g., counter/index (12122) is advanced to y<sub>e </sub>associated with start of fuzzy set given that y<sub>a </sub><x<sub>j </sub>(as shown by annotation 3 in <figref idref="DRAWINGS">FIG. 121(<i>b</i>)</figref>). Likewise, in one embodiment, B<sub>1 </sub>and/or its associated value(s are marked or moved into an auxiliary queue/list/table (e.g., 12130), as shown by annotation 4 in <figref idref="DRAWINGS">FIG. 1210</figref>)). In one embodiment, the record pointed by the advancing index/counter (e.g., B<sub>1</sub>) is tested against other crisp values (pointed by other index/counters) and items (fuzzy set/value related records) in auxiliary queue/list/table (e.g., 12125) associated with other list. In one embodiment, B<sub>1 </sub>is tested for join potential against A<sub>2</sub>, e.g., identified via auxiliary queue/list/table 12125. Assuming for example x<sub>j </sub><y<sub>b</sub>, the index/counter 12117 is advanced to x<sub>k </sub>associated with A<sub>4 </sub>(e.g., a precise or crisp value), as shown by annotation 5 in <figref idref="DRAWINGS">FIG. 121(<i>b</i>)</figref>. Likewise, the record pointed by the advancing index/counter (e.g., A<sub>4</sub>) is tested for potential join with other crisp value(s) (pointed by other index/counters) and items (fuzzy set/value related records, e.g., B<sub>1</sub>) in auxiliary queuellist/table (e.g., 12130) associated with other list. Similarly, since for example y<sub>b</sub><x<sub>k</sub>, index/counter 12122 is advanced to B<sub>9 </sub>having a, crisp value y<sub>e</sub>, as shown by annotation 6 in <figref idref="DRAWINGS">FIG. 121(<i>b</i>)</figref>. In one embodiment, y<sub>e</sub>, the value of B<sub>9</sub>, is tested for join with xi. (i.e., crisp value of A<sub>2 </sub>(currently pointed by index/counter 12117)) and fuzzy set/value A<sub>2 </sub>currently in auxiliary queue/list/table 12125, As depicted in this example by annotation 7 in <figref idref="DRAWINGS">FIG. 121(<i>b</i>)</figref>, index/counter 12117 advances to value x<sub>m </sub>associated with the end (of support) of fuzzy set/value A<sub>2 </sub>(e.g., type FE indicates fuzzy end). In one embodiment, upon such event, as for example depicted by annotation 8 in <figref idref="DRAWINGS">FIG. 121(<i>b</i>)</figref>, the record/item associated with A<sub>2 </sub>is marked (e.g., as non-pending) or removed from the associated auxiliary queue/list/table (e.g., 12125). In one embodiment, such record is marked/tagged for later removal upon the value pointed to by other index/counter surpasses x<sub>m</sub>. This allows finding other potential joins if other forthcoming value(s) pointed to by 12122, for example, falls between x<sub>i </sub>and x<sub>m </sub>(or support of A<sub>2</sub>). For example, when index/counter 12122 advances to yr associated with the start of fuzzy set/value B<sub>1 </sub>(as shown by annotation 9 in <figref idref="DRAWINGS">FIG. 121(<i>b</i>)</figref>), in one embodiment, auxiliary queue/list/table (e.g., 12125) is scanned and items marked for removal (e.g., A<sub>2</sub>) are removed having fuzzy ending value(s) (e.g., x<sub>m</sub>) less than current value (y<sub>n</sub>) pointed to by the advancing index/counter 12122. In this example, since the type associated with y<sub>n </sub>is also a fuzzy ending type (for fuzzy set/value B<sub>1</sub>), in one embodiment, the record associated with B<sub>1 </sub>in the associated auxiliary queue/list/table 12130, is similarly marked/tagged for removal, as shown by annotation 10 in <figref idref="DRAWINGS">FIG. 121(<i>b</i>)</figref>.
In one embodiment, tagging/marking (e.g., for removal) is done via codes and/or attributes associated with items in auxiliary queue/list/table. In one embodiment, several steps are taken in batch mode or at page level, for example, to enhance speed or the database performance. In one embodiment, a positive testing for join is followed by inserting the joined record (from two lists) in a joining list/table or a result set.
In various embodiments, various methods to join lists/tables based on variable taking fuzzy values are used. The resulting joined record, in one embodiment, includes a score relating to the joining values (fuzzy or crisp). For example, when determining the score for joining record associated with A<sub>2 </sub>from 12105 to B<sub>1 </sub>from 12110, the test score for the join (or threshold) is for example, determined by max-min approach, i.e.,
<maths id="MATH-US-00091" num="00091"><math overflow="scroll"><mrow><msub><mi>TS</mi><mrow><mi>join</mi><mo></mo><mrow><mo>(</mo><mrow><msub><mi>A</mi><mn>2</mn></msub><mo>,</mo><msub><mi>B</mi><mn>1</mn></msub></mrow><mo>)</mo></mrow></mrow></msub><mo>=</mo><mrow><munder><mi>sup</mi><mrow><mo>∀</mo><mi>x</mi></mrow></munder><mo></mo><mrow><mo>(</mo><mrow><mrow><msub><mi>μ</mi><msub><mi>A</mi><mn>2</mn></msub></msub><mo></mo><mrow><mo>(</mo><mi>x</mi><mo>)</mo></mrow></mrow><mo>⋀</mo><mrow><msub><mi>μ</mi><msub><mi>B</mi><mn>1</mn></msub></msub><mo></mo><mrow><mo>(</mo><mi>x</mi><mo>)</mo></mrow></mrow></mrow><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D20385.tif" /><img file="US2022121884A1_D20386.tif" /><img file="US2022121884A1_D20387.tif" /><img file="US2022121884A1_D20388.tif" /><img file="US2022121884A1_D20389.tif" /><img file="US2022121884A1_D20390.tif" /><img file="US2022121884A1_D20391.tif" /><img file="US2022121884A1_D20392.tif" /><img file="US2022121884A1_D20393.tif" /><img file="US2022121884A1_D20394.tif" /><img file="US2022121884A1_D20395.tif" /><img file="US2022121884A1_D20396.tif" /><img file="US2022121884A1_D20397.tif" /><img file="US2022121884A1_D20398.tif" /><img file="US2022121884A1_D20399.tif" /><img file="US2022121884A1_D20400.tif" /><img file="US2022121884A1_D20401.tif" /><img file="US2022121884A1_D20402.tif" /><img file="US2022121884A1_D20403.tif" /><img file="US2022121884A1_D20404.tif" /><img file="US2022121884A1_D20405.tif" /><img file="US2022121884A1_D20406.tif" /><img file="US2022121884A1_D20407.tif" /><img file="US2022121884A1_D20408.tif" /><img file="US2022121884A1_D20409.tif" /><img file="US2022121884A1_D20410.tif" /><img file="US2022121884A1_D20411.tif" /><img file="US2022121884A1_D20412.tif" /><img file="US2022121884A1_D20413.tif" /><img file="US2022121884A1_D20414.tif" /><img file="US2022121884A1_D20415.tif" /><img file="US2022121884A1_D20416.tif" /><img file="US2022121884A1_D20417.tif" /><img file="US2022121884A1_D20418.tif" /><img file="US2022121884A1_D20419.tif" /><img file="US2022121884A1_D20420.tif" /><img file="US2022121884A1_D20421.tif" /><img file="US2022121884A1_D20422.tif" /><img file="US2022121884A1_D20423.tif" /><img file="US2022121884A1_D20424.tif" /><img file="US2022121884A1_D20425.tif" /><img file="US2022121884A1_D20426.tif" /><img file="US2022121884A1_D20427.tif" /><img file="US2022121884A1_D20428.tif" /><img file="US2022121884A1_D20429.tif" /><img file="US2022121884A1_D20430.tif" /><img file="US2022121884A1_D20431.tif" /><img file="US2022121884A1_D20432.tif" /><img file="US2022121884A1_D20433.tif" /><img file="US2022121884A1_D20434.tif" /><img file="US2022121884A1_D20435.tif" /><img file="US2022121884A1_D20436.tif" /><img file="US2022121884A1_D20437.tif" /><img file="US2022121884A1_D20438.tif" /><img file="US2022121884A1_D20439.tif" /><img file="US2022121884A1_D20440.tif" /><img file="US2022121884A1_D20441.tif" /><img file="US2022121884A1_D20442.tif" /><img file="US2022121884A1_D20443.tif" /><img file="US2022121884A1_D20444.tif" /><img file="US2022121884A1_D20445.tif" /><img file="US2022121884A1_D20446.tif" /><img file="US2022121884A1_D20447.tif" /><img file="US2022121884A1_D20448.tif" /><img file="US2022121884A1_D20449.tif" /><img file="US2022121884A1_D20450.tif" /><img file="US2022121884A1_D20451.tif" /><img file="US2022121884A1_D20452.tif" /><img file="US2022121884A1_D20453.tif" /><img file="US2022121884A1_D20454.tif" /><img file="US2022121884A1_D20455.tif" /><img file="US2022121884A1_D20456.tif" /><img file="US2022121884A1_D20457.tif" /><img file="US2022121884A1_D20458.tif" /><img file="US2022121884A1_D20459.tif" /><img file="US2022121884A1_D20460.tif" /><img file="US2022121884A1_D20461.tif" /><img file="US2022121884A1_D20462.tif" /><img file="US2022121884A1_D20463.tif" /><img file="US2022121884A1_D20464.tif" /><img file="US2022121884A1_D20465.tif" /><img file="US2022121884A1_D20466.tif" /><img file="US2022121884A1_D20467.tif" /><img file="US2022121884A1_D20468.tif" /><img file="US2022121884A1_D20469.tif" /><img file="US2022121884A1_D20470.tif" /><img file="US2022121884A1_D20471.tif" /><img file="US2022121884A1_D20472.tif" /><img file="US2022121884A1_D20473.tif" /><img file="US2022121884A1_D20474.tif" /><img file="US2022121884A1_D20475.tif" /><img file="US2022121884A1_D20476.tif" /><img file="US2022121884A1_D20477.tif" /><img file="US2022121884A1_D20478.tif" /><img file="US2022121884A1_D20479.tif" /><img file="US2022121884A1_D20480.tif" /><img file="US2022121884A1_D20481.tif" /><img file="US2022121884A1_D20482.tif" /><img file="US2022121884A1_D20483.tif" /><img file="US2022121884A1_D20484.tif" /><img file="US2022121884A1_D20485.tif" /><img file="US2022121884A1_D20486.tif" /><img file="US2022121884A1_D20487.tif" /><img file="US2022121884A1_D20488.tif" /><img file="US2022121884A1_D20489.tif" /><img file="US2022121884A1_D20490.tif" /><img file="US2022121884A1_D20491.tif" /><img file="US2022121884A1_D20492.tif" /><img file="US2022121884A1_D20493.tif" /><img file="US2022121884A1_D20494.tif" /><img file="US2022121884A1_D20495.tif" /><img file="US2022121884A1_D20496.tif" />
In one embodiment, the join test score is used to affect the overall truth value or test score for the joined record, e.g.:
<br /><i>TS</i><sub>joined record</sub><i>=TS</i><sub>A</sub><sub><sub2>2</sub2></sub><i>{circumflex over ( )}TS</i><sub>B</sub><sub><sub2>1</sub2></sub><i>{circumflex over ( )}TS</i><sub>join(A</sub><sub><sub2>2</sub2></sub><sub>,B</sub><sub><sub2>1</sub2></sub><sub>) </sub>
Scoring with Fuzzy Map:
In one embodiment, a fuzzy map A* (e.g., as depicted in <figref idref="DRAWINGS">FIG. 122(<i>a</i>)</figref>) is modeled as a set of membership functions (e.g., in a piecewise fashion.). In one embodiment, a membership function, e.g., μ<sub>A</sub>(x) is modeled by its corner points (e.g., shown as black dots in <figref idref="DRAWINGS">FIG. 122(<i>a</i>)</figref>). In one embodiment, μ<sub>A</sub>(x) is modeled as a set of points (x, η) indicating corners in the piecewise membership function. In one embodiment, a fuzzy map (A, B), is represented by a (discrete or continuous) set of membership functions (e.g., denoted by {A<sub>α</sub>}), where, in one embodiment, α is a parameter controlling the position of the corner points of the membership function in the set. For example, as depicted in <figref idref="DRAWINGS">FIG. 122(<i>a</i>)</figref>, for α values of α<sub>2</sub>′, α<sub>1</sub>′, α<sub>1</sub>, and α<sub>2</sub>, the corresponding piecewise membership functions are denoted as A<sub>α2′</sub>, Aα<sub>α1′</sub>, A<sub>α1</sub>, and A<sub>α2</sub>. In one embodiment, an A<sub>α</sub>, is described by a set of corner points {(X<sub>i,α</sub>, η<sub>i,α</sub>)}, e.g., as depicted by white dots on A<sub>α2 </sub>in <figref idref="DRAWINGS">FIG. 122(<i>a</i>)</figref>. In this example, for α<sub>0</sub>, A<sub>α0 </sub>is A. In one embodiment, each (x, η) point on A<sub>α</sub>, corresponds to the same value or color/grayscale in A*, i.e.
<br />For ∀<i>x</i>, α: μ<sub>A</sub>*(<i>x, μ</i><sub>A</sub><sub><sub2>α</sub2></sub>(<i>x</i>))=<i>C</i><sub>α, B </sub>
where c is the possibility degree (or color/.grayscale) of the value of membership function. For example, as depicted in <figref idref="DRAWINGS">FIG. 122(<i>b</i>)</figref>, for various values of α, the color/grayscale measure of the fuzzy map is indicated by c(α, B). In one embodiment, the uncertainty measure B affects the shape of c(α, B). For example, the more uncertain B is, the wider c(α, B) becomes. In this example, the color associated with A<sub>α2′</sub>and A<sub>α2</sub>, is denoted by c<sub>2 </sub>corresponding to α values of α<sub>2</sub>′ and α<sub>2</sub>, respectively. In this example, color c<sub>0 </sub>(or 1) is associated with α<sub>0</sub>.
In one embodiment, a similarity measure between A and Aα is used as the basis for color/grayscale distribution with B. For example, in one embodiment as depicted in <figref idref="DRAWINGS">FIG. 123(<i>a</i>)</figref>, a similarity measure is used between two fuzzy set (based on a similarity approach, e.g., Jaccard similarity coefficient, geometric distance and Hausdorff metrics, or union and intersection operations, the maximum difference, and the difference and sum of membership grades). In one embodiment, for example, the following similarity measure is used:
<maths id="MATH-US-00092" num="00092"><math overflow="scroll"><mrow><mrow><mi>SIM</mi><mo></mo><mrow><mo>(</mo><mrow><mi>A</mi><mo>,</mo><msub><mi>A</mi><mi>α</mi></msub></mrow><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mfrac><mrow><mo></mo><mrow><mi>A</mi><mo>⋂</mo><msub><mi>A</mi><mi>α</mi></msub></mrow><mo></mo></mrow><mrow><mo></mo><mrow><mi>A</mi><mo>⋃</mo><msub><mi>A</mi><mi>α</mi></msub></mrow><mo></mo></mrow></mfrac><mo>=</mo><mfrac><mrow><mo>∫</mo><mrow><mrow><mi>min</mi><mo></mo><mrow><mo>(</mo><mrow><mrow><msub><mi>μ</mi><mi>A</mi></msub><mo></mo><mrow><mo>(</mo><mi>x</mi><mo>)</mo></mrow></mrow><mo>,</mo><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>α</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>x</mi><mo>)</mo></mrow></mrow></mrow><mo>)</mo></mrow></mrow><mo>·</mo><mi>dx</mi></mrow></mrow><mrow><mo>∫</mo><mrow><mrow><mi>max</mi><mo></mo><mrow><mo>(</mo><mrow><mrow><msub><mi>μ</mi><mi>A</mi></msub><mo></mo><mrow><mo>(</mo><mi>x</mi><mo>)</mo></mrow></mrow><mo>,</mo><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>α</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>x</mi><mo>)</mo></mrow></mrow></mrow><mo>)</mo></mrow></mrow><mo>·</mo><mi>dx</mi></mrow></mrow></mfrac></mrow></mrow></math></maths><img file="US2022121884A1_D20497.tif" /><img file="US2022121884A1_D20498.tif" /><img file="US2022121884A1_D20499.tif" /><img file="US2022121884A1_D20500.tif" /><img file="US2022121884A1_D20501.tif" /><img file="US2022121884A1_D20502.tif" /><img file="US2022121884A1_D20503.tif" /><img file="US2022121884A1_D20504.tif" /><img file="US2022121884A1_D20505.tif" /><img file="US2022121884A1_D20506.tif" /><img file="US2022121884A1_D20507.tif" /><img file="US2022121884A1_D20508.tif" /><img file="US2022121884A1_D20509.tif" /><img file="US2022121884A1_D20510.tif" /><img file="US2022121884A1_D20511.tif" /><img file="US2022121884A1_D20512.tif" /><img file="US2022121884A1_D20513.tif" /><img file="US2022121884A1_D20514.tif" /><img file="US2022121884A1_D20515.tif" /><img file="US2022121884A1_D20516.tif" /><img file="US2022121884A1_D20517.tif" /><img file="US2022121884A1_D20518.tif" /><img file="US2022121884A1_D20519.tif" /><img file="US2022121884A1_D20520.tif" /><img file="US2022121884A1_D20521.tif" /><img file="US2022121884A1_D20522.tif" /><img file="US2022121884A1_D20523.tif" /><img file="US2022121884A1_D20524.tif" /><img file="US2022121884A1_D20525.tif" /><img file="US2022121884A1_D20526.tif" /><img file="US2022121884A1_D20527.tif" /><img file="US2022121884A1_D20528.tif" /><img file="US2022121884A1_D20529.tif" /><img file="US2022121884A1_D20530.tif" /><img file="US2022121884A1_D20531.tif" /><img file="US2022121884A1_D20532.tif" /><img file="US2022121884A1_D20533.tif" /><img file="US2022121884A1_D20534.tif" /><img file="US2022121884A1_D20535.tif" /><img file="US2022121884A1_D20536.tif" /><img file="US2022121884A1_D20537.tif" /><img file="US2022121884A1_D20538.tif" /><img file="US2022121884A1_D20539.tif" /><img file="US2022121884A1_D20540.tif" /><img file="US2022121884A1_D20541.tif" /><img file="US2022121884A1_D20542.tif" /><img file="US2022121884A1_D20543.tif" /><img file="US2022121884A1_D20544.tif" /><img file="US2022121884A1_D20545.tif" /><img file="US2022121884A1_D20546.tif" /><img file="US2022121884A1_D20547.tif" /><img file="US2022121884A1_D20548.tif" /><img file="US2022121884A1_D20549.tif" /><img file="US2022121884A1_D20550.tif" /><img file="US2022121884A1_D20551.tif" /><img file="US2022121884A1_D20552.tif" /><img file="US2022121884A1_D20553.tif" /><img file="US2022121884A1_D20554.tif" /><img file="US2022121884A1_D20555.tif" /><img file="US2022121884A1_D20556.tif" /><img file="US2022121884A1_D20557.tif" /><img file="US2022121884A1_D20558.tif" /><img file="US2022121884A1_D20559.tif" /><img file="US2022121884A1_D20560.tif" /><img file="US2022121884A1_D20561.tif" /><img file="US2022121884A1_D20562.tif" /><img file="US2022121884A1_D20563.tif" /><img file="US2022121884A1_D20564.tif" /><img file="US2022121884A1_D20565.tif" /><img file="US2022121884A1_D20566.tif" /><img file="US2022121884A1_D20567.tif" /><img file="US2022121884A1_D20568.tif" /><img file="US2022121884A1_D20569.tif" /><img file="US2022121884A1_D20570.tif" /><img file="US2022121884A1_D20571.tif" /><img file="US2022121884A1_D20572.tif" /><img file="US2022121884A1_D20573.tif" /><img file="US2022121884A1_D20574.tif" /><img file="US2022121884A1_D20575.tif" /><img file="US2022121884A1_D20576.tif" /><img file="US2022121884A1_D20577.tif" /><img file="US2022121884A1_D20578.tif" /><img file="US2022121884A1_D20579.tif" /><img file="US2022121884A1_D20580.tif" /><img file="US2022121884A1_D20581.tif" /><img file="US2022121884A1_D20582.tif" /><img file="US2022121884A1_D20583.tif" /><img file="US2022121884A1_D20584.tif" /><img file="US2022121884A1_D20585.tif" /><img file="US2022121884A1_D20586.tif" /><img file="US2022121884A1_D20587.tif" /><img file="US2022121884A1_D20588.tif" /><img file="US2022121884A1_D20589.tif" /><img file="US2022121884A1_D20590.tif" /><img file="US2022121884A1_D20591.tif" /><img file="US2022121884A1_D20592.tif" /><img file="US2022121884A1_D20593.tif" /><img file="US2022121884A1_D20594.tif" /><img file="US2022121884A1_D20595.tif" /><img file="US2022121884A1_D20596.tif" /><img file="US2022121884A1_D20597.tif" /><img file="US2022121884A1_D20598.tif" /><img file="US2022121884A1_D20599.tif" /><img file="US2022121884A1_D20600.tif" /><img file="US2022121884A1_D20601.tif" /><img file="US2022121884A1_D20602.tif" /><img file="US2022121884A1_D20603.tif" /><img file="US2022121884A1_D20604.tif" /><img file="US2022121884A1_D20605.tif" /><img file="US2022121884A1_D20606.tif" /><img file="US2022121884A1_D20607.tif" /><img file="US2022121884A1_D20608.tif" />
In one embodiment, such similarity measure is based with the certainty measure B to determine the possibility measure (i.e., the color or grayscale) for A<sub>α</sub>. For example, in an embodiment, as depicted in <figref idref="DRAWINGS">FIG. 123(<i>b</i>)</figref>, the color or grayscale is determined as the value of the membership function of B at SIM(α), i.e.,
<br /><i>C</i><sub>α,B</sub>=μ<sub>B</sub>(SIM(<i>A,A</i><sub>α</sub>))
In one embodiment, certainty measure B is expressed as a crisp percentage B<sub>c </sub>(as opposed to a fuzzy value). In an embodiment, a fuzzy set B<sub>f </sub>is setup based on B<sub>c</sub>, e.g., as depicted in <figref idref="DRAWINGS">FIG. 123(<i>b</i>)</figref> with its core and support based on B<sub>c</sub>, in order to provide a graduated scale to assign color/grayscale value to various A<sub>α</sub>'s.
In one embodiment, a non-commutative function of (A, A<sub>α</sub>) is used to determine a similarity measure. In one embodiment, a different similarity function is used for α′ (e.g., <α<sub>0</sub>) than a (e.g., α<sub>0</sub>). In one embodiment, a different color/grayscale assignment is used for a′ (e.g., <α<sub>0</sub>) than a (e.g., >α<sub>0</sub>). In one embodiment, for example, increasing α (>α<sub>0</sub>) results in A<sub>α</sub> allowing more possibilities, i.e., μ<sub>Aα</sub>(x) ≥μ<sub>A</sub>(x) for all x, and decreasing α (<α<sub>0</sub>) results in A<sub>α</sub> allowing less possibilities, i.e., μ<sub>Aα</sub>(x) ≤μ<sub>A</sub>(x) for all x.
In one embodiment, when a fuzzy map, e.g., A*, is used in a calculation, a set -{A<sub>α</sub>} with corresponding color set c(α, B) is used to determine the result of the calculation. In one embodiment, multiple values of α's are used to model A*. In one embodiment, values of α span the shape of c(αB). In one embodiment, a predefined number of α's are used to form set {A<sub>α</sub>}. In one embodiment, the values of α's corresponding to the significant points of c(α, B) are used to form set {A<sub>α</sub>}. For example, in such an embodiment, the corner points of c(α, B) (depicted in <figref idref="DRAWINGS">FIG. 122(<i>b</i>)</figref>) are used determine set {A<sub>α</sub>}. In one embodiment, predefined colors (e.g., c=1 and 0.5) are used to determine (the corresponding α's and hence) set {A<sub>α</sub>}.
In one embodiment, a fuzzy probability measure (p*) of fuzzy map A*, given probability distribution p(x), is determined using set {A<sub>α</sub>}, as follows:
<maths id="MATH-US-00093" num="00093"><math overflow="scroll"><mrow><msup><mi>p</mi><mo>*</mo></msup><mo>≡</mo><mrow><msub><mi>p</mi><mi>x</mi></msub><mo>·</mo><msub><mi>μ</mi><msup><mi>A</mi><mo>*</mo></msup></msub></mrow></mrow></math></maths><img file="US2022121884A1_D20609.tif" /><img file="US2022121884A1_D20610.tif" /><img file="US2022121884A1_D20611.tif" /><img file="US2022121884A1_D20612.tif" /><img file="US2022121884A1_D20613.tif" /><img file="US2022121884A1_D20614.tif" /><img file="US2022121884A1_D20615.tif" /><img file="US2022121884A1_D20616.tif" /><img file="US2022121884A1_D20617.tif" /><img file="US2022121884A1_D20618.tif" /><img file="US2022121884A1_D20619.tif" /><img file="US2022121884A1_D20620.tif" /><img file="US2022121884A1_D20621.tif" /><img file="US2022121884A1_D20622.tif" /><img file="US2022121884A1_D20623.tif" /><img file="US2022121884A1_D20624.tif" /><img file="US2022121884A1_D20625.tif" /><img file="US2022121884A1_D20626.tif" /><img file="US2022121884A1_D20627.tif" /><img file="US2022121884A1_D20628.tif" /><img file="US2022121884A1_D20629.tif" /><img file="US2022121884A1_D20630.tif" /><img file="US2022121884A1_D20631.tif" /><img file="US2022121884A1_D20632.tif" /><img file="US2022121884A1_D20633.tif" /><img file="US2022121884A1_D20634.tif" /><img file="US2022121884A1_D20635.tif" /><img file="US2022121884A1_D20636.tif" /><img file="US2022121884A1_D20637.tif" /><img file="US2022121884A1_D20638.tif" /><img file="US2022121884A1_D20639.tif" /><img file="US2022121884A1_D20640.tif" /><img file="US2022121884A1_D20641.tif" /><img file="US2022121884A1_D20642.tif" /><img file="US2022121884A1_D20643.tif" /><img file="US2022121884A1_D20644.tif" /><img file="US2022121884A1_D20645.tif" /><img file="US2022121884A1_D20646.tif" /><img file="US2022121884A1_D20647.tif" /><img file="US2022121884A1_D20648.tif" /><img file="US2022121884A1_D20649.tif" /><img file="US2022121884A1_D20650.tif" /><img file="US2022121884A1_D20651.tif" /><img file="US2022121884A1_D20652.tif" /><img file="US2022121884A1_D20653.tif" /><img file="US2022121884A1_D20654.tif" /><img file="US2022121884A1_D20655.tif" /><img file="US2022121884A1_D20656.tif" /><img file="US2022121884A1_D20657.tif" /><img file="US2022121884A1_D20658.tif" /><img file="US2022121884A1_D20659.tif" /><img file="US2022121884A1_D20660.tif" /><img file="US2022121884A1_D20661.tif" /><img file="US2022121884A1_D20662.tif" /><img file="US2022121884A1_D20663.tif" /><img file="US2022121884A1_D20664.tif" /><img file="US2022121884A1_D20665.tif" /><img file="US2022121884A1_D20666.tif" /><img file="US2022121884A1_D20667.tif" /><img file="US2022121884A1_D20668.tif" /><img file="US2022121884A1_D20669.tif" /><img file="US2022121884A1_D20670.tif" /><img file="US2022121884A1_D20671.tif" /><img file="US2022121884A1_D20672.tif" /><img file="US2022121884A1_D20673.tif" /><img file="US2022121884A1_D20674.tif" /><img file="US2022121884A1_D20675.tif" /><img file="US2022121884A1_D20676.tif" /><img file="US2022121884A1_D20677.tif" /><img file="US2022121884A1_D20678.tif" /><img file="US2022121884A1_D20679.tif" /><img file="US2022121884A1_D20680.tif" /><img file="US2022121884A1_D20681.tif" /><img file="US2022121884A1_D20682.tif" /><img file="US2022121884A1_D20683.tif" /><img file="US2022121884A1_D20684.tif" /><img file="US2022121884A1_D20685.tif" /><img file="US2022121884A1_D20686.tif" /><img file="US2022121884A1_D20687.tif" /><img file="US2022121884A1_D20688.tif" /><img file="US2022121884A1_D20689.tif" /><img file="US2022121884A1_D20690.tif" /><img file="US2022121884A1_D20691.tif" /><img file="US2022121884A1_D20692.tif" /><img file="US2022121884A1_D20693.tif" /><img file="US2022121884A1_D20694.tif" /><img file="US2022121884A1_D20695.tif" /><img file="US2022121884A1_D20696.tif" /><img file="US2022121884A1_D20697.tif" /><img file="US2022121884A1_D20698.tif" /><img file="US2022121884A1_D20699.tif" /><img file="US2022121884A1_D20700.tif" /><img file="US2022121884A1_D20701.tif" /><img file="US2022121884A1_D20702.tif" /><img file="US2022121884A1_D20703.tif" /><img file="US2022121884A1_D20704.tif" /><img file="US2022121884A1_D20705.tif" /><img file="US2022121884A1_D20706.tif" /><img file="US2022121884A1_D20707.tif" /><img file="US2022121884A1_D20708.tif" /><img file="US2022121884A1_D20709.tif" /><img file="US2022121884A1_D20710.tif" /><img file="US2022121884A1_D20711.tif" /><img file="US2022121884A1_D20712.tif" /><img file="US2022121884A1_D20713.tif" /><img file="US2022121884A1_D20714.tif" /><img file="US2022121884A1_D20715.tif" /><img file="US2022121884A1_D20716.tif" /><img file="US2022121884A1_D20717.tif" /><img file="US2022121884A1_D20718.tif" /><img file="US2022121884A1_D20719.tif" /><img file="US2022121884A1_D20720.tif" /><maths id="MATH-US-00093-2" num="00093.2"><math overflow="scroll"><mrow><mrow><msub><mi>μ</mi><msup><mi>p</mi><mo>*</mo></msup></msub><mo></mo><mrow><mo>(</mo><mi>s</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><munder><mi>sup</mi><mrow><mo>∀</mo><mi>α</mi></mrow></munder><mo></mo><mrow><mi>c</mi><mo></mo><mrow><mo>(</mo><mrow><mi>α</mi><mo>,</mo><mi>B</mi></mrow><mo>)</mo></mrow></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D20721.tif" /><img file="US2022121884A1_D20722.tif" /><img file="US2022121884A1_D20723.tif" /><img file="US2022121884A1_D20724.tif" /><img file="US2022121884A1_D20725.tif" /><img file="US2022121884A1_D20726.tif" /><img file="US2022121884A1_D20727.tif" /><img file="US2022121884A1_D20728.tif" /><img file="US2022121884A1_D20729.tif" /><img file="US2022121884A1_D20730.tif" /><img file="US2022121884A1_D20731.tif" /><img file="US2022121884A1_D20732.tif" /><img file="US2022121884A1_D20733.tif" /><img file="US2022121884A1_D20734.tif" /><img file="US2022121884A1_D20735.tif" /><img file="US2022121884A1_D20736.tif" /><img file="US2022121884A1_D20737.tif" /><img file="US2022121884A1_D20738.tif" /><img file="US2022121884A1_D20739.tif" /><img file="US2022121884A1_D20740.tif" /><img file="US2022121884A1_D20741.tif" /><img file="US2022121884A1_D20742.tif" /><img file="US2022121884A1_D20743.tif" /><img file="US2022121884A1_D20744.tif" /><img file="US2022121884A1_D20745.tif" /><img file="US2022121884A1_D20746.tif" /><img file="US2022121884A1_D20747.tif" /><img file="US2022121884A1_D20748.tif" /><img file="US2022121884A1_D20749.tif" /><img file="US2022121884A1_D20750.tif" /><img file="US2022121884A1_D20751.tif" /><img file="US2022121884A1_D20752.tif" /><img file="US2022121884A1_D20753.tif" /><img file="US2022121884A1_D20754.tif" /><img file="US2022121884A1_D20755.tif" /><img file="US2022121884A1_D20756.tif" /><img file="US2022121884A1_D20757.tif" /><img file="US2022121884A1_D20758.tif" /><img file="US2022121884A1_D20759.tif" /><img file="US2022121884A1_D20760.tif" /><img file="US2022121884A1_D20761.tif" /><img file="US2022121884A1_D20762.tif" /><img file="US2022121884A1_D20763.tif" /><img file="US2022121884A1_D20764.tif" /><img file="US2022121884A1_D20765.tif" /><img file="US2022121884A1_D20766.tif" /><img file="US2022121884A1_D20767.tif" /><img file="US2022121884A1_D20768.tif" /><img file="US2022121884A1_D20769.tif" /><img file="US2022121884A1_D20770.tif" /><img file="US2022121884A1_D20771.tif" /><img file="US2022121884A1_D20772.tif" /><img file="US2022121884A1_D20773.tif" /><img file="US2022121884A1_D20774.tif" /><img file="US2022121884A1_D20775.tif" /><img file="US2022121884A1_D20776.tif" /><img file="US2022121884A1_D20777.tif" /><img file="US2022121884A1_D20778.tif" /><img file="US2022121884A1_D20779.tif" /><img file="US2022121884A1_D20780.tif" /><img file="US2022121884A1_D20781.tif" /><img file="US2022121884A1_D20782.tif" /><img file="US2022121884A1_D20783.tif" /><img file="US2022121884A1_D20784.tif" /><img file="US2022121884A1_D20785.tif" /><img file="US2022121884A1_D20786.tif" /><img file="US2022121884A1_D20787.tif" /><img file="US2022121884A1_D20788.tif" /><img file="US2022121884A1_D20789.tif" /><img file="US2022121884A1_D20790.tif" /><img file="US2022121884A1_D20791.tif" /><img file="US2022121884A1_D20792.tif" /><img file="US2022121884A1_D20793.tif" /><img file="US2022121884A1_D20794.tif" /><img file="US2022121884A1_D20795.tif" /><img file="US2022121884A1_D20796.tif" /><img file="US2022121884A1_D20797.tif" /><img file="US2022121884A1_D20798.tif" /><img file="US2022121884A1_D20799.tif" /><img file="US2022121884A1_D20800.tif" /><img file="US2022121884A1_D20801.tif" /><img file="US2022121884A1_D20802.tif" /><img file="US2022121884A1_D20803.tif" /><img file="US2022121884A1_D20804.tif" /><img file="US2022121884A1_D20805.tif" /><img file="US2022121884A1_D20806.tif" /><img file="US2022121884A1_D20807.tif" /><img file="US2022121884A1_D20808.tif" /><img file="US2022121884A1_D20809.tif" /><img file="US2022121884A1_D20810.tif" /><img file="US2022121884A1_D20811.tif" /><img file="US2022121884A1_D20812.tif" /><img file="US2022121884A1_D20813.tif" /><img file="US2022121884A1_D20814.tif" /><img file="US2022121884A1_D20815.tif" /><img file="US2022121884A1_D20816.tif" /><img file="US2022121884A1_D20817.tif" /><img file="US2022121884A1_D20818.tif" /><img file="US2022121884A1_D20819.tif" /><img file="US2022121884A1_D20820.tif" /><img file="US2022121884A1_D20821.tif" /><img file="US2022121884A1_D20822.tif" /><img file="US2022121884A1_D20823.tif" /><img file="US2022121884A1_D20824.tif" /><img file="US2022121884A1_D20825.tif" /><img file="US2022121884A1_D20826.tif" /><img file="US2022121884A1_D20827.tif" /><img file="US2022121884A1_D20828.tif" /><img file="US2022121884A1_D20829.tif" /><img file="US2022121884A1_D20830.tif" /><img file="US2022121884A1_D20831.tif" /><img file="US2022121884A1_D20832.tif" /><maths id="MATH-US-00093-3" num="00093.3"><math overflow="scroll"><mrow><mi>subject</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>to</mi></mrow></math></maths><img file="US2022121884A1_D20833.tif" /><img file="US2022121884A1_D20834.tif" /><img file="US2022121884A1_D20835.tif" /><img file="US2022121884A1_D20836.tif" /><img file="US2022121884A1_D20837.tif" /><img file="US2022121884A1_D20838.tif" /><img file="US2022121884A1_D20839.tif" /><img file="US2022121884A1_D20840.tif" /><img file="US2022121884A1_D20841.tif" /><img file="US2022121884A1_D20842.tif" /><img file="US2022121884A1_D20843.tif" /><img file="US2022121884A1_D20844.tif" /><img file="US2022121884A1_D20845.tif" /><img file="US2022121884A1_D20846.tif" /><img file="US2022121884A1_D20847.tif" /><img file="US2022121884A1_D20848.tif" /><img file="US2022121884A1_D20849.tif" /><img file="US2022121884A1_D20850.tif" /><img file="US2022121884A1_D20851.tif" /><img file="US2022121884A1_D20852.tif" /><img file="US2022121884A1_D20853.tif" /><img file="US2022121884A1_D20854.tif" /><img file="US2022121884A1_D20855.tif" /><img file="US2022121884A1_D20856.tif" /><img file="US2022121884A1_D20857.tif" /><img file="US2022121884A1_D20858.tif" /><img file="US2022121884A1_D20859.tif" /><img file="US2022121884A1_D20860.tif" /><img file="US2022121884A1_D20861.tif" /><img file="US2022121884A1_D20862.tif" /><img file="US2022121884A1_D20863.tif" /><img file="US2022121884A1_D20864.tif" /><img file="US2022121884A1_D20865.tif" /><img file="US2022121884A1_D20866.tif" /><img file="US2022121884A1_D20867.tif" /><img file="US2022121884A1_D20868.tif" /><img file="US2022121884A1_D20869.tif" /><img file="US2022121884A1_D20870.tif" /><img file="US2022121884A1_D20871.tif" /><img file="US2022121884A1_D20872.tif" /><img file="US2022121884A1_D20873.tif" /><img file="US2022121884A1_D20874.tif" /><img file="US2022121884A1_D20875.tif" /><img file="US2022121884A1_D20876.tif" /><img file="US2022121884A1_D20877.tif" /><img file="US2022121884A1_D20878.tif" /><img file="US2022121884A1_D20879.tif" /><img file="US2022121884A1_D20880.tif" /><img file="US2022121884A1_D20881.tif" /><img file="US2022121884A1_D20882.tif" /><img file="US2022121884A1_D20883.tif" /><img file="US2022121884A1_D20884.tif" /><img file="US2022121884A1_D20885.tif" /><img file="US2022121884A1_D20886.tif" /><img file="US2022121884A1_D20887.tif" /><img file="US2022121884A1_D20888.tif" /><img file="US2022121884A1_D20889.tif" /><img file="US2022121884A1_D20890.tif" /><img file="US2022121884A1_D20891.tif" /><img file="US2022121884A1_D20892.tif" /><img file="US2022121884A1_D20893.tif" /><img file="US2022121884A1_D20894.tif" /><img file="US2022121884A1_D20895.tif" /><img file="US2022121884A1_D20896.tif" /><img file="US2022121884A1_D20897.tif" /><img file="US2022121884A1_D20898.tif" /><img file="US2022121884A1_D20899.tif" /><img file="US2022121884A1_D20900.tif" /><img file="US2022121884A1_D20901.tif" /><img file="US2022121884A1_D20902.tif" /><img file="US2022121884A1_D20903.tif" /><img file="US2022121884A1_D20904.tif" /><img file="US2022121884A1_D20905.tif" /><img file="US2022121884A1_D20906.tif" /><img file="US2022121884A1_D20907.tif" /><img file="US2022121884A1_D20908.tif" /><img file="US2022121884A1_D20909.tif" /><img file="US2022121884A1_D20910.tif" /><img file="US2022121884A1_D20911.tif" /><img file="US2022121884A1_D20912.tif" /><img file="US2022121884A1_D20913.tif" /><img file="US2022121884A1_D20914.tif" /><img file="US2022121884A1_D20915.tif" /><img file="US2022121884A1_D20916.tif" /><img file="US2022121884A1_D20917.tif" /><img file="US2022121884A1_D20918.tif" /><img file="US2022121884A1_D20919.tif" /><img file="US2022121884A1_D20920.tif" /><img file="US2022121884A1_D20921.tif" /><img file="US2022121884A1_D20922.tif" /><img file="US2022121884A1_D20923.tif" /><img file="US2022121884A1_D20924.tif" /><img file="US2022121884A1_D20925.tif" /><img file="US2022121884A1_D20926.tif" /><img file="US2022121884A1_D20927.tif" /><img file="US2022121884A1_D20928.tif" /><img file="US2022121884A1_D20929.tif" /><img file="US2022121884A1_D20930.tif" /><img file="US2022121884A1_D20931.tif" /><img file="US2022121884A1_D20932.tif" /><img file="US2022121884A1_D20933.tif" /><img file="US2022121884A1_D20934.tif" /><img file="US2022121884A1_D20935.tif" /><img file="US2022121884A1_D20936.tif" /><img file="US2022121884A1_D20937.tif" /><img file="US2022121884A1_D20938.tif" /><img file="US2022121884A1_D20939.tif" /><img file="US2022121884A1_D20940.tif" /><img file="US2022121884A1_D20941.tif" /><img file="US2022121884A1_D20942.tif" /><img file="US2022121884A1_D20943.tif" /><img file="US2022121884A1_D20944.tif" /><maths id="MATH-US-00093-4" num="00093.4"><math overflow="scroll"><mrow><mi>s</mi><mo>=</mo><mrow><mo>∫</mo><mrow><mrow><mi>p</mi><mo></mo><mrow><mo>(</mo><mi>x</mi><mo>)</mo></mrow></mrow><mo>·</mo><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>α</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>x</mi><mo>)</mo></mrow></mrow><mo>·</mo><mi>dx</mi></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D20945.tif" /><img file="US2022121884A1_D20946.tif" /><img file="US2022121884A1_D20947.tif" /><img file="US2022121884A1_D20948.tif" /><img file="US2022121884A1_D20949.tif" /><img file="US2022121884A1_D20950.tif" /><img file="US2022121884A1_D20951.tif" /><img file="US2022121884A1_D20952.tif" /><img file="US2022121884A1_D20953.tif" /><img file="US2022121884A1_D20954.tif" /><img file="US2022121884A1_D20955.tif" /><img file="US2022121884A1_D20956.tif" /><img file="US2022121884A1_D20957.tif" /><img file="US2022121884A1_D20958.tif" /><img file="US2022121884A1_D20959.tif" /><img file="US2022121884A1_D20960.tif" /><img file="US2022121884A1_D20961.tif" /><img file="US2022121884A1_D20962.tif" /><img file="US2022121884A1_D20963.tif" /><img file="US2022121884A1_D20964.tif" /><img file="US2022121884A1_D20965.tif" /><img file="US2022121884A1_D20966.tif" /><img file="US2022121884A1_D20967.tif" /><img file="US2022121884A1_D20968.tif" /><img file="US2022121884A1_D20969.tif" /><img file="US2022121884A1_D20970.tif" /><img file="US2022121884A1_D20971.tif" /><img file="US2022121884A1_D20972.tif" /><img file="US2022121884A1_D20973.tif" /><img file="US2022121884A1_D20974.tif" /><img file="US2022121884A1_D20975.tif" /><img file="US2022121884A1_D20976.tif" /><img file="US2022121884A1_D20977.tif" /><img file="US2022121884A1_D20978.tif" /><img file="US2022121884A1_D20979.tif" /><img file="US2022121884A1_D20980.tif" /><img file="US2022121884A1_D20981.tif" /><img file="US2022121884A1_D20982.tif" /><img file="US2022121884A1_D20983.tif" /><img file="US2022121884A1_D20984.tif" /><img file="US2022121884A1_D20985.tif" /><img file="US2022121884A1_D20986.tif" /><img file="US2022121884A1_D20987.tif" /><img file="US2022121884A1_D20988.tif" /><img file="US2022121884A1_D20989.tif" /><img file="US2022121884A1_D20990.tif" /><img file="US2022121884A1_D20991.tif" /><img file="US2022121884A1_D20992.tif" /><img file="US2022121884A1_D20993.tif" /><img file="US2022121884A1_D20994.tif" /><img file="US2022121884A1_D20995.tif" /><img file="US2022121884A1_D20996.tif" /><img file="US2022121884A1_D20997.tif" /><img file="US2022121884A1_D20998.tif" /><img file="US2022121884A1_D20999.tif" /><img file="US2022121884A1_D21000.tif" /><img file="US2022121884A1_D21001.tif" /><img file="US2022121884A1_D21002.tif" /><img file="US2022121884A1_D21003.tif" /><img file="US2022121884A1_D21004.tif" /><img file="US2022121884A1_D21005.tif" /><img file="US2022121884A1_D21006.tif" /><img file="US2022121884A1_D21007.tif" /><img file="US2022121884A1_D21008.tif" /><img file="US2022121884A1_D21009.tif" /><img file="US2022121884A1_D21010.tif" /><img file="US2022121884A1_D21011.tif" /><img file="US2022121884A1_D21012.tif" /><img file="US2022121884A1_D21013.tif" /><img file="US2022121884A1_D21014.tif" /><img file="US2022121884A1_D21015.tif" /><img file="US2022121884A1_D21016.tif" /><img file="US2022121884A1_D21017.tif" /><img file="US2022121884A1_D21018.tif" /><img file="US2022121884A1_D21019.tif" /><img file="US2022121884A1_D21020.tif" /><img file="US2022121884A1_D21021.tif" /><img file="US2022121884A1_D21022.tif" /><img file="US2022121884A1_D21023.tif" /><img file="US2022121884A1_D21024.tif" /><img file="US2022121884A1_D21025.tif" /><img file="US2022121884A1_D21026.tif" /><img file="US2022121884A1_D21027.tif" /><img file="US2022121884A1_D21028.tif" /><img file="US2022121884A1_D21029.tif" /><img file="US2022121884A1_D21030.tif" /><img file="US2022121884A1_D21031.tif" /><img file="US2022121884A1_D21032.tif" /><img file="US2022121884A1_D21033.tif" /><img file="US2022121884A1_D21034.tif" /><img file="US2022121884A1_D21035.tif" /><img file="US2022121884A1_D21036.tif" /><img file="US2022121884A1_D21037.tif" /><img file="US2022121884A1_D21038.tif" /><img file="US2022121884A1_D21039.tif" /><img file="US2022121884A1_D21040.tif" /><img file="US2022121884A1_D21041.tif" /><img file="US2022121884A1_D21042.tif" /><img file="US2022121884A1_D21043.tif" /><img file="US2022121884A1_D21044.tif" /><img file="US2022121884A1_D21045.tif" /><img file="US2022121884A1_D21046.tif" /><img file="US2022121884A1_D21047.tif" /><img file="US2022121884A1_D21048.tif" /><img file="US2022121884A1_D21049.tif" /><img file="US2022121884A1_D21050.tif" /><img file="US2022121884A1_D21051.tif" /><img file="US2022121884A1_D21052.tif" /><img file="US2022121884A1_D21053.tif" /><img file="US2022121884A1_D21054.tif" /><img file="US2022121884A1_D21055.tif" /><img file="US2022121884A1_D21056.tif" />
where μ<sub>p</sub>* is the membership function of the fuzzy probability measure p*. In another words, s indicates the possible probability measures of A<sub>α</sub>, and the color associated with A<sub>α</sub> is associated to s as the measure of this possibility (or rather maximum color for various A<sub>α</sub>'s resulting in the same probability measure s is associated with s) indicating the membership function of p* in s domain.
For example, as depicted in <figref idref="DRAWINGS">FIG. 124(<i>a</i>)</figref>, a probability distribution p(x) in x domain is used to determine the probability measure for various A<sub>α</sub>'s. For example, for α values α<sub>2</sub>′, α<sub>1</sub>′, α<sub>1</sub>, and α<sub>2</sub>, the probability measures for (e.g., piecewise membership functions of) A<sub>α2′</sub>, A<sub>α1′</sub>, A<sub>α0</sub>, A<sub>α1</sub>, and A<sub>α2 </sub>are determined and demoted as s<sub>2</sub>′, s<sub>1</sub>′, s<sub>0</sub>, s<sub>1</sub>, and s<sub>2</sub>, respectively, as depicted in <figref idref="DRAWINGS">FIG. 124(<i>b</i>)</figref>. The corresponding color/grayscale (sup c) is determined as the measure of the possibility of the probability measure value of s, as depicted in <figref idref="DRAWINGS">FIG. 124(<i>b</i>)</figref>. Whereas the probability measure of A (according to p(x)) is a crisp value so, the probability measure of (A, B) is a fuzzy value p*.
In one embodiment, a test score is associated with a proposition or fact (e.g., in form of X is A). In one embodiment, this test score is based on a probability measure of A based on a probability distribution in X. In one embodiment, a fuzzy test score is associated with a proposition or fact (e.g., in form of X is A*), where the test score is based on a fuzzy probability measure of A* and a probability distribution in X. In one embodiment, multiple candidate probability distributions are used to determine test scores associated with each candidate probability distribution per one or more facts or propositions. In one embodiment, an aggregate test score is determined per candidate probability distribution based on associated test scores based on multiple facts or propositions. For example, as depicted in <figref idref="DRAWINGS">FIG. 125(<i>a</i>)</figref>, in one embodiment, multiple facts/propositions are used to determined test scores for one or more candidate probability distribution, e.g., p<sub>i</sub>(x) in X domain. In one embodiment, one or more propositions are in form of fuzzy map A* (e.g., (A<sub>j</sub>, B<sub>j</sub>)). As described in this disclosure, a fuzzy test score, p<sub>i,j</sub>, associated with the probability distribution p<sub>i</sub>(x) is determined based on fuzzy map A* (e.g., (A<sub>j</sub>, B<sub>j</sub>)). In one embodiment, one or more propositions are in form of Z-valuation, e.g., X is Z<sub>q </sub>(or (X, C<sub>q</sub>, D<sub>q</sub>)). As described in this disclosure, such Z valuation imposes a restriction (or test score ts<sub>i,q</sub>) on a candidate probability distribution p<sub>i</sub>(x), e.g., in form of value of membership function of D<sub>q </sub>for probability measure of C<sub>q</sub>. In one embodiment, such a test score is a crisp value in [0, 1] range. As depicted in <figref idref="DRAWINGS">FIG. 125(<i>a</i>)</figref>, test score ts<sub>i,q </sub>is shown as a sharp/crisp value between [0, 1] with a membership value (crisp) of 1. In one embodiment, one or more propositions are in form of fuzzy restriction, e.g., X is E<sub>k</sub>, where E<sub>k </sub>is a fuzzy set in X domain. As described in this disclosure (as depicted in <figref idref="DRAWINGS">FIG. 125(<i>a</i>)</figref>), a score (s<sub>i,k</sub>) is associated to a probability distribution p<sub>i</sub>(x), e.g., in form of a probability measure of E<sub>k </sub>based on p<sub>i</sub>(x). In one embodiment, various test scores (crisp and/or fuzzy) associated with a probability distribution p<sub>i</sub>(x) are aggregated by, for example, MIN or {circumflex over ( )} operation. For example, MIN operation is used between fuzzy sets/numbers and crisp numbers to determined an aggregate test score (t<sub>i</sub>) associated with a probability distribution p<sub>i</sub>(x).
<br /><i>t</i><sub>i </sub>=(. . . {circumflex over ( )}<i>p</i><sub>i,j</sub>* {circumflex over ( )}. . . {circumflex over ( )}<i>ts</i><sub>i,q</sub>{circumflex over ( )}. . . {circumflex over ( )}<i>s</i><sub>i,k</sub>{circumflex over ( )}. . . )
In one embodiment, {circumflex over ( )} operation takes the minimum of all the crisp test scores such as ts<sub>i,q </sub>and s<sub>i,k</sub>. In one embodiment, the {circumflex over ( )} operation with fuzzy set/numbers (e.g., p<sub>i,j</sub>*) uses extension principle. In one embodiment, the {circumflex over ( )} operation with fuzzy set/numbers (e.g., p<sub>i,j</sub>*) uses alphα-cut approach to determine a minimum fuzzy set. In one embodiment, a crisp number is modeled as a discrete impulse having a membership function of one, e.g., as depicted in <figref idref="DRAWINGS">FIG. 125(<i>a</i>)</figref>, for s<sub>i,k</sub>. In one embodiment, for example, a set of alpha cuts (e.g., at predefined values of 0<sup>+</sup>, 0.5, and 1) are used to determine the alpha cut intervals in various fuzzy sets/values and crisp numbers, as depicted in <figref idref="DRAWINGS">FIG. 125(<i>b</i>)</figref>. In one embodiment, piecewise corner points in fuzzy sets/values are used to determine MIN. For example, <figref idref="DRAWINGS">FIG. 125(<i>b</i>)</figref> depicts the MIN operation on two fuzzy sets p<sub>i,j </sub>* and p<sub>i,k </sub>*and two crisp numbers ts<sub>i,q </sub>and s<sub>i,k</sub>. The result of MIN operation, in the example, as depicted in <figref idref="DRAWINGS">FIG. 125(<i>b</i>)</figref>, is a fuzzy set with a membership function denoted as μ(t<sub>i</sub>) (shown in solid line). An approximate result based on alpha cuts at 0<sup>+</sup>, 0.5, and 1, is a fuzzy set denoted as μ′(t<sub>i</sub>)(shown in dash line in <figref idref="DRAWINGS">FIG. 125(<i>b</i>)</figref>). In one embodiment, a centroid or peak of μ(t<sub>i</sub>) or μ′(t<sub>i</sub>) is used as a test score associated with p<sub>i</sub>(x). In one embodiment, μ(t<sub>i</sub>) or μ′(t<sub>i</sub>) is used in a subsequent operation as the test score associated with p<sub>i</sub>(x).
Note that usage of “MIN” and “min” are context dependent. For example, in above “MIN” is used to indicate hierarchy/order between two or more fuzzy values/sets, such as “small”, “medium”, and “large”. “min” has been used to indicate the minimum of two values, such as the membership functions values at a given x, e.g., min(μ<sub>A</sub>(x), μ<sub>B</sub>(x)) for all x, for example, to indicate the membership function of (A ∩B).
More Examples & Applications:
In one embodiment, we have a method for fuzzy logic control, in which an input module receives a precisiated proposition associated with a protoform. A fuzzy logic inference engine evaluates a first fuzzy logic rule from the fuzzy logic rule repositoty. The fuzzy logic inference engine is in or loaded on or executed on or implemented in a computing device, which comprises one or more of following: computer, processor device, integrated circuit, microprocessor, or server. The fuzzy logic rule repository comprises one or more fuzzy logic rules. The fuzzy logic rule comprises an antecedent part and a consequent part. The precisiated proposition comprises a Z-valuation, which is in a form of ordered triple (X, A, B), representing a statement assignment of X to a pair (A, B), where X represents a variable, A is a fuzzy logic set in domain of X, and B is a fuzzy logic set representing a certainty indicator of X being possiblistically restricted by the fuzzy logic set A. <figref idref="DRAWINGS">FIG. 119</figref> is an example of a system described above.
The evaluating step comprises a test score evaluation module assigning a first test score to a candidate probability distribution for X based on the Z-valuation. The candidate probability distribution belongs to a set of candidate probability distributions. The test score evaluation module assigns a second test score to the antecedent part based on the antecedent part, set of candidate probability distributions, and the first test score. The fuzzy logic inference engine determines whether the antecedent part is satisfied beyond a threshold, based on the second test score. <figref idref="DRAWINGS">FIG. 119</figref> is an example of a system described above.
In one embodiment, we have the precisiated proposition comprising a Z-valuation. In one embodiment, we have the consequent part comprising a Z-valuation. The fuzzy logic inference engine determines whether the antecedent part is satisfied beyond a threshold. The system correlates the consequent part with a first truth value based on the antecedent part. The system assigns a first test score to a candidate probability distribution for X based on the Z-valuation. The candidate probability distribution belongs to a set of candidate probability distributions. The correlating step uses the first truth value and the first test score. The fuzzy logic inference engine aggregates a possibilistic restriction on the candidate probability distribution, based on the correlated consequent part. <figref idref="DRAWINGS">FIG. 119</figref> is an example of a system described above.
In one embodiment, we have all parts of the system comprising a Z-valuation. In one embodiment, we have the fuzzy logic rule repository comprising one or more databases, tables, or codes (e.g. as instructions or executables). In one embodiment, the set of candidate probability distributions is generated dynamically, obtained from a database, or input from an interface, e.g. by a user. In one embodiment, the set of candidate probability distributions is based on one or more parameters associated to a model of probability distribution function, e.g. a family of class of probability distribution functions. In one embodiment, the fuzzy logic inference engine uses backward chaining inference or forward chaining inference. In one embodiment, the fuzzy logic inference engine uses a pattern matching algorithm in a forward chaining inference. In one embodiment, the fuzzy logic inference engine performs one or more join operations with variable binding. <figref idref="DRAWINGS">FIG. 119</figref> is an example of a system described above.
In one embodiment, the system comprises a rule execution or a rule firing manager, an agenda or task manager, a knowledge base database or storage, a parallel rule execution module, device, or subsystem, a goal analyzing module or device, a resolving module or device, a deffuzification module or device, an aggregation module or device, a correlation module or device, and/or a join network. In one embodiment, the fuzzy logic inference engine comprises the test score evaluation module. In one embodiment, the fuzzy logic inference engine is separate or different from the test score evaluation module. <figref idref="DRAWINGS">FIG. 119</figref> is an example of a system described above.
Specific Applications:
In different embodiments, the system is designed for the different applications, such as: <ul id="ul0069" list-style="none"><li id="ul0069-0001" num="0000"><ul id="ul0070" list-style="none"><li id="ul0070-0001" num="1669">(a) economics and stock market or decision analysis (see <figref idref="DRAWINGS">FIG. 94</figref>),</li><li id="ul0070-0002" num="1670">(b) risk assessment and insurance (see <figref idref="DRAWINGS">FIG. 95</figref>),</li><li id="ul0070-0003" num="1671">(c) prediction or anticipation (see <figref idref="DRAWINGS">FIG. 96</figref>),</li><li id="ul0070-0004" num="1672">(d) rule-based characterization of imprecise functions and relations (see <figref idref="DRAWINGS">FIG. 97</figref>),</li><li id="ul0070-0005" num="1673">(e) biomedicine and medical diagnosis (see <figref idref="DRAWINGS">FIG. 99</figref>, e.g. for tele-medicine and remote diagnosis),</li><li id="ul0070-0006" num="1674">(f) medical equipment and measurements (see <figref idref="DRAWINGS">FIG. 98</figref>, e.g. for measuring blood pressure or X-ray analysis),</li><li id="ul0070-0007" num="1675">(g) robotics (see <figref idref="DRAWINGS">FIG. 100</figref>, e g. on a factory floor for an assembly line),</li><li id="ul0070-0008" num="1676">(h) automobile (see <figref idref="DRAWINGS">FIG. 101</figref>, e.g. measuring environmental parameters, to adjust braking system in different driving conditions),</li><li id="ul0070-0009" num="1677">(i) control systems and autonomous systems (see <figref idref="DRAWINGS">FIG. 102</figref>, e.g for driving a car autonomously, without a driver),</li><li id="ul0070-0010" num="1678">(j) searching for objects, search engines, and data mining (see <figref idref="DRAWINGS">FIG. 103</figref>, e.g. for searching td find friends in the vicinity of the user (or the store), for social networking, event planning, or marketing purposes),</li><li id="ul0070-0011" num="1679">(k) speaker or voice recognition (see <figref idref="DRAWINGS">FIG. 104</figref>, for an example of a voice recognition system),</li><li id="ul0070-0012" num="1680">(l) pattern or target recognition (e.g. airplane recognition or detection, or tracking in video frames, with signature or main features for an airplane) (see <figref idref="DRAWINGS">FIG. 105</figref>),</li><li id="ul0070-0013" num="1681">(m)security and biometrics (see <figref idref="DRAWINGS">FIG. 106</figref>),</li><li id="ul0070-0014" num="1682">(n) translation between languages (For example, one can use multiple systems for interpretation as shown as a part of <figref idref="DRAWINGS">FIG. 72</figref>, with one system per language, feeding each other, as a cascade, to translate between languages.).</li></ul></li></ul>
In one embodiment, the system does the translation between 2 languages, however, there is not a one-to-one mapping or relationship between 2 words or phrases in the 2 languages. Thus, the system uses the context to find the proper meaning, and for the second language (to which it is translated), the system carries the real meaning as an attachment to the word. For example, for the second language, for the translated part, we have:
[Tank, CONTAINER]
where TANK is the translation in English, and CONTAINER is the real concept behind the word TANK, to remove the ambiguity in the translation (as the word TANK has at least 2 meanings in the American English language).
Surveys:
In one embodiment, the system collects data through voting, survey, on-line, on-paper, using experts, using psychologists, using linguists, collecting opinions, with question on multiple choices with degree of agreement e.g. between 0 to 100, telephone surveys, computer surveys, online surveys, using social networks, using databases, government surveys, random surveys, statistical analysis, population specific surveys, target specific surveys, market surveys, using market reports, using census data, using agents on Internet, using robots, using search engines, or using neural networks as trainers, in order to get membership values, meaning of words or phrases in a language, region, dialect, profession, city, country, or population, language dynamics and evolvement, new words or usage of words, new technical words or Hollywood words or slangs, find the rate of changes in meanings, convergence or divergence of words or concepts or usages, define or extract membership curves and functions, reliability, credibility degree or value, information value, trustworthiness of the speaker or source, or any fuzzy parameter or Z-number concept, e.g. those defined or used in this disclosure.
This is a time-dependent exercise and concept, and it must be updated, as needed, or regularly, depending on the degree of dynamics of the vocabulary or dictionary or slangs or culture or industry or concept or immigration or changes in population mix, which are fuzzy values by themselves. The results of surveys and opinions of people, users, experts, section of population, and other data are stored in databases for future use, for example, for definition or values for Fuzzy membership functions or Z-number interpretations and applications.
In one embodiment, the system handles multiple Z-valuations or numbers. In one embodiment, the system does the reasoning step and/or summarization step with Z-valuations or numbers.
In one embodiment, please note that there are two types of IF-THEN statements. For the first type, at the THEN part, we set a value for a variable. Thus, if the IF section is partially satisfied, based on a membership value, then the value of the variable can be clipped or scaled down (e.g. as a ratio) based on (e.g. proportional to) the membership value. For the second type, at the THEN part, we have an action, e.g. to turn off the light switch for an equipment, which is a binary decision. In this case, if the IF section is partially satisfied, based on a membership value, then we have a threshold(s) (or ranges of values), for which for the values above or below the threshold, to activate or fire the THEN part, e.g. turn off the light switch for an equipment. The threshold can be expressed based on an absolute value, a relative value, a range, a Z-number, or a fuzzy value. Examples of threshold are 0.1, 0.5, 10 percent, 10 percent of average, 10 percent of maximum value, open/close range of real numbers (0. 0.5], 10 Kg (i.e. kilograms, for mass measurement), “usually 10 years”, or “about 10 years”.
Please note that since our method of computation is the closest to the human thinking and speech, it would be the most efficient way of instructing the machines to do a function based on the user's voice command (after parsing the speech, for speech recognition, and conversion to text, commands, templates, or computer codes, based on pre-defined and dynamic/adjustable grammar or rules).
Control systems, e.g. with multiple (If . . . Then . . . ) rules, can be used for efficient washing machines (consuming less water and detergent, based on level of dirt and type of clothing), braking system for train or cars (for optimum braking), air-conditioning system (better control of the temperature in the room, with less waste in energy), cameras or copy machines (for better image color adjustment or contrast adjustment or ink concentration), car fuel injection systems (for better air and fuel supply, for different engine environments and performances), parallel parking or autonomous driving cars (for optimum performances), robots in a factory assembly floor (with variations on objects received, on the manufacturing steps, for optimum correctional procedures), self-diagnosis and self-repair robots (for best possible diagnosis, to fix itself), system-of-systems (e.g. a colony of swimming robots acting together for a common task, e.g. finding an object in or under water, for proper target recognition or classification and proper feedback to each other, to guide other robots to proper areas of the ocean floor, to avoid duplicative work and effort by other robots in the colony), or any operation of complex machinery in a complex environment for optimum results. (The rules are discussed elsewhere in this disclosure.)
<figref idref="DRAWINGS">FIG. 60</figref> shows a fuzzy system, with multiple (If . . . Then . . . ) rules. There are 2 different main approaches for analysis and processing of the resulting membership function curves: (1) One method is to trim resulting membership function curve at the specific value of the membership function, as the upper allowed value. (2) The second method is to scale down the original membership function curve by a factor equal to the specific value of the membership function (which is a real number between 0 and 1), as the upper allowed value. Either way, the maximum allowed membership function is generally reduced from 1, in the final membership function curve.
In one embodiment, one uses composite maximum for the defuzzification step. In another embodiment, one uses composite moments (for the area under the curve, or the center of mass) for the defuzzification step.
For backward chaining inference engine, one can use a system as shown in <figref idref="DRAWINGS">FIG. 57</figref>, with a processor (or controlling) module, knowledge base, rule storage, and a task manager. <figref idref="DRAWINGS">FIG. 58</figref> shows a procedure on a system for finding the value of a goal, to fire (or trigger or execute) a rule (based on that value) (e.g. for Rule N, from a policy containing Rules R, K, L, M, N, and G).
<figref idref="DRAWINGS">FIG. 59</figref> shows a forward chaining inference engine (system), with a pattern matching engine that matches the current data state against the predicate of each rule, to find the ones that should be executed (or fired). Pattern matching module is connected to both processing (or controlling) module and interpreter module, to find the rules and also to change the association threads that find each candidate node for next loop (cycle).
As mentioned above, fuzzy reasoning systems can gather knowledge from multiple sources (experts), e.g. conflicting, collaborating, and cooperating experts. In a conventional system, one can use a weighted (biased) average technique, to assign weights on different advisors or sources of information. In the fuzzy system, one can use an adaptive peer ranking parameter (with peer ranking amplification), while firing rules in the fuzzy investment model, and with combination through weighted output averaging, or with combination through tizzy set aggregation (i.e. combined intelligence). To combine multiple fuzzy models, one uses a system such as the one shown in <figref idref="DRAWINGS">FIG. 50</figref>.
<figref idref="DRAWINGS">FIG. 51</figref> shows a feed-forward fuzzy system. <figref idref="DRAWINGS">FIG. 52</figref> shows a fuzzy feedback system, performing at different periods. <figref idref="DRAWINGS">FIG. 53</figref> shows an adaptive fuzzy system, in which an objective function is measured against, to change the parameters of the model. A training algorithm such as “If . . . Then . . . ” rules can be used, or fuzzy system rules are generated from the data. (The new rules are generated or modified.)
A fuzzy cognitive map (FCM) for causal flow can be used for adaptive and feedback systems, to model: if A<sub>i </sub>then A<sub>j </sub>to B<sub>ij</sub>, where the nodes are concepts (e.g. A<sub>i </sub>and A<sub>j</sub>) and B<sub>ij </sub>represents the degree of strength of the connection between A<sub>i </sub>and A<sub>j</sub>. To activate each concept, there is an activation threshold required (as the minimum strength required). This diagram can represent complex relationships (e.g. one concept increases or decreases the likelihood of another concept). A fuzzy cognitive map is shown in <figref idref="DRAWINGS">FIG. 54</figref>, with B<sub>ij </sub>displayed near the arrows and activation thresholds displayed inside the rectangles representing each state). A special function is used to combine fuzzy rule weights. <figref idref="DRAWINGS">FIG. 55</figref> is an example of the fuzzy cognitive map for the credit card fraud relationships, indicating positive or negative effects of one parameter on another, using 1 or −1 values, respectively (with the direction of the arrow).
For an M-state fuzzy cognitive map, we generally need an M×M matrix for the representation of all the relationships. So, if we get N opinions from N different experts, as N fuzzy cognitive maps, we can combine all N fuzzy cognitive maps using Σ (summation) operation on all corresponding matrix entries (L). Then, if each expert has a different level of expertise or reliability (as peer or user ranking, or an assigned weight, w<sub>j</sub>, for j=1, . . . , N), then we will have:
<br /><i>L</i>=Σ<sub>j</sub>(<i>w</i><sub>j</sub><i>L</i><sub>j</sub>)
To build a fuzzy model, one can go through iterations, as shown in <figref idref="DRAWINGS">FIG. 56</figref>, to validate a model, based on some thresholds or conditions.
For investment portfolio management for a client, one can have a financial management system as shown in <figref idref="DRAWINGS">FIG. 49</figref>, relating policy, rules, fuzzy sets, and hedges (e.g. high risk, medium risk, or low risk).
For knowledge mining and rule discovery, one can use Wang-Mendel rule discovery method, to partition input-output spaces into fuzzy regions, then generate fuzzy rules from training data, apply discriminant filter to rules, and create a combined fuzzy associative memory (FAM), which is a matrix (based on the inputs). A method is shown in <figref idref="DRAWINGS">FIG. 47</figref>. This can be used in health care claim (e.g. Medicare) and credit card processing fraud detections, as a knowledge mining technique. A system is shown in <figref idref="DRAWINGS">FIG. 48</figref>, for credit card fraud detection.
With the teachings mentioned above, in one embodiment, one can ask about “the top ten biggest companies” (which may change every year) or “top ten tallest mountains in the world” (which does not change every year), and get an answer by the search engine. See, for example, <figref idref="DRAWINGS">FIG. 109</figref>, for such a system.
The search engine can accumulate data from FACEBOOK or YOUTUBE or social sites or government sites or others on idle times, and store them for future searches in the databases, with classes and sub-classes, for faster retrieval, when needed. That also helps to find or distinguish people with the same exact name, build their profiles, and focus advertisement or marketing products, based on their preferences or past history or behaviors.
Please note that for the teachings above, a function y=f(x) as a graph, but without a known formula, can always be approximated by fuzzy graph, as piecewise approximation on the graph, which makes that relationship fuzzy. Then, one can solve based on the fuzzy graph, instead.
For systems that need load balancing, such as server farms for a search engine company or power generators in a electric grid for a country (which have different down times, delays, redundancies, supplies, demands, growths, expenses, new sources, or the like), the system can work in optimum conditions, or adjust fast, using the fuzzy rules and constraints for the system (as explained elsewhere in this disclosure), e.g. for emergency conditions and procedures, to reduce (for example) the blackout time for the consumers in the power grid in various parts of the country, or e.g. speed up the search engine in all parts of the world (by reducing the demand pressure on some areas, and increasing utilization percentages on idle or under-utilized areas of the server farms, to spread out the computing power in an optimized way), using the fuzzy parameters (such as the utilization factor which has a membership value between 0 and 1), as explained elsewhere in this disclosure.
For databases, the database entries can generally be ordered and compared, with respect to one or more fuzzy rules, to index and sort or extract (or query) some useful information from the database(s), resulting in a listing or an ordered table. For example, <figref idref="DRAWINGS">FIG. 61</figref> shows a system for credit card fraud detection, using a fuzzy SQL suspect determination module, in which fuzzy predicates are used in relational database queries. The fuzzy queries in relational database environment result in better fraud detection (because they fit better in real life situations). In one embodiment, the fuzzy database management process involves using fuzzy indexes, scanning database row, determining column membership grades, storing row locations and membership grades, and sorting the stored rows in descending membership order.
For one embodiment, <figref idref="DRAWINGS">FIG. 93</figref> shows an expert system, which can be integrated or combined with any of the systems taught in this disclosure.
The teachings above can be used for speech recognition, as well. For example, <figref idref="DRAWINGS">FIG. 62</figref> shows a method of conversion of the digitized speech into feature vectors (for example, suggested by S. B. Davis and P. Mermelstein). In our case, the feature vectors are not the exact matches, and the matching (or contribution) is based on (expressed as) the value of membership function for the corresponding feature vector. <figref idref="DRAWINGS">FIG. 63</figref> shows a system for language recognition or determination, with various membership values for each language (e.g. English, French, and German). The feature vectors can also be used for speaker recognition (e.g. male-female identity, or a specific person's identity, from pre-recorded samples in a database from various people). This can be used for the verification of the identity of a specific user, or to find the possible owner of a specific speech among many users.
Feature vectors can be used for speech recognition, as well, which can be done after the language is determined. In this case, one tries to match the phones or words with a large database of dictionary of all possible words or phones or sequence of phones in a specific language, pre-recorded and categorized. Again, the membership function values are used to find the possible words, via the possible sequence of phones which make up those words, phrases, or sentences. In one embodiment, the sequence of phones is compared to a chain of pointers connecting database phones, in a predetermined database, for all possible combinations of phones, resulting in all possible words, phrases, or sentences, especially the most common ones in a language, to give a possibility of each candidate word or phrase, to rank and select one or more of them for further processing, depending on some threshold(s) which can be a fuzzy parameter itself. In one embodiment, the sequences of phones are mapped to the words in a relational database, which can be updated by the user frequently, or gets trained to recognize the words (with an accompanied neural network system) for a specific user(s).
The similar teachings can be applied to the OCR (optical character recognition) of typed text or handwriting or signature. The text can be broken down in units of letters, pieces of words or letters, or feature vectors (as a basis for a fuzzy set, corresponding to an N-dimensional feature space), and gets compared with those in a database with variations on style or in handwriting, to find the possible targets, with various membership values.
This can be applied to any pattern recognition system or method, such as image mining or recognition on a large number of images (for example, for satellite or radar or laser or stereo or 3D (3-dimensional) imaging), e.g. using a knowledge-based database, with metadata attached or annotated to each image, identifying the source, parameters, or details of the image, e.g. as keywords or indices (which can also be used for database query). This can be used as a user-trainable search tool, employing a neural network module, with scoring functions using examples and counterexamples histograms. For example, in a bin (or partition) where there are more counterexamples than the number of examples, the resulting score is negative. These can be used for the recognition of (for example) trucks, cars, people, structures, and buildings in the images, with membership values associated with each target recognition. Each stored object or class of objects in the database (of all possible objects) has a signature (or one or more specific features, in an N-dimensional feature space, such as the length of the object, the angle between two lines, or the ratio of the length-to-width of the object), which can be matched to (or compared with) a target, with a corresponding membership value for each feature. This can be used for biometrics and security applications, as well, such as face recognition, iris recognition, hand recognition, or fingerprint recognition (e.g. with feature vectors defined from the curved pieces on fingerprints).
There are 2 major types of fuzzy inference systems: Mamdani-type (using the center of mass of the aggregation result) and Sugeno-type, both of which can be used in the systems of the current invention.
In one embodiment, the fuzzy system is used for trip planning or scheduling and its optimization in a trip or daily work. For example, the time for traffic delays and time for leaving the office, plus the threshold time for catching an air plane, are all expressed as fuzzy parameters, as discussed and analyzed elsewhere in this disclosure.
In one embodiment, when we have many systems, one feeding another one, we may want to keep the result of one in fuzzy form (as fuzzy region(s)), e.g. without applying the centroid defuzzification step. This way, the information does not get lost, when it feeds into another system, and it is also convertible to the human's natural language, based on the combination of predetermined templates and their corresponding hedges, stored beforehand in some database (for comparison and conclusion or conversion).
Context Dependent:
Please note that the concept of “tall” (as an example) is both speaker-dependent and audience-dependent. For example, the same person giving lectures in Holland (having very tall population, in general) and Indonesia means differently, when talking with the audience of different population (having different size and height) in different countries, regarding various concepts, such as “being tall”. This is also time-dependent. For example, if a person is giving lecture in the year 1700 AD (or talk about people living a few hundred years ago), in comparison to today (when people are generally taller), the concept of “being tall” is different for those situations. For some embodiments, the membership function and values are time-dependent. In addition, for some embodiments, the element of time is a part of the context analysis.
General Notes:
In one embodiment, the sum of the values of membership functions (corresponding to any point on the horizontal axis) is exactly 1. See <figref idref="DRAWINGS">FIG. 70</figref> for an example, for the range of reliability factor or parameter, with 3 designations of Low, Medium, and High.
Please note that for all of our teachings here, different truth-value systems (e.g. those suggested by or known as Lukasiewicz, Godel, Product, and Zadeh), for definitions of e.g. T-norm operation, T-co-norm, and negation, can be used. For example, the symbol {circumflex over ( )} means AND, “minimum”, or PRODUCT, for various truth-value systems. We can be consistent on one definition throughout the calculations and analysis (from the beginning to the end), or alternatively, mix the definitions (i.e. use various definitions for the same operation, from various truth-value systems) for various steps of the analysis. Either way, it is covered in our teachings here, for this patent application.
For all the systems taught here, one can use a microprocessor, processor, computer, computing device, controller, CPU, central processing module, processing unit, or controlling unit, to calculate, analyze, convert, and process the data, and it can store the information on a disk, hard drive, memory unit, storage unit, ROM, RAM, optical disc, magnetic unit, memory module, database, flash drive, removable drive, server, PC, RAID, tape, or the like. The information can be processed serially or in parallel. The communication between different units, devices, or modules are done by wire, cable, fiber optics, wirelessly, WiFi, Bluetooth, through network. Internet, copper interconnect, antenna, satellite dish, or the like.
Any variations/combinations of the teachings here/this disclosure are also intended to be covered by this patent application.
Z-Webs:
Here, we introduce Z-webs, including Z-factors and Z-nodes, for the understanding of relationships between objects, subjects, abstract ideas, concepts, or the like, including face, car, images, people, emotions, mood, text, natural language, voice, music, video, locations, formulas, facts, historical data, landmarks, personalities, ownership, family, friends, love, happiness, social behavior, voting behavior, and the like, to be used for many applications in our life, including on the search engine, analytics, Big Data processing, natural language processing, economy forecasting, face recognition, dealing with reliability and certainty, medical diagnosis, pattern recognition, object recognition, biometrics, security analysis, risk analysis, fraud detection, satellite image analysis, machine generated data analysis, machine learning, training samples, extracting data or patterns (from the video, images, and the like), editing video or images, and the like. Z-factors include reliability factor, confidence factor, expertise factor, bias factor, and the like, which is associated with each Z-node in the Z-web.
Approximate Z-Number Evaluation:
In this section, we present a method for approximate evaluation of Z-Numbers, using category sets of probability distributions corresponding to similar certainty measures. All the figures are displayed in Appendix 1, as color images. This is also (partially) the subject of a paper (pages 476-483 of the conf. proceedings) and presentation given at an international Fuzzy conf. in Baku, Azerbaijan, on Dec 3-5, 2012 (“The 2<sup>nd </sup>World Conference on Soft Computing”), by the inventors. Appendix 1 is a copy of the paper at the Baku Conf. Appendix 3 is a copy of the VU graph PowerPoint presentation at the Baku Cont. Appendix 2 is a copy of the handwritten notes, in addition to the teachings of Appendices 1 and 3. All the Appendices 1-3 are the teachings of the current inventors, in support of the current disclosure, and are incorporated herein.
A Z-Number is denoted as an ordered pair (A, B), where A and B are fuzzy numbers (typically perception-based and described in natural language), in order to describe the level of certainty or reliability of a fuzzy restriction of a real-valued uncertain variable X in Z-valuation (X, A, B). (See L. A. Zadeh, “A note on Z-numbers,” Inform. Sciences, vol. 181, pp. 2923-2932, March 2011.) For example, the proposition “the price of ticket is usually high”, may be expressed as a Z-valuation (price or ticket, high, usually). In Z-valuation, the certainty component B describes the reliability of the possibilistic restriction, R, for the random variable X, where
<br />R(X): X is A (1)
with the reliability restriction given by
<br />Prob(X is A) is B (2)
In another words, the certainty component B, restricts the probability measure of A, denoted by v,
<br /><i>v</i>=Prob(<i>X </i>is <i>A</i>)=∫<sub>X </sub>μ<sub>A</sub>(<i>x</i>)·<i>p</i><sub>x</sub>(<i>x</i>)·<i>dx </i> (3)
where μ<sub>A</sub>(x) is the membership function of x in fuzzy set A on X domain, and p<sub>X </sub>is the probability distribution of X. Therefore, the certainty component .B indirectly restricts the possibilities of various (candidate) hidden probability distributions of X by: (eq. 4 below)
<maths id="MATH-US-00094" num="00094"><math overflow="scroll"><mrow><mrow><mrow><msub><mi>μ</mi><mi>B</mi></msub><mo></mo><mrow><mo>(</mo><mi>v</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><msub><mi>μ</mi><mi>B</mi></msub><mo></mo><mrow><mo>(</mo><mrow><munder><mo>∫</mo><mi>X</mi></munder><mo></mo><mrow><mrow><msub><mi>μ</mi><mi>A</mi></msub><mo></mo><mrow><mo>(</mo><mi>x</mi><mo>)</mo></mrow></mrow><mo>·</mo><mrow><msub><mi>p</mi><mi>x</mi></msub><mo></mo><mrow><mo>(</mo><mi>x</mi><mo>)</mo></mrow></mrow><mo>·</mo><mi>dx</mi></mrow></mrow><mo>)</mo></mrow></mrow></mrow><mo>,</mo></mrow></math></maths><img file="US2022121884A1_D21057.tif" /><img file="US2022121884A1_D21058.tif" /><img file="US2022121884A1_D21059.tif" /><img file="US2022121884A1_D21060.tif" /><img file="US2022121884A1_D21061.tif" /><img file="US2022121884A1_D21062.tif" /><img file="US2022121884A1_D21063.tif" /><img file="US2022121884A1_D21064.tif" /><img file="US2022121884A1_D21065.tif" /><img file="US2022121884A1_D21066.tif" /><img file="US2022121884A1_D21067.tif" /><img file="US2022121884A1_D21068.tif" /><img file="US2022121884A1_D21069.tif" /><img file="US2022121884A1_D21070.tif" /><img file="US2022121884A1_D21071.tif" /><img file="US2022121884A1_D21072.tif" /><img file="US2022121884A1_D21073.tif" /><img file="US2022121884A1_D21074.tif" /><img file="US2022121884A1_D21075.tif" /><img file="US2022121884A1_D21076.tif" /><img file="US2022121884A1_D21077.tif" /><img file="US2022121884A1_D21078.tif" /><img file="US2022121884A1_D21079.tif" /><img file="US2022121884A1_D21080.tif" /><img file="US2022121884A1_D21081.tif" /><img file="US2022121884A1_D21082.tif" /><img file="US2022121884A1_D21083.tif" /><img file="US2022121884A1_D21084.tif" /><img file="US2022121884A1_D21085.tif" /><img file="US2022121884A1_D21086.tif" /><img file="US2022121884A1_D21087.tif" /><img file="US2022121884A1_D21088.tif" /><img file="US2022121884A1_D21089.tif" /><img file="US2022121884A1_D21090.tif" /><img file="US2022121884A1_D21091.tif" /><img file="US2022121884A1_D21092.tif" /><img file="US2022121884A1_D21093.tif" /><img file="US2022121884A1_D21094.tif" /><img file="US2022121884A1_D21095.tif" /><img file="US2022121884A1_D21096.tif" /><img file="US2022121884A1_D21097.tif" /><img file="US2022121884A1_D21098.tif" /><img file="US2022121884A1_D21099.tif" /><img file="US2022121884A1_D21100.tif" /><img file="US2022121884A1_D21101.tif" /><img file="US2022121884A1_D21102.tif" /><img file="US2022121884A1_D21103.tif" /><img file="US2022121884A1_D21104.tif" /><img file="US2022121884A1_D21105.tif" /><img file="US2022121884A1_D21106.tif" /><img file="US2022121884A1_D21107.tif" /><img file="US2022121884A1_D21108.tif" /><img file="US2022121884A1_D21109.tif" /><img file="US2022121884A1_D21110.tif" /><img file="US2022121884A1_D21111.tif" /><img file="US2022121884A1_D21112.tif" /><img file="US2022121884A1_D21113.tif" /><img file="US2022121884A1_D21114.tif" /><img file="US2022121884A1_D21115.tif" /><img file="US2022121884A1_D21116.tif" /><img file="US2022121884A1_D21117.tif" /><img file="US2022121884A1_D21118.tif" /><img file="US2022121884A1_D21119.tif" /><img file="US2022121884A1_D21120.tif" /><img file="US2022121884A1_D21121.tif" /><img file="US2022121884A1_D21122.tif" /><img file="US2022121884A1_D21123.tif" /><img file="US2022121884A1_D21124.tif" /><img file="US2022121884A1_D21125.tif" /><img file="US2022121884A1_D21126.tif" /><img file="US2022121884A1_D21127.tif" /><img file="US2022121884A1_D21128.tif" /><img file="US2022121884A1_D21129.tif" /><img file="US2022121884A1_D21130.tif" /><img file="US2022121884A1_D21131.tif" /><img file="US2022121884A1_D21132.tif" /><img file="US2022121884A1_D21133.tif" /><img file="US2022121884A1_D21134.tif" /><img file="US2022121884A1_D21135.tif" /><img file="US2022121884A1_D21136.tif" /><img file="US2022121884A1_D21137.tif" /><img file="US2022121884A1_D21138.tif" /><img file="US2022121884A1_D21139.tif" /><img file="US2022121884A1_D21140.tif" /><img file="US2022121884A1_D21141.tif" /><img file="US2022121884A1_D21142.tif" /><img file="US2022121884A1_D21143.tif" /><img file="US2022121884A1_D21144.tif" /><img file="US2022121884A1_D21145.tif" /><img file="US2022121884A1_D21146.tif" /><img file="US2022121884A1_D21147.tif" /><img file="US2022121884A1_D21148.tif" /><img file="US2022121884A1_D21149.tif" /><img file="US2022121884A1_D21150.tif" /><img file="US2022121884A1_D21151.tif" /><img file="US2022121884A1_D21152.tif" /><img file="US2022121884A1_D21153.tif" /><img file="US2022121884A1_D21154.tif" /><img file="US2022121884A1_D21155.tif" /><img file="US2022121884A1_D21156.tif" /><img file="US2022121884A1_D21157.tif" /><img file="US2022121884A1_D21158.tif" /><img file="US2022121884A1_D21159.tif" /><img file="US2022121884A1_D21160.tif" /><img file="US2022121884A1_D21161.tif" /><img file="US2022121884A1_D21162.tif" /><img file="US2022121884A1_D21163.tif" /><img file="US2022121884A1_D21164.tif" /><img file="US2022121884A1_D21165.tif" /><img file="US2022121884A1_D21166.tif" /><img file="US2022121884A1_D21167.tif" /><img file="US2022121884A1_D21168.tif" />
where μ<sub>B</sub>(v) is the membership function of the probability measure v in fuzzy set B.
Here, we show a method to approximate Z-valuation, based on categories (sets) of p<sub>X </sub>'s with similar probability measures (or resulting in similar certainty measure), as an approach to reuse predetermined calculations of probability measures. First, we demonstrate an example of Z-valuation without such approach, and then, we present an approximate approach to Z-valuation via categorical sets of probability distributions.
A. Z Valuation: Basics:
The Z-valuation uses the mapping of the test scores given by (4) to each of hidden probability distribution candidates of X (See L. A, Zadeh, “A note on Z-numbers,” Inform. Sciences, vol 181, pp. 2923-2932, March 2011. See also R. Yager, “On Z-valuations using Zadeh's Z-numbers,” Int. J. Intell. Syst., Vol. 27, Issue 3, pp. 259-278, March 2012.), collectively referred to as
<br />Prob. Distrib. Candidates={p<sub>i}, </sub> (5)
where i numerates different candidates. <figref idref="DRAWINGS">FIG. 1</figref> of Appendix 1 conceptually illustrates the mapping, where each p<sub>i </sub>is first mapped to a probability measure of A, v<sub>i</sub>, and then mapped to a test score determined by B, where
<br /><i>v</i><sub>i</sub>=μ<sub>A</sub><i>·p</i><sub>i</sub>=∫<sub>x</sub>μ<sub>A</sub>(<i>x</i>)·<i>p</i><sub>i</sub>(<i>x</i>)·<i>dx, </i> (6)
and
<br /><i>ts</i><sub>i</sub>=μ<sub>B</sub>(<i>v</i><sub>i</sub>) (7)
Note that the dot symbol in (μ<sub>A</sub>·p<sub>i</sub>) in (6) is used as shorthand for the probability measure. <figref idref="DRAWINGS">FIG. 1</figref> of Appendix 1 shows the test score mapping to hidden probability distribution candidates p<sub>i </sub>in X, for Z-valuation (X,A,B).
Via the extension principle, the application of the restriction (test scores) on p<sub>x,i</sub>(x) (i.e., probability distribution candidates in X domain) to other entities is illustrated. For example, the restriction on p<sub>x,i</sub>(x) can be extended. to the possibilistic restriction on the corresponding probability distributions, p<sub>y,i</sub>(y), in Y domain, where
<br />Y=f(X).
In such a case, the restrictions can further be extended to the probability measures, w<sub>i</sub>, of a fuzzy set A<sub>y </sub>in Y domain, based on p<sub>y,i</sub>(y). The aggregation of the best test scores for w<sub>i </sub>would determine the certainty component B<sub>Y </sub>in Z-valuation (Y,A<sub>Y</sub>,B<sub>Y</sub>), based on the original Z-valuation (X,A<sub>X</sub>,B<sub>X</sub>), as indicated in <figref idref="DRAWINGS">FIG. 2</figref> of Appendix 1, which illustrates the extension of test scores to Y domain. <figref idref="DRAWINGS">FIG. 2</figref> of Appendix 1 is a test score mapping from X domain to Y domain and aggregation of test scores on probability measures, w, for Z-valuation (Y,A<sub>Y</sub>,B<sub>Y</sub>).
For simplicity, as shown in <figref idref="DRAWINGS">FIG. 2</figref> of Appendix 1. three probability distribution candidates in X domain, p<sub>x,1</sub>, p<sub>x,2</sub>, and p<sub>x,3</sub>, are assigned test scores ts<sub>1 </sub>and ts<sub>2</sub>, via certainty restriction on probability measures v<sub>1 </sub>and v<sub>2 </sub>(with p<sub>x,2</sub>, and p<sub>x,3</sub>, having the same probability measure v<sub>2 </sub>for A<sub>x</sub>). By applying f(X) to each probability distribution candidate in X domain, we can obtain a corresponding probability distribution in Y domain, denoted as p<sub>y,i</sub>, which can be used to compute the corresponding probability measure of A<sup>Y </sup>(assume given), denoted as w<sub>i</sub>. In this example, p<sub>y,1</sub>, and p<sub>y,2 </sub>(mapped from p<sub>x,1</sub>, and p<sub>x,2</sub>) result in the same probability measure w<sub>2 </sub>(or aggregated w bin), while p<sub>y,3 </sub>(mapped from p<sub>x,3</sub>) maps into w<sub>1</sub>. In this simple example, the aggregation of the best test scores for p<sub>y,i</sub>, denoted as ts(p<sub>y,i</sub>), in w domain (e.g., in each w bin) would result in the following membership function for B<sub>Y</sub>:
<br />μ<sub>B</sub><sub><sub2>y</sub2></sub>(<i>w</i><sub>1</sub>)=<i>ts</i><sub>2 </sub>
<br />μ<sub>B</sub><sub><sub2>y</sub2></sub>(<i>w</i><sub>2</sub>)=max(<i>ts</i><sub>1</sub><i>, ts</i><sub>2</sub>).
In other words, in this scenario,
<maths id="MATH-US-00095" num="00095"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><msub><mi>μ</mi><msub><mi>B</mi><mi>Y</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>w</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><munder><mi>sup</mi><mrow><mo>∀</mo><msub><mi>p</mi><mrow><mi>y</mi><mo>,</mo><mi>i</mi></mrow></msub></mrow></munder><mo></mo><mrow><mi>ts</mi><mo></mo><mrow><mo>(</mo><msub><mi>p</mi><mrow><mi>y</mi><mo>,</mo><mi>i</mi></mrow></msub><mo>)</mo></mrow></mrow></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mn>8</mn><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2022121884A1_D21169.tif" /><img file="US2022121884A1_D21170.tif" /><img file="US2022121884A1_D21171.tif" /><img file="US2022121884A1_D21172.tif" /><img file="US2022121884A1_D21173.tif" /><img file="US2022121884A1_D21174.tif" /><img file="US2022121884A1_D21175.tif" /><img file="US2022121884A1_D21176.tif" /><img file="US2022121884A1_D21177.tif" /><img file="US2022121884A1_D21178.tif" /><img file="US2022121884A1_D21179.tif" /><img file="US2022121884A1_D21180.tif" /><img file="US2022121884A1_D21181.tif" /><img file="US2022121884A1_D21182.tif" /><img file="US2022121884A1_D21183.tif" /><img file="US2022121884A1_D21184.tif" /><img file="US2022121884A1_D21185.tif" /><img file="US2022121884A1_D21186.tif" /><img file="US2022121884A1_D21187.tif" /><img file="US2022121884A1_D21188.tif" /><img file="US2022121884A1_D21189.tif" /><img file="US2022121884A1_D21190.tif" /><img file="US2022121884A1_D21191.tif" /><img file="US2022121884A1_D21192.tif" /><img file="US2022121884A1_D21193.tif" /><img file="US2022121884A1_D21194.tif" /><img file="US2022121884A1_D21195.tif" /><img file="US2022121884A1_D21196.tif" /><img file="US2022121884A1_D21197.tif" /><img file="US2022121884A1_D21198.tif" /><img file="US2022121884A1_D21199.tif" /><img file="US2022121884A1_D21200.tif" /><img file="US2022121884A1_D21201.tif" /><img file="US2022121884A1_D21202.tif" /><img file="US2022121884A1_D21203.tif" /><img file="US2022121884A1_D21204.tif" /><img file="US2022121884A1_D21205.tif" /><img file="US2022121884A1_D21206.tif" /><img file="US2022121884A1_D21207.tif" /><img file="US2022121884A1_D21208.tif" /><img file="US2022121884A1_D21209.tif" /><img file="US2022121884A1_D21210.tif" /><img file="US2022121884A1_D21211.tif" /><img file="US2022121884A1_D21212.tif" /><img file="US2022121884A1_D21213.tif" /><img file="US2022121884A1_D21214.tif" /><img file="US2022121884A1_D21215.tif" /><img file="US2022121884A1_D21216.tif" /><img file="US2022121884A1_D21217.tif" /><img file="US2022121884A1_D21218.tif" /><img file="US2022121884A1_D21219.tif" /><img file="US2022121884A1_D21220.tif" /><img file="US2022121884A1_D21221.tif" /><img file="US2022121884A1_D21222.tif" /><img file="US2022121884A1_D21223.tif" /><img file="US2022121884A1_D21224.tif" /><img file="US2022121884A1_D21225.tif" /><img file="US2022121884A1_D21226.tif" /><img file="US2022121884A1_D21227.tif" /><img file="US2022121884A1_D21228.tif" /><img file="US2022121884A1_D21229.tif" /><img file="US2022121884A1_D21230.tif" /><img file="US2022121884A1_D21231.tif" /><img file="US2022121884A1_D21232.tif" /><img file="US2022121884A1_D21233.tif" /><img file="US2022121884A1_D21234.tif" /><img file="US2022121884A1_D21235.tif" /><img file="US2022121884A1_D21236.tif" /><img file="US2022121884A1_D21237.tif" /><img file="US2022121884A1_D21238.tif" /><img file="US2022121884A1_D21239.tif" /><img file="US2022121884A1_D21240.tif" /><img file="US2022121884A1_D21241.tif" /><img file="US2022121884A1_D21242.tif" /><img file="US2022121884A1_D21243.tif" /><img file="US2022121884A1_D21244.tif" /><img file="US2022121884A1_D21245.tif" /><img file="US2022121884A1_D21246.tif" /><img file="US2022121884A1_D21247.tif" /><img file="US2022121884A1_D21248.tif" /><img file="US2022121884A1_D21249.tif" /><img file="US2022121884A1_D21250.tif" /><img file="US2022121884A1_D21251.tif" /><img file="US2022121884A1_D21252.tif" /><img file="US2022121884A1_D21253.tif" /><img file="US2022121884A1_D21254.tif" /><img file="US2022121884A1_D21255.tif" /><img file="US2022121884A1_D21256.tif" /><img file="US2022121884A1_D21257.tif" /><img file="US2022121884A1_D21258.tif" /><img file="US2022121884A1_D21259.tif" /><img file="US2022121884A1_D21260.tif" /><img file="US2022121884A1_D21261.tif" /><img file="US2022121884A1_D21262.tif" /><img file="US2022121884A1_D21263.tif" /><img file="US2022121884A1_D21264.tif" /><img file="US2022121884A1_D21265.tif" /><img file="US2022121884A1_D21266.tif" /><img file="US2022121884A1_D21267.tif" /><img file="US2022121884A1_D21268.tif" /><img file="US2022121884A1_D21269.tif" /><img file="US2022121884A1_D21270.tif" /><img file="US2022121884A1_D21271.tif" /><img file="US2022121884A1_D21272.tif" /><img file="US2022121884A1_D21273.tif" /><img file="US2022121884A1_D21274.tif" /><img file="US2022121884A1_D21275.tif" /><img file="US2022121884A1_D21276.tif" /><img file="US2022121884A1_D21277.tif" /><img file="US2022121884A1_D21278.tif" /><img file="US2022121884A1_D21279.tif" /><img file="US2022121884A1_D21280.tif" />
subject to
<br /><i>w</i>=μ<sub>A</sub><sub><sub2>y</sub2></sub><i>·p</i><sub>y,i</sub>.
In case of single variable dependency Y=f(X), the probability measure w can be evaluated by unpacking the probability distribution in Y as illustrated by (9) and transforming the integration over X domain as shown in (10), without explicitly evaluating p<sub>y,i</sub>:
<maths id="MATH-US-00096" num="00096"><math overflow="scroll"><mtable><mtr><mtd><mrow><msub><mi>w</mi><mi>i</mi></msub><mo>=</mo><mrow><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>Y</mi></msub></msub><mo>·</mo><msub><mi>p</mi><mrow><mi>y</mi><mo>,</mo><mi>i</mi></mrow></msub></mrow><mo>=</mo><mrow><mrow><munder><mo>∫</mo><mi>Y</mi></munder><mo></mo><mrow><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>Y</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>y</mi><mo>)</mo></mrow></mrow><mo>·</mo><mrow><msub><mi>p</mi><mrow><mi>y</mi><mo>,</mo><mi>i</mi></mrow></msub><mo></mo><mrow><mo>(</mo><mi>y</mi><mo>)</mo></mrow></mrow><mo>·</mo><mi>dy</mi></mrow></mrow><mo>=</mo><mrow><msub><mo>∫</mo><mi>Y</mi></msub><mo></mo><mrow><mrow><msub><mi>μ</mi><msub><mi>A</mi><mi>Y</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>y</mi><mo>)</mo></mrow></mrow><mo>·</mo><mrow><msub><mo>∑</mo><mi>j</mi></msub><mo></mo><mrow><mfrac><mrow><msub><mi>p</mi><mrow><mi>x</mi><mo>,</mo><mi>i</mi></mrow></msub><mo></mo><mrow><mo>(</mo><msub><mi>x</mi><mi>j</mi></msub><mo>)</mo></mrow></mrow><mrow><mo></mo><mrow><msup><mi>f</mi><mi>′</mi></msup><mo></mo><mrow><mo>(</mo><msub><mi>x</mi><mi>j</mi></msub><mo>)</mo></mrow></mrow><mo></mo></mrow></mfrac><mo>·</mo><mi>dy</mi></mrow></mrow></mrow></mrow></mrow></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mn>9</mn><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2022121884A1_D21281.tif" /><img file="US2022121884A1_D21282.tif" /><img file="US2022121884A1_D21283.tif" /><img file="US2022121884A1_D21284.tif" /><img file="US2022121884A1_D21285.tif" /><img file="US2022121884A1_D21286.tif" /><img file="US2022121884A1_D21287.tif" /><img file="US2022121884A1_D21288.tif" /><img file="US2022121884A1_D21289.tif" /><img file="US2022121884A1_D21290.tif" /><img file="US2022121884A1_D21291.tif" /><img file="US2022121884A1_D21292.tif" /><img file="US2022121884A1_D21293.tif" /><img file="US2022121884A1_D21294.tif" /><img file="US2022121884A1_D21295.tif" /><img file="US2022121884A1_D21296.tif" /><img file="US2022121884A1_D21297.tif" /><img file="US2022121884A1_D21298.tif" /><img file="US2022121884A1_D21299.tif" /><img file="US2022121884A1_D21300.tif" /><img file="US2022121884A1_D21301.tif" /><img file="US2022121884A1_D21302.tif" /><img file="US2022121884A1_D21303.tif" /><img file="US2022121884A1_D21304.tif" /><img file="US2022121884A1_D21305.tif" /><img file="US2022121884A1_D21306.tif" /><img file="US2022121884A1_D21307.tif" /><img file="US2022121884A1_D21308.tif" /><img file="US2022121884A1_D21309.tif" /><img file="US2022121884A1_D21310.tif" /><img file="US2022121884A1_D21311.tif" /><img file="US2022121884A1_D21312.tif" /><img file="US2022121884A1_D21313.tif" /><img file="US2022121884A1_D21314.tif" /><img file="US2022121884A1_D21315.tif" /><img file="US2022121884A1_D21316.tif" /><img file="US2022121884A1_D21317.tif" /><img file="US2022121884A1_D21318.tif" /><img file="US2022121884A1_D21319.tif" /><img file="US2022121884A1_D21320.tif" /><img file="US2022121884A1_D21321.tif" /><img file="US2022121884A1_D21322.tif" /><img file="US2022121884A1_D21323.tif" /><img file="US2022121884A1_D21324.tif" /><img file="US2022121884A1_D21325.tif" /><img file="US2022121884A1_D21326.tif" /><img file="US2022121884A1_D21327.tif" /><img file="US2022121884A1_D21328.tif" /><img file="US2022121884A1_D21329.tif" /><img file="US2022121884A1_D21330.tif" /><img file="US2022121884A1_D21331.tif" /><img file="US2022121884A1_D21332.tif" /><img file="US2022121884A1_D21333.tif" /><img file="US2022121884A1_D21334.tif" /><img file="US2022121884A1_D21335.tif" /><img file="US2022121884A1_D21336.tif" /><img file="US2022121884A1_D21337.tif" /><img file="US2022121884A1_D21338.tif" /><img file="US2022121884A1_D21339.tif" /><img file="US2022121884A1_D21340.tif" /><img file="US2022121884A1_D21341.tif" /><img file="US2022121884A1_D21342.tif" /><img file="US2022121884A1_D21343.tif" /><img file="US2022121884A1_D21344.tif" /><img file="US2022121884A1_D21345.tif" /><img file="US2022121884A1_D21346.tif" /><img file="US2022121884A1_D21347.tif" /><img file="US2022121884A1_D21348.tif" /><img file="US2022121884A1_D21349.tif" /><img file="US2022121884A1_D21350.tif" /><img file="US2022121884A1_D21351.tif" /><img file="US2022121884A1_D21352.tif" /><img file="US2022121884A1_D21353.tif" /><img file="US2022121884A1_D21354.tif" /><img file="US2022121884A1_D21355.tif" /><img file="US2022121884A1_D21356.tif" /><img file="US2022121884A1_D21357.tif" /><img file="US2022121884A1_D21358.tif" /><img file="US2022121884A1_D21359.tif" /><img file="US2022121884A1_D21360.tif" /><img file="US2022121884A1_D21361.tif" /><img file="US2022121884A1_D21362.tif" /><img file="US2022121884A1_D21363.tif" /><img file="US2022121884A1_D21364.tif" /><img file="US2022121884A1_D21365.tif" /><img file="US2022121884A1_D21366.tif" /><img file="US2022121884A1_D21367.tif" /><img file="US2022121884A1_D21368.tif" /><img file="US2022121884A1_D21369.tif" /><img file="US2022121884A1_D21370.tif" /><img file="US2022121884A1_D21371.tif" /><img file="US2022121884A1_D21372.tif" /><img file="US2022121884A1_D21373.tif" /><img file="US2022121884A1_D21374.tif" /><img file="US2022121884A1_D21375.tif" /><img file="US2022121884A1_D21376.tif" /><img file="US2022121884A1_D21377.tif" /><img file="US2022121884A1_D21378.tif" /><img file="US2022121884A1_D21379.tif" /><img file="US2022121884A1_D21380.tif" /><img file="US2022121884A1_D21381.tif" /><img file="US2022121884A1_D21382.tif" /><img file="US2022121884A1_D21383.tif" /><img file="US2022121884A1_D21384.tif" /><img file="US2022121884A1_D21385.tif" /><img file="US2022121884A1_D21386.tif" /><img file="US2022121884A1_D21387.tif" /><img file="US2022121884A1_D21388.tif" /><img file="US2022121884A1_D21389.tif" /><img file="US2022121884A1_D21390.tif" /><img file="US2022121884A1_D21391.tif" /><img file="US2022121884A1_D21392.tif" />
where j denotes the consecutive monotonic ranges of f(X) in X domain, and x<sub>j </sub>is the solution for f<sup>1</sup>(y), if any, within the monotonic range j, for a given y. This takes into account that the probability (p<sub>y,i</sub>, dy) for an event within the infinitesimal interval of [y, y+dy] in Y domain, is the summation of the infinitesimal probabilities from various infinitesimal intervals [x<sub>j</sub>+dx<sub>j</sub>] (if applicable) in X domain, where for each j:
<br /><i>dy=f</i>′(<i>x</i><sub>j</sub>)·<i>dx</i><sub>j </sub>
Therefore, with repacking the integration (9) in X domain over the consecutive monotonic ranges of f(X), we obtain:
<br /><i>w</i><sub>i</sub>=∫<sub>X </sub>μ<sub>A</sub><sub><sub2>y</sub2></sub>(<i>f</i>(<i>x</i>))·<i>p</i><sub>x,i</sub>(<i>x</i>)·<i>dx </i> (10)
Furthermore, if f(X) is monotonic (i.e., f<sup>1</sup>(y) has only one solution in X, if any) ANDμ<sub>A</sub><sub><sub2>y </sub2></sub>is obtained from μ<sub>A</sub><sub><sub2>X </sub2></sub>via the extension principle by applying f(X) to A<sub>X</sub>, then w<sub>i </sub>is guaranteed to be equal to v<sub>i </sub>for all candidate probability distributions p<sub>x,i</sub>, because μ<sub>A</sub><sub><sub2>y</sub2></sub>(y)=μ<sub>A</sub><sub><sub2>X</sub2></sub>(x) for ∀y=f(x) in such a case. This also means that in such a case, B<sub>Y </sub>becomes equal to B<sub>X</sub>, and no additional computation would be necessary.
B. Z-Valuation: Example:
To illustrate an example of Z-valuation, assume the following is given:
<br /><i>X</i>=(<i>A</i><sub>X</sub><i>, B</i><sub>X</sub>),
<br /><i>Y=f</i>(<i>X</i>)=(<i>X</i>+2)<sup>2</sup>, and
<br />A<sub>Y</sub>.
The goal is to determine the certainty value B<sub>Y </sub>for the proposition that (Y is A<sub>Y</sub>), i.e., the Z-valuation (Y, A<sub>Y</sub>, B<sub>Y</sub>). For purpose of this example, assume <figref idref="DRAWINGS">FIGS. 3, 4, and 5</figref> of Appendix 1 depict the membership functions for A<sub>X</sub>, B<sub>X</sub>, and A<sub>Y</sub>, respectively. The function f(X) is also depicted in <figref idref="DRAWINGS">FIG. 6</figref> of Appendix 1. <figref idref="DRAWINGS">FIG. 3</figref> of Appendix 1 is the membership function of A<sub>X</sub>, e.g., “X is around zero”, <figref idref="DRAWINGS">FIG. 4</figref> of Appendix 1 is the membership function of B<sub>X</sub>, e.g., “Likely”. <figref idref="DRAWINGS">FIG. 5</figref> of Appendix 1 is the membership function of A<sub>Y</sub>, e.g., “Y is about nine”. <figref idref="DRAWINGS">FIG. 6</figref> of Appendix 1 is a diagram depicting f(X).
In this example, the set of candidate probability distribution for X was constructed using Normal distributions with mean (m<sub>x</sub>) ranging from −2 to 2 and standard deviation (σ<sub>x</sub>) ranging from 0<sup>+</sup> (close to Dirac delta function) to 1.2. <figref idref="DRAWINGS">FIGS. 7 and 8</figref> of Appendix 1 depict the probability measure of A<sub>X</sub>, denoted as v, based on (3) and each of these probability distribution candidates represented by a point on (m<sub>x</sub>, σ<sub>x</sub>) plane. These also illustrate the contour maps of constant probability measures. <figref idref="DRAWINGS">FIGS. 9 and 10</figref> of Appendix 1 depict the test scores (denoted as ts) for each probability distribution candidate, based on the application of certainty component B<sub>X </sub>to each probability measure, v, via (4). Given that fax imposes a test score on each v, the probability distribution candidates that form a contour (on (m<sub>x</sub>, σ<sub>x</sub>) plane) for constant v, also form a contour for the corresponding test score. However, given that a range of v values may result in the same test score (e.g., for v less than 0.5 or above 0.75, in this example), some test score contours on (m<sub>x</sub>, σ<sub>x</sub>) plane collapse to flat ranges (e.g., for test scores 0 and 1, in this example), as depicted on <figref idref="DRAWINGS">FIGS. 9 and 10</figref> of Appendix 1.
B<sub>Y </sub>applying (10), we can then determine the probability measure of A<sub>Y </sub>(in Y domain), denoted as w, based on the probability distribution candidates in X domain (i.e., bypassing the direct calculation of the corresponding probability distributions in Y domain). The probability measure w is depicted in <figref idref="DRAWINGS">FIGS. 11 and 12</figref> of Appendix 1 for each probability distribution candidate in (m<sub>x</sub>, σ<sub>x</sub>) plane.
Given that each probability distribution candidate is associated with a possibility restriction test score (as shown for example in <figref idref="DRAWINGS">FIG. 10</figref> of Appendix 1), such test score can be applied and correlated with the probability measure w (shown for example in <figref idref="DRAWINGS">FIG. 12</figref> of Appendix 1). A given w (or a w bin) may be associated with multiple test scores as indicated by contours of constant w or regions of very close or similar w in <figref idref="DRAWINGS">FIG. 12</figref> of Appendix 1.
Therefore, to assign a final test score to a given w (or w bin) based on (8), we can determine the maximum test score for all w's associated with the given w bin.
The result of an intermediate step for determining the maximum test score for correlated w's (i.e., falling in the same w bin) is illustrated in <figref idref="DRAWINGS">FIG. 13</figref> of Appendix 1, on the (m<sub>X</sub>, σ<sub>X</sub>) plane (for illustrative comparison with <figref idref="DRAWINGS">FIG. 11</figref> of Appendix 1).
The resulting maximum test score associated with a given w bin defines the membership function of w (or a value of w representing the w bin) in B<sub>Y</sub>, as depicted for this example in <figref idref="DRAWINGS">FIG. 14</figref> of Appendix 1. As shown in <figref idref="DRAWINGS">FIGS. 11 and 13</figref> of Appendix 1, where w is high, the maximum associated test score is low, resulting in B<sub>Y </sub>which represents “significantly less than 25%” for this example. <figref idref="DRAWINGS">FIG. 7</figref> of Appendix 1 is the probability measure of A<sub>X</sub>, v, per each (Normal) probability distribution candidate represented by (m<sub>X</sub>, σ<sub>X</sub>). <figref idref="DRAWINGS">FIG. 8</figref> of Appendix 1 is the contours of the probability measure of A<sub>X</sub>, v, per each (Normal) probability distribution candidate represented by (m<sub>X</sub>, σ<sub>X</sub>). <figref idref="DRAWINGS">FIG. 9</figref> of Appendix 1 is the test score based on certainty measure B<sub>X </sub>for each (Normal) probability distribution candidate represented by (m<sub>X</sub>, σ<sub>X</sub>). <figref idref="DRAWINGS">FIG. 10</figref> of Appendix 1 is the test score based on certainty measure B<sub>X </sub>for each (Normal) probability distribution candidate represented by (m<sub>X</sub>, σ<sub>X</sub>). <figref idref="DRAWINGS">FIG. 11</figref> of Appendix 1 is the probability measure of A<sub>Y</sub>, w, per each probability distribution (Normal) candidate represented by (m<sub>X</sub>, σ<sub>X</sub>).
<figref idref="DRAWINGS">FIG. 12</figref> of Appendix 1 is the contours of the probability measure of A<sub>Y</sub>, w, per each probability distribution (Normal) candidate represented by (m<sub>X</sub>, σ<sub>X</sub>). <figref idref="DRAWINGS">FIG. 13</figref> of Appendix 1 is the maximum test score for a w-bin associated with each probability distribution (Normal) candidate represented by (m<sub>X</sub>, σ<sub>X</sub>). <figref idref="DRAWINGS">FIG. 14</figref> of Appendix 1 is the maximum test scores for w-bins defining the membership function of w in fuzzy set B<sub>Y</sub>, e.g., “significantly less than 25%”.
II. Z-Valuation Using Granular Category Sets:
A. Predetermined Category Sets: Test Scores, Probability Measures, and Probability Distributions:
The probability measure of Ax, denoted as v, may be predetermined and reused, given that the integration in (3) may be normalized based on the general shape of the membership function of A<sub>X </sub>and the class/parameters of probability distribution candidates. In normalized form, for example, a category of normalized membership function may be defined as symmetric trapezoid with its support at interval [−1,1] with a single parameter, β, indicating the ratio of its core to its support (as shown in <figref idref="DRAWINGS">FIG. 15</figref> of Appendix 1). Examples of classes of probability distribution are Normal distribution and Poisson distribution, with their corresponding parameters normalized with respect to normalized A<sub>X</sub>. For example, for Normal distribution, the parameters (m<sub>x</sub>, σ<sub>x</sub>) may be normalized with respect to half width of the support having the origin of the normalized coordinate translated to cross zero at the center of the support.
Furthermore, we may reduce the level and complexity of computation in approximating the Z-valuation by using a granular approach. For example, for a category of normalized A<sub>X </sub>(e.g., symmetric trapezoid with β of about 0.5, as shown in <figref idref="DRAWINGS">FIG. 15</figref> of Appendix 1), we may predetermine relations/mapping, (or a set of inference rules) between (fuzzy or crisp) subset of probability distribution candidates (of a given class such as Normal or Poisson distribution) and (fuzzy or crisp) subsets of probability measures, v's (as for example shown in <figref idref="DRAWINGS">FIG. 16</figref> of Appendix 1).
Let V<sub>j </sub>denote a category/set of probability measures of A<sub>X </sub>probability measure “High”), where j numerates such categories in v domain. Each V<sub>j </sub>corresponds to a range or (fuzzy or crisp) subset of probability distribution candidates, denoted by C<sub>j </sub>whose p<sub>i </sub>members are defined via the following membership function: (eq. 11, below)
<maths id="MATH-US-00097" num="00097"><math overflow="scroll"><mrow><mrow><mrow><msub><mi>μ</mi><msub><mi>C</mi><mi>j</mi></msub></msub><mo></mo><mrow><mo>(</mo><msub><mi>p</mi><mi>i</mi></msub><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mrow><msub><mi>μ</mi><msub><mi>V</mi><mi>j</mi></msub></msub><mo></mo><mrow><mo>(</mo><mrow><msub><mi>μ</mi><mi>A</mi></msub><mo>·</mo><msub><mi>p</mi><mi>i</mi></msub></mrow><mo>)</mo></mrow></mrow><mo>=</mo><mrow><msub><mi>μ</mi><msub><mi>V</mi><mi>j</mi></msub></msub><mo></mo><mrow><mo>(</mo><mrow><munder><mo>∫</mo><mi>X</mi></munder><mo></mo><mrow><mrow><msub><mi>μ</mi><mi>A</mi></msub><mo></mo><mrow><mo>(</mo><mi>x</mi><mo>)</mo></mrow></mrow><mo>·</mo><mrow><msub><mi>p</mi><mi>i</mi></msub><mo></mo><mrow><mo>(</mo><mi>x</mi><mo>)</mo></mrow></mrow><mo>·</mo><mi>dx</mi></mrow></mrow><mo>)</mo></mrow></mrow></mrow></mrow><mo>,</mo></mrow></math></maths><img file="US2022121884A1_D21393.tif" /><img file="US2022121884A1_D21394.tif" /><img file="US2022121884A1_D21395.tif" /><img file="US2022121884A1_D21396.tif" /><img file="US2022121884A1_D21397.tif" /><img file="US2022121884A1_D21398.tif" /><img file="US2022121884A1_D21399.tif" /><img file="US2022121884A1_D21400.tif" /><img file="US2022121884A1_D21401.tif" /><img file="US2022121884A1_D21402.tif" /><img file="US2022121884A1_D21403.tif" /><img file="US2022121884A1_D21404.tif" /><img file="US2022121884A1_D21405.tif" /><img file="US2022121884A1_D21406.tif" /><img file="US2022121884A1_D21407.tif" /><img file="US2022121884A1_D21408.tif" /><img file="US2022121884A1_D21409.tif" /><img file="US2022121884A1_D21410.tif" /><img file="US2022121884A1_D21411.tif" /><img file="US2022121884A1_D21412.tif" /><img file="US2022121884A1_D21413.tif" /><img file="US2022121884A1_D21414.tif" /><img file="US2022121884A1_D21415.tif" /><img file="US2022121884A1_D21416.tif" /><img file="US2022121884A1_D21417.tif" /><img file="US2022121884A1_D21418.tif" /><img file="US2022121884A1_D21419.tif" /><img file="US2022121884A1_D21420.tif" /><img file="US2022121884A1_D21421.tif" /><img file="US2022121884A1_D21422.tif" /><img file="US2022121884A1_D21423.tif" /><img file="US2022121884A1_D21424.tif" /><img file="US2022121884A1_D21425.tif" /><img file="US2022121884A1_D21426.tif" /><img file="US2022121884A1_D21427.tif" /><img file="US2022121884A1_D21428.tif" /><img file="US2022121884A1_D21429.tif" /><img file="US2022121884A1_D21430.tif" /><img file="US2022121884A1_D21431.tif" /><img file="US2022121884A1_D21432.tif" /><img file="US2022121884A1_D21433.tif" /><img file="US2022121884A1_D21434.tif" /><img file="US2022121884A1_D21435.tif" /><img file="US2022121884A1_D21436.tif" /><img file="US2022121884A1_D21437.tif" /><img file="US2022121884A1_D21438.tif" /><img file="US2022121884A1_D21439.tif" /><img file="US2022121884A1_D21440.tif" /><img file="US2022121884A1_D21441.tif" /><img file="US2022121884A1_D21442.tif" /><img file="US2022121884A1_D21443.tif" /><img file="US2022121884A1_D21444.tif" /><img file="US2022121884A1_D21445.tif" /><img file="US2022121884A1_D21446.tif" /><img file="US2022121884A1_D21447.tif" /><img file="US2022121884A1_D21448.tif" /><img file="US2022121884A1_D21449.tif" /><img file="US2022121884A1_D21450.tif" /><img file="US2022121884A1_D21451.tif" /><img file="US2022121884A1_D21452.tif" /><img file="US2022121884A1_D21453.tif" /><img file="US2022121884A1_D21454.tif" /><img file="US2022121884A1_D21455.tif" /><img file="US2022121884A1_D21456.tif" /><img file="US2022121884A1_D21457.tif" /><img file="US2022121884A1_D21458.tif" /><img file="US2022121884A1_D21459.tif" /><img file="US2022121884A1_D21460.tif" /><img file="US2022121884A1_D21461.tif" /><img file="US2022121884A1_D21462.tif" /><img file="US2022121884A1_D21463.tif" /><img file="US2022121884A1_D21464.tif" /><img file="US2022121884A1_D21465.tif" /><img file="US2022121884A1_D21466.tif" /><img file="US2022121884A1_D21467.tif" /><img file="US2022121884A1_D21468.tif" /><img file="US2022121884A1_D21469.tif" /><img file="US2022121884A1_D21470.tif" /><img file="US2022121884A1_D21471.tif" /><img file="US2022121884A1_D21472.tif" /><img file="US2022121884A1_D21473.tif" /><img file="US2022121884A1_D21474.tif" /><img file="US2022121884A1_D21475.tif" /><img file="US2022121884A1_D21476.tif" /><img file="US2022121884A1_D21477.tif" /><img file="US2022121884A1_D21478.tif" /><img file="US2022121884A1_D21479.tif" /><img file="US2022121884A1_D21480.tif" /><img file="US2022121884A1_D21481.tif" /><img file="US2022121884A1_D21482.tif" /><img file="US2022121884A1_D21483.tif" /><img file="US2022121884A1_D21484.tif" /><img file="US2022121884A1_D21485.tif" /><img file="US2022121884A1_D21486.tif" /><img file="US2022121884A1_D21487.tif" /><img file="US2022121884A1_D21488.tif" /><img file="US2022121884A1_D21489.tif" /><img file="US2022121884A1_D21490.tif" /><img file="US2022121884A1_D21491.tif" /><img file="US2022121884A1_D21492.tif" /><img file="US2022121884A1_D21493.tif" /><img file="US2022121884A1_D21494.tif" /><img file="US2022121884A1_D21495.tif" /><img file="US2022121884A1_D21496.tif" /><img file="US2022121884A1_D21497.tif" /><img file="US2022121884A1_D21498.tif" /><img file="US2022121884A1_D21499.tif" /><img file="US2022121884A1_D21500.tif" /><img file="US2022121884A1_D21501.tif" /><img file="US2022121884A1_D21502.tif" /><img file="US2022121884A1_D21503.tif" /><img file="US2022121884A1_D21504.tif" />
Therefore according to (11), we may predetermine C<sub>j </sub>via a similar method of applying test scores to the probability distribution candidates, p<sub>i</sub>, (as for example shown in <figref idref="DRAWINGS">FIG. 9</figref> of Appendix 1), by replacing B<sub>X </sub>with V<sub>j</sub>. For example, the categories of probability measure V<sub>Low </sub>and V<sub>High </sub>(shown in <figref idref="DRAWINGS">FIGS. 17 and 18</figref> of Appendix 1, respectively), correspond to the (category) fuzzy sets of probability distribution candidates, denotes as C<sub>Low </sub>and C<sub>High </sub>(with labels used in place of j), with a membership function depicted in <figref idref="DRAWINGS">FIGS. 19 and 20</figref> of Appendix 1, respectively.
Furthermore, the certainty levels (test scores) may also be made into granular (fuzzy or crisp) sets TS<sub>k</sub>, e.g., in order to reduce the complexity of calculation during the aggregation process of Z-valuation. Index k numerates these test score category sets. <figref idref="DRAWINGS">FIG. 16</figref> of Appendix 1 may also serve as an example of such categorization (with test score replacing v).
In one approach, the certainty component B<sub>X </sub>is granularly decomposed or mapped (or approximately expressed) via pairs of probability measure and test score category sets, i.e., (V<sub>j</sub>, TS<sub>k</sub>)'s, as for example demonstrated in <figref idref="DRAWINGS">FIG. 21</figref> of Appendix 1. In one approach, each relation pair may be further associated with a weight<sub>j,k </sub>that indicates the degree of mapping of B<sub>X </sub>among the pairs (e.g., when TS<sub>k </sub>is a predefined set). For example:
<maths id="MATH-US-00098" num="00098"><math overflow="scroll"><mrow><msub><mi>weight</mi><mrow><mi>j</mi><mo>,</mo><mi>k</mi></mrow></msub><mo>=</mo><mrow><mrow><munder><mi>sup</mi><mrow><mi>v</mi><mo>∈</mo><mrow><mo>[</mo><mrow><mn>0</mn><mo>,</mo><mn>1</mn></mrow><mo>]</mo></mrow></mrow></munder><mo></mo><mrow><mo>(</mo><mrow><mrow><msub><mi>μ</mi><msub><mi>V</mi><mi>j</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>v</mi><mo>)</mo></mrow></mrow><mo>⋀</mo><mrow><msub><mi>μ</mi><msub><mi>TS</mi><mi>k</mi></msub></msub><mo></mo><mrow><mo>(</mo><mrow><msub><mi>μ</mi><msub><mi>B</mi><mi>X</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>v</mi><mo>)</mo></mrow></mrow><mo>)</mo></mrow></mrow></mrow><mo>)</mo></mrow></mrow><mo>.</mo></mrow></mrow></math></maths><img file="US2022121884A1_D21505.tif" /><img file="US2022121884A1_D21506.tif" /><img file="US2022121884A1_D21507.tif" /><img file="US2022121884A1_D21508.tif" /><img file="US2022121884A1_D21509.tif" /><img file="US2022121884A1_D21510.tif" /><img file="US2022121884A1_D21511.tif" /><img file="US2022121884A1_D21512.tif" /><img file="US2022121884A1_D21513.tif" /><img file="US2022121884A1_D21514.tif" /><img file="US2022121884A1_D21515.tif" /><img file="US2022121884A1_D21516.tif" /><img file="US2022121884A1_D21517.tif" /><img file="US2022121884A1_D21518.tif" /><img file="US2022121884A1_D21519.tif" /><img file="US2022121884A1_D21520.tif" /><img file="US2022121884A1_D21521.tif" /><img file="US2022121884A1_D21522.tif" /><img file="US2022121884A1_D21523.tif" /><img file="US2022121884A1_D21524.tif" /><img file="US2022121884A1_D21525.tif" /><img file="US2022121884A1_D21526.tif" /><img file="US2022121884A1_D21527.tif" /><img file="US2022121884A1_D21528.tif" /><img file="US2022121884A1_D21529.tif" /><img file="US2022121884A1_D21530.tif" /><img file="US2022121884A1_D21531.tif" /><img file="US2022121884A1_D21532.tif" /><img file="US2022121884A1_D21533.tif" /><img file="US2022121884A1_D21534.tif" /><img file="US2022121884A1_D21535.tif" /><img file="US2022121884A1_D21536.tif" /><img file="US2022121884A1_D21537.tif" /><img file="US2022121884A1_D21538.tif" /><img file="US2022121884A1_D21539.tif" /><img file="US2022121884A1_D21540.tif" /><img file="US2022121884A1_D21541.tif" /><img file="US2022121884A1_D21542.tif" /><img file="US2022121884A1_D21543.tif" /><img file="US2022121884A1_D21544.tif" /><img file="US2022121884A1_D21545.tif" /><img file="US2022121884A1_D21546.tif" /><img file="US2022121884A1_D21547.tif" /><img file="US2022121884A1_D21548.tif" /><img file="US2022121884A1_D21549.tif" /><img file="US2022121884A1_D21550.tif" /><img file="US2022121884A1_D21551.tif" /><img file="US2022121884A1_D21552.tif" /><img file="US2022121884A1_D21553.tif" /><img file="US2022121884A1_D21554.tif" /><img file="US2022121884A1_D21555.tif" /><img file="US2022121884A1_D21556.tif" /><img file="US2022121884A1_D21557.tif" /><img file="US2022121884A1_D21558.tif" /><img file="US2022121884A1_D21559.tif" /><img file="US2022121884A1_D21560.tif" /><img file="US2022121884A1_D21561.tif" /><img file="US2022121884A1_D21562.tif" /><img file="US2022121884A1_D21563.tif" /><img file="US2022121884A1_D21564.tif" /><img file="US2022121884A1_D21565.tif" /><img file="US2022121884A1_D21566.tif" /><img file="US2022121884A1_D21567.tif" /><img file="US2022121884A1_D21568.tif" /><img file="US2022121884A1_D21569.tif" /><img file="US2022121884A1_D21570.tif" /><img file="US2022121884A1_D21571.tif" /><img file="US2022121884A1_D21572.tif" /><img file="US2022121884A1_D21573.tif" /><img file="US2022121884A1_D21574.tif" /><img file="US2022121884A1_D21575.tif" /><img file="US2022121884A1_D21576.tif" /><img file="US2022121884A1_D21577.tif" /><img file="US2022121884A1_D21578.tif" /><img file="US2022121884A1_D21579.tif" /><img file="US2022121884A1_D21580.tif" /><img file="US2022121884A1_D21581.tif" /><img file="US2022121884A1_D21582.tif" /><img file="US2022121884A1_D21583.tif" /><img file="US2022121884A1_D21584.tif" /><img file="US2022121884A1_D21585.tif" /><img file="US2022121884A1_D21586.tif" /><img file="US2022121884A1_D21587.tif" /><img file="US2022121884A1_D21588.tif" /><img file="US2022121884A1_D21589.tif" /><img file="US2022121884A1_D21590.tif" /><img file="US2022121884A1_D21591.tif" /><img file="US2022121884A1_D21592.tif" /><img file="US2022121884A1_D21593.tif" /><img file="US2022121884A1_D21594.tif" /><img file="US2022121884A1_D21595.tif" /><img file="US2022121884A1_D21596.tif" /><img file="US2022121884A1_D21597.tif" /><img file="US2022121884A1_D21598.tif" /><img file="US2022121884A1_D21599.tif" /><img file="US2022121884A1_D21600.tif" /><img file="US2022121884A1_D21601.tif" /><img file="US2022121884A1_D21602.tif" /><img file="US2022121884A1_D21603.tif" /><img file="US2022121884A1_D21604.tif" /><img file="US2022121884A1_D21605.tif" /><img file="US2022121884A1_D21606.tif" /><img file="US2022121884A1_D21607.tif" /><img file="US2022121884A1_D21608.tif" /><img file="US2022121884A1_D21609.tif" /><img file="US2022121884A1_D21610.tif" /><img file="US2022121884A1_D21611.tif" /><img file="US2022121884A1_D21612.tif" /><img file="US2022121884A1_D21613.tif" /><img file="US2022121884A1_D21614.tif" /><img file="US2022121884A1_D21615.tif" /><img file="US2022121884A1_D21616.tif" />
In one scenario, the decomposition of B<sub>x </sub>may be expressed as series of tuples in the form (V<sub>j</sub>,TS<sub>k</sub>,weig,ht<sub>j,k</sub>) or simply as a matrix with weight<sub>j,k </sub>as its elements. Given the correspondence between C<sub>j </sub>and V<sub>j</sub>, the granular test score sets TS<sub>k</sub>'s are also associated with granular probability distribution candidate sets, C<sub>j</sub>'s (with the same weight<sub>j,k</sub>).
In another approach, a non-categorical test score e.g., a fuzzy or crisp set) TS<sub>j </sub>is determined for each V<sub>j </sub>(and C<sub>j</sub>), e.g., by using extension principle, based on mapping via B<sub>X</sub>:
<maths id="MATH-US-00099" num="00099"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><msub><mi>μ</mi><msub><mi>TS</mi><mi>j</mi></msub></msub><mo></mo><mrow><mo>(</mo><mi>ts</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><munder><mi>sup</mi><mrow><msup><mi>v</mi><mi>′</mi></msup><mo>∈</mo><mrow><mo>[</mo><mrow><mn>0</mn><mo>,</mo><mn>1</mn></mrow><mo>]</mo></mrow></mrow></munder><mo>(</mo><mrow><mrow><msub><mi>μ</mi><msub><mi>V</mi><mi>j</mi></msub></msub><mo></mo><mrow><mo>(</mo><msup><mi>v</mi><mi>′</mi></msup><mo>)</mo></mrow></mrow><mo>,</mo><mstyle><mtext></mtext></mstyle><mo></mo><mrow><mrow><mi>subject</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mrow><mi>to</mi><mo>:</mo><mi>ts</mi></mrow></mrow><mo>=</mo><mrow><mrow><msub><mi>μ</mi><msub><mi>B</mi><mi>X</mi></msub></msub><mo></mo><mrow><mo>(</mo><msup><mi>v</mi><mi>′</mi></msup><mo>)</mo></mrow></mrow><mo>.</mo></mrow></mrow></mrow></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mn>12</mn><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2022121884A1_D21617.tif" /><img file="US2022121884A1_D21618.tif" /><img file="US2022121884A1_D21619.tif" /><img file="US2022121884A1_D21620.tif" /><img file="US2022121884A1_D21621.tif" /><img file="US2022121884A1_D21622.tif" /><img file="US2022121884A1_D21623.tif" /><img file="US2022121884A1_D21624.tif" /><img file="US2022121884A1_D21625.tif" /><img file="US2022121884A1_D21626.tif" /><img file="US2022121884A1_D21627.tif" /><img file="US2022121884A1_D21628.tif" /><img file="US2022121884A1_D21629.tif" /><img file="US2022121884A1_D21630.tif" /><img file="US2022121884A1_D21631.tif" /><img file="US2022121884A1_D21632.tif" /><img file="US2022121884A1_D21633.tif" /><img file="US2022121884A1_D21634.tif" /><img file="US2022121884A1_D21635.tif" /><img file="US2022121884A1_D21636.tif" /><img file="US2022121884A1_D21637.tif" /><img file="US2022121884A1_D21638.tif" /><img file="US2022121884A1_D21639.tif" /><img file="US2022121884A1_D21640.tif" /><img file="US2022121884A1_D21641.tif" /><img file="US2022121884A1_D21642.tif" /><img file="US2022121884A1_D21643.tif" /><img file="US2022121884A1_D21644.tif" /><img file="US2022121884A1_D21645.tif" /><img file="US2022121884A1_D21646.tif" /><img file="US2022121884A1_D21647.tif" /><img file="US2022121884A1_D21648.tif" /><img file="US2022121884A1_D21649.tif" /><img file="US2022121884A1_D21650.tif" /><img file="US2022121884A1_D21651.tif" /><img file="US2022121884A1_D21652.tif" /><img file="US2022121884A1_D21653.tif" /><img file="US2022121884A1_D21654.tif" /><img file="US2022121884A1_D21655.tif" /><img file="US2022121884A1_D21656.tif" /><img file="US2022121884A1_D21657.tif" /><img file="US2022121884A1_D21658.tif" /><img file="US2022121884A1_D21659.tif" /><img file="US2022121884A1_D21660.tif" /><img file="US2022121884A1_D21661.tif" /><img file="US2022121884A1_D21662.tif" /><img file="US2022121884A1_D21663.tif" /><img file="US2022121884A1_D21664.tif" /><img file="US2022121884A1_D21665.tif" /><img file="US2022121884A1_D21666.tif" /><img file="US2022121884A1_D21667.tif" /><img file="US2022121884A1_D21668.tif" /><img file="US2022121884A1_D21669.tif" /><img file="US2022121884A1_D21670.tif" /><img file="US2022121884A1_D21671.tif" /><img file="US2022121884A1_D21672.tif" /><img file="US2022121884A1_D21673.tif" /><img file="US2022121884A1_D21674.tif" /><img file="US2022121884A1_D21675.tif" /><img file="US2022121884A1_D21676.tif" /><img file="US2022121884A1_D21677.tif" /><img file="US2022121884A1_D21678.tif" /><img file="US2022121884A1_D21679.tif" /><img file="US2022121884A1_D21680.tif" /><img file="US2022121884A1_D21681.tif" /><img file="US2022121884A1_D21682.tif" /><img file="US2022121884A1_D21683.tif" /><img file="US2022121884A1_D21684.tif" /><img file="US2022121884A1_D21685.tif" /><img file="US2022121884A1_D21686.tif" /><img file="US2022121884A1_D21687.tif" /><img file="US2022121884A1_D21688.tif" /><img file="US2022121884A1_D21689.tif" /><img file="US2022121884A1_D21690.tif" /><img file="US2022121884A1_D21691.tif" /><img file="US2022121884A1_D21692.tif" /><img file="US2022121884A1_D21693.tif" /><img file="US2022121884A1_D21694.tif" /><img file="US2022121884A1_D21695.tif" /><img file="US2022121884A1_D21696.tif" /><img file="US2022121884A1_D21697.tif" /><img file="US2022121884A1_D21698.tif" /><img file="US2022121884A1_D21699.tif" /><img file="US2022121884A1_D21700.tif" /><img file="US2022121884A1_D21701.tif" /><img file="US2022121884A1_D21702.tif" /><img file="US2022121884A1_D21703.tif" /><img file="US2022121884A1_D21704.tif" /><img file="US2022121884A1_D21705.tif" /><img file="US2022121884A1_D21706.tif" /><img file="US2022121884A1_D21707.tif" /><img file="US2022121884A1_D21708.tif" /><img file="US2022121884A1_D21709.tif" /><img file="US2022121884A1_D21710.tif" /><img file="US2022121884A1_D21711.tif" /><img file="US2022121884A1_D21712.tif" /><img file="US2022121884A1_D21713.tif" /><img file="US2022121884A1_D21714.tif" /><img file="US2022121884A1_D21715.tif" /><img file="US2022121884A1_D21716.tif" /><img file="US2022121884A1_D21717.tif" /><img file="US2022121884A1_D21718.tif" /><img file="US2022121884A1_D21719.tif" /><img file="US2022121884A1_D21720.tif" /><img file="US2022121884A1_D21721.tif" /><img file="US2022121884A1_D21722.tif" /><img file="US2022121884A1_D21723.tif" /><img file="US2022121884A1_D21724.tif" /><img file="US2022121884A1_D21725.tif" /><img file="US2022121884A1_D21726.tif" /><img file="US2022121884A1_D21727.tif" /><img file="US2022121884A1_D21728.tif" />
<figref idref="DRAWINGS">FIG. 15</figref> of Appendix 1 is a membership function parameter β (ratio of core to support), which adjusts the symmetric trapezoid shape from triangular with (β=0) to crisp with (β=1). <figref idref="DRAWINGS">FIG. 16</figref> of Appendix 1 shows examples of various granular (fuzzy) sets of probability measures. <figref idref="DRAWINGS">FIG. 17</figref> of Appendix 1 is membership function of v in V<sub>Low</sub>. <figref idref="DRAWINGS">FIG. 18</figref> of Appendix 1 is membership function of v in V<sub>High</sub>. <figref idref="DRAWINGS">FIG. 19</figref> of Appendix 1 is membership function of p<sub>i </sub>in C<sub>Low</sub>, (with p<sub>i </sub>represented by its parameters (m<sub>X</sub>, σ<sub>X</sub>)). <figref idref="DRAWINGS">FIG. 20</figref> of Appendix 1 is membership function of p<sub>i </sub>in C<sub>High </sub>(with p<sub>i </sub>represented by its parameters (m<sub>X</sub>, σ<sub>X</sub>)). <figref idref="DRAWINGS">FIG. 21</figref> of Appendix 1 is an example of granularizing/mapping of B<sub>X</sub>, via (V<sub>j</sub>, TS<sub>k</sub>) pairs.
B. Computation and Aggregation via Normalized Categories:
One advantage of reusing the predetermined normalized categories is the reduction in number of calculations, such as the integration or summation in determining probability measures per individual probability distribution candidates in X domain or their corresponding probability distributions in Y domain, per (4) and (8). In addition, instead of propagating the test scores via an individual probability distribution candidate, the extension of the test scores may be done at a more granular level of the probability distribution candidate subsets C<sub>j</sub>, which are typically far fewer in number than the individual probability distribution candidates. However, the aggregation of test scores for Z-valuation, e.g., for (Y,A<sub>Y</sub>,B<sub>Y</sub>), will involve additional overlap determination involving various normalized category sets, as described below.
The normalization of symmetrical trapezoid membership function A<sub>Y</sub>, e.g., “Y is about nine,” as shown in <figref idref="DRAWINGS">FIG. 5</figref> of Appendix 1, involves shifting the origin by −9 and scaling the width by 0.5 (in Y domain) in order to match the position and width of the support to the normalized template depicted in <figref idref="DRAWINGS">FIG. 15</figref> of Appendix 1 (with β=0 determined as the ratio of the core to support), Note that such normalization (translation and scaling) also impacts the location and scaling of associated p<sub>y</sub>'s (e.g., mean and standard deviation) in order to preserve the probability measure of A<sub>Y </sub>per (8).
Note that the predetermined categorical subset of probability distributions in Y domain, denoted as C<sub>Y,j</sub>, that is associated with V<sub>j</sub>, may be distinct from the corresponding one in X domain, denoted as C<sub>X,j</sub>, e.g., due to parameters such as β (or the class of the membership, such as trapezoid or ramp). For example, <figref idref="DRAWINGS">FIG. 22</figref> of Appendix 1 illustrates the membership function of C<sub>Y,High</sub>, for normalized A<sub>Y </sub>(β=0), for comparison with C<sub>X,High</sub>, depicted in <figref idref="DRAWINGS">FIG. 20</figref> of Appendix 1, for the same values of normalized probability distribution parameters. <figref idref="DRAWINGS">FIG. 22</figref> of Appendix 1 is membership function of p<sub>y </sub>in C<sub>Y,High </sub>(with p<sub>y </sub>represented by its parameters (m<sub>Y</sub>, σ<sub>Y</sub>)).
Mapping in X Domain:
In one approach to estimate (10), we may determine (or approximate) μ<sub>A</sub><sub><sub2>y</sub2></sub>(f (x)) in X domain as for example depicted in <figref idref="DRAWINGS">FIG. 23</figref> of Appendix 1, labeled μ<sub>A</sub><sub><sub2>y—X</sub2></sub>(x). Then, we may proceed with mapping and normalization of the membership function to one or more normalized categories of membership functions (e.g., a symmetric trapezoid shape with (β=0)). <figref idref="DRAWINGS">FIG. 23</figref> of Appendix 1 is membership function μ<sub>A</sub><sub><sub2>y→X</sub2></sub>(x). In such an approach, the normalization effects on A<sub>X </sub>and A<sub>Y—X </sub>are combined into a transformation operation, T, (e.g., translation and scaling) used to also transform the normalized probability distribution parameters (e.g., mean and standard deviation). Thus, T also transforms the predetermined subsets of probability distribution candidates, C<sub>X,j</sub>, to C<sub>X,j</sub><sup>T</sup>, e.g., via the extension principle, as follows:
<maths id="MATH-US-00100" num="00100"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><mrow><msub><mi>μ</mi><msubsup><mi>C</mi><mrow><mi>X</mi><mo>,</mo><mi>j</mi></mrow><mi>T</mi></msubsup></msub><mo></mo><mrow><mo>(</mo><msubsup><mi>p</mi><mrow><mi>X</mi><mo>,</mo><mi>i</mi></mrow><mi>T</mi></msubsup><mo>)</mo></mrow></mrow><mo>=</mo><mrow><munder><mi>sup</mi><mrow><mo>∀</mo><msub><mi>p</mi><mrow><mi>X</mi><mo>,</mo><mi>i</mi></mrow></msub></mrow></munder><mo></mo><mrow><msub><mi>μ</mi><msubsup><mi>C</mi><mrow><mi>X</mi><mo>,</mo><mi>j</mi></mrow><mi>T</mi></msubsup></msub><mo></mo><mrow><mo>(</mo><msub><mi>p</mi><mrow><mi>X</mi><mo>,</mo><mi>i</mi></mrow></msub><mo>)</mo></mrow></mrow></mrow></mrow><mo></mo><mstyle><mtext></mtext></mstyle><mo></mo><mrow><mi>subject</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>to</mi></mrow><mo></mo><mstyle><mtext></mtext></mstyle><mo></mo><mrow><mrow><msubsup><mi>p</mi><mrow><mi>X</mi><mo>,</mo><mi>i</mi></mrow><mi>T</mi></msubsup><mo>=</mo><mrow><mi>T</mi><mo></mo><mrow><mo>(</mo><msub><mi>p</mi><mrow><mi>X</mi><mo>,</mo><mi>i</mi></mrow></msub><mo>)</mo></mrow></mrow></mrow><mo>,</mo></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mn>13</mn><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2022121884A1_D21729.tif" /><img file="US2022121884A1_D21730.tif" /><img file="US2022121884A1_D21731.tif" /><img file="US2022121884A1_D21732.tif" /><img file="US2022121884A1_D21733.tif" /><img file="US2022121884A1_D21734.tif" /><img file="US2022121884A1_D21735.tif" /><img file="US2022121884A1_D21736.tif" /><img file="US2022121884A1_D21737.tif" /><img file="US2022121884A1_D21738.tif" /><img file="US2022121884A1_D21739.tif" /><img file="US2022121884A1_D21740.tif" /><img file="US2022121884A1_D21741.tif" /><img file="US2022121884A1_D21742.tif" /><img file="US2022121884A1_D21743.tif" /><img file="US2022121884A1_D21744.tif" /><img file="US2022121884A1_D21745.tif" /><img file="US2022121884A1_D21746.tif" /><img file="US2022121884A1_D21747.tif" /><img file="US2022121884A1_D21748.tif" /><img file="US2022121884A1_D21749.tif" /><img file="US2022121884A1_D21750.tif" /><img file="US2022121884A1_D21751.tif" /><img file="US2022121884A1_D21752.tif" /><img file="US2022121884A1_D21753.tif" /><img file="US2022121884A1_D21754.tif" /><img file="US2022121884A1_D21755.tif" /><img file="US2022121884A1_D21756.tif" /><img file="US2022121884A1_D21757.tif" /><img file="US2022121884A1_D21758.tif" /><img file="US2022121884A1_D21759.tif" /><img file="US2022121884A1_D21760.tif" /><img file="US2022121884A1_D21761.tif" /><img file="US2022121884A1_D21762.tif" /><img file="US2022121884A1_D21763.tif" /><img file="US2022121884A1_D21764.tif" /><img file="US2022121884A1_D21765.tif" /><img file="US2022121884A1_D21766.tif" /><img file="US2022121884A1_D21767.tif" /><img file="US2022121884A1_D21768.tif" /><img file="US2022121884A1_D21769.tif" /><img file="US2022121884A1_D21770.tif" /><img file="US2022121884A1_D21771.tif" /><img file="US2022121884A1_D21772.tif" /><img file="US2022121884A1_D21773.tif" /><img file="US2022121884A1_D21774.tif" /><img file="US2022121884A1_D21775.tif" /><img file="US2022121884A1_D21776.tif" /><img file="US2022121884A1_D21777.tif" /><img file="US2022121884A1_D21778.tif" /><img file="US2022121884A1_D21779.tif" /><img file="US2022121884A1_D21780.tif" /><img file="US2022121884A1_D21781.tif" /><img file="US2022121884A1_D21782.tif" /><img file="US2022121884A1_D21783.tif" /><img file="US2022121884A1_D21784.tif" /><img file="US2022121884A1_D21785.tif" /><img file="US2022121884A1_D21786.tif" /><img file="US2022121884A1_D21787.tif" /><img file="US2022121884A1_D21788.tif" /><img file="US2022121884A1_D21789.tif" /><img file="US2022121884A1_D21790.tif" /><img file="US2022121884A1_D21791.tif" /><img file="US2022121884A1_D21792.tif" /><img file="US2022121884A1_D21793.tif" /><img file="US2022121884A1_D21794.tif" /><img file="US2022121884A1_D21795.tif" /><img file="US2022121884A1_D21796.tif" /><img file="US2022121884A1_D21797.tif" /><img file="US2022121884A1_D21798.tif" /><img file="US2022121884A1_D21799.tif" /><img file="US2022121884A1_D21800.tif" /><img file="US2022121884A1_D21801.tif" /><img file="US2022121884A1_D21802.tif" /><img file="US2022121884A1_D21803.tif" /><img file="US2022121884A1_D21804.tif" /><img file="US2022121884A1_D21805.tif" /><img file="US2022121884A1_D21806.tif" /><img file="US2022121884A1_D21807.tif" /><img file="US2022121884A1_D21808.tif" /><img file="US2022121884A1_D21809.tif" /><img file="US2022121884A1_D21810.tif" /><img file="US2022121884A1_D21811.tif" /><img file="US2022121884A1_D21812.tif" /><img file="US2022121884A1_D21813.tif" /><img file="US2022121884A1_D21814.tif" /><img file="US2022121884A1_D21815.tif" /><img file="US2022121884A1_D21816.tif" /><img file="US2022121884A1_D21817.tif" /><img file="US2022121884A1_D21818.tif" /><img file="US2022121884A1_D21819.tif" /><img file="US2022121884A1_D21820.tif" /><img file="US2022121884A1_D21821.tif" /><img file="US2022121884A1_D21822.tif" /><img file="US2022121884A1_D21823.tif" /><img file="US2022121884A1_D21824.tif" /><img file="US2022121884A1_D21825.tif" /><img file="US2022121884A1_D21826.tif" /><img file="US2022121884A1_D21827.tif" /><img file="US2022121884A1_D21828.tif" /><img file="US2022121884A1_D21829.tif" /><img file="US2022121884A1_D21830.tif" /><img file="US2022121884A1_D21831.tif" /><img file="US2022121884A1_D21832.tif" /><img file="US2022121884A1_D21833.tif" /><img file="US2022121884A1_D21834.tif" /><img file="US2022121884A1_D21835.tif" /><img file="US2022121884A1_D21836.tif" /><img file="US2022121884A1_D21837.tif" /><img file="US2022121884A1_D21838.tif" /><img file="US2022121884A1_D21839.tif" /><img file="US2022121884A1_D21840.tif" />
where p<sub>X,i</sub><sup>T </sup>represents the transformed probability distribution candidate (in X domain) from p<sub>X,i</sub>.
Since in our example, μ<sub>A</sub><sub><sub2>x </sub2></sub>(depicted in <figref idref="DRAWINGS">FIG. 3</figref> of Appendix 1) is already in a normalized form, we focus on the transformation due normalization of μ<sub>A</sub><sub><sub2>y→X</sub2></sub>(x). Note that in <figref idref="DRAWINGS">FIG. 11</figref> of Appendix 1, the outline of probability measure w for (σ<sub>X</sub>=0+) is the same as the membership function μ<sub>A</sub><sub><sub2>y→X</sub2></sub>(x) prior to the normalization, as depicted in 23 of Appendix 1. To normalize μ<sub>A</sub><sub><sub2>y→X</sub2></sub>(x), the membership function must be scaled by factor of about 3, denoted by s, and translated by the amount of −3 (or −1 before scaling), denoted by t. The ordered translation and scaling operations, denoted by T<sub>t </sub>and T<sub>s </sub>respectively, define the transformation operation which also transforms a probability distribution (13) by scaling and translating its parameters, for example:
<br /><i>p</i><sub>X,i</sub><sup>T</sup>=(<i>p</i><sub>X,i</sub>)=<i>T</i><sub>t</sub><i>·T</i><sub>s</sub><i>·p</i><sub>X,i</sub>, (14)
with
<br /><i>T</i><sub>s</sub><i>·p</i><sub>x,i</sub><i>=T</i><sub>s</sub>(<i>m</i><sub>X,i</sub>, σ<sub>X,i</sub>)=(<i>s·m</i><sub>X,i</sub><i>,·σ</i><sub>X,i</sub>),
<br /><i>T</i><sub>t</sub><i>·p</i><sub>X,i</sub><i>=T</i><sub>t</sub>(<i>m</i><sub>X,i</sub>, σ<sub>X,i</sub>)=(<i>m</i><sub>X,i</sub>+σ<sub>X,i</sub>).
Once normalized, μ<sub>A</sub><sub><sub2>y→X</sub2></sub>(x) is associated with a predetermined subset(s) of normalized probability distributions, C<sub>Y,j</sub>'s (e.g., as shown in <figref idref="DRAWINGS">FIGS. 22, 24 and 25</figref> of Appendix 1 for j as “High,” “Med,” and “Med-Low” (or “ML”), respectively). To associate C<sub>Y,j </sub>with the test score value(s) (e.g., TS<sub>X,n</sub>) assigned to C<sub>X,n </sub>(shown for example in <figref idref="DRAWINGS">FIG. 20</figref> of Appendix 1 with n as “High”), the relative position and scaling of C<sub>Y,j </sub>and C<sub>X,n </sub>are adjusted by transforming to C<sub>X,n </sub>to C<sub>X,n</sub><sup>T </sup>per (13), to determine the intersection between C<sub>X,n</sub><sup>T </sup>and C<sub>Y,j</sub>, for example by:
<maths id="MATH-US-00101" num="00101"><math overflow="scroll"><mtable><mtr><mtd><mrow><msub><mi>I</mi><mrow><mi>j</mi><mo>,</mo><mi>n</mi></mrow></msub><mo>=</mo><mrow><munder><mi>sup</mi><mrow><mo>∀</mo><msubsup><mi>p</mi><mrow><mi>X</mi><mo>,</mo><mi>i</mi></mrow><mi>T</mi></msubsup></mrow></munder><mo>(</mo><mrow><mrow><msub><mi>μ</mi><msubsup><mi>C</mi><mrow><mi>X</mi><mo>,</mo><mi>n</mi></mrow><mi>T</mi></msubsup></msub><mo></mo><mrow><mo>(</mo><mrow><msubsup><mi>p</mi><mrow><mi>X</mi><mo>,</mo><mi>i</mi></mrow><mi>T</mi></msubsup><mo>⋀</mo><mrow><msub><mi>μ</mi><msub><mi>C</mi><mrow><mi>Y</mi><mo>,</mo><mi>j</mi></mrow></msub></msub><mo></mo><mrow><mo>(</mo><msubsup><mi>p</mi><mrow><mi>X</mi><mo>,</mo><mi>i</mi></mrow><mi>T</mi></msubsup><mo>)</mo></mrow></mrow></mrow><mo>)</mo></mrow></mrow><mo>,</mo></mrow></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mn>15</mn><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2022121884A1_D21841.tif" /><img file="US2022121884A1_D21842.tif" /><img file="US2022121884A1_D21843.tif" /><img file="US2022121884A1_D21844.tif" /><img file="US2022121884A1_D21845.tif" /><img file="US2022121884A1_D21846.tif" /><img file="US2022121884A1_D21847.tif" /><img file="US2022121884A1_D21848.tif" /><img file="US2022121884A1_D21849.tif" /><img file="US2022121884A1_D21850.tif" /><img file="US2022121884A1_D21851.tif" /><img file="US2022121884A1_D21852.tif" /><img file="US2022121884A1_D21853.tif" /><img file="US2022121884A1_D21854.tif" /><img file="US2022121884A1_D21855.tif" /><img file="US2022121884A1_D21856.tif" /><img file="US2022121884A1_D21857.tif" /><img file="US2022121884A1_D21858.tif" /><img file="US2022121884A1_D21859.tif" /><img file="US2022121884A1_D21860.tif" /><img file="US2022121884A1_D21861.tif" /><img file="US2022121884A1_D21862.tif" /><img file="US2022121884A1_D21863.tif" /><img file="US2022121884A1_D21864.tif" /><img file="US2022121884A1_D21865.tif" /><img file="US2022121884A1_D21866.tif" /><img file="US2022121884A1_D21867.tif" /><img file="US2022121884A1_D21868.tif" /><img file="US2022121884A1_D21869.tif" /><img file="US2022121884A1_D21870.tif" /><img file="US2022121884A1_D21871.tif" /><img file="US2022121884A1_D21872.tif" /><img file="US2022121884A1_D21873.tif" /><img file="US2022121884A1_D21874.tif" /><img file="US2022121884A1_D21875.tif" /><img file="US2022121884A1_D21876.tif" /><img file="US2022121884A1_D21877.tif" /><img file="US2022121884A1_D21878.tif" /><img file="US2022121884A1_D21879.tif" /><img file="US2022121884A1_D21880.tif" /><img file="US2022121884A1_D21881.tif" /><img file="US2022121884A1_D21882.tif" /><img file="US2022121884A1_D21883.tif" /><img file="US2022121884A1_D21884.tif" /><img file="US2022121884A1_D21885.tif" /><img file="US2022121884A1_D21886.tif" /><img file="US2022121884A1_D21887.tif" /><img file="US2022121884A1_D21888.tif" /><img file="US2022121884A1_D21889.tif" /><img file="US2022121884A1_D21890.tif" /><img file="US2022121884A1_D21891.tif" /><img file="US2022121884A1_D21892.tif" /><img file="US2022121884A1_D21893.tif" /><img file="US2022121884A1_D21894.tif" /><img file="US2022121884A1_D21895.tif" /><img file="US2022121884A1_D21896.tif" /><img file="US2022121884A1_D21897.tif" /><img file="US2022121884A1_D21898.tif" /><img file="US2022121884A1_D21899.tif" /><img file="US2022121884A1_D21900.tif" /><img file="US2022121884A1_D21901.tif" /><img file="US2022121884A1_D21902.tif" /><img file="US2022121884A1_D21903.tif" /><img file="US2022121884A1_D21904.tif" /><img file="US2022121884A1_D21905.tif" /><img file="US2022121884A1_D21906.tif" /><img file="US2022121884A1_D21907.tif" /><img file="US2022121884A1_D21908.tif" /><img file="US2022121884A1_D21909.tif" /><img file="US2022121884A1_D21910.tif" /><img file="US2022121884A1_D21911.tif" /><img file="US2022121884A1_D21912.tif" /><img file="US2022121884A1_D21913.tif" /><img file="US2022121884A1_D21914.tif" /><img file="US2022121884A1_D21915.tif" /><img file="US2022121884A1_D21916.tif" /><img file="US2022121884A1_D21917.tif" /><img file="US2022121884A1_D21918.tif" /><img file="US2022121884A1_D21919.tif" /><img file="US2022121884A1_D21920.tif" /><img file="US2022121884A1_D21921.tif" /><img file="US2022121884A1_D21922.tif" /><img file="US2022121884A1_D21923.tif" /><img file="US2022121884A1_D21924.tif" /><img file="US2022121884A1_D21925.tif" /><img file="US2022121884A1_D21926.tif" /><img file="US2022121884A1_D21927.tif" /><img file="US2022121884A1_D21928.tif" /><img file="US2022121884A1_D21929.tif" /><img file="US2022121884A1_D21930.tif" /><img file="US2022121884A1_D21931.tif" /><img file="US2022121884A1_D21932.tif" /><img file="US2022121884A1_D21933.tif" /><img file="US2022121884A1_D21934.tif" /><img file="US2022121884A1_D21935.tif" /><img file="US2022121884A1_D21936.tif" /><img file="US2022121884A1_D21937.tif" /><img file="US2022121884A1_D21938.tif" /><img file="US2022121884A1_D21939.tif" /><img file="US2022121884A1_D21940.tif" /><img file="US2022121884A1_D21941.tif" /><img file="US2022121884A1_D21942.tif" /><img file="US2022121884A1_D21943.tif" /><img file="US2022121884A1_D21944.tif" /><img file="US2022121884A1_D21945.tif" /><img file="US2022121884A1_D21946.tif" /><img file="US2022121884A1_D21947.tif" /><img file="US2022121884A1_D21948.tif" /><img file="US2022121884A1_D21949.tif" /><img file="US2022121884A1_D21950.tif" /><img file="US2022121884A1_D21951.tif" /><img file="US2022121884A1_D21952.tif" />
where I<sub>j,n </sub>describes a grade for overlap between C<sub>X,n</sub><sup>T </sup>and C<sub>Y,j</sub>. <figref idref="DRAWINGS">FIG. 26</figref> of Appendix 1 schematically illustrates the (fuzzy) intersection of C<sub>X,n</sub><sup>T </sup>and C<sub>Y,j</sub>, with n being “High” and j being “ML”, based on the predetermined category sets C<sub>X,High </sub>and C<sub>Y,ML </sub>from <figref idref="DRAWINGS">FIGS. 20 and 25</figref> of Appendix 1, respectively. <figref idref="DRAWINGS">FIG. 24</figref> of Appendix 1 is membership function C<sub>Y,Med</sub>. <figref idref="DRAWINGS">FIG. 25</figref> of Appendix 1 is membership function C<sub>Y,ML</sub>. <figref idref="DRAWINGS">FIG. 26</figref> of Appendix 1 is illustrating the fuzzy intersection of C<sub>Y,j </sub>and C<sup>T</sup><sub>X,n</sub>, where C<sup>T</sup><sub>X,n</sub>, is transformed from C<sub>X,n </sub>via scaling and translation. For the predetermined category sets C<sub>Y,j </sub>and C<sub>X,n</sub>, C<sub>Y,ML </sub>and C<sub>X,High </sub>are used from <figref idref="DRAWINGS">FIGS. 25 and 20</figref> of Appendix 1.
For example, as shown in <figref idref="DRAWINGS">FIG. 26</figref> of Appendix 1, C<sub>X,High</sub><sup>T </sup>overlaps C<sub>Y,ML </sub>(to a degree), while it may not intersect C<sub>Y,Med </sub>(which is depicted in <figref idref="DRAWINGS">FIG. 24</figref> of Appendix 1). If I<sub>j,n </sub>exceeds an (optional) overlap threshold value, then we may apply the category test score TS<sub>k </sub>associated with C<sub>X,n</sub>, to C<sub>Y,j</sub>. Note that the association with TS<sub>k </sub>was determined based on B<sub>X</sub>, e.g., through mapping of μ<sub>B</sub><sub><sub2>X </sub2></sub>to the relation pairs (V<sub>X,n</sub>, TS<sub>X,k</sub>). This means that the category set of probability measures V<sub>Y,j </sub>associated with C<sub>Y,j </sub>may get associated with category test score TS<sub>X,k</sub>, as well. In general, V<sub>X,n </sub>and V<sub>Y,j </sub>may be sets of probability measures belonging to the same family of sets (i.e., without X or Y dependencies). The steps from B<sub>X </sub>to approximating B<sub>Y </sub>is conceptually summarized as:
<maths id="MATH-US-00102" num="00102"><math overflow="scroll"><mrow><mrow><mtable><mtr><mtd><mrow><msub><mi>B</mi><mi>X</mi></msub><mo></mo><mover><mo>→</mo><mi>map</mi></mover><mo></mo><mrow><mo>(</mo><mrow><msub><mi>V</mi><mrow><mi>X</mi><mo>,</mo><mi>n</mi></mrow></msub><mo>,</mo><msub><mi>TS</mi><mrow><mi>X</mi><mo>,</mo><mi>k</mi></mrow></msub></mrow><mo>)</mo></mrow></mrow></mtd></mtr><mtr><mtd><mrow><mrow><mtable><mtr><mtd><mrow><msub><mi>B</mi><mi>X</mi></msub><mo>→</mo><mrow><msub><mi>C</mi><mrow><mi>X</mi><mo>,</mo><mi>n</mi></mrow></msub><mo></mo><mover><mo>→</mo><mi>T</mi></mover><mo></mo><msubsup><mi>C</mi><mrow><mi>X</mi><mo>,</mo><mi>n</mi></mrow><mi>T</mi></msubsup></mrow></mrow></mtd></mtr><mtr><mtd><mrow><msub><mi>A</mi><mi>Y</mi></msub><mo></mo><mover><mo>→</mo><mi>f</mi></mover><mo></mo><mrow><msub><mi>A</mi><mrow><mi>Y</mi><mo>→</mo><mi>X</mi></mrow></msub><mo>→</mo><msub><mi>C</mi><mrow><mi>Y</mi><mo>,</mo><mi>j</mi></mrow></msub></mrow></mrow></mtd></mtr></mtable><mo>}</mo></mrow><mo>→</mo><msub><mi>I</mi><mrow><mi>j</mi><mo>,</mo><mi>n</mi></mrow></msub></mrow></mtd></mtr></mtable><mo>}</mo></mrow><mo>→</mo><mrow><mrow><mo>(</mo><mrow><msub><mi>V</mi><mrow><mi>Y</mi><mo>,</mo><mi>j</mi></mrow></msub><mo>,</mo><msub><mi>TS</mi><mrow><mi>X</mi><mo>,</mo><mi>k</mi></mrow></msub></mrow><mo>)</mo></mrow><mo></mo><mover><mo>→</mo><mrow><mi>approx</mi><mo>.</mo></mrow></mover><mo></mo><mrow><msub><mi>B</mi><mi>Y</mi></msub><mo>.</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D21953.tif" /><img file="US2022121884A1_D21954.tif" /><img file="US2022121884A1_D21955.tif" /><img file="US2022121884A1_D21956.tif" /><img file="US2022121884A1_D21957.tif" /><img file="US2022121884A1_D21958.tif" /><img file="US2022121884A1_D21959.tif" /><img file="US2022121884A1_D21960.tif" /><img file="US2022121884A1_D21961.tif" /><img file="US2022121884A1_D21962.tif" /><img file="US2022121884A1_D21963.tif" /><img file="US2022121884A1_D21964.tif" /><img file="US2022121884A1_D21965.tif" /><img file="US2022121884A1_D21966.tif" /><img file="US2022121884A1_D21967.tif" /><img file="US2022121884A1_D21968.tif" /><img file="US2022121884A1_D21969.tif" /><img file="US2022121884A1_D21970.tif" /><img file="US2022121884A1_D21971.tif" /><img file="US2022121884A1_D21972.tif" /><img file="US2022121884A1_D21973.tif" /><img file="US2022121884A1_D21974.tif" /><img file="US2022121884A1_D21975.tif" /><img file="US2022121884A1_D21976.tif" /><img file="US2022121884A1_D21977.tif" /><img file="US2022121884A1_D21978.tif" /><img file="US2022121884A1_D21979.tif" /><img file="US2022121884A1_D21980.tif" /><img file="US2022121884A1_D21981.tif" /><img file="US2022121884A1_D21982.tif" /><img file="US2022121884A1_D21983.tif" /><img file="US2022121884A1_D21984.tif" /><img file="US2022121884A1_D21985.tif" /><img file="US2022121884A1_D21986.tif" /><img file="US2022121884A1_D21987.tif" /><img file="US2022121884A1_D21988.tif" /><img file="US2022121884A1_D21989.tif" /><img file="US2022121884A1_D21990.tif" /><img file="US2022121884A1_D21991.tif" /><img file="US2022121884A1_D21992.tif" /><img file="US2022121884A1_D21993.tif" /><img file="US2022121884A1_D21994.tif" /><img file="US2022121884A1_D21995.tif" /><img file="US2022121884A1_D21996.tif" /><img file="US2022121884A1_D21997.tif" /><img file="US2022121884A1_D21998.tif" /><img file="US2022121884A1_D21999.tif" /><img file="US2022121884A1_D22000.tif" /><img file="US2022121884A1_D22001.tif" /><img file="US2022121884A1_D22002.tif" /><img file="US2022121884A1_D22003.tif" /><img file="US2022121884A1_D22004.tif" /><img file="US2022121884A1_D22005.tif" /><img file="US2022121884A1_D22006.tif" /><img file="US2022121884A1_D22007.tif" /><img file="US2022121884A1_D22008.tif" /><img file="US2022121884A1_D22009.tif" /><img file="US2022121884A1_D22010.tif" /><img file="US2022121884A1_D22011.tif" /><img file="US2022121884A1_D22012.tif" /><img file="US2022121884A1_D22013.tif" /><img file="US2022121884A1_D22014.tif" /><img file="US2022121884A1_D22015.tif" /><img file="US2022121884A1_D22016.tif" /><img file="US2022121884A1_D22017.tif" /><img file="US2022121884A1_D22018.tif" /><img file="US2022121884A1_D22019.tif" /><img file="US2022121884A1_D22020.tif" /><img file="US2022121884A1_D22021.tif" /><img file="US2022121884A1_D22022.tif" /><img file="US2022121884A1_D22023.tif" /><img file="US2022121884A1_D22024.tif" /><img file="US2022121884A1_D22025.tif" /><img file="US2022121884A1_D22026.tif" /><img file="US2022121884A1_D22027.tif" /><img file="US2022121884A1_D22028.tif" /><img file="US2022121884A1_D22029.tif" /><img file="US2022121884A1_D22030.tif" /><img file="US2022121884A1_D22031.tif" /><img file="US2022121884A1_D22032.tif" /><img file="US2022121884A1_D22033.tif" /><img file="US2022121884A1_D22034.tif" /><img file="US2022121884A1_D22035.tif" /><img file="US2022121884A1_D22036.tif" /><img file="US2022121884A1_D22037.tif" /><img file="US2022121884A1_D22038.tif" /><img file="US2022121884A1_D22039.tif" /><img file="US2022121884A1_D22040.tif" /><img file="US2022121884A1_D22041.tif" /><img file="US2022121884A1_D22042.tif" /><img file="US2022121884A1_D22043.tif" /><img file="US2022121884A1_D22044.tif" /><img file="US2022121884A1_D22045.tif" /><img file="US2022121884A1_D22046.tif" /><img file="US2022121884A1_D22047.tif" /><img file="US2022121884A1_D22048.tif" /><img file="US2022121884A1_D22049.tif" /><img file="US2022121884A1_D22050.tif" /><img file="US2022121884A1_D22051.tif" /><img file="US2022121884A1_D22052.tif" /><img file="US2022121884A1_D22053.tif" /><img file="US2022121884A1_D22054.tif" /><img file="US2022121884A1_D22055.tif" /><img file="US2022121884A1_D22056.tif" /><img file="US2022121884A1_D22057.tif" /><img file="US2022121884A1_D22058.tif" /><img file="US2022121884A1_D22059.tif" /><img file="US2022121884A1_D22060.tif" /><img file="US2022121884A1_D22061.tif" /><img file="US2022121884A1_D22062.tif" /><img file="US2022121884A1_D22063.tif" /><img file="US2022121884A1_D22064.tif" />
The determination of the test scores for V<sub>Y,j </sub>may be implemented via a set of fuzzy rules linking C<sub>X,n </sub>and C<sub>Y,j </sub>. For example, the antecedent of each rule is triggered if the corresponding I<sub>j,n </sub>is above an overlap threshold, and the consequent of the rule assigns TS<sub>X,k</sub>'s (or an aggregate of TS<sub>X,k</sub>'s based on weight<sub>n,k </sub>for a given n) to a variable SC<sub>Y,j</sub>. A simpler test score assignment rule may use a non-categorical test score TS<sub>X,n </sub>which is determined for each V<sub>X,n</sub>, e.g., via (12), based on the mapping through B<sub>X</sub>:
<br />Rule<sub>j,n</sub>: if (I<sub>j,n</sub>) then (SC<sub>Y,j </sub>is TS<sub>X,n</sub>) (16)
However, in correlation/aggregation of assigned (fuzzy) test scores to variable SC<sub>Y,j</sub>, we must consider the maximization of test score required by (8). For example, in aggregating the rules for SC<sub>Y,j</sub>, we may use cα-cuts to determine an aggregated (fuzzy) result, denoted as AGSC<sub>Y,j</sub>, as follows: (Eq. 17 below)
<maths id="MATH-US-00103" num="00103"><math overflow="scroll"><mrow><msub><mi>AGSC</mi><mrow><mi>Y</mi><mo>,</mo><mi>j</mi></mrow></msub><mo>=</mo><mrow><munder><mi>MAX</mi><mi>n</mi></munder><mo></mo><mrow><mo>(</mo><mrow><mi>Correl</mi><mo></mo><mrow><mo>(</mo><mrow><msub><mi>I</mi><mrow><mi>j</mi><mo>,</mo><mi>n</mi></mrow></msub><mo>,</mo><msub><mi>TS</mi><mrow><mi>X</mi><mo>,</mo><mi>n</mi></mrow></msub></mrow><mo>)</mo></mrow></mrow><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D22065.tif" /><img file="US2022121884A1_D22066.tif" /><img file="US2022121884A1_D22067.tif" /><img file="US2022121884A1_D22068.tif" /><img file="US2022121884A1_D22069.tif" /><img file="US2022121884A1_D22070.tif" /><img file="US2022121884A1_D22071.tif" /><img file="US2022121884A1_D22072.tif" /><img file="US2022121884A1_D22073.tif" /><img file="US2022121884A1_D22074.tif" /><img file="US2022121884A1_D22075.tif" /><img file="US2022121884A1_D22076.tif" /><img file="US2022121884A1_D22077.tif" /><img file="US2022121884A1_D22078.tif" /><img file="US2022121884A1_D22079.tif" /><img file="US2022121884A1_D22080.tif" /><img file="US2022121884A1_D22081.tif" /><img file="US2022121884A1_D22082.tif" /><img file="US2022121884A1_D22083.tif" /><img file="US2022121884A1_D22084.tif" /><img file="US2022121884A1_D22085.tif" /><img file="US2022121884A1_D22086.tif" /><img file="US2022121884A1_D22087.tif" /><img file="US2022121884A1_D22088.tif" /><img file="US2022121884A1_D22089.tif" /><img file="US2022121884A1_D22090.tif" /><img file="US2022121884A1_D22091.tif" /><img file="US2022121884A1_D22092.tif" /><img file="US2022121884A1_D22093.tif" /><img file="US2022121884A1_D22094.tif" /><img file="US2022121884A1_D22095.tif" /><img file="US2022121884A1_D22096.tif" /><img file="US2022121884A1_D22097.tif" /><img file="US2022121884A1_D22098.tif" /><img file="US2022121884A1_D22099.tif" /><img file="US2022121884A1_D22100.tif" /><img file="US2022121884A1_D22101.tif" /><img file="US2022121884A1_D22102.tif" /><img file="US2022121884A1_D22103.tif" /><img file="US2022121884A1_D22104.tif" /><img file="US2022121884A1_D22105.tif" /><img file="US2022121884A1_D22106.tif" /><img file="US2022121884A1_D22107.tif" /><img file="US2022121884A1_D22108.tif" /><img file="US2022121884A1_D22109.tif" /><img file="US2022121884A1_D22110.tif" /><img file="US2022121884A1_D22111.tif" /><img file="US2022121884A1_D22112.tif" /><img file="US2022121884A1_D22113.tif" /><img file="US2022121884A1_D22114.tif" /><img file="US2022121884A1_D22115.tif" /><img file="US2022121884A1_D22116.tif" /><img file="US2022121884A1_D22117.tif" /><img file="US2022121884A1_D22118.tif" /><img file="US2022121884A1_D22119.tif" /><img file="US2022121884A1_D22120.tif" /><img file="US2022121884A1_D22121.tif" /><img file="US2022121884A1_D22122.tif" /><img file="US2022121884A1_D22123.tif" /><img file="US2022121884A1_D22124.tif" /><img file="US2022121884A1_D22125.tif" /><img file="US2022121884A1_D22126.tif" /><img file="US2022121884A1_D22127.tif" /><img file="US2022121884A1_D22128.tif" /><img file="US2022121884A1_D22129.tif" /><img file="US2022121884A1_D22130.tif" /><img file="US2022121884A1_D22131.tif" /><img file="US2022121884A1_D22132.tif" /><img file="US2022121884A1_D22133.tif" /><img file="US2022121884A1_D22134.tif" /><img file="US2022121884A1_D22135.tif" /><img file="US2022121884A1_D22136.tif" /><img file="US2022121884A1_D22137.tif" /><img file="US2022121884A1_D22138.tif" /><img file="US2022121884A1_D22139.tif" /><img file="US2022121884A1_D22140.tif" /><img file="US2022121884A1_D22141.tif" /><img file="US2022121884A1_D22142.tif" /><img file="US2022121884A1_D22143.tif" /><img file="US2022121884A1_D22144.tif" /><img file="US2022121884A1_D22145.tif" /><img file="US2022121884A1_D22146.tif" /><img file="US2022121884A1_D22147.tif" /><img file="US2022121884A1_D22148.tif" /><img file="US2022121884A1_D22149.tif" /><img file="US2022121884A1_D22150.tif" /><img file="US2022121884A1_D22151.tif" /><img file="US2022121884A1_D22152.tif" /><img file="US2022121884A1_D22153.tif" /><img file="US2022121884A1_D22154.tif" /><img file="US2022121884A1_D22155.tif" /><img file="US2022121884A1_D22156.tif" /><img file="US2022121884A1_D22157.tif" /><img file="US2022121884A1_D22158.tif" /><img file="US2022121884A1_D22159.tif" /><img file="US2022121884A1_D22160.tif" /><img file="US2022121884A1_D22161.tif" /><img file="US2022121884A1_D22162.tif" /><img file="US2022121884A1_D22163.tif" /><img file="US2022121884A1_D22164.tif" /><img file="US2022121884A1_D22165.tif" /><img file="US2022121884A1_D22166.tif" /><img file="US2022121884A1_D22167.tif" /><img file="US2022121884A1_D22168.tif" /><img file="US2022121884A1_D22169.tif" /><img file="US2022121884A1_D22170.tif" /><img file="US2022121884A1_D22171.tif" /><img file="US2022121884A1_D22172.tif" /><img file="US2022121884A1_D22173.tif" /><img file="US2022121884A1_D22174.tif" /><img file="US2022121884A1_D22175.tif" /><img file="US2022121884A1_D22176.tif" />
where Correl(I<sub>j,n</sub>, TS<sub>n</sub>) modifies the membership function of TS<sub>X,n </sub>by correlating it with the factor I<sub>j,n</sub>, e.g., via scaling or truncation. Membership function of B<sub>Y </sub>is then approximated by a series of fuzzy relations (V<sub>Y,j</sub>, AGSC<sub>Y,j</sub>).
For a given w (probability measure of A<sub>Y</sub>), μ<sub>BY</sub>(w) may be approximated as a fuzzy number (or a defuzzified value), by further aggregation using fuzzy relations (V<sub>Y,j</sub>, AGSC<sub>Y,j</sub>), e.g.: (Eq. 18 below)
<maths id="MATH-US-00104" num="00104"><math overflow="scroll"><mrow><mrow><msub><mi>μ</mi><msub><mi>B</mi><mi>Y</mi></msub></msub><mo></mo><mrow><mo>(</mo><mrow><mi>w</mi><mo>,</mo><mi>ts</mi></mrow><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mrow><munder><mi>sup</mi><mi>j</mi></munder><mo></mo><mrow><mo>(</mo><mrow><mrow><msub><mi>μ</mi><msub><mi>V</mi><mrow><mi>Y</mi><mo>,</mo><mi>j</mi></mrow></msub></msub><mo></mo><mrow><mo>(</mo><mi>w</mi><mo>)</mo></mrow></mrow><mo>⋀</mo><mrow><msub><mi>μ</mi><msub><mi>AGSC</mi><mrow><mi>Y</mi><mo>,</mo><mi>j</mi></mrow></msub></msub><mo></mo><mrow><mo>(</mo><mi>ts</mi><mo>)</mo></mrow></mrow></mrow><mo>)</mo></mrow></mrow><mo>.</mo></mrow></mrow></math></maths><img file="US2022121884A1_D22177.tif" /><img file="US2022121884A1_D22178.tif" /><img file="US2022121884A1_D22179.tif" /><img file="US2022121884A1_D22180.tif" /><img file="US2022121884A1_D22181.tif" /><img file="US2022121884A1_D22182.tif" /><img file="US2022121884A1_D22183.tif" /><img file="US2022121884A1_D22184.tif" /><img file="US2022121884A1_D22185.tif" /><img file="US2022121884A1_D22186.tif" /><img file="US2022121884A1_D22187.tif" /><img file="US2022121884A1_D22188.tif" /><img file="US2022121884A1_D22189.tif" /><img file="US2022121884A1_D22190.tif" /><img file="US2022121884A1_D22191.tif" /><img file="US2022121884A1_D22192.tif" /><img file="US2022121884A1_D22193.tif" /><img file="US2022121884A1_D22194.tif" /><img file="US2022121884A1_D22195.tif" /><img file="US2022121884A1_D22196.tif" /><img file="US2022121884A1_D22197.tif" /><img file="US2022121884A1_D22198.tif" /><img file="US2022121884A1_D22199.tif" /><img file="US2022121884A1_D22200.tif" /><img file="US2022121884A1_D22201.tif" /><img file="US2022121884A1_D22202.tif" /><img file="US2022121884A1_D22203.tif" /><img file="US2022121884A1_D22204.tif" /><img file="US2022121884A1_D22205.tif" /><img file="US2022121884A1_D22206.tif" /><img file="US2022121884A1_D22207.tif" /><img file="US2022121884A1_D22208.tif" /><img file="US2022121884A1_D22209.tif" /><img file="US2022121884A1_D22210.tif" /><img file="US2022121884A1_D22211.tif" /><img file="US2022121884A1_D22212.tif" /><img file="US2022121884A1_D22213.tif" /><img file="US2022121884A1_D22214.tif" /><img file="US2022121884A1_D22215.tif" /><img file="US2022121884A1_D22216.tif" /><img file="US2022121884A1_D22217.tif" /><img file="US2022121884A1_D22218.tif" /><img file="US2022121884A1_D22219.tif" /><img file="US2022121884A1_D22220.tif" /><img file="US2022121884A1_D22221.tif" /><img file="US2022121884A1_D22222.tif" /><img file="US2022121884A1_D22223.tif" /><img file="US2022121884A1_D22224.tif" /><img file="US2022121884A1_D22225.tif" /><img file="US2022121884A1_D22226.tif" /><img file="US2022121884A1_D22227.tif" /><img file="US2022121884A1_D22228.tif" /><img file="US2022121884A1_D22229.tif" /><img file="US2022121884A1_D22230.tif" /><img file="US2022121884A1_D22231.tif" /><img file="US2022121884A1_D22232.tif" /><img file="US2022121884A1_D22233.tif" /><img file="US2022121884A1_D22234.tif" /><img file="US2022121884A1_D22235.tif" /><img file="US2022121884A1_D22236.tif" /><img file="US2022121884A1_D22237.tif" /><img file="US2022121884A1_D22238.tif" /><img file="US2022121884A1_D22239.tif" /><img file="US2022121884A1_D22240.tif" /><img file="US2022121884A1_D22241.tif" /><img file="US2022121884A1_D22242.tif" /><img file="US2022121884A1_D22243.tif" /><img file="US2022121884A1_D22244.tif" /><img file="US2022121884A1_D22245.tif" /><img file="US2022121884A1_D22246.tif" /><img file="US2022121884A1_D22247.tif" /><img file="US2022121884A1_D22248.tif" /><img file="US2022121884A1_D22249.tif" /><img file="US2022121884A1_D22250.tif" /><img file="US2022121884A1_D22251.tif" /><img file="US2022121884A1_D22252.tif" /><img file="US2022121884A1_D22253.tif" /><img file="US2022121884A1_D22254.tif" /><img file="US2022121884A1_D22255.tif" /><img file="US2022121884A1_D22256.tif" /><img file="US2022121884A1_D22257.tif" /><img file="US2022121884A1_D22258.tif" /><img file="US2022121884A1_D22259.tif" /><img file="US2022121884A1_D22260.tif" /><img file="US2022121884A1_D22261.tif" /><img file="US2022121884A1_D22262.tif" /><img file="US2022121884A1_D22263.tif" /><img file="US2022121884A1_D22264.tif" /><img file="US2022121884A1_D22265.tif" /><img file="US2022121884A1_D22266.tif" /><img file="US2022121884A1_D22267.tif" /><img file="US2022121884A1_D22268.tif" /><img file="US2022121884A1_D22269.tif" /><img file="US2022121884A1_D22270.tif" /><img file="US2022121884A1_D22271.tif" /><img file="US2022121884A1_D22272.tif" /><img file="US2022121884A1_D22273.tif" /><img file="US2022121884A1_D22274.tif" /><img file="US2022121884A1_D22275.tif" /><img file="US2022121884A1_D22276.tif" /><img file="US2022121884A1_D22277.tif" /><img file="US2022121884A1_D22278.tif" /><img file="US2022121884A1_D22279.tif" /><img file="US2022121884A1_D22280.tif" /><img file="US2022121884A1_D22281.tif" /><img file="US2022121884A1_D22282.tif" /><img file="US2022121884A1_D22283.tif" /><img file="US2022121884A1_D22284.tif" /><img file="US2022121884A1_D22285.tif" /><img file="US2022121884A1_D22286.tif" /><img file="US2022121884A1_D22287.tif" /><img file="US2022121884A1_D22288.tif" />
ii) Overlap Approximation:
An approach to approximate or render the overlap (15) between the category sets, such as C<sub>X,n</sub>, may use α-cuts to present each crisp α-cuts of predetermined category set as a set of points in (m,σ) space. These sets of points may be modeled efficiently, e.g., based on graphical models, optimized for fast transformation and intersection operations. For example, the models that use peripheral description for the α-cuts allow robust and efficient determination of intersection and avoid the need to transform all the points within the set individually, in order to reduce the computation involved in (13).
iii) Estimation Using Contour Approach:
In addition to predetermining C<sub>X,n</sub>, based on V<sub>X.n</sub>, for a normalized set A<sub>X</sub>, we can predetermine various α-cuts of probability measures (e.g., depicted as contours of constant v in <figref idref="DRAWINGS">FIGS. 7 and 8</figref> of Appendix 1) or various α-cuts of associated test scores (e.g., depicted as contours of constant test scores, ts, in <figref idref="DRAWINGS">FIGS. 9 and 10</figref> of Appendix 1) for a set of predefined (e.g., most frequently used) B<sub>X </sub>components. These α-cuts that represent sets of probability distribution candidates in (m, σ) space (already associated with specific test scores) may be transformed per (13) and intersected with C<sub>Y,j </sub>in extending their test scores to V<sub>Y,j</sub>. In essence, this is similar to the previous analysis except V<sub>X,n </sub>and TS<sub>X,n </sub>become singleton, and C<sub>X,n </sub>becomes a crisp set, while C<sub>Y,j </sub>and V<sub>Y,j </sub>are predetermined (crisp or fuzzy) set.
Another approach uses (e.g., piecewise) representation of B<sub>X </sub>(not predefined) where based on inspection or description, hey values of v associated with key values of test scores may readily be ascertained (e.g., based on α-cuts), resulting in a set of (v<sub>i</sub>, ts<sub>i</sub>) pairs. Then, the predetermine α-cuts of probability measures (e.g., depicted as contours of constant v in <figref idref="DRAWINGS">FIGS. 7 and 8</figref> of Appendix 1) are used to interpolate the contours of constant ts<sub>i</sub>'s in (m, σ) space, based on the corresponding v<sub>i </sub>values. Again, these crisp contours of constant (crisp) ts<sub>i</sub>'s, may be transformed and intersected with C<sub>Y,j </sub>to extend the test scores to V<sub>Y,j </sub>for estimating B<sub>Y</sub>.
For quick estimation of B<sub>Y </sub>in an alternate approach, the predetermined α-cuts (i.e., w's) of probability measures for normalized Ay may be used (similar to those shown in <figref idref="DRAWINGS">FIGS. 7 and 8</figref> of Appendix 1 based on A<sub>X</sub>), in essence, turning V<sub>Y,j </sub>to a singleton and C<sub>Y,j </sub>to a crisp set (contour) for carrying out the intersect determination. The estimates for μ<sub>BY</sub>(w) may be determined via interpolation between the aggregated test score results obtained those w values associated with the α-cuts.
In one embodiment, for Z-number analysis, for probability distributions analysis, the predetermined categories of hidden probability distribution candidates and normalized Fuzzy membership functions facilitate the pre-calculation of probability measures and their associated reliability measures in Z evaluation or as Z-factors, for fast determination of the reliability levels of new propositions or conclusions. This approach opens the door to the extension of the reliability measures (e.g., via extension principle) to new propositions, based on graphical analysis of contours (α-cuts) of similar probability measures in the domain of parameters representing the probability distribution candidates. Basically, we will use the transformation and mapping of categorical set of the probability distribution candidates (represented as regions or α-cut contours) for extension of the reliability measures. This way, as we pre-calculate and store the shapes and results in our library or database for future use (as templates), the new analysis on any new data can be much faster, because we can readily match it with one of the templates, whose results are already calculated and stored, for immediate use.
Now, let's look at Appendix 2. In one embodiment, referring to the top FIG. and derivation on page 1 of Appendix 2, we have different values of v<sub>α,n</sub>, based on various α-cuts (with (ts=α)). Then, we match against category (singleton) v<sub>s </sub>(see the bottom FIG. on page 1 of Appendix 2). Then, on FIG. and derivation on page 2 of our Appendix 2, we get a series of the curves. We use the predetermined contours C<sub>s,m </sub>of probability measures v<sub>s,m</sub>. Note that (v<sub>s,m</sub>=p<sub>i</sub>·μ<sub>AX</sub><sup>normalized</sup>). Note that p<sub>i</sub>'s define the contour(s) for v<sub>s,m </sub>(or regions of p<sub>i</sub>'s) defining region(s) for v<sub>s,m </sub>(such as 0 or 1), to interpolate and determine contours (or regions) of constant v<sub>α,n</sub>'s, denoted by C<sub>α,m</sub>. These are associated with test scores set by α, i.e. (ts=α) for C<sub>α,m</sub>.
Then, on FIG. and derivation on page 3 of our Appendix 2, we transform or do other manipulations, according to extension rules (e.g. on normalized) for μ<sub>AY</sub>:
<br /><i>C</i><sub>α,m</sub><sup>T</sup><i>=T</i>(C<sub>α,m</sub>)
While maintaining the test score for C<sub>α,m</sub><sup>T </sup>(as α).
Based on categories of w<sub>s,j </sub>(similar to v<sub>s,n </sub>except for w), probability measure of A<sub>Y </sub>in Y-domain, where w<sub>s,j </sub>are singletons (predefined), have corresponding contours (or regions) C<sub>s,j </sub>(see the figure on the bottom of page 3 of our Appendix 2). Then, we find the intercepts between C<sub>α, m</sub><sup>T </sup>and C<sub>s,j</sub>, if any, i.e. I<sub>α,m,j</sub>.
Then, on FIG. and derivation on page 4 of our Appendix 2, based on the intercepts, we find the best test score for a given C<sub>s,j </sub>extended from C<sub>α,m</sub><sup>T</sup>, e.g.:
<br />ts<sub>s,j</sub>=sup∀α′ α′
where I<sub>α′,mj </sub>exists.
(i.e., the best test score from intercept points to a given C<sub>s,j</sub>.)
Now, we associate ts<sub>s,j </sub>to w<sub>s,j </sub>to construct (μ<sub>BY </sub>(w)), and interpolate for other w (see the figure on the bottom of page 4 of our Appendix 2). Since ts<sub>i,j</sub>'s source is α, ts<sub>s,j</sub>'s appear as α-cuts in μ<sub>BY</sub>, as well.
Then, on derivation on page 5 of our Appendix 2, we have: Where the scenario involves e.g. z=f(x,y), instead of y=f(x) (where the solution may be worked out in the X-domain), we can still use contours (or regions) of specific test scores (e.g. based on α-cuts), and contours determined by interpolation of predefined or predetermined probability measure contours or regions. The manipulation, e.g. (p<sub>z</sub>=p<sub>x</sub>Op<sub>y</sub>), can be implemented based on contours or regions of constant test scores (for X or Y), instead of individual p<sub>x,i</sub>, and p<sub>y,i</sub>, to reduce the number of combinations and calculation. The test scores can be extracted from X, Y domains to Z domain (in this example) and maximized based on the intercept points in p<sub>z </sub>domain with predetermined contours of probability measures of (normalized) A<sub>Z</sub>, to again calculate μ<sub>BZ</sub>.
<figref idref="DRAWINGS">FIG. 126</figref> is a system for Z-number estimation and calculation, with all related modules and components shown in the Figure, with a processor or computing unit in the middle for controlling all the operations and commands (Z-number estimator).
Thus, in summary, the above section provides the methods for approximation or calculation or manipulation of Z-numbers, and related concepts. Now, we explain other components of our inventions, below.
Thumbnail Transformation:
In one embodiment, the input data (e.g., image) is preprocessed. For example, the image is transformed into a smaller thumbnail that preserve the high level nature of the image content, while not necessarily preserving its unique characteristics. This may be achieved, for example, by down sampling or aggregation of neighboring pixels. Other methods may include reduction of the variable space by consolidating the colors into intensity (e.g., gray scale) and/or reducing the number of bits representing color or intensity. Such a transformation is denoted as thumbnail.
A thumbnail includes less resolution and data, and hence, it contains less overall detailed features. The purpose is to simplify the task of dealing with many pixels while still managing to detect the high level features associated with the images (or other type of data). For example, using a thumbnail, a recognition module quickly identifies the presence of a head or face (while not intended to necessarily determine the identity of the person or object).
One embodiment uses a preliminary search to detect main features in a thumbnail data/image for fast computation. In one embodiment, the limitation may be on the number of pixels on the visual layer (via preprocessing). In one embodiment, the limitation is imposed on the detection/classifier network (e.g., on hidden layers) itself. For example, the main features are learned and isolated (e.g., by units or neurons of higher hidden layers) or learned by targeted attempt (e.g., by keeping all other weights and letting the weight on certain units change when learning a certain feature.)
Feature Detection and Learning:
In one embodiment, for example where labeled training samples may be difficult to prepare or scarce, the training is done with unlabeled samples to learn the features from the sample details. For example, a restricted Boltzmann machine (RBM) may be used to successively learn the features one layer at a time.
A Boltzmann machine refers to a type of stochastic recurrent neural network, where the probability of the state is based on an energy function defined based on the weights/biases associated with the units and the state of such units. In a Boltzmann machine, some units are denoted visible where the state may be set/clamped or observed and others may be hidden (e.g., those used for determining features). In the Restricted Boltzmann machine (RBM), the weights between hidden units within the same layer are eliminated to simplify the learning process. The learning process tends modifies the weights and biases so that the energy state associated with the samples learned are lowered and the probability of such states is increased. In one embodiment, the state of hidden layers are presented by a stochastic binary variable (e.g., in [0, 1]range) based on a sigmoid such as logistic function. In one embodiment, the energy function is given as
<maths id="MATH-US-00105" num="00105"><math overflow="scroll"><mrow><mi>E</mi><mo>=</mo><mrow><mrow><mo>-</mo><mrow><munder><mo>∑</mo><mrow><mi>i</mi><mo>,</mo><mi>j</mi></mrow></munder><mo></mo><mrow><msub><mi>v</mi><mi>i</mi></msub><mo>·</mo><msub><mi>h</mi><mi>j</mi></msub><mo>·</mo><msub><mi>w</mi><mrow><mi>i</mi><mo>,</mo><mi>j</mi></mrow></msub></mrow></mrow></mrow><mo>-</mo><mrow><munder><mo>∑</mo><mi>i</mi></munder><mo></mo><mrow><msub><mi>v</mi><mi>i</mi></msub><mo>·</mo><msub><mi>b</mi><mi>i</mi></msub></mrow></mrow><mo>-</mo><mrow><munder><mo>∑</mo><mi>j</mi></munder><mo></mo><mrow><msub><mi>h</mi><mi>j</mi></msub><mo>·</mo><msub><mi>c</mi><mi>j</mi></msub></mrow></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D22289.tif" /><img file="US2022121884A1_D22290.tif" /><img file="US2022121884A1_D22291.tif" /><img file="US2022121884A1_D22292.tif" /><img file="US2022121884A1_D22293.tif" /><img file="US2022121884A1_D22294.tif" /><img file="US2022121884A1_D22295.tif" /><img file="US2022121884A1_D22296.tif" /><img file="US2022121884A1_D22297.tif" /><img file="US2022121884A1_D22298.tif" /><img file="US2022121884A1_D22299.tif" /><img file="US2022121884A1_D22300.tif" /><img file="US2022121884A1_D22301.tif" /><img file="US2022121884A1_D22302.tif" /><img file="US2022121884A1_D22303.tif" /><img file="US2022121884A1_D22304.tif" /><img file="US2022121884A1_D22305.tif" /><img file="US2022121884A1_D22306.tif" /><img file="US2022121884A1_D22307.tif" /><img file="US2022121884A1_D22308.tif" /><img file="US2022121884A1_D22309.tif" /><img file="US2022121884A1_D22310.tif" /><img file="US2022121884A1_D22311.tif" /><img file="US2022121884A1_D22312.tif" /><img file="US2022121884A1_D22313.tif" /><img file="US2022121884A1_D22314.tif" /><img file="US2022121884A1_D22315.tif" /><img file="US2022121884A1_D22316.tif" /><img file="US2022121884A1_D22317.tif" /><img file="US2022121884A1_D22318.tif" /><img file="US2022121884A1_D22319.tif" /><img file="US2022121884A1_D22320.tif" /><img file="US2022121884A1_D22321.tif" /><img file="US2022121884A1_D22322.tif" /><img file="US2022121884A1_D22323.tif" /><img file="US2022121884A1_D22324.tif" /><img file="US2022121884A1_D22325.tif" /><img file="US2022121884A1_D22326.tif" /><img file="US2022121884A1_D22327.tif" /><img file="US2022121884A1_D22328.tif" /><img file="US2022121884A1_D22329.tif" /><img file="US2022121884A1_D22330.tif" /><img file="US2022121884A1_D22331.tif" /><img file="US2022121884A1_D22332.tif" /><img file="US2022121884A1_D22333.tif" /><img file="US2022121884A1_D22334.tif" /><img file="US2022121884A1_D22335.tif" /><img file="US2022121884A1_D22336.tif" /><img file="US2022121884A1_D22337.tif" /><img file="US2022121884A1_D22338.tif" /><img file="US2022121884A1_D22339.tif" /><img file="US2022121884A1_D22340.tif" /><img file="US2022121884A1_D22341.tif" /><img file="US2022121884A1_D22342.tif" /><img file="US2022121884A1_D22343.tif" /><img file="US2022121884A1_D22344.tif" /><img file="US2022121884A1_D22345.tif" /><img file="US2022121884A1_D22346.tif" /><img file="US2022121884A1_D22347.tif" /><img file="US2022121884A1_D22348.tif" /><img file="US2022121884A1_D22349.tif" /><img file="US2022121884A1_D22350.tif" /><img file="US2022121884A1_D22351.tif" /><img file="US2022121884A1_D22352.tif" /><img file="US2022121884A1_D22353.tif" /><img file="US2022121884A1_D22354.tif" /><img file="US2022121884A1_D22355.tif" /><img file="US2022121884A1_D22356.tif" /><img file="US2022121884A1_D22357.tif" /><img file="US2022121884A1_D22358.tif" /><img file="US2022121884A1_D22359.tif" /><img file="US2022121884A1_D22360.tif" /><img file="US2022121884A1_D22361.tif" /><img file="US2022121884A1_D22362.tif" /><img file="US2022121884A1_D22363.tif" /><img file="US2022121884A1_D22364.tif" /><img file="US2022121884A1_D22365.tif" /><img file="US2022121884A1_D22366.tif" /><img file="US2022121884A1_D22367.tif" /><img file="US2022121884A1_D22368.tif" /><img file="US2022121884A1_D22369.tif" /><img file="US2022121884A1_D22370.tif" /><img file="US2022121884A1_D22371.tif" /><img file="US2022121884A1_D22372.tif" /><img file="US2022121884A1_D22373.tif" /><img file="US2022121884A1_D22374.tif" /><img file="US2022121884A1_D22375.tif" /><img file="US2022121884A1_D22376.tif" /><img file="US2022121884A1_D22377.tif" /><img file="US2022121884A1_D22378.tif" /><img file="US2022121884A1_D22379.tif" /><img file="US2022121884A1_D22380.tif" /><img file="US2022121884A1_D22381.tif" /><img file="US2022121884A1_D22382.tif" /><img file="US2022121884A1_D22383.tif" /><img file="US2022121884A1_D22384.tif" /><img file="US2022121884A1_D22385.tif" /><img file="US2022121884A1_D22386.tif" /><img file="US2022121884A1_D22387.tif" /><img file="US2022121884A1_D22388.tif" /><img file="US2022121884A1_D22389.tif" /><img file="US2022121884A1_D22390.tif" /><img file="US2022121884A1_D22391.tif" /><img file="US2022121884A1_D22392.tif" /><img file="US2022121884A1_D22393.tif" /><img file="US2022121884A1_D22394.tif" /><img file="US2022121884A1_D22395.tif" /><img file="US2022121884A1_D22396.tif" /><img file="US2022121884A1_D22397.tif" /><img file="US2022121884A1_D22398.tif" /><img file="US2022121884A1_D22399.tif" /><img file="US2022121884A1_D22400.tif" />
where v<sub>i </sub>and h<sub>j </sub>denote the state of the i<sup>th </sup>visible unit and the j<sup>th </sup>hidden unit (as for example depicted in <figref idref="DRAWINGS">FIG. 180</figref>), respectively, and b<sub>i </sub>and c<sub>j </sub>are bias or threshold associated to such units, respectively. w<sub>ij </sub>is an undirected weight or connection strength linking such units. Per Boltzmann machine, the probability of the state c (for a given set of Hand V states of the units) depends on the weights (including bias values) and the state of H and V:
<maths id="MATH-US-00106" num="00106"><math overflow="scroll"><mrow><mrow><mi>P</mi><mo></mo><mrow><mo>(</mo><mi>α</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mrow><mi>P</mi><mo></mo><mrow><mo>(</mo><mrow><mi>V</mi><mo>,</mo><mi>H</mi></mrow><mo>)</mo></mrow></mrow><mo>=</mo><mfrac><msup><mi>e</mi><mfrac><mrow><mo>-</mo><msub><mi>E</mi><mi>α</mi></msub></mrow><mi>T</mi></mfrac></msup><mrow><msub><mo>∑</mo><mi>β</mi></msub><mo></mo><msup><mi>e</mi><mfrac><mrow><mo>-</mo><msub><mi>E</mi><mi>β</mi></msub></mrow><mi>T</mi></mfrac></msup></mrow></mfrac></mrow></mrow></math></maths><img file="US2022121884A1_D22401.tif" /><img file="US2022121884A1_D22402.tif" /><img file="US2022121884A1_D22403.tif" /><img file="US2022121884A1_D22404.tif" /><img file="US2022121884A1_D22405.tif" /><img file="US2022121884A1_D22406.tif" /><img file="US2022121884A1_D22407.tif" /><img file="US2022121884A1_D22408.tif" /><img file="US2022121884A1_D22409.tif" /><img file="US2022121884A1_D22410.tif" /><img file="US2022121884A1_D22411.tif" /><img file="US2022121884A1_D22412.tif" /><img file="US2022121884A1_D22413.tif" /><img file="US2022121884A1_D22414.tif" /><img file="US2022121884A1_D22415.tif" /><img file="US2022121884A1_D22416.tif" /><img file="US2022121884A1_D22417.tif" /><img file="US2022121884A1_D22418.tif" /><img file="US2022121884A1_D22419.tif" /><img file="US2022121884A1_D22420.tif" /><img file="US2022121884A1_D22421.tif" /><img file="US2022121884A1_D22422.tif" /><img file="US2022121884A1_D22423.tif" /><img file="US2022121884A1_D22424.tif" /><img file="US2022121884A1_D22425.tif" /><img file="US2022121884A1_D22426.tif" /><img file="US2022121884A1_D22427.tif" /><img file="US2022121884A1_D22428.tif" /><img file="US2022121884A1_D22429.tif" /><img file="US2022121884A1_D22430.tif" /><img file="US2022121884A1_D22431.tif" /><img file="US2022121884A1_D22432.tif" /><img file="US2022121884A1_D22433.tif" /><img file="US2022121884A1_D22434.tif" /><img file="US2022121884A1_D22435.tif" /><img file="US2022121884A1_D22436.tif" /><img file="US2022121884A1_D22437.tif" /><img file="US2022121884A1_D22438.tif" /><img file="US2022121884A1_D22439.tif" /><img file="US2022121884A1_D22440.tif" /><img file="US2022121884A1_D22441.tif" /><img file="US2022121884A1_D22442.tif" /><img file="US2022121884A1_D22443.tif" /><img file="US2022121884A1_D22444.tif" /><img file="US2022121884A1_D22445.tif" /><img file="US2022121884A1_D22446.tif" /><img file="US2022121884A1_D22447.tif" /><img file="US2022121884A1_D22448.tif" /><img file="US2022121884A1_D22449.tif" /><img file="US2022121884A1_D22450.tif" /><img file="US2022121884A1_D22451.tif" /><img file="US2022121884A1_D22452.tif" /><img file="US2022121884A1_D22453.tif" /><img file="US2022121884A1_D22454.tif" /><img file="US2022121884A1_D22455.tif" /><img file="US2022121884A1_D22456.tif" /><img file="US2022121884A1_D22457.tif" /><img file="US2022121884A1_D22458.tif" /><img file="US2022121884A1_D22459.tif" /><img file="US2022121884A1_D22460.tif" /><img file="US2022121884A1_D22461.tif" /><img file="US2022121884A1_D22462.tif" /><img file="US2022121884A1_D22463.tif" /><img file="US2022121884A1_D22464.tif" /><img file="US2022121884A1_D22465.tif" /><img file="US2022121884A1_D22466.tif" /><img file="US2022121884A1_D22467.tif" /><img file="US2022121884A1_D22468.tif" /><img file="US2022121884A1_D22469.tif" /><img file="US2022121884A1_D22470.tif" /><img file="US2022121884A1_D22471.tif" /><img file="US2022121884A1_D22472.tif" /><img file="US2022121884A1_D22473.tif" /><img file="US2022121884A1_D22474.tif" /><img file="US2022121884A1_D22475.tif" /><img file="US2022121884A1_D22476.tif" /><img file="US2022121884A1_D22477.tif" /><img file="US2022121884A1_D22478.tif" /><img file="US2022121884A1_D22479.tif" /><img file="US2022121884A1_D22480.tif" /><img file="US2022121884A1_D22481.tif" /><img file="US2022121884A1_D22482.tif" /><img file="US2022121884A1_D22483.tif" /><img file="US2022121884A1_D22484.tif" /><img file="US2022121884A1_D22485.tif" /><img file="US2022121884A1_D22486.tif" /><img file="US2022121884A1_D22487.tif" /><img file="US2022121884A1_D22488.tif" /><img file="US2022121884A1_D22489.tif" /><img file="US2022121884A1_D22490.tif" /><img file="US2022121884A1_D22491.tif" /><img file="US2022121884A1_D22492.tif" /><img file="US2022121884A1_D22493.tif" /><img file="US2022121884A1_D22494.tif" /><img file="US2022121884A1_D22495.tif" /><img file="US2022121884A1_D22496.tif" /><img file="US2022121884A1_D22497.tif" /><img file="US2022121884A1_D22498.tif" /><img file="US2022121884A1_D22499.tif" /><img file="US2022121884A1_D22500.tif" /><img file="US2022121884A1_D22501.tif" /><img file="US2022121884A1_D22502.tif" /><img file="US2022121884A1_D22503.tif" /><img file="US2022121884A1_D22504.tif" /><img file="US2022121884A1_D22505.tif" /><img file="US2022121884A1_D22506.tif" /><img file="US2022121884A1_D22507.tif" /><img file="US2022121884A1_D22508.tif" /><img file="US2022121884A1_D22509.tif" /><img file="US2022121884A1_D22510.tif" /><img file="US2022121884A1_D22511.tif" /><img file="US2022121884A1_D22512.tif" />
where E<sub>α</sub> is the energy associated with state α; T denotes the “Temperature” of the system; the denominator denotes the “partition function”, Z; and β denotes any state of the system. Since the energy of a state is proportional to negative log probability of the state, the probability that a binary stochastic unit j is at state 1 (or ON) in such RBM becomes the following logistic function:
<maths id="MATH-US-00107" num="00107"><math overflow="scroll"><mrow><msub><mi>p</mi><mrow><mi>j</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>is</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>ON</mi></mrow></msub><mo>=</mo><mfrac><mn>1</mn><mrow><mn>1</mn><mo>+</mo><msup><mi>e</mi><mfrac><mrow><mrow><mo>-</mo><mi>Δ</mi></mrow><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><msub><mi>E</mi><mi>j</mi></msub></mrow><mi>T</mi></mfrac></msup></mrow></mfrac></mrow></math></maths><img file="US2022121884A1_D22513.tif" /><img file="US2022121884A1_D22514.tif" /><img file="US2022121884A1_D22515.tif" /><img file="US2022121884A1_D22516.tif" /><img file="US2022121884A1_D22517.tif" /><img file="US2022121884A1_D22518.tif" /><img file="US2022121884A1_D22519.tif" /><img file="US2022121884A1_D22520.tif" /><img file="US2022121884A1_D22521.tif" /><img file="US2022121884A1_D22522.tif" /><img file="US2022121884A1_D22523.tif" /><img file="US2022121884A1_D22524.tif" /><img file="US2022121884A1_D22525.tif" /><img file="US2022121884A1_D22526.tif" /><img file="US2022121884A1_D22527.tif" /><img file="US2022121884A1_D22528.tif" /><img file="US2022121884A1_D22529.tif" /><img file="US2022121884A1_D22530.tif" /><img file="US2022121884A1_D22531.tif" /><img file="US2022121884A1_D22532.tif" /><img file="US2022121884A1_D22533.tif" /><img file="US2022121884A1_D22534.tif" /><img file="US2022121884A1_D22535.tif" /><img file="US2022121884A1_D22536.tif" /><img file="US2022121884A1_D22537.tif" /><img file="US2022121884A1_D22538.tif" /><img file="US2022121884A1_D22539.tif" /><img file="US2022121884A1_D22540.tif" /><img file="US2022121884A1_D22541.tif" /><img file="US2022121884A1_D22542.tif" /><img file="US2022121884A1_D22543.tif" /><img file="US2022121884A1_D22544.tif" /><img file="US2022121884A1_D22545.tif" /><img file="US2022121884A1_D22546.tif" /><img file="US2022121884A1_D22547.tif" /><img file="US2022121884A1_D22548.tif" /><img file="US2022121884A1_D22549.tif" /><img file="US2022121884A1_D22550.tif" /><img file="US2022121884A1_D22551.tif" /><img file="US2022121884A1_D22552.tif" /><img file="US2022121884A1_D22553.tif" /><img file="US2022121884A1_D22554.tif" /><img file="US2022121884A1_D22555.tif" /><img file="US2022121884A1_D22556.tif" /><img file="US2022121884A1_D22557.tif" /><img file="US2022121884A1_D22558.tif" /><img file="US2022121884A1_D22559.tif" /><img file="US2022121884A1_D22560.tif" /><img file="US2022121884A1_D22561.tif" /><img file="US2022121884A1_D22562.tif" /><img file="US2022121884A1_D22563.tif" /><img file="US2022121884A1_D22564.tif" /><img file="US2022121884A1_D22565.tif" /><img file="US2022121884A1_D22566.tif" /><img file="US2022121884A1_D22567.tif" /><img file="US2022121884A1_D22568.tif" /><img file="US2022121884A1_D22569.tif" /><img file="US2022121884A1_D22570.tif" /><img file="US2022121884A1_D22571.tif" /><img file="US2022121884A1_D22572.tif" /><img file="US2022121884A1_D22573.tif" /><img file="US2022121884A1_D22574.tif" /><img file="US2022121884A1_D22575.tif" /><img file="US2022121884A1_D22576.tif" /><img file="US2022121884A1_D22577.tif" /><img file="US2022121884A1_D22578.tif" /><img file="US2022121884A1_D22579.tif" /><img file="US2022121884A1_D22580.tif" /><img file="US2022121884A1_D22581.tif" /><img file="US2022121884A1_D22582.tif" /><img file="US2022121884A1_D22583.tif" /><img file="US2022121884A1_D22584.tif" /><img file="US2022121884A1_D22585.tif" /><img file="US2022121884A1_D22586.tif" /><img file="US2022121884A1_D22587.tif" /><img file="US2022121884A1_D22588.tif" /><img file="US2022121884A1_D22589.tif" /><img file="US2022121884A1_D22590.tif" /><img file="US2022121884A1_D22591.tif" /><img file="US2022121884A1_D22592.tif" /><img file="US2022121884A1_D22593.tif" /><img file="US2022121884A1_D22594.tif" /><img file="US2022121884A1_D22595.tif" /><img file="US2022121884A1_D22596.tif" /><img file="US2022121884A1_D22597.tif" /><img file="US2022121884A1_D22598.tif" /><img file="US2022121884A1_D22599.tif" /><img file="US2022121884A1_D22600.tif" /><img file="US2022121884A1_D22601.tif" /><img file="US2022121884A1_D22602.tif" /><img file="US2022121884A1_D22603.tif" /><img file="US2022121884A1_D22604.tif" /><img file="US2022121884A1_D22605.tif" /><img file="US2022121884A1_D22606.tif" /><img file="US2022121884A1_D22607.tif" /><img file="US2022121884A1_D22608.tif" /><img file="US2022121884A1_D22609.tif" /><img file="US2022121884A1_D22610.tif" /><img file="US2022121884A1_D22611.tif" /><img file="US2022121884A1_D22612.tif" /><img file="US2022121884A1_D22613.tif" /><img file="US2022121884A1_D22614.tif" /><img file="US2022121884A1_D22615.tif" /><img file="US2022121884A1_D22616.tif" /><img file="US2022121884A1_D22617.tif" /><img file="US2022121884A1_D22618.tif" /><img file="US2022121884A1_D22619.tif" /><img file="US2022121884A1_D22620.tif" /><img file="US2022121884A1_D22621.tif" /><img file="US2022121884A1_D22622.tif" /><img file="US2022121884A1_D22623.tif" /><img file="US2022121884A1_D22624.tif" />
where T controls relative width of the above logistic function, and ΔE<sub>j </sub>(for example for a hidden unit) is given by:
<maths id="MATH-US-00108" num="00108"><math overflow="scroll"><mrow><mrow><mi>Δ</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><msub><mi>E</mi><mi>j</mi></msub></mrow><mo>=</mo><mrow><mrow><munder><mo>∑</mo><mi>i</mi></munder><mo></mo><mrow><msub><mi>v</mi><mi>i</mi></msub><mo>·</mo><msub><mi>w</mi><mrow><mi>i</mi><mo>,</mo><mi>j</mi></mrow></msub></mrow></mrow><mo>+</mo><msub><mi>c</mi><mi>j</mi></msub></mrow></mrow></math></maths><img file="US2022121884A1_D22625.tif" /><img file="US2022121884A1_D22626.tif" /><img file="US2022121884A1_D22627.tif" /><img file="US2022121884A1_D22628.tif" /><img file="US2022121884A1_D22629.tif" /><img file="US2022121884A1_D22630.tif" /><img file="US2022121884A1_D22631.tif" /><img file="US2022121884A1_D22632.tif" /><img file="US2022121884A1_D22633.tif" /><img file="US2022121884A1_D22634.tif" /><img file="US2022121884A1_D22635.tif" /><img file="US2022121884A1_D22636.tif" /><img file="US2022121884A1_D22637.tif" /><img file="US2022121884A1_D22638.tif" /><img file="US2022121884A1_D22639.tif" /><img file="US2022121884A1_D22640.tif" /><img file="US2022121884A1_D22641.tif" /><img file="US2022121884A1_D22642.tif" /><img file="US2022121884A1_D22643.tif" /><img file="US2022121884A1_D22644.tif" /><img file="US2022121884A1_D22645.tif" /><img file="US2022121884A1_D22646.tif" /><img file="US2022121884A1_D22647.tif" /><img file="US2022121884A1_D22648.tif" /><img file="US2022121884A1_D22649.tif" /><img file="US2022121884A1_D22650.tif" /><img file="US2022121884A1_D22651.tif" /><img file="US2022121884A1_D22652.tif" /><img file="US2022121884A1_D22653.tif" /><img file="US2022121884A1_D22654.tif" /><img file="US2022121884A1_D22655.tif" /><img file="US2022121884A1_D22656.tif" /><img file="US2022121884A1_D22657.tif" /><img file="US2022121884A1_D22658.tif" /><img file="US2022121884A1_D22659.tif" /><img file="US2022121884A1_D22660.tif" /><img file="US2022121884A1_D22661.tif" /><img file="US2022121884A1_D22662.tif" /><img file="US2022121884A1_D22663.tif" /><img file="US2022121884A1_D22664.tif" /><img file="US2022121884A1_D22665.tif" /><img file="US2022121884A1_D22666.tif" /><img file="US2022121884A1_D22667.tif" /><img file="US2022121884A1_D22668.tif" /><img file="US2022121884A1_D22669.tif" /><img file="US2022121884A1_D22670.tif" /><img file="US2022121884A1_D22671.tif" /><img file="US2022121884A1_D22672.tif" /><img file="US2022121884A1_D22673.tif" /><img file="US2022121884A1_D22674.tif" /><img file="US2022121884A1_D22675.tif" /><img file="US2022121884A1_D22676.tif" /><img file="US2022121884A1_D22677.tif" /><img file="US2022121884A1_D22678.tif" /><img file="US2022121884A1_D22679.tif" /><img file="US2022121884A1_D22680.tif" /><img file="US2022121884A1_D22681.tif" /><img file="US2022121884A1_D22682.tif" /><img file="US2022121884A1_D22683.tif" /><img file="US2022121884A1_D22684.tif" /><img file="US2022121884A1_D22685.tif" /><img file="US2022121884A1_D22686.tif" /><img file="US2022121884A1_D22687.tif" /><img file="US2022121884A1_D22688.tif" /><img file="US2022121884A1_D22689.tif" /><img file="US2022121884A1_D22690.tif" /><img file="US2022121884A1_D22691.tif" /><img file="US2022121884A1_D22692.tif" /><img file="US2022121884A1_D22693.tif" /><img file="US2022121884A1_D22694.tif" /><img file="US2022121884A1_D22695.tif" /><img file="US2022121884A1_D22696.tif" /><img file="US2022121884A1_D22697.tif" /><img file="US2022121884A1_D22698.tif" /><img file="US2022121884A1_D22699.tif" /><img file="US2022121884A1_D22700.tif" /><img file="US2022121884A1_D22701.tif" /><img file="US2022121884A1_D22702.tif" /><img file="US2022121884A1_D22703.tif" /><img file="US2022121884A1_D22704.tif" /><img file="US2022121884A1_D22705.tif" /><img file="US2022121884A1_D22706.tif" /><img file="US2022121884A1_D22707.tif" /><img file="US2022121884A1_D22708.tif" /><img file="US2022121884A1_D22709.tif" /><img file="US2022121884A1_D22710.tif" /><img file="US2022121884A1_D22711.tif" /><img file="US2022121884A1_D22712.tif" /><img file="US2022121884A1_D22713.tif" /><img file="US2022121884A1_D22714.tif" /><img file="US2022121884A1_D22715.tif" /><img file="US2022121884A1_D22716.tif" /><img file="US2022121884A1_D22717.tif" /><img file="US2022121884A1_D22718.tif" /><img file="US2022121884A1_D22719.tif" /><img file="US2022121884A1_D22720.tif" /><img file="US2022121884A1_D22721.tif" /><img file="US2022121884A1_D22722.tif" /><img file="US2022121884A1_D22723.tif" /><img file="US2022121884A1_D22724.tif" /><img file="US2022121884A1_D22725.tif" /><img file="US2022121884A1_D22726.tif" /><img file="US2022121884A1_D22727.tif" /><img file="US2022121884A1_D22728.tif" /><img file="US2022121884A1_D22729.tif" /><img file="US2022121884A1_D22730.tif" /><img file="US2022121884A1_D22731.tif" /><img file="US2022121884A1_D22732.tif" /><img file="US2022121884A1_D22733.tif" /><img file="US2022121884A1_D22734.tif" /><img file="US2022121884A1_D22735.tif" /><img file="US2022121884A1_D22736.tif" />
Note that in an embodiment with T is set to zero, the stochastic nature of the binary units becomes deterministic, i.e., taking the value sigmoid function (zero or one), as in Hopfield Network.
In one embodiment, the training attempts to reduce the Kullback-Leibler divergence, G, between the distributions of V states based on the training sets and based on thermal equilibrium of the Boltzmann machine, by modifying weights and biases, e.g., via a gradient decent over G with respect to a given weight or bias. The aim of training is to determine weights/biases such that the training samples have high probability. In maximizing the average probability of a state V, P(V), with respect to weights, we have
<maths id="MATH-US-00109" num="00109"><math overflow="scroll"><mrow><msub><mrow><mo>〈</mo><mfrac><mrow><mrow><mo>∂</mo><mi>log</mi></mrow><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><mi>P</mi><mo></mo><mrow><mo>(</mo><mi>V</mi><mo>)</mo></mrow></mrow></mrow><mrow><mo>∂</mo><msub><mi>w</mi><mrow><mi>i</mi><mo>,</mo><mi>j</mi></mrow></msub></mrow></mfrac><mo>〉</mo></mrow><mi>data</mi></msub><mo>=</mo><mrow><msub><mrow><mo>〈</mo><mrow><msub><mi>v</mi><mi>i</mi></msub><mo></mo><msub><mi>h</mi><mi>j</mi></msub></mrow><mo>〉</mo></mrow><mi>data</mi></msub><mo>-</mo><msub><mrow><mo>〈</mo><mrow><msub><mi>v</mi><mi>i</mi></msub><mo></mo><msub><mi>h</mi><mi>j</mi></msub></mrow><mo>〉</mo></mrow><mi>model</mi></msub></mrow></mrow></math></maths><img file="US2022121884A1_D22737.tif" /><img file="US2022121884A1_D22738.tif" /><img file="US2022121884A1_D22739.tif" /><img file="US2022121884A1_D22740.tif" /><img file="US2022121884A1_D22741.tif" /><img file="US2022121884A1_D22742.tif" /><img file="US2022121884A1_D22743.tif" /><img file="US2022121884A1_D22744.tif" /><img file="US2022121884A1_D22745.tif" /><img file="US2022121884A1_D22746.tif" /><img file="US2022121884A1_D22747.tif" /><img file="US2022121884A1_D22748.tif" /><img file="US2022121884A1_D22749.tif" /><img file="US2022121884A1_D22750.tif" /><img file="US2022121884A1_D22751.tif" /><img file="US2022121884A1_D22752.tif" /><img file="US2022121884A1_D22753.tif" /><img file="US2022121884A1_D22754.tif" /><img file="US2022121884A1_D22755.tif" /><img file="US2022121884A1_D22756.tif" /><img file="US2022121884A1_D22757.tif" /><img file="US2022121884A1_D22758.tif" /><img file="US2022121884A1_D22759.tif" /><img file="US2022121884A1_D22760.tif" /><img file="US2022121884A1_D22761.tif" /><img file="US2022121884A1_D22762.tif" /><img file="US2022121884A1_D22763.tif" /><img file="US2022121884A1_D22764.tif" /><img file="US2022121884A1_D22765.tif" /><img file="US2022121884A1_D22766.tif" /><img file="US2022121884A1_D22767.tif" /><img file="US2022121884A1_D22768.tif" /><img file="US2022121884A1_D22769.tif" /><img file="US2022121884A1_D22770.tif" /><img file="US2022121884A1_D22771.tif" /><img file="US2022121884A1_D22772.tif" /><img file="US2022121884A1_D22773.tif" /><img file="US2022121884A1_D22774.tif" /><img file="US2022121884A1_D22775.tif" /><img file="US2022121884A1_D22776.tif" /><img file="US2022121884A1_D22777.tif" /><img file="US2022121884A1_D22778.tif" /><img file="US2022121884A1_D22779.tif" /><img file="US2022121884A1_D22780.tif" /><img file="US2022121884A1_D22781.tif" /><img file="US2022121884A1_D22782.tif" /><img file="US2022121884A1_D22783.tif" /><img file="US2022121884A1_D22784.tif" /><img file="US2022121884A1_D22785.tif" /><img file="US2022121884A1_D22786.tif" /><img file="US2022121884A1_D22787.tif" /><img file="US2022121884A1_D22788.tif" /><img file="US2022121884A1_D22789.tif" /><img file="US2022121884A1_D22790.tif" /><img file="US2022121884A1_D22791.tif" /><img file="US2022121884A1_D22792.tif" /><img file="US2022121884A1_D22793.tif" /><img file="US2022121884A1_D22794.tif" /><img file="US2022121884A1_D22795.tif" /><img file="US2022121884A1_D22796.tif" /><img file="US2022121884A1_D22797.tif" /><img file="US2022121884A1_D22798.tif" /><img file="US2022121884A1_D22799.tif" /><img file="US2022121884A1_D22800.tif" /><img file="US2022121884A1_D22801.tif" /><img file="US2022121884A1_D22802.tif" /><img file="US2022121884A1_D22803.tif" /><img file="US2022121884A1_D22804.tif" /><img file="US2022121884A1_D22805.tif" /><img file="US2022121884A1_D22806.tif" /><img file="US2022121884A1_D22807.tif" /><img file="US2022121884A1_D22808.tif" /><img file="US2022121884A1_D22809.tif" /><img file="US2022121884A1_D22810.tif" /><img file="US2022121884A1_D22811.tif" /><img file="US2022121884A1_D22812.tif" /><img file="US2022121884A1_D22813.tif" /><img file="US2022121884A1_D22814.tif" /><img file="US2022121884A1_D22815.tif" /><img file="US2022121884A1_D22816.tif" /><img file="US2022121884A1_D22817.tif" /><img file="US2022121884A1_D22818.tif" /><img file="US2022121884A1_D22819.tif" /><img file="US2022121884A1_D22820.tif" /><img file="US2022121884A1_D22821.tif" /><img file="US2022121884A1_D22822.tif" /><img file="US2022121884A1_D22823.tif" /><img file="US2022121884A1_D22824.tif" /><img file="US2022121884A1_D22825.tif" /><img file="US2022121884A1_D22826.tif" /><img file="US2022121884A1_D22827.tif" /><img file="US2022121884A1_D22828.tif" /><img file="US2022121884A1_D22829.tif" /><img file="US2022121884A1_D22830.tif" /><img file="US2022121884A1_D22831.tif" /><img file="US2022121884A1_D22832.tif" /><img file="US2022121884A1_D22833.tif" /><img file="US2022121884A1_D22834.tif" /><img file="US2022121884A1_D22835.tif" /><img file="US2022121884A1_D22836.tif" /><img file="US2022121884A1_D22837.tif" /><img file="US2022121884A1_D22838.tif" /><img file="US2022121884A1_D22839.tif" /><img file="US2022121884A1_D22840.tif" /><img file="US2022121884A1_D22841.tif" /><img file="US2022121884A1_D22842.tif" /><img file="US2022121884A1_D22843.tif" /><img file="US2022121884A1_D22844.tif" /><img file="US2022121884A1_D22845.tif" /><img file="US2022121884A1_D22846.tif" /><img file="US2022121884A1_D22847.tif" /><img file="US2022121884A1_D22848.tif" />
where the average over the data means average over the training data (i.e., when V units sample from the training sets and are clamped to a training sample while hidden units are updated repeatedly to reach equilibrium distribution), and the average over model means the average from Boltzmann machine sampling from its equilibrium distribution (at a given T). In one embodiment, learning algorithm uses a small learning rate with the above to perform gradient decent. Similarly, the following can be used in learning bias c<sub>j</sub>:
<maths id="MATH-US-00110" num="00110"><math overflow="scroll"><mrow><msub><mrow><mo>〈</mo><mfrac><mrow><mrow><mo>∂</mo><mi>log</mi></mrow><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><mi>P</mi><mo></mo><mrow><mo>(</mo><mi>V</mi><mo>)</mo></mrow></mrow></mrow><mrow><mo>∂</mo><msub><mi>c</mi><mi>j</mi></msub></mrow></mfrac><mo>〉</mo></mrow><mi>data</mi></msub><mo>=</mo><mrow><msub><mrow><mo>〈</mo><msub><mi>h</mi><mi>j</mi></msub><mo>〉</mo></mrow><mi>data</mi></msub><mo>-</mo><msub><mrow><mo>〈</mo><msub><mi>h</mi><mi>j</mi></msub><mo>〉</mo></mrow><mi>model</mi></msub></mrow></mrow></math></maths><img file="US2022121884A1_D22849.tif" /><img file="US2022121884A1_D22850.tif" /><img file="US2022121884A1_D22851.tif" /><img file="US2022121884A1_D22852.tif" /><img file="US2022121884A1_D22853.tif" /><img file="US2022121884A1_D22854.tif" /><img file="US2022121884A1_D22855.tif" /><img file="US2022121884A1_D22856.tif" /><img file="US2022121884A1_D22857.tif" /><img file="US2022121884A1_D22858.tif" /><img file="US2022121884A1_D22859.tif" /><img file="US2022121884A1_D22860.tif" /><img file="US2022121884A1_D22861.tif" /><img file="US2022121884A1_D22862.tif" /><img file="US2022121884A1_D22863.tif" /><img file="US2022121884A1_D22864.tif" /><img file="US2022121884A1_D22865.tif" /><img file="US2022121884A1_D22866.tif" /><img file="US2022121884A1_D22867.tif" /><img file="US2022121884A1_D22868.tif" /><img file="US2022121884A1_D22869.tif" /><img file="US2022121884A1_D22870.tif" /><img file="US2022121884A1_D22871.tif" /><img file="US2022121884A1_D22872.tif" /><img file="US2022121884A1_D22873.tif" /><img file="US2022121884A1_D22874.tif" /><img file="US2022121884A1_D22875.tif" /><img file="US2022121884A1_D22876.tif" /><img file="US2022121884A1_D22877.tif" /><img file="US2022121884A1_D22878.tif" /><img file="US2022121884A1_D22879.tif" /><img file="US2022121884A1_D22880.tif" /><img file="US2022121884A1_D22881.tif" /><img file="US2022121884A1_D22882.tif" /><img file="US2022121884A1_D22883.tif" /><img file="US2022121884A1_D22884.tif" /><img file="US2022121884A1_D22885.tif" /><img file="US2022121884A1_D22886.tif" /><img file="US2022121884A1_D22887.tif" /><img file="US2022121884A1_D22888.tif" /><img file="US2022121884A1_D22889.tif" /><img file="US2022121884A1_D22890.tif" /><img file="US2022121884A1_D22891.tif" /><img file="US2022121884A1_D22892.tif" /><img file="US2022121884A1_D22893.tif" /><img file="US2022121884A1_D22894.tif" /><img file="US2022121884A1_D22895.tif" /><img file="US2022121884A1_D22896.tif" /><img file="US2022121884A1_D22897.tif" /><img file="US2022121884A1_D22898.tif" /><img file="US2022121884A1_D22899.tif" /><img file="US2022121884A1_D22900.tif" /><img file="US2022121884A1_D22901.tif" /><img file="US2022121884A1_D22902.tif" /><img file="US2022121884A1_D22903.tif" /><img file="US2022121884A1_D22904.tif" /><img file="US2022121884A1_D22905.tif" /><img file="US2022121884A1_D22906.tif" /><img file="US2022121884A1_D22907.tif" /><img file="US2022121884A1_D22908.tif" /><img file="US2022121884A1_D22909.tif" /><img file="US2022121884A1_D22910.tif" /><img file="US2022121884A1_D22911.tif" /><img file="US2022121884A1_D22912.tif" /><img file="US2022121884A1_D22913.tif" /><img file="US2022121884A1_D22914.tif" /><img file="US2022121884A1_D22915.tif" /><img file="US2022121884A1_D22916.tif" /><img file="US2022121884A1_D22917.tif" /><img file="US2022121884A1_D22918.tif" /><img file="US2022121884A1_D22919.tif" /><img file="US2022121884A1_D22920.tif" /><img file="US2022121884A1_D22921.tif" /><img file="US2022121884A1_D22922.tif" /><img file="US2022121884A1_D22923.tif" /><img file="US2022121884A1_D22924.tif" /><img file="US2022121884A1_D22925.tif" /><img file="US2022121884A1_D22926.tif" /><img file="US2022121884A1_D22927.tif" /><img file="US2022121884A1_D22928.tif" /><img file="US2022121884A1_D22929.tif" /><img file="US2022121884A1_D22930.tif" /><img file="US2022121884A1_D22931.tif" /><img file="US2022121884A1_D22932.tif" /><img file="US2022121884A1_D22933.tif" /><img file="US2022121884A1_D22934.tif" /><img file="US2022121884A1_D22935.tif" /><img file="US2022121884A1_D22936.tif" /><img file="US2022121884A1_D22937.tif" /><img file="US2022121884A1_D22938.tif" /><img file="US2022121884A1_D22939.tif" /><img file="US2022121884A1_D22940.tif" /><img file="US2022121884A1_D22941.tif" /><img file="US2022121884A1_D22942.tif" /><img file="US2022121884A1_D22943.tif" /><img file="US2022121884A1_D22944.tif" /><img file="US2022121884A1_D22945.tif" /><img file="US2022121884A1_D22946.tif" /><img file="US2022121884A1_D22947.tif" /><img file="US2022121884A1_D22948.tif" /><img file="US2022121884A1_D22949.tif" /><img file="US2022121884A1_D22950.tif" /><img file="US2022121884A1_D22951.tif" /><img file="US2022121884A1_D22952.tif" /><img file="US2022121884A1_D22953.tif" /><img file="US2022121884A1_D22954.tif" /><img file="US2022121884A1_D22955.tif" /><img file="US2022121884A1_D22956.tif" /><img file="US2022121884A1_D22957.tif" /><img file="US2022121884A1_D22958.tif" /><img file="US2022121884A1_D22959.tif" /><img file="US2022121884A1_D22960.tif" />
In one embodiment, where the weights are absent between the hidden units, the updating of the hidden states, H, is done in parallel as the hidden units are conditionally independent for a given set of visible states, V. In one embodiment, sampling from model involves one or more iterations alternating between updating (in parallel) hidden and visible layers based on each other. In one embodiment, sampling for the model is substituted with sampling from reconstruction, which updates the hidden units (for example, in parallel) using the visible units clamped to a training set, then updates the visible units (e.g., in parallel)t to get a reconstruction from the features in the hidden layers, followed by updating the hidden units based on the reconstruction. This approach approximates the gradient decent of contrastive divergence in an efficient and fast manner. In RBM learning, contrastive divergence can be used instead of maximum likelihood learning which is expensive. In one embodiment, T is lowered from a higher initial value to make low cost (energy) states more probable than high cost states, while the higher initial value of T allows for reaching and sampling equilibrium states quicker. In one embodiment, the stochastic nature of binary units allows escaping from local minima. In one embodiment, during the reconstruction, a subset of visible units are clamped to input data to reconstruct other visible units from the features including those affected or derived (e.g., stochastically) from the input data. The training in such a conditional Boltzmann machine tends to maximize the log probability of the observed visual units (now taken as output in reconstruction), given the input data.
In one embodiment, other non-binary discrete stochastic units may be used. In one embodiment, continuous value units may be used. In one embodiment, mean filed units are used having their state (in the range of [0, 1]) determined by the total input (e.g., a logistic function) and a noise (e.g., as a Gaussian). In one embodiment, other stochastic functions/distributions (e.g., binomial and Poisson) are used for the units. In one embodiment, where continuous data (including semi-continuous data with many levels as opposed to few discrete levels) is used for state of the visible units, the sampling from a probability distribution (e.g., Gaussian with a given variance, with the mean determined by the other signal and weights) keeps the stochastic nature, while making the signal in visible unit continuous (as opposed to discrete). The hidden layers may stay binary (stochastic). In one embodiment, stochastic visible units use continuous signal (e.g., in [0, 1] range) based on other signals and weights and a probability distribution (e.g., logistic function) for sampling or updating its signal.
In one embodiment, following the training of one RBM, another hidden layer is added on top which employs the lower RBM's hidden layer as input to determine higher level features, and the training is done one layer at the time. For example, <figref idref="DRAWINGS">FIG. 181</figref> illustrates 3 level RBM with 3 hidden layers H<sup>(1)</sup>, H<sup>(2)</sup>, and H<sup>(3)</sup>. In one embodiment, in training the weights (w<sup>(3)</sup>) for additional hidden layer (H<sup>(3)</sup>), the weights for the trained lower layers are fixed. The fixed weights are used to pass data from bottom up to higher layer and to reconstruct from top down based on higher order features. In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 182</figref>, RBMs are stack on top of each other and training is done one layer at the time from bottom up. In one embodiment, the visible units have continuous value state (e.g., logistic units). In one embodiment, in training a higher level RBM (e.g., RBM<sup>(3)</sup>), signals in its corresponding visible units (e.g., V<sup>(3)</sup>) are set to the probability values associated with the corresponding hidden units (e.g., H(<sup>2</sup>)) of the previous RBM, while the hidden units (H<sup>(2)</sup>) themselves are binary stochastic units. In one embodiment, the top hidden layer (e.g., H<sup>(3)</sup>) has continuous stochastic value, e.g., based on Gaussian probability distribution (e.g., with unit variance) having a mean based on the weights (e.g., w<sup>(3)</sup>) and signals from its corresponding visible units, V<sup>(3) </sup>(e.g., logistic units). In one embodiment, the top hidden layer includes a relatively low number of units e.g., for representing the high level features as low dimensional codes). In one embodiment, hidden units use continuous variables for to represent their features/dimensions, e.g., to facilitate classification based on high level features from the top hidden level (e.g., via training one or more correlation layers, or other methods such as SVM). In one embodiment, layer by layer training creates proper features detection in the hidden layers to enhance the back-propagation in discrimination. This allows for fine tuning by local search, e.g., via contrastive wake-sleep approach for better generation. In one embodiment, few labeled samples are used to fine tune the classification boundaries after the features have already been determined primarily based on the unlabeled data features.
In one embodiment, weights (y<sub>i,k</sub>) are introduced in the visible layer while training the weights (w<sub>i,j</sub>) between the visible layer and the hidden layer (e.g., as depicted in <figref idref="DRAWINGS">FIG. 183</figref>). In one embodiment, this approach is also used for higher level RBMs by introducing weights between hidden units of the lower RBM while training the weights for the higher RBM. In this sense, the RBM becomes a semi-restricted Boltzmann machine. In one embodiment, a gradient decent approach for modifying the weights follows the following update contrastive divergence method:
<br />Δw<sub>i,j</sub>=ε·(<img file="US2022121884A1_D22961.tif" />v<sub>i</sub>h<sub>j</sub><img file="US2022121884A1_D22962.tif" /><sup>0</sup>−<img file="US2022121884A1_D22963.tif" />v<sub>i</sub>h<sub>j</sub><img file="US2022121884A1_D22964.tif" /><sup>1</sup>)
<br />Δy<sub>i,k</sub>=ε′·(<img file="US2022121884A1_D22965.tif" />v<sub>i</sub>v<sub>k</sub><img file="US2022121884A1_D22966.tif" /><sup>0</sup>−<img file="US2022121884A1_D22967.tif" />v<sub>i</sub>v<sub>k</sub><img file="US2022121884A1_D22968.tif" /><sup>1</sup>)
where superscript 0 indicates the correlation after the initial update of hidden layer after clamping the training sample to the visual units, and superscript 1 indicates the correlation after the hidden layer is updated next time by the reconstruction at the visual layer. In one embodiment, to get to the reconstruction in the visible layer, the visible units are updated one or more times (e.g., iteratively in parallel) based on the current weights, the updated hidden units, and the state of the visible units (from the initial or prior iteration). In one embodiment, the update activity involves stochastic sampling from the probability distribution (e.g., logistic function). Note that ε and ε′ correspond to the learning rate. In one embodiment, the hidden units are updated multiple times before the correlations are used to determine changes in weight. In one embodiment, visible units with continuous value state (e.g., mean field units) are updated in parallel based on the total input to the unit (e.g., based on a logistic function).
In one embodiment, intra-layer weights are introduced during the training of a higher hidden layer in order to establish tighter relationships among inter-layer units (e.g., neighboring visible units corresponding to neighboring pixels in an imageldata). This enforces constraint during generation. In an embodiment, this facilitates the generation of the parts of a larger recognized object that would not fit each other due to loose relationships between corresponding sub-features. In one embodiment, more features (e.g., redundant) are used to tighten the relationships. In one embodiment, the interrelations between the features (e.g., constraints or rules) are used to limit the choices (i.e., placement of parts), and the placement of one feature helps determine the placement of the other features based on the interrelationship between those features.
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 184</figref>, an autoencoder, e.g., a deep autoencoder, is provided by stacking further hidden layers, in reverse order with respect to the lower layer, having the same size and the same corresponding interlayer weights as their corresponding lower layers. While the lower half layers (including the coding layer H<sup>(3)</sup>) act as a decoder, the added top layers act as encoder to produce similar data in V′ (output) based on the features learned/captured at the coding layer. The added weights in <figref idref="DRAWINGS">FIG. 184</figref> are depicted with superscript T to indicate that these weights (initially) are represented by the transpose matrix representing the corresponding weights in the lower layers. In one embodiment, the weights of the autoencoder is fine tuned, e.g., by using a back propagation method based on gradient decent. Since the initial weights of autoencoder were determined by a greedy pre-training of lower RBMs, the back propagation will be efficient. In one embodiment, during the back propagation fine tuning, the stochastic binary units are assumed to be deterministic continuous value units adopting the probability value as their state value, to carry out the back propagation. In one embodiment, the objective function (error function) to optimize in back propagation, is the cross entropy error, E<sub>s</sub>, between the data (e.g., image pixel intensity in V layer) and the reconstruction (e.g., the corresponding pixel intensities in V′ Output), for a given sample:
<maths id="MATH-US-00111" num="00111"><math overflow="scroll"><mrow><msub><mi>E</mi><mi>s</mi></msub><mo>=</mo><mrow><munder><mo>∑</mo><mi>i</mi></munder><mo></mo><mrow><mo>(</mo><mrow><mrow><mrow><msub><mi>v</mi><mi>i</mi></msub><mo>·</mo><mi>log</mi></mrow><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><msubsup><mi>v</mi><mi>i</mi><mi>′</mi></msubsup></mrow><mo>+</mo><mrow><mrow><mo>(</mo><mrow><mn>1</mn><mo>-</mo><msub><mi>v</mi><mi>i</mi></msub></mrow><mo>)</mo></mrow><mo>·</mo><mrow><mi>log</mi><mo></mo><mrow><mo>(</mo><mrow><mn>1</mn><mo>-</mo><msubsup><mi>v</mi><mi>i</mi><mi>′</mi></msubsup></mrow><mo>)</mo></mrow></mrow></mrow></mrow><mo>)</mo></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D22969.tif" /><img file="US2022121884A1_D22970.tif" /><img file="US2022121884A1_D22971.tif" /><img file="US2022121884A1_D22972.tif" /><img file="US2022121884A1_D22973.tif" /><img file="US2022121884A1_D22974.tif" /><img file="US2022121884A1_D22975.tif" /><img file="US2022121884A1_D22976.tif" /><img file="US2022121884A1_D22977.tif" /><img file="US2022121884A1_D22978.tif" /><img file="US2022121884A1_D22979.tif" /><img file="US2022121884A1_D22980.tif" /><img file="US2022121884A1_D22981.tif" /><img file="US2022121884A1_D22982.tif" /><img file="US2022121884A1_D22983.tif" /><img file="US2022121884A1_D22984.tif" /><img file="US2022121884A1_D22985.tif" /><img file="US2022121884A1_D22986.tif" /><img file="US2022121884A1_D22987.tif" /><img file="US2022121884A1_D22988.tif" /><img file="US2022121884A1_D22989.tif" /><img file="US2022121884A1_D22990.tif" /><img file="US2022121884A1_D22991.tif" /><img file="US2022121884A1_D22992.tif" /><img file="US2022121884A1_D22993.tif" /><img file="US2022121884A1_D22994.tif" /><img file="US2022121884A1_D22995.tif" /><img file="US2022121884A1_D22996.tif" /><img file="US2022121884A1_D22997.tif" /><img file="US2022121884A1_D22998.tif" /><img file="US2022121884A1_D22999.tif" /><img file="US2022121884A1_D23000.tif" /><img file="US2022121884A1_D23001.tif" /><img file="US2022121884A1_D23002.tif" /><img file="US2022121884A1_D23003.tif" /><img file="US2022121884A1_D23004.tif" /><img file="US2022121884A1_D23005.tif" /><img file="US2022121884A1_D23006.tif" /><img file="US2022121884A1_D23007.tif" /><img file="US2022121884A1_D23008.tif" /><img file="US2022121884A1_D23009.tif" /><img file="US2022121884A1_D23010.tif" /><img file="US2022121884A1_D23011.tif" /><img file="US2022121884A1_D23012.tif" /><img file="US2022121884A1_D23013.tif" /><img file="US2022121884A1_D23014.tif" /><img file="US2022121884A1_D23015.tif" /><img file="US2022121884A1_D23016.tif" /><img file="US2022121884A1_D23017.tif" /><img file="US2022121884A1_D23018.tif" /><img file="US2022121884A1_D23019.tif" /><img file="US2022121884A1_D23020.tif" /><img file="US2022121884A1_D23021.tif" /><img file="US2022121884A1_D23022.tif" /><img file="US2022121884A1_D23023.tif" /><img file="US2022121884A1_D23024.tif" /><img file="US2022121884A1_D23025.tif" /><img file="US2022121884A1_D23026.tif" /><img file="US2022121884A1_D23027.tif" /><img file="US2022121884A1_D23028.tif" /><img file="US2022121884A1_D23029.tif" /><img file="US2022121884A1_D23030.tif" /><img file="US2022121884A1_D23031.tif" /><img file="US2022121884A1_D23032.tif" /><img file="US2022121884A1_D23033.tif" /><img file="US2022121884A1_D23034.tif" /><img file="US2022121884A1_D23035.tif" /><img file="US2022121884A1_D23036.tif" /><img file="US2022121884A1_D23037.tif" /><img file="US2022121884A1_D23038.tif" /><img file="US2022121884A1_D23039.tif" /><img file="US2022121884A1_D23040.tif" /><img file="US2022121884A1_D23041.tif" /><img file="US2022121884A1_D23042.tif" /><img file="US2022121884A1_D23043.tif" /><img file="US2022121884A1_D23044.tif" /><img file="US2022121884A1_D23045.tif" /><img file="US2022121884A1_D23046.tif" /><img file="US2022121884A1_D23047.tif" /><img file="US2022121884A1_D23048.tif" /><img file="US2022121884A1_D23049.tif" /><img file="US2022121884A1_D23050.tif" /><img file="US2022121884A1_D23051.tif" /><img file="US2022121884A1_D23052.tif" /><img file="US2022121884A1_D23053.tif" /><img file="US2022121884A1_D23054.tif" /><img file="US2022121884A1_D23055.tif" /><img file="US2022121884A1_D23056.tif" /><img file="US2022121884A1_D23057.tif" /><img file="US2022121884A1_D23058.tif" /><img file="US2022121884A1_D23059.tif" /><img file="US2022121884A1_D23060.tif" /><img file="US2022121884A1_D23061.tif" /><img file="US2022121884A1_D23062.tif" /><img file="US2022121884A1_D23063.tif" /><img file="US2022121884A1_D23064.tif" /><img file="US2022121884A1_D23065.tif" /><img file="US2022121884A1_D23066.tif" /><img file="US2022121884A1_D23067.tif" /><img file="US2022121884A1_D23068.tif" /><img file="US2022121884A1_D23069.tif" /><img file="US2022121884A1_D23070.tif" /><img file="US2022121884A1_D23071.tif" /><img file="US2022121884A1_D23072.tif" /><img file="US2022121884A1_D23073.tif" /><img file="US2022121884A1_D23074.tif" /><img file="US2022121884A1_D23075.tif" /><img file="US2022121884A1_D23076.tif" /><img file="US2022121884A1_D23077.tif" /><img file="US2022121884A1_D23078.tif" /><img file="US2022121884A1_D23079.tif" /><img file="US2022121884A1_D23080.tif" />
where v<sub>i </sub>and v<sub>i</sub>′ are the state of the i<sup>th </sup>units (or intensity of the image at given pixel corresponding to unit i) associated with V and V′, respectively. In one embodiment, for the same number of parameters, deep autoencoders tend to produce less generalization errors compared to shallow ones.
In one embodiment, the dimensionality of the data is reduced via the coding presentation at the coding layer (e.g., H<sup>(3)</sup>) having few units compared to the number of units in V.
In one embodiment, a noise signal is introduced in the top hidden layer units (e.g., H<sup>(3)</sup>) during training (but the same for the corresponding training data sample used in V layer) to adjust the weights resulting in more bimodal probabilities in order to make the system more resilient against the noise in the data.
In one embodiment, the features of the training samples are learned, e.g., via an unsupervised learning algorithm (e.g., by greedy learning by RBMs). Then, the features are correlated or associated with labels from a subset of training sample, as for example depicted in <figref idref="DRAWINGS">FIG. 185</figref>. Labels are clamped to a set of units (in L layer) during the training, while data (e.g., image pixels) are clamped to the V units. An RBM is added on top to learn the correlation or association between the data features and the labels. During the training, L layer and one or more hidden layers (e.g., H<sup>(2)</sup>) provide data to C layer (which may be an RBM, as well). Labels may be binary, multi-valued discrete, or continuous. Similarly the weights (e.g., W<sup>(c)</sup>) and biases related to the added layer are learned by feeding labels and corresponding Data at L and V layers, respectively.
Once the association between the labels and Data is learned, in one embodiment, data. is input to V layer, and its corresponding label is ascertained at L layer, by having the units in C layer drive the units in L layer. In one embodiment, data samples corresponding to a label may be constructed by clamping unit(s) in L layer to derive units in C Layer, and followed by a top-down reconstruction in V layer. In one embodiment, a subset of units in V layer are clamped to input (e.g., to input a partial image or a portion of image) and the state of one or more labels are set in L layer by clamping to environment. Then, the other unclamped V units are used to determine the state of the other V units (given the clamped visible and label units), deterministically or stochastically (e.g., through iteration). In one embodiment, a larger image may be recovered from partial data (e.g., partial image) through reconstruction.
Reliability Measure:
In one embodiment, the strength of the correlation between data and label or conformity of data to the system (e.g., a trained system) may be determined based on the energy of states given the clamped data (and label). In one embodiment, the strength of correlation or conformity is based on relative probability of various states. For example, the energy difference of two states in Boltzmann machine (in equilibrium) is proportional to the log of the ratio of their probabilities. In one embodiment, the relative strength of the correlation or conformity is based on the relative probability of two states. In one embodiment, a baseline for the probability of training samples is established during and/or after training. In one embodiment, the strength of correlation or conformity indicates how well the state(s) representing the data (and label) fit into the energy landscape of the system. In one embodiment, as depicted in <figref idref="DRAWINGS">FIG. 186</figref>, the strength of correlation or conformity of a dataset (including any associated label) is used to determine Z-factor associated with the associated features and/or classification of the data from the network.
In one embodiment, the quality of the search is evaluated based one or more approaches including for example, the probability, e.g., the total energy of RBM, or the difference between the regenerated data/image and the input, the frequency the recognized labels change while anchoring the visible units/neurons to the input/image.
Learning Based on Models:
In one embodiment, the learning is achieved through simulation using a data (and label) sample generation based on one or more models. In one embodiment, a network trained based on model(s) is used to recognize and classify actual data which may not have been seen before. In one embodiment, the system is trained to infer the potential model(s) itself by recognizing the (e.g., observed) data conforming to a particular model and its associated labels/parameters.
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 187</figref>, a sample generator is used to provide data (e.g., images) for training.: rendering unit renders the data according to one or more models (e.g., functional, tabular, and/or heuristic) and the corresponding model parameters governing the instantiation of the model by the rendering unit. In one embodiment, at least a subset of model parameters are generated stochastically (or via a deterministic sequential algorithm) by a randomizer unit, which for example, uses applicable probability model(s) and/or model rules to generate the subset of model parameters within given ranges or constraints. In one embodiment, the training of the network (e.g., a deep belief network based on Boltzmann machines) is done repeatedly generating training data samples via the sample generator to teed to the V layer of a network being trained. In one embodiment, the training is done one hidden layer at the time (e.g., until H<sup>(3)</sup>). In one embodiment, the training of hidden layers is done unsupervised (i.e., without supplying labeled training samples). In one embodiment, an autoencoder is setup (e.g., as shown in <figref idref="DRAWINGS">FIG. 187</figref>) and fine tuned using back propagation. In one embodiment, a correlation or associative layer is added to learn the correlation between the features of the data and the labels (L<sub>M</sub>), where the labels are supplied by the sample generator (along with the rendered data). In one embodiment, for example as depicted in <figref idref="DRAWINGS">FIG. 188</figref>, multiple L<sub>M </sub>layers (e.g., in parallel) are used to represent various classes of (e.g., independent) models. In one embodiment, the relevant weights between C layer and an L<sub>M </sub>layer are fixed for one class of model(s) while training another class of model(s) through the same C layer. In one embodiment, the cross correlation between two models is determined, via cross correlation (e.g., through layer C) between the labels associates with both models. For example, by a subset of labels from L<sub>M1 </sub>layer is clamped and sampled generated from top-down reconstruction from layer C to layer LM2 are used to determine such cross correlation. In one embodiment, states on layer C are stochastically run to derive the reconstruction in both L<sub>M1 </sub>and L<sub>M2 </sub>layers for determining a correlation between the reconstructions samples. In one embodiment, the units in layer C are derived (e.g., through inference) from V layer (by inputting data), and labels are reconstructed in layers L<sub>M1 </sub>and L<sub>M2</sub>. In one embodiment, the levels of conformity or correlation of data supplied to V units (or a subset of V units) with models(s) are obtained for each model based on relative probabilities and energy of states. In comparing on model to another, the weights associated with one model are not used in determining energy or probability associated with the other model (for such comparison).
In one embodiment, noise is incorporated into the rendering in order to make the network more resilient to noise. In one embodiment, a stochastic noise (e.g., Gaussian) is applied to the rendering, e.g., in illumination, intensity, texture, color, contrast, saturation, edges, scale, angles, perspective, projection, skew, rotation, or twist, across or for portion(s) of the image. In one embodiment, noise is added to a hidden layer in a reproducible manner, i.e., for a given data sample (or for a given model parameters), in order to adjust the weight to result in a more modal range of activities to increase tolerance for noise.
In one embodiment, elastic distortions (as well as affine transformations) are used to expand the size and variety of the training set, e.g., when the training set is produced from a model (such as a rendered data/image) or when the data/image is provided separately as part of a training set. In one embodiment, such a distortion is parameterized and rendered by the rendering unit. One embodiment used both affine (e.g., translation, scaling, reflection, rotation, homothety, shear mapping, and squeeze mapping) and distorting type transformations. In one embodiment, various transformations are rendered to generate training dataset to let the system learn features that are transformation invariant. In one embodiment, a shape model is generated with various parameters, such as various textures, colors, sizes and orientations, to let the system learn the invariant features such as the relative positions of the sub features of the modeled shape. In one embodiment, orthogonal matrixes, for example, are used to perform rotation and reflection transformation for rendering the image or on the provided data sample.
In one embodiment, the features of a high level model (with parameters) are learned by a system (such as RBM) through training (e.g., unsupervised). For example, in one embodiment, a 3D model generates various 2D images at different poses (including position, orientation, and scale) and expressions/emotions (or illumination), and the system would learn correlation between the images and their features (derived from the model). Then, the model parameters (and their probabilities) may be obtained for an image.
In one embodiment, various samples are generated/rendered from a 3D model, by varying relative location and angle of the viewer and the model object (e.g. polar coordinates (r, θ, φ)). These variation span various poses (based on θ and φ) and scaling (based on r), using other perspective parameters (e.g., derived from cameralviewer's view span).
In one embodiment, a 3D model rendering mapped to 2D images is based on the normal vectors at a given point of the 3D model, illumination parameters (e.g., location of light(s) and intensity), and reflectivity and texture model of the surface. In one embodiment, the location/presence of rigid points from the model improves the accuracy. In one embodiment, PIE (pose, illumination, expression) variations are used to generate training data/images (e.g., by rendering in 2D).
In one embodiment, multiple models can be learned in combination. E.g., the model for generating of texture of surfaces or colors can be learned in conjunction with a 3D model of head or body. In rendering a 3D model, the texture model may be incorporated to provide textures and colors for the rendered images used for training. The correlation between the model parameters and the rendered images is learned via training. In one embodiment, noise is added to prevent over fitting and regularize the weights to better generalize when used with out of sample data/images.
In one embodiment, getting a low level of conformity of a data/image (for example based in a conformity measure such as energy error or probabilities) with a trained system (e.g., based on a model) causes the data to be marked/tagged or included in a set of data to be recognized/classified by other expert systems/networks.
In one embodiment, the model comprises of rules governing the parameters, structure, and relationships between various components and sub-components of the model. In one embodiment, the rules engine is iteratively executed to generate sample data for training, by using a rules engine.
In one embodiment, the model includes a databases of background and foreground objects (with parameters) or images. In one embodiment, various data samples are created with various background and foreground models to train the system recognize high level features of foreground and background (e.g., wide uniform horizontal bands or regions of color/intensity). In one embodiment, generic labels are used to train the correlation between the labels and the features of the background or foreground scenes.
Correlating of Features and Locations of Interest within the Data (e.g., Image):
In one embodiment, a location within the image is specified by a continuous value (e.g., in range of [0, 1] to indicate/identify the location or pixel along a direction (e.g., x or y direction) in the data/image) or a multi-discrete value (e.g., indicating/identifying a range of locations or pixels along a direction in the date/image). In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 189</figref>, a position L in the data (e.g., a pixel map), is represented by its (x, y) coordinate. In one embodiment, x or y may be fuzzy numbers (e.g., with membership functions such as triangular, trapezoidal, rectangular, or singular). In one embodiment, the state of a unit (e.g., neurons) is represented by fuzzy values. In one embodiment, information such as coordinates, width, height, orientation, type of shape, are presented by units in a parameter layer P. In one embodiment, M layer(s) are used to provide/approximate the membership function value of a parameter, such as coordinate of a location. The units in M represent the values (or range of values) that a parameter may take. In one embodiment, a unit in M layer corresponds to a pixel (or a range of pixels) along a direction (e.g., x axis) within the image. In one embodiment, one or more units (e.g., continuous valued) in M layer are set to represent the membership function over the pixels (or range of pixels), for example in x axis, corresponding to the corresponding fuzzy parameter in P layer that, for example, represents the x coordinate of L. In one embodiment, units in M layer are used to train association of, for example, a location on the image and the features of the image. In one embodiment, weighted link are made from P or M units to a correlation layer C for training the association. In one embodiment, weighted links from M layer are made to hidden layers to associate parameters to features of the image. In one embodiment, M layer(s) includes a unit for every pixel (or a range of pixels) on the image, e.g., full coverage to specify any shape (or blob) in M layer for association with the image.
In one embodiment, where inter-layer links between units are not fully connected, the connection from M layers to units in lower hidden layer(s) are substantially arranged to spatially resemble or correspond to M units' corresponding pixels (or range of pixels) in the image viewed via V layer. In such a case, the links from V layer to higher hidden layers are also limited in number of connectivity, and for example, the few links follow a fan out pattern from a 2D layout of V layer to next hidden layer.
In one embodiment, blobs (of fuzzy blobs) are provided on M layer for association with the image during training. Fuzzy blob, for example, may have fractional membership function value at the blob's edge. In an embodiment, the membership function value in range of [0, 1] is represented by a logistic function in a unit.
In one embodiment, the location, area, or focus of interest is provided on M layer with corresponding training sample in V layer, to train the correlation. In one embodiment, the representation of the focus of interest may be a (fuzzy or crisp) border or a region specified parametrically or per pixel.
In one embodiment, with a training sample having multiple focuses of interest, the training may be performed by submitting the same data (image) with individual focus of interests during the training. In one embodiment, the stochastic nature of C layer will cause reconstruction of focus of interest in M or P layers, given an input image (or a portion of image) in V layer. For example, in training face recognition, images including one or more faces are supplied to V layer while their corresponding focuses of interest (e.g., the location/size of the face) are supplied to M or P layers, to train the correlation. In one embodiment, the various focuses of interest are iteratively constructed in M or P layer by clamping data (e.g., an image) in V to, for example, derive stochastically the corresponding focuses of interest from C layer. In one embodiment, the reconstructed parameters are output in M or P layers based on their corresponding probability.
In one embodiment, the correlation of image/data to its locations of interest is performed during training by implementing a representation of such locations on a layer of units laid out to correspond to the image/data (e.g. by linking such units to a hidden layer above V layer). In one embodiment, the position parameters (e.g., location, width/height, type, orientation) and the coverage parameters (border type, fill type, fuzzy/crisp) are used to render representation of the location(s) of interest on the representation units, e.g., by using a value in range of [0, 1]. In one embodiment, the fuzzy type rendering helps avoid making false correlations with other irrelevant features in the image/data, by representing the features of the location of interest as coarse. Fill type rendering identifies a blob where the location of interest is in the image, so that if the features of the interest are in the middle of the location, the training would catch the correlation.
In one embodiment, we have: a system for image recognition in an image recognition platform, said system comprising: an interface which receives an image; said interface receives a location of interest; a neural network; wherein said neural network comprises a visual layer and a first hidden layer; wherein said visual layer is located below said first hidden layer; wherein said neural network receives said image and said location of interest; wherein said image is connected to said visual layer; a parameter layer; wherein said parameter layer is added to said neural network; a representation layer; wherein said representation layer is added to said neural network; wherein said parameter layer has information for coordinates, width, height, orientation, or type of shape for said location of interest; wherein said representation layer reperesents a value, values, or range of values that said parameter layer has for said location of interest; wherein said representation layer has a weighted link to a second hidden layer, connected horizontally from side of said neural network; wherein said second hidden layer is located between said visual layer and said first hidden layer; wherein said second hidden layer is located above said visual layer; wherein said second hidden layer is located below said first hidden layer; a correlation layer; wherein said correlation layer is located above said first hidden layer. (Please note that the parameter layer is optional and can be bypassed by layer M (or representation layer), i.e., directly connecting to layer M, in <figref idref="DRAWINGS">FIG. 189</figref>.)
In one embodiment, we have these options/additions/variations:
wherein said representation layer is connected to said correlation layer in both directions.
wherein said parameter layer is connected to said correlation layer in both directions.
wherein said correlation layer correlates said representation layer with said image.
wherein said correlation layer correlates said parameter layer with said image.
wherein said correlation layer correlates said location of interest with said image, using said representation layer.
wherein said correlation layer correlates said location of interest with said image, using said parameter layer.
wherein said correlation layer reconstructs, in reverse mode, after training.
wherein said system comprises or applies one or more of following: softmax, cross entropy, sigmoid cross entropy, contrastive, Eucledean distance, sum of squares of difference, multinomial logistic, infogain, generalization of multinomial logistic, or hinge or margin loss layer, unit, or comparison module.
wherein said system comprises or applies one of following between said representation layer and said second hidden layer: softmax, cross entropy, sigmoid cross entropy, contrastive, Eucledean distance, sum of squares of difference, muitinomial logistic, infogain, generalization of multinomial logistic, or hinge or margin loss layer, unit, or comparison module.
wherein said neural network is not fully connected.
wherein said connection between said representation layer and said second hidden layer is not fully connected.
wherein said neural network comprises convolutional neural network connectivity format.
wherein said representation layer is expressed in Carthesian coordinates.
wherein said representation layer is expressed in polar or angular coordinates.
wherein said parameter layer is expressed in Fuzzy values.
wherein said location of interest is a part of an object represented by said image.
wherein said location of interest is represented as a coarse value or Fuzzy value.
wherein said system is used or applied recursively in said image recognition platform, to find or distinguish or detect or recognize various objects and their components. (See <figref idref="DRAWINGS">FIG. 189</figref>.)
Limiting Number of Weights Based on 2D Fan Out Layout:
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 190</figref>, the extent of the inter-layer connections are limited for the lower layers (e.g., H<sup>(1) </sup>and/or H<sup>(2)</sup>). In one embodiment, the number of inter-layer connections between the lower layers is substantially less than that of fully connected ones. For example, if the (average) number of fan out links per unit, f, is significantly smaller than the number of units in the higher layer, the number of inter-layer connections (or weights) are significantly reduced compared to the fully connected scheme. This scheme helps reduce the complexity of the structure, reduces the over fitting, and enhances generalization. Conversely, the number of fan out links (top-down, e.g., from H<sup>(1) </sup>to V units) are also limiting a until in the higher layer to relatively few units at the lower unit. Therefore, in one embodiment, for example, the number of fan out links from a unit in to V units may be about 3 to 10 pixel wide.
In one embodiment, there are multiple type of units in a hidden layer (e.g., H<sup>(1)</sup>)), with each type corresponding to different number (or range of number) of links to its lower layer units. In one embodiment, for example, type 1 units have about f<sub>1 </sub>links (e.g., about 3-10 links), type 1 units have about f<sub>2 </sub>links (e.g., about 20-30 links), and type 3 are fully connect. In one embodiment, there are more number of units (e.g., in H<sup>(1) </sup>layer) which have less number of connections to the lower layer units (e.g., in V layer), i.e., most units in H<sup>(1) </sup>have few connections to V layer units and few units in H<sup>(1) </sup>are fully connected to units in V layer.
Training with Samples of Varying Reliability:
In one embodiment, a measure of reliability of training samples may be provided with the sample data. In one embodiment, a default value for the reliability is assumed if not provided for a particular sample.
In one embodiment, an error function (to be minimized by training) defined over the training sample space (e.g., in a batch processing of an epoch) accounts for data sample reliability by including sample reliability factor as a weight in the contribution of the data sample to the batch error function, e.g., in the summation of the errors contributed from individual data samples.
In one embodiment, for example, a stochastic approach is used (instead of full epoch batch) to sample one (or several) training data sample(s) while optimizing the sample error function, and the sample error function is weighted by the reliability factor of the data sample. In one embodiment, the learning rate (e.g., the factor associated with the step to take in modifying the weights during the training) is modified based on the reliability weight for a given data sample used during the learning (e.g., in stochastic sampling of the data samples).
In one embodiment, some key data samples may be marked as the key representative samples. In one embodiment, an elevated weight is assigned to such samples during the training, e.g., to simulate the training with multiple instances of such training sample.
Preprocessing Prior to Classification and Training:
In one embodiment, one or more types of preprocessing is performed on the data (e.g., used for training or recognition) to focus on certain aspects of the data (e.g., image) in order to make the training and classification more efficient. In one embodiment, the preprocessing makes certain features to become more pronounced and easier to distinguish by the network (during and after training). For example, a filter such as Sabel filter is used in the preprocessing of an image to detect the line edges before feeding as training set for an RBM. In one embodiment, the preprocessing reduces features that may be less relevant in detection of pose and greatly simplify an initial step of choosing a more relevant expert system to further classify the image. In one embodiment, the preprocessing may actually introduce artifacts into the preprocessed image, e.g., a shadow on a face, may result in an edge across the face after an edge detector filter. In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 191</figref>, multiple preprocessing (e.g., edge detection, edge sharpening, contrast enhancement, intensity conversion (e.g., non-linear mapping), cosine transformation, and histogram) are performed, for example, in parallel, and the preprocessed image is fed into various networks, classifiers, or feature detectors for detection of classification(s) and feature(s) (e.g., denoted by CF<sub>1 </sub>and CF<sub>n</sub>). In one embodiment, the classification and/or feature detection is associated with one or more measures of reliability factor (e.g., denoted as R<sub>1 </sub>and R<sub>n</sub>). Based on the features/classes detected (and their corresponding reliability factors), in one embodiment, further feature detection or classification (e.g., more detailed detection/classification, expert system, or sub-classification used for example for identity recognition) are identified, chosen, and/or scheduled to be performed. In one embodiment, the outcome of further feature analysis/detection or classification are consolidated/mixed based on the reliability of the results (e.g., from classifiers or expert modules) as well as the reliability of parameter extraction based on the model (e.g., a front pose and side view images of a person's head present the aspects of facial features with different reliability due the image projection from 3D to 2D, as well as hidden/blocked features).
In one embodiment, the reliability of an expert module is trained by correlating the features indicating the domain of the expert module with the error encountered by the expert module.
Fuzzy Valued Feature/Label Output:
In one embodiment, multiple units are used to present various labels corresponding to a class of object. In one embodiment, feature detection system is used to train document classification based on learned (e.g., unsupervised) features corresponding to documents based on terms contained in the document (such as statistics of several hundred or several thousand common words). In one embodiment, latent semantic analysis (LSA) is used to provide the correlation between the terms or documents based on document-term matrix, and decomposition using orthogonal matrices and a low dimensional diagonal matrix (to a low dimensional space), e.g., by using single value decomposition technique (SVD). In one embodiment, RBMs are used for learning features, e.g., by limiting to top hidden layer to low number of units (dimensions/features). In one embodiment, the similarity between documents is determined by comparing (e.g., by cosine similarity) of their features. In one embodiment, the features (e.g., continuous valued) are correlated/associated with provided labels/classification (e.g., in supervised training). For example, in one embodiment, the labels indicate the type of document, such as legal, historical, fiction, scientific, business, manufacturing, technical, etc. In one embodiment, the layers are supplied to label units and correlation/association is learned via a correlation layer, e.g., by using an RBM and using the features learned from unsupervised training. In one embodiment, more than one label may be provided during the training of a sample (e.g., a document). In one embodiment, the labels are binary (e.g., indicating whether the document is “technical” or not). In one embodiment, the labels are continuous valued (or multi-valued), e.g., having values in range [0, 1], to indicate the degree in which the document is classified by a label (or the membership function of the document in the label's class). In one embodiment, upon training the correlation/association, given an input data (e.g., a document), the reconstruction of labels (as output via, for example, correlation layer), presents the classification of the document based on those labels. In one embodiment, one or more labels are identified in the output, indicating that the document is determined to belong to both classes/types. In one embodiment, the output (multi-valued or continuous) indicates the degree in which the document is determined to be of the class/type. In one embodiment, the values output at the labels are thresholded (or further discretized) to simplify the presentation and further usage. For example, in one embodiment, an output less than 15% is zeroed, or an output more than 85% is turned to 100%.
In one embodiment, the membership function values presented by the output values in label units are consolidated to form a fuzzy number. For example, in one embodiment, the labels reconstructed from a handwriting recognition sample, show the membership function values in classes “1”, “7”, and “2”. In one embodiment, the labels for expression (e.g., facial) can be represented by fuzzy concept, e.g., smiling, laughing, sad, angry, scared, nervous, sleepy, apprehensive, surprised, and tired. And each label may have a degree of membership (e.g., degree of smiling compared to neutral) for a sample data, used for training. The labels may also be correlated based on the training data.
In one embodiment, various labels (i.e., their membership degrees) get correlated/associated with the features (e.g., at the top hidden layer of RBM or deep belief network) via training through a correlation layer.
Adding New Features:
In one embodiment, an already trained (e.g., unsupervised) feature detector (e.g., RBMs or a deep belief network) is used to provide additional feature(s). In one embodiment, one or more units are added at the top hidden layer. In one embodiment, the weights/biases related to the units already at the top (e.g., hidden) layer are fixed/frozen, and training (e.g., unsupervised) is performed to adjust the weights/biases related to the added units. In one embodiment, the added units represent a set of sub features that help enhance the reconstruction from top-down direction. In one embodiment, regularization techniques (e.g., limiting the weight amounts or weight decay techniques) or verification techniques (e.g., testing using reserved test datasets) are used to maintain or monitor generalization. In one embodiment, training samples with and without the features are provided to adjust the weights of the added units. In one embodiment, back propagation is used for fine tuning of the weights/biases. In one embodiment, the added units and the previous units are used to make association and/or correlation with labeled samples, e.g., during the supervised training.
In one embodiment, an expert classifier/detector is trained predominantly from one class to detect the distinguishing features of data within the class. In one embodiment, a set of feature nodes/units/neurons are added, e.g., to the top hidden layer of RBMs, for training to detect features of an additional class (for new expert). In one embodiment, the original expert classifier/detector is trained for a different class of objects (or expertise) to detect/determine the new features at the added units at the top layer. In one embodiment, the related weights/biases for the existing units at the top layer are fixed (i.e., prevented from changing) while training for the additional class. In one embodiment, redundant features (units) are eliminated (for example from the top layer) based on their strong correlation between those from the existing expert and the additional expert. In one embodiment, correlations between top redundant units are determined based on sampling from the data in the visible layer. In one embodiment, the correlation or covariance between top redundant units (e.g., at layer H<sup>(3)</sup>) are determined based on their biases and weights to the lower layer units.
In one embodiment, additional units are provided in lower hidden layers (e.g., layer H<sup>(2)</sup>) to allow more flexibility to handle more complex feature sets in a class of data/images. In one embodiment, the redundancy of such units are determined by strong correlation between the stochastic probability associated with such units, e.g., based on the value of logistic function of the total input to the unit. In one embodiment, in eliminating a unit due to redundancy, the weights linking the remaining unit to other units (e.g., in a higher layer) are updated by consolidating (e.g., algebraically) the corresponding weights from the existing and redundant units, in order to maintain the same total input to the top layer linked unit.
Focus of Interest with Variable Resolution:
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIGS. 192(<i>a</i>)-(<i>b</i>)</figref>, the data (e.g., image) is laid out using a set of non-uniform sections, with smaller size (higher resolution) sections at the center of the image, and larger (low resolution) sections further way from the center. For example, as shown in <figref idref="DRAWINGS">FIG. 192(<i>a</i>)</figref>, the sections are rectangular (or squared) forming square bands with increasing size. In one embodiment, the consecutive segment sizes are multiple (e.g., 2) of the next smaller size (as for example depicted in <figref idref="DRAWINGS">FIG. 192(<i>a</i>)</figref>). In one embodiment, as depicted in <figref idref="DRAWINGS">FIG. 192(<i>b</i>)</figref>, multiple segment sizes may be used in various bands around the center, for example, in diagonal positions compared to the center. In one embodiment, the relative size of the segments may be a rational number (fraction), as for example depicted in <figref idref="DRAWINGS">FIG. 192(<i>b</i>)</figref>.
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIGS. 193(<i>a</i>)-(<i>b</i>)</figref>, some of the segments are radially distributed from the center, having similar sizes but different orientation. In one embodiment, the segment radial boundaries are approximated by an arc (e.g., of a circle), as for example depicted in <figref idref="DRAWINGS">FIG. 193(<i>a</i>)</figref>. In one embodiment, the segment boundaries are defined by a polygon, as for example depicted in <figref idref="DRAWINGS">FIG. 193(<i>b</i>)</figref>.
In one embodiment, the resolution/size of segments varies in vertical or horizontal direction, as for example depicted in <figref idref="DRAWINGS">FIGS. 194(<i>a</i>)-(<i>b</i>)</figref>, respectively.
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIGS. 195(<i>a</i>)-(<i>b</i>)</figref>, the segment layout follows a transformation(s) such as rotation, skew, perspective, scaling, or even distorting type transformation, In one embodiment, the details in an image is recognized (or trained) by mapping the image (or portion of the image) in such a transformed segment layout.
In one embodiment, features of an object (e.g., pose including rotation) is determined, and based on such features, features of sub-objects of other objects depicted in an image are extracted by preprocessing (e.g., mapping) a portion of an image into a segmented layout with variable resolution. Then, the mapped image (or portion thereof) is provided to a classifier or feature recognition system to determine the features from the mapped image. For example, in an embodiment, a frame depicted in an image is identified (e.g., a frame of a picture or a frame corresponding to a side of a building or a container). In one embodiment, based on the perspective/skew/projection of the frame or other indicators), the image or a portion of image is mapped to a segmented layout for input to a network for further feature detection or classification.
In one embodiment, mapping of an image to a segment is done by averaging the intensity/color of the pixels falling into the segment. In one embodiment, summary information from the enclosed pixels of the image is attributed to the segment (e.g., texture, variance of intensity/color).
In one embodiment, a recognition/classification network or module (e.g., a deep belief network or RBIs) is trained using a variable segment layout associated with its visible/input layer. In one embodiment, an image is mapped to a variable segment layout before inputting to a recognition/classification network or module (e.g., for training or for recognition).
In one embodiment, an expert module uses/selects a variable segment layout to use based on other features of data/image determined by other recognition module. For example, a text recognition module may use a layout such as those, for example, depicted in <figref idref="DRAWINGS">FIGS. 194(<i>a</i>)-(<i>b</i>) and 195(<i>b</i>)</figref>.
Estimating/Predicting/Localizing, the Focuses of Interests:
In one embodiment, the locations of interest (e.g., the location of faces within an image) is determined by a scanning the image through a variable size window over an image at different location on the image, searching for example for particular features or signatures (e.g., head or face). In one embodiment, the locations of interest are determined, for example, by determining an enclosure (e.g., the smallest enclosure, such as rectangle or ellipse) around the object of interest, to localize the object within an image. In one embodiment, the type of object (e.g., face) and its location (including orientation, skew, etc.) and other parameters (e.g., pose or identity of the object) are extracted and associated with the image. Then, such image and the associated information are used to train a feature detector/classifier to learn or predict the focuses of interest, by correlating/associating the image features with the locations of interest. In one embodiment, the image and various positions of interest are iteratively inputted to the system during training. The stochastic nature of the correlation layer, stochastically reconstruct parameters associated with the location of interest as output, e.g., using an RBM.
In one embodiment, a feature recognizes/classifier uses a data/image to extract features from an initial location (e.g., from the center of the image through a window or through a variable segment mapping). In one embodiment, based in the features determined, a set of one or more focuses of interest is reconstructed from the correlation layer (e.g., iteratively and stochastically). Then, the image is used to extract additional features from those predicted locations, e.g., through a window or a variable segment mapping. For each exploring location, a set of a location of focuses of interest are further predicted. In one embodiment, such lists of focuses of interest are consolidated and checked against the locations already covered. In one embodiment, the process stops after a certain number of locations of interest explored (for a given type of image), a certain number of features found, predicted location of interests were exhausted, certain amount of resources (es., computing power expanded), or other rules.
Partial Image Training:
In one embodiment, partial images, e.g., masked or blocked, are used for training a detection/classifier module. In one embodiment, image samples are prepared by masking out the portions omitted e.g., by hiding the portion of image using straight edges through the image. In one embodiment, a randomizer generated masking parameters (e.g., the location of the mask edge). In one embodiment, the rendering module applies the mask to the image before inputting the masked image to the recognition module. In one embodiment, the masked regions of the image are filled with random fill color or random texture/pattern.
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 196</figref>, the masked image is mapped/associated with the visible layer of a recognition/classifier module only at the units corresponding to the unmasked portion of the image. In one embodiment, during the training of an RMB, the visible units corresponding to masked portion of the image remain unclamped (i.e., their state stochastically adopt a value based on other units while the other visible units are clamped to sample data).
In one embodiment, during the training, the weights/biases associated with unclamped V units are not allowed to change due to the learning step involving the training with the corresponding partial image. In one embodiment, the contributions to the error function related to the undamped visible units are ignored in the training step using the corresponding partial image/data.
In one embodiment, in the partial image training, the weight/bias adjustments for a learning step is modified by scaling the learning rate for a given unit (e.g., a hidden unit in H<sup>(1) </sup>layer) with the ratio of the number of its links traceable to the clamped visible units and the number of its links traceable to any visible unit. In one embodiment, similar adjustment to the learning rate is made with respect to a higher level hidden unit (e.g., in layer H<sup>(2)</sup>) by, for example, determining such ratio (indirectly) by tracing through layer H<sup>(1)</sup>, or simply by estimating the ratio based on similar average ratio from the traceable units in H<sup>(1) </sup>layer. For higher hidden layers where each unit is quite likely traceable to every visible unit, the ratio is estimated as number of clamped visible units to number of visible units. In one embodiment, by tempering the learning rate, the impact of the partial image on the weights is tempered as well. In one embodiment, by limiting the adjustment of weights, the impact of learning from phantom or residual data/images from the unclamped is also reduced.
Learning Higher Details Iteratively:
In one embodiment, an effective (approximate) thumbnail is input to a visible layer of a feature detector/classifier (during training or search) by blocking/masking the data from the original image, from being clamped to the corresponding units in the visible layer, except as to sparse visible units, as for example depicted in <figref idref="DRAWINGS">FIG. 197(<i>a</i>)</figref>. For example, if the thumbnail has 8 times less resolution in both directions, then about 1 in 64 pixels from the data/image (i.e., 1 in 8 from each direction) is taken to approximate a thumbnail (e.g., without averaging with their neighboring pixels), and it is provided to the visible layer, e.g., to the corresponding unit that would have otherwise taken that pixel value when the V units are clamped with all of the data.
In one embodiment, the preprocessed thumbnail is applied to the visible layer, as for example depicted in <figref idref="DRAWINGS">FIG. 197(<i>b</i>)</figref>, by clamping a thumbnail pixel value (e.g. obtained by averaging the data/image pixel values) to a corresponding (sparse) visible unit in V layer, according to the resolution reduction from the imageldata to the thumbnail. For example, if the thumbnail has 8 times less resolution in both directions, then about 1 in 64 units in V layer are used to clamp to the corresponding thumbnail pixel values, e.g., by connecting 1 in 8 visible units in both directions.
In one embodiment, the thumbnail pixel value is applied to multiple visible units, as for example depicted in <figref idref="DRAWINGS">FIG. 197(<i>c</i>)</figref>, as if the thumbnail is expanded back to the image/data size with wide pixels covering multiple visible units. For example, if the thumbnail has 8 times less resolution in both directions, then each thumbnail pixel is clamped to about 64 units in V layer corresponding to image pixels, had the thumbnail were to expand to the image/data size.
In one embodiment, the learning of features is initially performed by using thumbnails. In one embodiment, e.g., as shown in <figref idref="DRAWINGS">FIGS. 197(<i>a</i>)-(<i>b</i>)</figref>, the weights related to unclamped visible units not used to determine the error function and their related weights are not modified in the learning steps. In one embodiment, the learning of weights related to higher layers is performed using a learning rate, based on the number of traceable clamped visible units in V layer. In one embodiment, the second round of training uses higher resolution thumbnails, involving more visible units in the training. In one embodiment, during the second round of training, the learning rate for weights/biases related to the visible units involved in the first round of training starts lower than the learning rate for the visible units just used in the second round of training. In one embodiment, the learning rate is adjusted, so that before the end of the second round of training, the learning rate is substantially the same for all visible units involved in the second round of training.
In one embodiment, the stepwise learning of features from high level to more detailed takes advantage of the training weights established in earlier rounds of training.
Context Relationships:
In one embodiment, the datasets (e.g., images) include (or associated with) various objects or concepts (e.g., face, body, book, computer, chair, car, plane, road, and building). In one embodiment, classifiers are trained to detect high level signatures/features of various objects/concepts, e.g., by training the classifiers with (labeled) training data sets, including those with and without object features. Some data sets may include multiple objects or concepts, and therefore, the occurrences of the objects/concepts overlap. In one embodiment, a classifier may classify multiple objects/concepts. In one embodiment, the correlations between the objects/concepts are determined as the result of classification of various datasets. In one embodiment, a data-concept matrix is setup based on the classification of the data sets, and further analyzed, for example, by decomposition using orthogonal matrices and a (e.g., low dimensional) diagonal matrix (e.g., to a low dimensional space), e.g., by using single value decomposition technique (SVD). In one embodiment, this dimensional space represents various contexts (e.g., family, sitting, coworkers, house, office, city, outdoor, and landscape) that support or relate to various object/concepts. In one embodiment, each context represents/contributes a set of weights representing the relationships between object/concepts.
In one embodiment, upon detection or classification of a feature of an object/concept in a data/image, the distance of the data to one or more clusters representing various contexts is determined. In one embodiment, the clusters (or contexts) that support the data are determined. In one embodiment, a set of other concepts/objects are identified based on the correlation with the classified object/concept from the image. In one embodiment, the image/data is further explored, e.g., by other classifiers or feature/object detectors), selected based on the set of predicted/suggested concepts/objects. For example, in one embodiment, a face and a computer is detected in an image. Then, it is determined that such a data is consistent with several contexts (e.g., office and home) ranked in order of distance or consistency level to such clusters, or it is determined that such data is correlated to other objects such as keyboard, table, screen, room, etc., with various correlation strengths. In one embodiment, the classifiers or expert modules tuned for such objects are used to further detect the presence of such objects in the data.
In one embodiment, the contextual relationship between objects/concepts is used to further detect other objects/concept in data/image, by prioritizing and selecting the corresponding feature detectors/classifiers, as for example depicted in <figref idref="DRAWINGS">FIG. 198</figref>.
Object Detection in Layers:
In one embodiment, an object/feature detector/classifier detects an object in a data/image. In one embodiment, the detected object may be part of or component of another object or detected for example based on the recognition of a partial image. In one embodiment, the structure of the object (e.g., the periphery, blob, coverage projection, or support regions) is determined based on localization of the object within the image (e.g., through reconstruction). In one embodiment, the potential objects/concepts in the image are determined, e.g., based on the context of the image or correlation with the context(s) of the detected object. In one embodiment, the visible structure of the object is removed from the image, e.g., as part of the objects in the image foreground. In one embodiment, e.g., with RBMs or deep belief networks, partial clamping of the input (visible) data is done for regions in the image not removed. Based on the context or correlation with other types of objects, corresponding detectors, e.g., RBMs or deep belief networks, are used to detect objects (which may be partially visible). In one embodiment, through reconstruction at the visible layer, the hidden/blocked portion of such objects is estimated/predicted. For example, this facilitates reconstructing background (if learned) or the rest of the face of a person (if learned). This approach can be executed continuously or iteratively to gather correlated collections of objects or their degree of possibilities based on the reliability factors. In one embodiment, more specific context may be derived based on each correlated (and for example expanding) collection of objects, and further information or proposition may be interred (with a reliability factor) based on the image, by feeding the relationships and the reliability factors in a knowledge web.
In one embodiment, face recognition is performed on a partially blocked face in an image using a feature detector/classifier and database of known signature (vectors) associated with identified faces. In one embodiment, the comparison of detected features provides a matching probability measure between the partial image and a subset of those known in the database. In one embodiment, the reconstructed image at, for example, unclamped visible units representing the blocked portion, may provide full a face candidate for comparison with those images in the database.
In one embodiment, the consistency/reliability of a potential match with images/features (whether known or not) in a database is associated with the measure of uniqueness among the matches. The uniqueness measure indicates how uniquely the input image/feature is matched among the other images in the database.
In one embodiment, based on the context, there is a correlation between the hidden/blocked objects and the blocking object. For example, a dark glass covering a person's eye region has a strong correlation with the eyes. B<sub>Y </sub>training with the similar data/images with and without glasses, the correlation between the features of two data samples, given other common features may be established. In one embodiment, a data/image: is searched by a trained feature detector/classifier. The features/labels indicating “wearing dark glasses” are activated based on previous training/correlation/association. In one embodiment, the region of dark glasses is identified (having correlation with the feature/label). In one embodiment, the value of feature/label is modified (e.g., forced off) by clamping the feature/label to the forced value. In one embodiment, such change/modification related to a feature/label is sent to a correlator/analyzer to determine the region on the data/image affected by the change, e.g., by reconstruction mechanism and comparison. In one embodiment, a threshold is used to limit the affected region on the image/data, e.g., based on relative changes in color, contrast, or intensity, size of region/sub-region. In one embodiment, the visible units corresponding to the thresholded region on the image/data are unclamped, while the other regions are kept clamped to the corresponding image/data pixel/portion. In one embodiment, a reconstruction in V layer, based on the forced value of the label/feature is used to recover one or more candidates for the blocked image within the unclamped visible units. In one embodiment, a two step process to uncover the blocked images, uses the rest of the (unblocked) image as prior condition in predicting a likely covered image, as opposed to a top-down pass to reconstruct the whole image which may create more variety in the visible layer. In one embodiment, multiple pass from bottom up (inference) and top-down (reconstruction) is performed to obtain more candidate or likely candidates under the constraint of clamping the visible layer to the unblocked portion of the image.
In one embodiment, the correlation between the blocked object (e.g., eyes) and the blocking object (e.g., dark glasses) is learned by sequential learning or by using two instances of the classifier/feature detector (denoted as “C/FD”), as for example depicted in <figref idref="DRAWINGS">FIG. 202</figref>. In one embodiment, a controller module selects a feature (or label) (such as “Dark Glasses”) and supply it to the label layer (e.g., by clamping the corresponding label unit to the label value (e.g., in range of [0, 1]). In one embodiment, the controller module provides the selection to a database (e.g., of images) to select a pair of images identical within the class of images but for the feature selected (e.g., two images of the same person with or without dark glasses, in similar pose and expression). The images are provided to the same (trained) classifier/feature detector (e.g., to two instances in parallel or using the same instance sequentially). The features of both images (and in particular the differences between their features) are correlated using a correlator/analyzer module (e.g., having unit/neurons) with the label/feature difference identified in the label layer (e.g., L<sub>i</sub>). In one embodiment, the L layer represents the labels indicated the feature differences between the images (denoted by ΔL). In one embodiment, more than one label is selected by the controller (indicating the differences between the features of the images selected from the database for training the correlation). In one embodiment, during the search process (i.e., for detecting objects in data/image). for uncovering the blocked feature (e.g., eyes region), a force flag selector is used to let the units representing the change in image features contribute to the state of the image features for top-down reconstruction of the image in the visible layer, while the controller maintains the corresponding label unit in ΔL layer to (e.g., stochastically) invoke the state of the units representing the change in image features. In one embodiment, the units are not separately set aside in the correlator/analyzer for determining the image feature difference/distance/vector between the two images. In one embodiment, the weights related to the units in the correlator/analyzer are trained to detect the feature differences by a stochastic or batch learning algorithm.
Measure of Scale in Context:
In one embodiment, upon recognizing an object by a feature/object detector/classifier, the size of the detected object relative within the image and the relevant context(s) are used to correlate to size of other objects potentially in the image. In one embodiment, such estimates for the sizes of other objects are used to locate potential areas in the image and the sizes to search for such potential objects. In one embodiment, this approach facilitates discovery of other objects in the image more efficiently given the location and size of window for searching for such objects have higher probability to yield detection of such objects.
In one embodiment, one or more pose detection modules (e.g., based on edge detection or color region/shape) are used to determine the pose of a face within an image/data. The scaling determined from the pose detection(s) is used to make more efficient detailed feature detection, for example, by scaling the portion of image containing the pose based on the size in a preprocessing step prior to inputting the preprocessed image to an expert feature detector.
Variable Field of Focus with Limited Data/Pixel Points:
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 199(<i>a</i>)</figref>, the recognition of object in data/image employs a wide widow (e.g., rectangular, circular, elliptical) of focus on the image, but with a limited number of pixels (i.e., with low resolution). In one embodiment, the image within the window of focus is mapped to the specified number of pixel (e.g., in mapping/creating a thumbnail image). In one embodiment, the high level features and objects (or classes of objects, such as people and faces) are detected/located within this wide focus of the image. Then, in one embodiment, a narrower window of focus, containing similar number of pixels (i.e., higher resolution), is used to explore the object(s) located during the previous detection. In one embodiment, such process is done iteratively until reaching a maximum focus (or narrowest window of focus), maximum resolution of the original image, full identification of object, or satisfaction of a search criterion or constraint (e.g., based on a rule or policy). In one embodiment, with wide window of focus, small details, such as texture that require higher resolution, may not detected. In one embodiment, an expert feature detector/classifier is used with a narrower window of focus to efficiently determine features of an object in image/data, after the class of object is determined at a high level by a prior feature detector using a wider window of focus.
In one embodiment, a quick scan recognition approach is used, based on resolution level of the focus widow. In one embodiment, at a given resolution level (e.g., R<sub>1 </sub>or R<sub>2</sub>, as for example depicted in <figref idref="DRAWINGS">FIG. 199(<i>b</i>)</figref>), a portion of image is picked based on (e.g., predefined) windows associated with the resolution level (e.g., 1 window for R<sub>1</sub>, and 13 overlapping windows for R<sub>2</sub>, as for example depicted in <figref idref="DRAWINGS">FIG. 199(<i>b</i>)</figref>). In one embodiment, a thumbnail or portion of the image at the picked window for the given resolution is prepared. A feature recognition/classifier is used to locate/recognize objects within the window (e.g., in the thumbnail). In one embodiment, if an object or a class of object is found in a resolution level (e.g., 2), the search is continued for more objects of similar class in other windows at the same level of resolution. In one embodiment, if the detected object or class of object is not reliably matched/classified by the classifier/feature detector, then the search proceeds to the next higher resolution for more detailed recognition or for increasing the reliability of recognition/classification of the object, or to eliminate or reduce the potential for a false positive. In one embodiment, the approach for searching within the same resolution or gearing up to higher resolution is stopped upon reaching a resolution limit or a threshold for computing resources. In one embodiment, the determination of which window to pick next is based on an order associated with the context of the image. For example in a photo of standing people, the search proceeds horizontally to identify people (e.g., from faces). In one embodiment, the windows closer to the center of the image are ranked higher to be picked for search. In one embodiment, the next window to pick is determined based on the likelihood of finding features/objects within similar images (e.g., based on training).
In one embodiment, the sizes of the windows for a given resolution are the same (e.g., for a given context). In one embodiment, the sizes of the windows for a given resolution are different depending on the location within the image (e.g., based on the context).
In one embodiment, the location of the windows are picked, determined, or adjusted based on the location of the object(s) detected in another windows, the context, the proximity and relative positions of the objects and/or the scale/size of the objects.
Learning High Level Features by Limiting Learning Space:
As mentioned in this specification, one approach to learn the high level (e.g., class of object such as presence of face, as opposed to for example the identity of the person based on detailed detection of facial features) is to detect the object/class of object based on a thumbnail (e.g., via preprocessing) of the data/image. In one embodiment, the training for a high level feature detection focuses on the structure of the neurons or units used in a classifier/feature detector. In one embodiment, the resulting feature units at top layer are limited to few features, while the training is used with data/images that may include thumbnail and high resolution data/images, including those with and without the targeted features. In one embodiment, a correlation layer is used to established the features correlation with labels by feeding the labels (e.g., via a label layer) to a correlation layer, or use a supervised training to train a classifier based on the labeled samples (e.g., using SVM).
Learning Via Partially Labeled or Mixed Labeled Training Set:
In one embodiment, the labels for supervised training or for making association with object features (e.g., already trained in RBMs or deep belief networks), may not reflect all the applicable properties of the sample training set. For example, a data/image containing a person and a chair may only be labeled as person. In one embodiment, as for example shown in <figref idref="DRAWINGS">FIG. 200</figref>, a sample training data/image may depict two people (e.g., David and Jim, based on for example the annotation associated with the image), Eiffel tower (in the distance) and a taxi. The labels may be drawn from the annotations based on correlation/conversion to generic labels, such as Person and Car, through a semantic web or through a latent semantic analyzer. In one embodiment, the associated labels (whether drawn automatically or assigned manually) are fed to corresponding units in L (label) layer for training the association/correlation to the features learned by feature detectors/classifiers such as RBMs or deep belief networks. In an example, the annotation is missing “Taxi”, and the label may not include the generic label “Car” or “Vehicle” (or even “Taxi”). In one embodiment, the unused labels associated with a training data is unclamped, and even though the relevant features (e.g., indicating a car in the image) exist, the correlation is not punished (i.e., skewed) for not having the correlation with the missing label. In another word, in one embodiment, the missing label is prevented to skew the correlation and mislead the learning as if the label was set incorrectly. In one embodiment, the undamped labels do not contribute to the error function, and their related weights are prevented to change during the learning step (e.g., by setting the corresponding learning rate to zero for the related weights and biases). In one embodiment, the labels provided for the training are associated with corresponding reliability factors. In one embodiment, such reliability factors (e.g., in range of [0, 1]) are used to scale the learning step related to weights and biases of such unit. In one embodiment, the state of unclamped label units are allowed to vary stochastically based on links form other units. In one embodiment, some labels are used as positive (e.g., with a reliability factor) indicators of the features to discriminate, and their absence are not used to indicate the absence of features. In one embodiment, the absence of some labels are used to indicate the absence of the feature from the data/image (e.g., with a reliability factor). In such a case, for example, the state of the corresponding label unit is clamped to indicate absence of feature.
In one embodiment, specific annotations that repeat often (e.g., “Eiffel Tower”) (e.g., in a collection of images/data or a series of related images/data or within a large collection of data/images from various sources and various reliability) is taken as label for training association by adding an additional label unit (e.g., a binary unit) representing the added label.
In one embodiment, meta data such as the GPS data (or for example other accompanying metadata captured with images taken from mobile devices such as smart phones) are used as labels (e.g., continuous valued). In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 201</figref>, the correlation can also be established between the labels. For example, suppose an image/photo is missing the associated label “Eiffel Tower”, but based on the correlation with the GPS data given the image/data, the label “Eiffel Tower” is reconstructed in the corresponding unclamped label unit when searching for the features of the photo/image: by a feature detector/classifier. In one embodiment, the reconstructed label is imported into the annotations associated with the image./data with a relevant certainty factor (e.g., based on the correlation). In one embodiment, based on the reconstruction of the labels, relevant (e.g., expert) detectors/classifiers associated with such labels/concepts are used to further validate the match. In one embodiment, such recognition of labels (e.g., the identity of people) is extended to recognition of people in various images (e.g., with no annotation or partial annotation) in order to implement auto-annotation of the images, based on recognition/identification of individuals in other images. In one embodiment, the existing annotations associated with a data/image are compared with the constructed/predicted label for conflict or redundancy, based on the correlation between the terms of annotation. In one embodiment, a subset of annotations associated with a data/image is used (e.g., selected in random) to determine the reliability of their correlation to the image/data based on a feature detector/classifier. In one embodiment, potentially unreliable annotations (e.g., a subset) are determined based on low reliability of correlation of the image/data with corresponding labels. In one embodiment, the unreliable annotations are tagged as such (e.g., with reliability factor). In one embodiment, the reliability factor is associated/inferred to the annotator (e.g., a person) by contributing to the annotator's reliability of annotations for a given context.
Search and Indexing:
<figref idref="DRAWINGS">FIG. 203</figref> depicts an example of an embodiment for indexing and search. In one embodiment, a network and/or sources of information are used to fetch various content, tags, and metadata, via hots or background processes. A cache is updated with the changes in the information gathered. In one embodiment, the background processes use the information from the network traffic or domain name servers to fetch resources. Via background processing, analytics engines organize, categorize, recognize, and correlate various cached content, and an index/relationship database is updated to facilitate (e.g., a real time) online query. Upon such query, a ranking query engine uses the query to return ranked result using the index/relationship database. In one embodiment, the online query is cached and analyzed for patterns of queries and to facilitate ranking and caching. In one embodiment, the user selects a result of the query and the user selection is also cached to correlate with the query and/or the user by analytics engines. Content, summary, or URL related to the selection is fetched from caches and returned to the user.
In one embodiment, map reduce technique is used to handle “Big Data” processing across distributed file system and systems. The task, such as distributed search (among the machines) use small portion of the data (e.g., one chunk at the time) and provide the result to a central machine(s) for collection. An instance of search task/job keeps the information about the search and identities the result accordingly, so the result may be available or extended time. The result may get updated and available for use in real time.
Facial Expressions and Emotions:
In one embodiment, the weights on features that are affected largely by various emotional states or ranges are reduced in an attempt to distinguish the invariant features that would help identify an individual among a database of individuals associated with a set of features (e.g., invariant features), However, in one embodiment, the reduction of weight on the affected features will also impact (reduce) the distinctive features between individual labels.
In one embodiment, the expressions and emotional states are learned as features captured in the images. For example, in one embodiment, RBMs or deep belief networks regenerate or construct unseen images with new emotions, by setting the correlated label (for an emotion/expression) and letting the reconstruction provide an image in a visible layer.
Time Series and Video:
In one embodiment, multiple images are compared together to detect or infer transformation, e.g., translation, rotation, scaling of objects or features between the images. In one embodiment, the frames (images) from a time series collection (e.g., a video segment) is used to extract different poses of an object (e.g., a person's head), different expressions (emotions). In one embodiment, speaker recognition module, based on the analysis of sound track of audio/video tracks, identifies/distinguishes speakers and associates those entities to time segments in the audio/video tracks. An image extractor module uses the time segments to extract potential images at different poses of that speaker from the video track (in synch with audio).
In one embodiment, the feature detector is trained on various poses and expressions with many unlabeled samples before training with labeled samples to make association of features with labels (e.g., pose parameters, expression parameters, emotion states/degrees).
In one embodiment, the image transformation is modeled via a higher order Boltzmann machine, which links more than two units via a weight. A factored higher order Boltzmann machine reduces the complexity or the number of parameters (compared to non-factored version), where the weight (e.g., between 3 units i, j, and k) is factored into 3 mutual weights corresponding to each pair of units, in a multiplicative way: (w<sub>i,j</sub>·w<sub>j,k</sub>·w<sub>k,i</sub>·s<sub>i</sub>·s<sub>j</sub>·s<sub>k</sub>), as schematically shown in <figref idref="DRAWINGS">FIG. 204(<i>a</i>)</figref>. In one embodiment, one signal, e.g., s<sub>k</sub>, acts as a binary controller, i.e., when value of zero, the interaction between units i and j reverts to low order Boltzmann machine.
In one embodiment, as for example depicted in <b>204</b>(<i>b</i>), short range temporal data (e.g., image) is modeled by providing a number of e.g., consecutive) frames (e.g., 2 to 5 for large number of visible units per frame of data, or about 100 for few visible units, e.g., representing the parameters of motion instead of pixel images) from earlier times/series. In one embodiment, the data from these frames are provided to visible and hidden layers of RBM. CRBM denotes conditional RBM due to dependency of the hidden units on the previous states of visible units. In one embodiment, such a temporal module is stacked after training features on the lower layer. In one embodiment, the units representing previous frames are initialized (or their swapped) based on the units representing then current frames. In one embodiment, the same number of visible units (or hidden units) is used for each frame (representing current or previous frames:). In one embodiment, the energy state of CRBM includes terms based on quadratic offset of the visible units' states from their corresponding dynamic mean (e.g., a linear combination of their previous states). In one embodiment, the bias for a hidden unit is based on its dynamic mean. In one embodiment, the weights for the linear combinations to get dynamic mean for a hidden or visible unit are autoregressive weights. In one embodiment, the contrastive divergence method is used in learning the weights and biases, by for example sampling the hidden units based on the visible units (current and previous), and reconstructing the visible units based on the sampled hidden units. The visible (or hidden units) corresponding to previous frames are not updated in this approach. In one embodiment, the hidden units are sampled based on logistic function. In one embodiment, the visible units are reconstructed using a Gaussian distribution (e.g., with unit variance) and a mean based on the weighted links from the hidden layer and the visible units' dynamic mean. In one embodiment, during the learning process, the learning rate in order of 0.001 is used for the weights between the visible and hidden layers. In one embodiment, during the learning process, the learning rate in order of 0.0001 is used for the autoregressive weights.
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 205(<i>a</i>)</figref>, the older frames use less number of visible units, e.g., by lowering the resolution/size of the frame as it gets older. In one embodiment, the longer lasting coarse features of motion are learned/detected based on the decreasing resolution for older frames. In one embodiment, the value/state of the visible units associated with previous frames are based on a linear combination (e.g., average) of the states of visible units from when the frame was current, as for example depicted in <figref idref="DRAWINGS">FIG. 205(<i>b</i>)</figref>. In one embodiment, such linear combination is based on the reduction of resolution from the original frame to that of previous frame. For example, if a previous frame is 3 times smaller in each dimension compared to the original frame, then the state of a visible unit associated with the previous frame is based on (e.g., average of 3×3 visible units from the time the previous frame was current). Conversely, in one embodiment, fewer units from the previous frames contribute to the dynamic mean of the current units (in visible or hidden layers), as for example depicted in <figref idref="DRAWINGS">FIG. 205(<i>c</i>)</figref>. In one embodiment, a snap shot of the visible units are taken for scaling according to resolution reduction for previous frames.
In one embodiment, the features recognized from previous analysis of the older frames are used with a predictive model such as Kalman filter to estimate the localization of the features in the current or upcoming frames. In one embodiment, for example based on such estimates/prediction, the analysis of frame (e.g., the current frame) is initially limited to a portion of the frame containing the estimated localization of the tracked features. In one embodiment, an area of focus of interest is used to analyze the portion of the data/image.
In one embodiment, stochastic sampling at hidden layers (e.g., based on an initial condition in visible layer) and the reconstruction in the visible layer reconstructs learned motion (in sequence), based on the learned weights, including autoregressive weights. In one embodiment, the learned (features) of the motion is correlated with a label via a correlation layer or other classifiers. In one embodiment, using one or more labels, the motion is reconstructed in sequence in visible layer via top-down regeneration. In one embodiment, a mix of motions are reconstructed based on a combination of labels (e.g., with varying degree).
In one embodiment, Long-short-term-memory (LSTM) which a recurrent type neural network is used to model the data in time series. In one embodiment, LSTM block includes sigmoid units (e.g., based on logistic function) to allow access to the block and control its functions (e.g., input, memorize, forget, and recall). It also uses product type units (with no weight) and summation units to direct the data through the block. In one embodiment, an LSTM module is trained via back propagation through time with iterative gradient decent algorithm.
Classifier and Complexities:
In one embodiment, linear models, such as perceptron, linear regression, and/or logistic regression are used. For example, perceptron is used for classification, e.g., in or out, accept or deny, and is trained by perceptron learning algorithm including a pocket version. The linear regression is for example used to determine (continuous valued or real valued) amount, based on squared error function and pseudo-inverse algorithm. The logistic regression is used for example in determining probability, based on cross entropy error, using a gradient decent algorithm. Noise and error in input data makes the nature of the training data probabilistic. The VC (Vapnik-Chervonenkis) dimension for a Hypothesis set (i.e., he most points that can be shuttered by the hypothesis set) is related to hypothesis set's growth function, and in one embodiment, the VC inequality (in terms of growth function and number of training samples) provides a rule of experience for the number of points needed for training (e.g., >10× VC dimension). The VC inequality places an upper bound on the probability of the out-of-sample error (i.e., the generalization error) is within the in-sample error by a given error margin and a given number of in-sample (training) data. In one embodiment, a maximizing likelihood approach is used to select a hypothesis from the hypothesis set that results in maximum likelihood of getting the data given the hypothesis. In one embodiment, the learning with logistic regression uses a cross-entropy error log(1+exp(−y<sub>n</sub>W<sup>T</sup>>n)) with (x<sub>n</sub>,y<sub>n</sub>) representing the labeled data point and W is the weight matrix to be optimized. In one embodiment, the optimization uses a gradient decent approach by using variable size step (large to small). In one embodiment, the step size is proportional to the gradient which fixes learning rate (appearing as a multiplier for the learning step). One embodiment uses an adaptive learning rate. In one embodiment, the default learning rate is 0.1. In one embodiment, the number of iterations of epoch is limited to a maximum (early stopping), in order to avoid over fitting the noise/error and deteriorate generalization by increasing the out of sample error. In one embodiment, in order to tackle the problem of local minimum, the optimization starts at different initial values of weights (e.g., based on heuristic). In one embodiment, the “temperature” is used to escape local minimum, e.g., in RBM learning, the optimization starts at a high temperature, to allow escaping the local minimum. In one embodiment, a stochastic gradient decent is used by taking one data sample at the time, resulting in generally a simple, cheap, and random approach to optimization in comparison to batch optimization where all data sets are used in each step of optimization. In one embodiment, a binary search method is used to explore along the direction of error gradient. In one embodiment, a conjugate gradient is used to estimate the second order error from previous data points. In one embodiment, a multiclass classification is approached based on binary decision, i.e., 1 vs. all, 2 from the rest, etc. In one embodiment, non-linear transformation is used to optimize based on a feature in a transformed space. In one embodiment, the VC dimension of the neural network is approximately the number of weights and biases. In one embodiment, a regularization approach is used to kill some weights (e.g., in random) to enhance generalization (and reduce over fitting). In one embodiment, a genetic optimization is approach is used. In one embodiment, a regularization approach is used to limit the choice and ranges. In one embodiment, a validation is used to test the generalization, by dividing the sample data for fitting and cross comparing the error. In one embodiment, kernel methods are used for small labeled data and top features to model the classification. For example, one embodiment uses thousands of unlabeled training set with various orientations to learn features (including the orientation), and it uses few hundred labeled training sets to discriminate orientation (with regression for angle). In RBM training, the number of training cases may be less than number of weights as long as the number of pixels is much more than weights, because there are a lot of features that can he extracted from pixels. In one embodiment, the discriminative training (e.g., based on labels) quickly fits the data, and it is stopped quickly to avoid over fitting. In one embodiment, a weight decay technique is used to implement regularization in learning. In one embodiment, about 20% of the data samples are reserved for validation (and not training). In one embodiment, cross validation is used to conserve the number of data sample for fitting. In one embodiment, the probabilities indicating the certainty of inferences based on the correlated training sets are tracked, for example, to infer one pose from a different pose.
Feature Extraction:
In one embodiment, we note that people of same ethnicity or region (or members of the same species of animals) generally recognize each other better. For example, all tigers look the same to an average human, but tigers themselves can recognize each other very easily and efficiently. Or, a Middle Eastern person can distinguish other Middle Eastern people more accurately and efficiently, than what a Chinese person can, among the same set of people from the Middle Eastern origin (or the same set of pictures of people from the Middle Eastern origin), assuming that the Chinese person never lived among Middle Eastern people or lived in that region of the world.
The same is also true (for example) for the case of the identical triplets in humans, which can be distinguished easier by themselves. In addition, their parents can distinguish them easier than the rest of the general public can. The reason is that an average human can see a tiger as an animal with 4 legs and stripes, similar to a big domesticated cat, as the dominant features, however, the tigers see or focus on some other features or more details of stripes, to distinguish themselves or as they see themselves. Since a tiger's eyes and brain are trained by looking at a lot of other tigers for many years, their distinguishing features are all set accordingly, to focus and look for the right features or sub-features, to make the distinction. For example, they may look at the ratio of 2 lengths on 2 specific stripes, or width of a stripe near the nose, as the focused or re-focused features, to find or classify or distinguish the other tigers or objects or subjects. Such specific features may be transparent to the human eye and brain, as they do not know what to look for in a huge volume of information received by the eye or brain. It is also consistent with the fact that a zoo keeper (dealing with tigers for years) can distinguish them much easier than an average human, as the zoo keeper has seen many tigers, and thus, her brain and eyes are trained for those features and characteristics.
So, sub-sampling the input from all universe (for humans, for example), or U<sub>H</sub>, is very critical for training purposes, to train appropriately, for a given task. Filtering or focusing or zooming in a few features (F<sub>F</sub>), out of, e.g., billions of patterns or features available (F<sub>U</sub>), on the sensory basis or recorded or obtained, when selected appropriately for the task at hand (T<sub>A</sub>), reduces the training time and cost, and increases efficiency and accuracy of recognition and classification and appropriate response. Mathematically, we have:
T<sub>A</sub>→F<sub>F </sub>
Wherein F<sub>F</sub>⊂F<sub>U </sub>
Wherein U<sub>H</sub>→F<sub>U </sub>
Wherein “arrow” symbol indicates that the right hand side item is obtained from the left side item.
Large or Voluminous Input Data:
The same is true for an infant (e.g. 5-month old, at the early age) listening to all the noise and voices around herself, e.g., possibly spoken in English and French by bilingual parents or nanny, and the noise from highway outside in the background, as well as the very noisy and loud fan on the ceiling, or the voice of her grandfather and grandmother, with the TV announcer or anchor in the background shouting about a recent news or an advertisement about a car. She receives a large amount of voice and noise data by her ears (or internally from vibration on the ground or floor), but in the first few months, she gets all of the data with the same weight and importance. Overwhelmed by the large incoming data, she mostly ignores most of the input data, even the voices of her parents, that are supposed to be important to her well-being. After a while, though, she will understand that her parents' voice are more important than the noise of the cars outside or fan on the ceiling, even if they are very loud or louder. So, she will tune and filter or put more weights for those features or voices, as she gets trained on distinguishing between the voice, noise, music, warnings, background noise, dangerous signs or screech/scream, or angry tones. The same is true for vocabulary and. grammar in a language.
It is the readjusting, reassigning, or rearranging the orders or weights or features, which focuses or re-focusers the learning subject on new or different features at the different stages of learning process, including distinguishing features or pattern recognitions. Thus, the learning process is dynamic and self-adjusting or adjusted by a trigger or test against a threshold or from an outside input. It evolves, as it gets more sophisticated, for more capabilities.
For example, in one embodiment, as the time passes, a subset of input features F<sub>1</sub>(. . . )) are selected at a given time (t<sub>N</sub>), compared to the previous time (t<sub>N-1</sub>), until the subset becomes the same as the set itself from the previous time. Then, there is no need to sub-select anymore, to reduce the set of features. Thus, the optimization process stops at that point, and the final sub-set is selected and obtained. Mathematically, we have:
<br />F<sub>1</sub>(t<sub>N</sub>) ⊂F<sub>1 </sub>(t<sub>N-1</sub>)
For ∀ t<sub>i </sub>
<br />Until we have: <i>F</i><sub>1 </sub>(<i>t</i><sub>Ml )≡</sub><i>F</i><sub>1 </sub>(<i>t</i><sub>M-1</sub>)
In machine learning, in one embodiment, we initially teach the machine the language or other things or subjects without any rule or grammar, just by training samples, and usually by sheer number of training samples. Then, on the second phase, we teach or input the machine some basic rules, e.g. Fuzzy rules or rules engine. Then, on the 3<sup>rd </sup>phase, we train the machine with more training samples, simultaneous with more rules being input, to have some order to the training and. samples, which is a very powerful way of learning rules and getting trained very efficiently.
In one embodiment, the machine learns one language (or concept) by training samples only. Then, we teach the 2<sup>nd </sup>or 3<sup>rd </sup>language by mapping and templates, based on the first language, especially with grammar or rules, for more efficient learning.
In one embodiment, the machine learns the OCR or recognition of the text based on strokes or basic curves which in combination make up the letters. For example, for letter “t”, we have the shape “1” plus the shape “-”, with their relative positions with respect to each other. So, we have 2 basic strokes in our dictionary, so far, namely, “1” and “-”. Once we do this for all letters and marks on keyboard or in language, we get a lot of basic strokes in common in our dictionary, which we can re-use for others.
In one embodiment, the machine learns based upon the strokes, first. Then, it learns based on the shape of letters, e.g. “t”. Then, it learns based on the words, e.g. “tall”. Then, it learns based on the phrases, e.g. “tall building”. So, in multiple stages, it graduates from basics to more complex structures, and reads phrase by phrase to understand the text, similar to an experienced human speed reader, who can read the articles in a specific subject of her specialty very fast, faster than an average person, in which she scans, reads, and understands the text by chunks bigger than simple letters or words.
In one embodiment, instead of the machine learning in different stages, the 1<sup>st </sup>machine learns the strokes, and feeds to the 2<sup>nd </sup>machine, which learns the letters, and feeds to the 3<sup>rd </sup>machine, which learns the words, and feeds to the 4th machine, which learns the phrases, and so on.
In one embodiment, we have a neural network, with multiple hidden layers, each layer representing a more complex structure, for learning process, e.g. the first one for strokes, the second one for letters, the third one for words, the fourth one for phrases, and so on. In one embodiment, we have enough processing elements (PE) in each hidden layer for our learning machine, with artificial neural network (ANN) structure, so that it can accommodate a language with all its strokes, letters, words, and phrases. For example, for English language, for the second layer, we have 26 PEs, if we only deal with the 26 English letters of alphabet, and only with lower case, and only in one type and format, as our universe of possibilities, for recognition purposes. In one embodiment, with enough training and samples, with all the weights and PEs set, we set all the recognition for letter-level recognition in the language at the second hidden layer.
Data Segmentation or Classification, for Data Processing or Recognition:
In another word, in our daily life, we routinely receive a large amount of data, in which a first subset of that data may be useful for the first task, and a second subset of that data is useful for the second task (analysis, recognition, or distinction). So, for the first task, if we get rid of the rest of the original data that is not used, as useless data, to save storage space or increase recovery or retrieval speed, then, later, for the second task, we do not have the proper data for the second subset of the data, to complete the second task properly. However, if we have enough space to keep all or most of the original data, at least temporarily, to keep most or all of the second subset, or to keep all of the original data intact, then our second task can be accomplished successfully or relatively more successfully. One example is when we get voice data and image data from the same source at the same time, and the first task is to understand the voice data, and the second task is to understand the image data, which (in turn) comprises text images and pictures, which corresponds to subtask of text recognition (e.g. OCR) and subtask of picture recognition (e.g. face recognition). <figref idref="DRAWINGS">FIG. 171</figref> is an example of such a system.
Data Segmentation or Classification, for Separate Optimization:
Another situation is when, for example, we have a compound image, which includes the combination of thin sharp line drawings and color photos. If one tries to optimize or improve the quality of one region or one type, e.g., the color photos, the other regions or types can be defocused or smudged, e.g. un-sharpening the lines, which destroys the crisp and sharpness or continuity of the thin line drawings, effectively destroying the black/white line drawings (or the text part) of the image. That is, we degrade the second part of the image, by improving the first part or section or type or region of the image.
Thus, we may want to classify and segment the original data, so that each part or section or type is optimized or improved separately, as the optimization is not universal for all parts of the image or data. For example, to read the text better/improve the text quality, the rest of the image (e.g. the color pictures) may get degraded at the same time. Thus, in one example, it is better to segment and classify first, and then do the optimization per region or type, or per task, as needed, e.g. to optimize the text only, and leave the rest of the image intact.
Separate optimizations with different degrees of optimization or filtering or transformation can be applied to different regions of an image, as shown in an example in <figref idref="DRAWINGS">FIGS. 129 and 176</figref> (for the general system). So, for example, for intensity, for some part of the image, we emphasize, and in another part of the image, we deemphasize, to bring out some features for examination and recognition, optimized for that range of intensity. Thus, we map the intensity off-diagonal for a range, for different regions of image, as shown in <figref idref="DRAWINGS">FIG. 129</figref>. Then, we union all of the regions together to get the whole picture at the end. Or, alternatively, in one example, one can change everything along with the text optimization, altogether, which possibly degrades the other parts of the image, as the result. That is, the text is improved, at the expense of everything else in the image, e.g., for the situations which we do not care about the non-text data.
Optimization:
Note that the optimization is not universal. For example, we take a picture at night with a camera using a flash light, from a metal surface, with high reflection of light, which overwhelms the resulting image, with a big blob of high intensity light reflected and captured in the image, and the text underneath is not visible at all, at the first glance. However, if one plays with and adjusts contrast and intensity/other image parameters, at one point the text on the image from the metal surface becomes visible, of course, at the expense of the rest of the image (as it becomes degraded). That is, the optimization is usually localized and for specific purpose. That is, generally, the optimization is not universal, or not for all-purposes, or not for all types of data, or not for all regions of image.
Scope of Search:
In one embodiment, we start from task or goal, to limit or set the scope of search or result or filtering. Thus, the question (or task or goal or what we are asked for or looking for) ultimately determines how to optimize (or view or filter or twist or modify or convert or transform) the data or image. That is, the assigned task gives the proper context or scope, so that we can focus to search or filter or optimize for the corresponding answer or result. That is, there is no single answer or filtering for all tasks or goals. Each task demands and corresponds to its own filter or transformation or result. That is, the scope of the transformation or filtering is determined or limited by the task (or assigned goal at hand), itself. Another way to look at it is that once we define the “noise”, as what the noise is in that context or environment, then we can define the filter that reduces that noise, which sets the goals or tasks for our optimization.
Relationship Possibilities:
Note that there are extremely large amount of relationship possibilities from a very limited finite set of data. For example, let's look at the tiger example again. The tigers may have only about 20 different stripes, as an example, as a finite and very limited set of data, e.g. expressed by a set of pixel data representing an image, e.g., with specific 256 color resolutions for each component of color RGB data and at 600×600 dpi pixel resolution in 2-D orthogonal axes/directions.
However, we can define much bigger number of relationships (e.g. hundreds of billions (although some are not independent of others, and can be derived from others)) between these 20 stripes, e.g. ratio between width and length of each stripe or between stripes, or angles or curvatures of each stripe or multiple stripes, as different combinations of ratios of these features, which by far dwarfs the number or size of the original data corresponding to 20 different stripes. However, from among all these ratios (e.g. billions), maybe, there are only a handful, say e.g., 3 stripes behind the nose and ear for each tiger, with their corresponding lengths or their ratios, that produce only 6 numbers, as an example, that are the determining parameters to distinguish any tiger in the set. So, only 6 numbers are needed for our recognition process. However, this is not readily apparent, when we look at the original 600×600 image, or when we look at the billions of calculated ratios or relationships or lengths.
Thus, one has to know what to look for, which is usually a subset of the original data or relationships or features, to make the recognition in the universe of the objects, to recognize all or most of the members of that universe. To zoom and focus on those 6 numbers (as an example), one can reduce the calculation and memory needed to do the task of the recognition, the same way a tiger recognizing her own family and siblings in a fast and efficient way, with much less analysis than an average human would do, to recognize the same tigers, if it is possible at all.
In one embodiment, we do not know what we are looking for, e.g. in a “big data” analytics. In those situations, we guess at some pattern or feature, as candidate(s), from our history or experience or library or other user's experience or using expert's opinion in other or similar situations, to test the hypothesis, to see if the first candidate yields anything in search or recognition. If not, then the system moves to the second candidate, and so on, to exhaust the list of candidates. If any candidate yields anything, then we continue the analysis on that candidate and follow that pattern or feature. In principal, we may end up using multiple candidates and find all the corresponding patterns or features.
The candidates can also be picked up randomly from our universe of possibilities or library, in some situations, e.g. where there is no preference in mind, or no experience or history on file. For example, for images received, we may want to see if we can find any face in the images, or find any text, or car, or any function with sinusoidal behavior (e.g. periodic), e.g. with intensity of pixels going up and down periodically, e.g. in a bar-code image with parallel stripes with some periodicity (T) or frequency (f).
Multiple Recognizers or Classifiers:
Let's look at the human/face recognizer engine or module or software. If a recognizer is trained for pictures or images of people from Middle East to distinguish among them (first module), and another one is trained from Chinese or oriental people or training samples or images (second module), then we do not want to re-train one module to change its weights, e.g. neural network weights, to convert or optimize first module to become second module. Thus, we want to keep both as-is, as each module is optimized on a subset of samples. So, in a first level, we figure out and sort based on the regions of the world, on a coarse and quick basis, and on the second level of analysis, we send the result(s) or images for analysis to the first module and the second module, and so on, which are optimized based on a subset or region of the world or population, to do an accurate recognition in that subset, only. This hierarchical model can expand to many layers, to go to subsets of a subset, for further analysis. So, in this embodiment, to be efficient, not all recognitions are done in one level or one recognizes or one neural network, as an example. See e.g. <figref idref="DRAWINGS">FIG. 130</figref> for such a system.
In one embodiment, we use our search engine as multiple expert systems, e.g. it has a section for English language, a section for French language, a section for car engine, a section for food and wine, and the like. See e.g. <figref idref="DRAWINGS">FIG. 131</figref> for such a system. B<sub>Y </sub>splitting the queries or searches according to classes or topics, and then splitting into subtopics and sub-subtopics and so on, we can get the context right, to go to the appropriate Z-web. For example, an abbreviation or word used in food industry has no meaning or different meaning than that of the car industry. So, for efficiency and for accuracy, we need to get the context or environment right as soon as possible, and classify and process accordingly.
<figref idref="DRAWINGS">FIG. 127</figref> shows a system for context determination, with language input device, which feeds dissecting and parsing modules to get the components or parts of the sentence, which feeds the analyzing module (which e.g. may include memory units and processor units or CPU or computing module), which is connected to the context determination module, which is connected to the default analyzer module and multiple other context analyzer modules, each with different expertise or level of analysis or depth or subject matter (e.g. scientific expertise, or chemical expertise or knowledge), which are all connected to the sorting module, which is connected to both fuzzy membership values module (or alternatively, crisp scoring value or weight module) and correlation module (to sort and correlate the results), which is connected to the aggregator module to aggregate the results from above, which is connected to output module, e.g. printout or computer monitor or display or any graphic or table or list generator, for the user to use or see, or for other systems to use, e.g. as an input (e.g. without any human intervention or input or review).
In one embodiment, the context is hard to guess from one sentence (S<sub>text</sub>). So, we usually need a large sampling or history or third entity input. However, in one example, Z-web itself can also help set the context right. For example, if we have 2 context candidates in mind to try, namely Context-1 and Context-2, then the corresponding Z-webs can be examined, namely Z-web-1 and Z-web-2, respectively. Then, if e.g. we have more nodes (or higher weights or reliability factors) related to our S<sub>text </sub>from Z-web-1 than that of Z-web-2, then we can conclude that between the two contexts, Z-web-1 or Context-1 is probably a more relevant context. So, between the 2 choices, we choose Context-1 as our context. See e.g. <figref idref="DRAWINGS">FIG. 132</figref> for such a structure or system.
In one embodiment, we have multiple recognizers or classifiers, with different degrees of complexity (and overhead and cost and accuracy and depth analysis and focus). We cascade or chain them as from simple to more complex ones in series, one feeding the other, so that if the answer is NO for one level, it does not have to try the next level classifier any more, and stops the process at that point, with exit from the loop. If the answer is YES, then it tries the next level classifier, which goes more in depth, to find more about the object, or classify more specifically, based on the result of the previous classifier (which had a broader scope of inspection). For example, first, we find it is a text document, then, we will find out it is a book, and then, we will find out it is a novel. Obviously, if it were not a “text” determination at the first level of classification, we did not have to activate or feed it into the “book classifier” or “novel classifier” in the next steps, as they would have been useless, as their expertise or focus would not be needed at all. Thus, the system is more efficient and more compartmentalized and more expert-oriented and more depth analysis and deeper classification or recognition, now.
To combine classifiers, in one embodiment, for classifiers which only return the selected class or rejection, we can use the following methods to combine the classifiers: maximizing posterior probabilities, voting method, or Dempster-Shafer theory. To combine classifiers, in one embodiment, for classifiers which return a ranked list of classes or categories, we can use the following methods to combine the classifiers: Borda counts or logistic regression method. To combine classifiers, in one embodiment, for classifiers which return a ranked list of classes or categories, together with the classifiers which return a measurement associated with each class, we can use the following methods to combine the classifiers: weighted sum, ruled based, fuzzy integral model for classifier fusion, associative switch, or trained perceptron. To combine classifiers, in one embodiment, for all classifiers of any type, we can use the hierarchical decision making method. To combine classifiers, in one embodiment, we use and add the complementary classifier, to improve the performance of the combination. To combine classifiers, in one embodiment, we use unanimous voting or majority voting scheme for combination.
Classifiers:
In one embodiment, we have the nearest neighbor rule for training samples and the closest prototype, for assigning the corresponding class, to optimize the classification. In one embodiment, we get a binarized image. Then, it is thinned to get the skeleton image. Then, the system extracts a set of features to classify (as a separate class for recognition).
In one embodiment, we use a Markov chain-based classifier, with state transition probability depending only on the current state. For example, for Markov chain, we can represent an object with its boundaries or border or edge line, which is represented by a collection of points connected together using short straight lines, which can be represented by a chain of points, going from one to next, based on a direction and distance values, to set or get to the next point. So, starting from point one, we can complete the loop and find the boundaries or border of an object, and each point depends on the prior point in the chain, which is based on Markov model.
In one embodiment, for classification, we use “Fuzzy c-Means Clustering Method”, with a fuzzy pseudopartition or fuzzy c-partition of our set (where c is the number of fuzzy classes in partition), in terms of cluster centers, and using inner product induced norm in our space (representing distances in that space). The performance metrics measures the weighted sum of distances between cluster centers and elements in those clusters. We want to minimize such a function. First, we choose an initial pseudopartition. Then, we calculate the c-cluster centers in the form of:
<br />S<sub>i</sub>=(Σ<sub>k</sub>[P<sub>i</sub>(x<sub>k</sub>)]<sup>n </sup>x<sub>k</sub>)/(Σ<sub>k</sub>[P<sub>i</sub>(x<sub>k</sub>)]<sup>n</sup>)
for the initial pseudopartition and a specific n, wherein {P<sub>1</sub>, P<sub>2</sub>, . . . , P<sub>c</sub>} represents a fuzzy pseudopartition, x<sub>k </sub>represents a set of given data, and S<sub>i </sub>represents the partition (with association being strong within clusters, but weak between clusters).
Then, we update the values, for (t+1) instance: If the distance measure ∥x<sub>k</sub>-S<sub>i(t)</sub>∥<sup>2</sup>>0, then we have:
<br /><i>P</i><sub>i</sub><sup>(t+1) </sup>(<i>x</i><sub>k</sub>)=(Σ<sub>j</sub>((∥i x<sub>k</sub><i>−S</i><sub>i(t)</sub>∥<sup>2</sup>)/(∥<i>x</i><sub>k</sub><i>−S</i><sub>j(t)</sub>∥<sup>2</sup>))<sup>(1/n−1)</sup>)<sup>−1 </sup>
wherein j runs from 1 to c. If ∥x<sub>k</sub>-S<sub>i(t)</sub>∥<sup>2</sup>=0, then we have: (Σ<sub>i </sub>P<sub>i</sub><sup>(t+1) </sup>(x<sub>k</sub>)=1), for (i∈I). Otherwise, we have: (P<sub>i</sub><sup>(t+1) </sup>(x<sub>k</sub>)=0).
Then, we compare the values for instances t and (t+1). If the difference (or the distance in our space) is less than a predetermined threshold, then the system stops the process (and exits the loop). Otherwise, the system (or controller or processor) increases the counter t by 1, and repeats the loop again, as shown above (until it exits the loop at one point in the future).
In one embodiment, in the manipulation of Z-web, for any fuzzy clustering, we use the method detailed above, for clustering and recognition purposes.
In one embodiment, for pattern recognition or classification, we use clustering tree, e.g. with Euclidean distance or Hamming distance, or use Fuzzy Membership Roster Method. In one embodiment, for fuzzy pattern recognition, we use the degree of membership of an object to associate the object to a class or multiple classes (in contrast to the conventional or classical classification goal or method). That gives us more flexibility for classification. In one embodiment, we use a minimum threshold, for min. value for the membership, below which the membership is set to zero.
In one embodiment, we use fuzzy syntactic method for language(s) and its respective grammar, which governs the rules for string of symbols that makes up the language (or replaces the language or makes a template or encodes the language or summarizes the language). In one embodiment, we use fuzzy grammar, which is not crisp, and is based on overlap and partial relationship, with membership function or value expressing such a relationship, relaxing the strict requirement by crisp or conventional grammar, making it more compatible with natural language processing and human language. In one embodiment, we use multi-level hierarchical classification method, for class, subclass, and so on, at different levels.
Minimum Number of Objects Needed:
For the minimum number of objects needed for defining or describing a situation or relationship, let's look at one example. Let's assume a mother is teaching her new-born son how to speak English. If in that universe, there is no radio, TV, CD, or book available, and there is nobody else available to talk to them, then the distinction between “I” and “You” would be very hard for the son to understand, as he may think that “You” is his first name, at least at the beginning, because there is no third person to talk to, or other interactions with a third party, or a video to watch with a third person talking in it, that can set the meaning of “You” properly for the son. So, it would, at least initially, be very confusing for the son. So, for any given situation, one needs a minimum number of objects, or a “minimum” arrangement or setup, to define the situation properly and define the relationship between those objects properly.
Minimum Vocabulary Needed:
In addition, in a universe with 2. people only, there is no need to have a third person referral, e.g., “he”, “she”, “him”, or “hers”, in the language, because there is no use for it at all, and it may not make any sense to have an extra baggage or term or name or reference in the language for a non-existence concept or object. So, in one embodiment, we can reduce and simplify the minimum vocabulary set needed to operate or communicate in that universe, by eliminating the excess baggage or words or terms.
Age Progression Model for Pictures:
For all human races, genders, and face shapes, one finds Np clusters, based on P<sub>D </sub>dimensions or number of parameters extracted from each sample. For each type of face, from N<sub>P </sub>possible types, one defines or designs a set of S<sub>A </sub>age progression templates for different ages of the person, which can be morphed in a series, as the person gets old. This can be done analytical or mathematical based on coordinates and curves defined for each face. This can also be done by using a series of pictures from a real person at different ages, to fit the model, or for learning using a neural network, or use as template for that type of face. Of course, the larger the number of examples or number of people, snip, the better the template will be for the fit. So, we need a lot of pictures of many people of different face shapes, at different ages. See e.g. <figref idref="DRAWINGS">FIG. 133</figref> for such a system.
To be efficient, we use a subset of those images, as the ones from similar ages do not help any further. For example, the image of a person between 41 and 42 years of age does not generally change much. So, it is not much helpful to store both. But, image of a person, for every 6 months, between the ages 2-3, changes a lot, and so, it should be stored more often/frequent at younger ages, as an example. So, in a series of age progression images, one can mark the major changes as the main ages or images to keep, as a good sampling set or collection. So, we define the difference between 2 images, e.g. at pixel level, as difference between pixels, divided by the value of the original pixel, as the normalized value, to compare the relative changes in images at different ages, to find the largest jumps and changes at different ages.
So, we can find the major changes from real images. Alternatively, we can find the major changes based on prior knowledge from many thousands of images of other people, to categorize the age brackets, and find the break points, or alternatively, from medical database, indicating the expected changes for an average human, for various major changes in shape, height, face, or features, e.g. beard or hair loss, versus age brackets or break points in time axis, e.g. for the people from Middle East, as a subset of population, with expected values.
Note that if the scales or angles of view of the faces are not the same, in 2 images, then, before comparison, we have to adjust or normalize to one size or direction, so that we can compare them meaningfully. To adjust the size, one measures e.g. the length or width or diagonal of the face or nose, as the calibration metrics or normalization factor, to scale one with respect to the second one. To adjust the angle, one has to look at the symmetry or direction of the nose with respect to the oval of the face or position of ears or eyes, as an example, to estimate the direction and angle of rotation, to adjust the direction of the face, or normalize the direction. For angle adjustment, we use models we have for rotation of the face as templates, to morph one to the other direction. The models are based on N<sub>P </sub>possible types of the head or face in our database, described above, to get a better result, After rotation of the face, we compare it to the second image, which has about the same orientation. Then, it is a fair comparison. In one embodiment, all faces are turned to the same direction for comparisons, e.g. front view, only. See e.g. <figref idref="DRAWINGS">FIG. 134</figref> for such a system.
In one embodiment, instead of rotating the image, we look for an image of the same person corresponding to the same rotated view or angle, from the same age category, if it is available in the database. Then, no rotation is needed, and less computation power is used.
To do the morphing from the first angle to the second angle, for the image of the face, we model the face or head as a mesh with contours, with points on it, as a template for each angle direction or view). Moving from one point from the first angle template to the next corresponding point on the second angle template is equivalent to moving the contours or meshes slightly around its current position. We choose the morphing in small increments for angles so that the differences are manageable by slight movements of contours or meshes. We can model the slight movements by vectors and translations and rotations of vectors, or a combination of them, in a series of instructions to morph properly, for piecewise regions of mesh or contour on the face.
Another way to do this vector modeling is by modeling and fitting a real picture or image of a person at different angles point by point (by coordinate in 3-D), then connecting the neighboring points to get contours, and from the series of contours get the mesh, modeling the face. Then, we have this repeated for different angles for the same person. Then, store the data for that person, representing one of the N<sub>P </sub>possible types, that corresponds to that type of head or face, in a database, for future referral and comparison.
During this process, for a given first point on the mesh, we find a corresponding second point on the template for a second angle or view. Then, on the coordinate of the 3,-D model, with 3 components (x, y, z), we find how much the first point (x1, y1, z1) moved (to the second point (x2, y2, z2)), which is:
(x2-x1) in x-direction
(y2-y1) in y-direction
(z2-z1) in z-direction
We can repeat/get this calculated for multiple points, and then model all of those changes in coordinates in 3-D for those multiple points, using translation, scaling, and rotation, or a combination of the above. That would be our final recipe or series of instructions or steps for morphing process.
Please note that the translation is based on (x2-x1) in x-direction, (y2-y1) in)7-direction, and (z2-z1) in z-direction. The scaling is based on (A x1) in x-direction, (B y1) in y-direction, and (C z1) in z-direction. The rotation is based on matrix of rotation, e.g. in 2-D expressed as a 2×2 matrix (M<sub>2×2</sub>), with the following 4 entries (M<sub>ij</sub>), for a clockwise rotation by angle α on a 2-D plane, as one example:
<br />M<sub>11</sub>=cos α; M<sub>12</sub>=−sin α; M<sub>21</sub>=sin α; M<sub>22</sub>=cos α
In one embodiment, we use 3 types of templates for face model in 3-D (dimensional) for face recognition, or after scanning the face (with a light, scanner, or by a 2D image or multiple 2-D images), or for storage, library, or comparison, alone or in combination: (1) wire mesh using thousands of points on the face, (2) contours of face for topography and geometry, e.g. cheek bone curves and structure, and (3) semantic model, which models the face based on the general semantics and description of the face, e.g. “big nose” or “small lips”, which are Fuzzy descriptions, with corresponding library of descriptors and shapes, plus rules engine or database, defining those beforehand, so that we can store or reconstruct or combine Fuzzy features e.g. “big nose” and “small lips”, and e.g. make up a face from descriptors later, or compare 2 faces just using descriptors without reconstructing the faces at all, which is very fast and cheap, for a Fuzzy match or closeness degree. In one embodiment, we use many small steps between Fuzzy descriptors on the scale or axis, to have differentiation between objects more easily and have a good coverage for all samples in the defined set or universe, e.g. for “height” property, we will have: “short”, “very short”, “very very short”, “extremely short”, “unbelievably short”, and so on. See e.g. <figref idref="DRAWINGS">FIG. 135</figref> for such a system.
The method of recognition mentioned above is helpful as one of the parameters for face recognition, or validation for identity of a person, using pictures of different years or ages, to find a person, Identity recognition, in turn, is a factor for determination of the relationships between objects and humans (or other subjects), and to build such a web of relationships or Z-web from all these determinations, like a tree structure, with nodes and branches, with strength of relationship and reliability of the determination e.g. symbolized with the thickness and inverse length of the branches (respectively), connecting the concepts as nodes, for example, for display purposes, for visual examination by the user (which we call Z-web).
In one embodiment, we have a picture, or multiple pictures of a same person, possibly from different angles, and then we feed that to the system, and then from library, based on shape comparison (e.g. features and parameters of the head in N-dimensional feature space), the system chooses the most possible type of head, out of say e.g. 105 types it has, to suggest that as a model, Once we have the model, we fit those one or more pictures into that model, and construct point by point or mesh structure or contour map of the face. The model has some parameters as variables, which can be adjusted in 3D using those 2D images as input, which gives elasticity to the form of the face and head in the 3D format, for minor adjustments to the 3D model in computer (which can be displayed for the user, as well, as an option). In addition, the same 3D model can be input to a 3D printer, or 2D rendering image printer, or laser induced bubble printer (in plastic or glass), to construct the same head in the solid format, e.g. in glass or plastic or polymer.
In one embodiment, we have e.g. front view of a person, e.g. in a picture or image. Then, we use slanting or some deforming lens or filter or translational transform(s) to change the shape of the face slightly, and store them as the basis for the rotating or moving head slightly, from the front view position (from its original position, with small perturbation or movements), in the library. So, we can use them as eigenfaces for frontal or near frontal sideway faces, for the future face modeling, face replacement, face recognition, face storage, as linear combination of eigenfaces, face approximation, efficient storing of faces, coding the face, and comparison of faces. See e.g. <figref idref="DRAWINGS">FIG. 136</figref> for such a system.
In one embodiment, we have orthogonal or orthonormal eigenfaces as basis. In one embodiment, we have non-orthogonal or non-orthonormal eigenfaces as basis, e.g. some being as linear combination of others, which is less efficient for recognition (and being too redundant), but easier to generate the basis functions, due to less constraints on basis functions. In one embodiment, we obtain eigenfaces from thousands of samples, by cloudifying or fuzzifying or averaging pixels in large neighborhood regions for the samples, in the first step. Then, optionally, we can stop there, and use the result of the first step as our final answer, as eigenfaces. Or, we go one more step, in another embodiment, and we average the first step results together, to get even more “cloudy” images, as our final result, for our basis, for eigenfaces. Or, we go one more step, in a loop, recursively, in another embodiment, and we average the averages again, until it is cloudy enough or we reach N loop count, and we stop at that point, yielding our eigenfaces. Then, any given face is a linear combination of our eigenfaces. See e.g. <figref idref="DRAWINGS">FIG. 137</figref> for such a system.
To remove redundant eigenfaces from our basis functions, e.g. to have an orthogonal set, we try or choose one eigenface, and if we can write it in terms of linear combination of others, then that chosen eigenface is redundant (and not needed) and can be removed from the set. In one embodiment, to make some image fuzzified, we can use fuzzy parameters, rather than crisp ones, or use dirty or oily lens for image, or use defocused lens or out-of-focus lens for images, as a filter or transformation or operator, to get the cloudy or average effect between pixels.
In one embodiment, for face recognition, or eyes or any other object, we have Sobel operator or filter or matrix or convolution, based on gradient or derivative, so that the operator finds the gradient of the image intensity at each pixel, e.g. the direction of the largest increase for pixel intensity (with the rate) or contrast, as an indication of abruptness of changes in the image, to find the edges or boundaries, to find the objects or recognize them. In one embodiment, other filter kernels, e.g. Scharr operators, can be used for edge detection or gradient analysis.
In one embodiment, for face recognition, we use edge detection or other object recognition methods to find eyes (or nose), first, as an anchor point or feature. Then, from the eyes' positions, we know relatively where other parts may be located, if it is a real face, based on expected values or distances based on face models in library, e.g. as a probability distribution or expected value or average value or median value, for distances. See e.g. <figref idref="DRAWINGS">FIG. 138</figref> for such a system. Or, in one embodiment, based on the eyes' positions, we can normalize the face size or other components or the image, for faster comparison. In one embodiment, for face recognition, we find the edges, first. In one embodiment, for face recognition, we find the separate components, e.g. eyes and nose and mouth, first. In one embodiment, for face recognition, we find the whole face, as a whole, first, using e.g. eigenfaces. In one embodiment, we combine the 3 methods mentioned above, for different parts or components or stages of image or object or recognition process, for higher efficiency. In one embodiment, we generate the eigenfaces based on a large number of samples or pictures of many people, e.g. from front view or from side view, for different sets of corresponding eigenfaces, for front or side view, respectively, e.g. using averaging or weighted averaging on pictures, or using a training module.
Z-Web Representation and Manipulation:
The graphic representation of Z-web makes it easier to visually understand the strength of relationship and reliability factor, among other factors embedded in the Z-web, as explained in other parts of the current specification. The graphical representation also mirrors fuzzy parameters, as the human visual perception is not crisp, but it is fuzzy, similar to natural language processing and expression.
To get an object, one searches for nodes on the Z-web (e.g. using an index on a database or listing, using a query), and once the node is determined or found, the connectors and branches coming to or from that node are examined for determination of the reliability and other factors mentioned in this disclosure, from the numbers or sizes or dimensions associated with the connectors and branches, e.g. the thickness or length of the branch between 2 nodes. The “circle of influence” is based on (in different embodiments): the neighboring nodes, or N-th neighboring nodes, or nodes within radius R<sub>node</sub>, centered at that original node, as a hyper-sphere, in the m-dimensional Z-web space, with m coordinates. The circle of influence gives us the guidance as to where and how far we should go for related nodes or concepts or objects, in the branches, to find other objects or recognize objects or find the reliabilities or confirm the objects. Sometimes, the influence of the circle of influence dies off gradually, and not abruptly, using a fuzzy parameter to model that behavior. In other embodiments, the influence of the circle of influence dies off abruptly, which is an easier model to handle and calculate for.
The user interface or GUI is based on a region or section of Z-web displayed in 3-dimensional or 2-dimensional space or coordinate, in one example. The storage of the Z-web is done in relational databases, in one example, to store node parameters and branch parameters and values, which can be fuzzy or crisp or based on natural language, e.g. “small”, e.g., to describe the length of the branch.
To insert some nodes, in between 2 nodes, e.g., one can break the branch connecting the 2 nodes, and insert the piece or node in between, and add 2 new branches to the beginning and end of the added piece, to connect to the rest of the Z-web to expand the Z-web, if needed. The reverse process is applicable, for elimination of a node, if the concept or object is not applicable anymore (e.g. a species of an animal is extinct in year 2020, and the node relating or describing the current live species on planet Earth described in the Z-web has to be updated and eliminated).
Two (or more) Z-webs can be combined, as well. For example, if they do not have any common nodes, the combination is just the simple union of both, with not much adjustment. However, if they have some common nodes (e.g. object “animal” being present in both Z-webs, as a common node), the common nodes can be overlapped together, as a single node, and the branches for a common node can be added from one Z-web into another Z-web. After that, any other node or branch automatically follows the old connections they had from the original 2 Z-webs. However, in one embodiment, we make an adjustment on the values for nodes and branches for the overlapped common nodes to make them compatible. For example, all values can be normalized based on the value of one node on the first Z-web, with respect to the corresponding value of the same node on the second Z-web (mirror node), or ratio of those two values applied to all the values on the second Z-web, to “normalize” the second Z-web, with respect to the first Z-web, to make them compatible.
In one embodiment, we make the adjustment on the node, based on the reliability factor, or other factors mentioned in this disclosure. For example, the value of the first node on the first Z-web is changed towards (or changed to) its mirror node on the second Z-web, if the second Z-web has more reliability factor corresponding to that node. The change can be straight and exact assignment of the value of the mirror node, or can be gradual or partial adjustment towards that value, which could be a fuzzy concept by itself. for example, “almost the value of mirror node” or “90 percent of the value of mirror node”.
In one embodiment, one party makes a first Z-web, and then combines it with N other parties producing N other Z-webs, as described above, to increase the knowledge base and relationship base, including reliability, credibility, truth value, and other factors mentioned elsewhere in this disclosure. This also takes care of the contradictions and inconsistent results, to fix or find anomalies or biases or other parameters described in this disclosure.
As time passes, the size of the super-Z-web increases, and its value grows, as more people or entities contribute to that super-Z-web, which includes more concepts and objects. If all branches associated with a node is broken, the node becomes irrelevant, and can be eliminated from the Z-web. If a node is accessed a lot, its “popularity” value goes up, making it harder to break the branches later. If a value is confirmed or approximately confirmed, in a fuzzy sense, then the reliability of that value increases.
The branches between nodes are not-directional, in one embodiment, so that the relationship is e.g. bi-directional or symmetric. For example, if object A is close to, or located close to, B, in terms of Euclidean distance or meter or length, then B is also close to A. Thus, relationship between A and B is symmetric in that respect. However, in another example, the relationship of “ownership” is not symmetric between a “car” and a “person”, because a person owns a car, but not vice versa. Thus, “ownership” is a directional relationship or branch, between 2 nodes. See e.g. <figref idref="DRAWINGS">FIG. 139</figref> for such a system.
In one embodiment, we have hunches or random guesses, or using guided templates, to follow some scenarios, to guess and validate some relationships between the objects. The rules are used for validation of the hunch or guess, e.g. using game theory. For example, one relationship between 2 people in a picture is father-son relationship, as a guess, which can be suggested and followed up to validate that guess, if it is true. If the parameters are non-crisp, then we use Fuzzy logic and sets and boundaries and values. If the assumption or guess ends up with contradiction, we back track, to invalidate the original assumption, and try another guess.
Of course, if later on, we have an input from social network (e.g. FACEBOOK® or LINKEDIN®) or family picture or family album web site or matching family names (or maiden name) or ancestry-type web site, that 2 people may be related, then we do not need to try the guess scheme, and the discovery goes much faster.
In one embodiment, to update a first object, which is based on one or more second object(s), the system tags the second objects) or node(s) in the Z-web, so that if there is any changes on the second object (e.g. above a threshold, or any changes whatsoever), then as a trigger event, it would. trigger the Z-web to ask the calculation module or the processor module to recalculate the first node and all its properties, including all its Z.-factors, and optionally let the user know about the update event, for the user to extract data from the first node again, if desired. In one embodiment, it also propagates the update to the other nodes in the Z-web, or other related Z-webs. In one embodiment, this is used for incremental or small changes, or for fast update, or parallel updates in various regions of the Z-web (regionally or in small scale e.g. around one node only). In one embodiment, we have a Z-web with multiple nodes connected to each other, based on the relationships and functions, with different strengths or closeness for each branch connecting the nodes, each having its own Z-factor, including reliability factor and other factors discussed in this disclosure, with each node representing an object, concept, emotion, status, mood, mode, state, subject, number, human, animal, car, table, face, name, birth date, event, or the like.
Accessory Models:
Now, let's look at the accessory models for humans, animals, objects, faces, eyes, or other body parts, for image recognition. For example, for a human, the person may wear or carry a pair of glasses, hair piece, hat, beard (real or fake), moustache (grow or wear, fake or real, e.g. with different styles or sizes or forms or shapes), ski mask, eye patch, sun glasses, scarf, big loose rain coat, turtleneck clothing, body or face covers, umbrella, other accessories, and the like. These alter, modify, cover partially or fully, or hide the features (e.g. curvatures or contours or markers) of the body, face, human, or animal, in a way to make it harder or difficult to make proper or correct recognitions or classifications.
To overcome this problem, we can do multiple solutions. First method is to extrapolate or interpolate the regions, colors, texture, or lines in the image, to fill up the gaps or missing or covered part(s). There are multiple ways to do this. One is to filter or un-sharpen the image or lines to fill the small gaps. Another way is to distinguish the regions or open regions or connected regions, to copy the texture or color from one and paste and extend the patches or small copied regions into the neighboring connected regions, to fill up the gaps with correct color and texture, as much as possible.
Another method is to first add (for example) a pair of glasses to the picture of a specific/same person, by superimposing the picture/image of a pair of glasses on top of the person's face/person's image, and then to compare the resulting image to the images with pair of glasses, for proper recognition or verification for the face or person.
Another way is to compare only the visible parts with corresponding parts of the target images, to find the matches or degree of matches, and treat the invisible parts or hidden regions as “DONOT CARE” regions or “NEUTRAL” regions, which do not contribute to the match analysis.
Another way is to first use a template or generic face with glasses or a model with glasses or an accessory model (e.g. using real image of mannequin, or computer generated model or mesh or 3D surface, or averaging the normalized coordinates of thousands of images of the face), to modify or morph the first image, to compare the modified image to the second image, for match analysis and recognition.
Another way is to use neural networks for training purpose, with a large set of faces with eye glasses (for example), so that the neural network is trained (with weights set) to distinguish a person with glasses, or distinguish a specific person with glasses (e.g. with any style or type of glasses, or even when the person not wearing the glasses). In that case, a person with many types of glasses can be photographed for input to the training module, for training the neural network. See e.g. <figref idref="DRAWINGS">FIG. 140</figref> for such a system.
In one embodiment, one can model different glasses as a 2-D (2-dimensional) object, and superimpose on the first image/picture. In one embodiment, one can model different glasses as a 3-D object, and superimpose on the first image/picture. The 3-D model is more computing power intensive, but has the advantage of better perspective and more realistic views from different angles. In general, any accessory on human, face, animal, automobile, or other objects can be modeled in 2-D or 3-D model, and stored in one or more databases, for usage, superimposing, editing, replacing, morphing, converting, or adding to the image or model of another object, e.g., human, face, animal, automobile, or other objects.
In one embodiment, one models different glasses separately and models different faces separately, and then superimpose them together. In one embodiment, one models different glasses and different faces together, as one object. In one embodiment, one models the objects using a real faces and real glasses (e.g. pictures or images from real objects), by classifying them, using many training samples, and having at least one of each classification stored for future referral. For example, if we have N<sub>f </sub>different types of faces and N<sub>g </sub>different types of glasses, then we will have (N<sub>f</sub>, N<sub>g</sub>) different types of combination of faces and glasses. Similarly, for M objects, we will have (N<sub>1</sub>N<sub>2</sub>. . . N<sub>M</sub>) different types of combination of those M objects, stored in the database.
In one embodiment, one models the objects using a real faces and computer generated glasses types. In one embodiment, one models the objects using a computer generated face types and real glasses. In one embodiment, one models the objects using a computer generated face types and computer generated glasses types.
In one embodiment, the computer generated types are based on real images of real objects, as well, which are classified as different types by the computer, and an average or typical sample is stored as an example of that specific type in the database. In one embodiment, the storage of the example is either analytical, e.g. mathematical formulation of curves and meshes, to mimic the surfaces in 3-D, or brute force storage as a point-by-point storage of coordinates of data points, in 3-D (x, y, z) coordinates.
Features in Images (or Other Subjects) are Recognized in Different Orders:
Let's assume we are showing a picture of a red 2-door convertible Ford car to multiple recognizer units or modules. In the first order or step, they all may recognize the car in the image. Then, in the second order or step, they may recognize red color, or 2-door, or convertible, or Ford. brand. Thus, based on the background or experience or training of the recognizer units or modules, the next step may be very different for the recognition process. Eventually, all or most of the features may be obtained by most or all the recognizer modules, but in very different orders. So, there is no universal classification or universal correctness in recognition or absolute classifier or single answer or single recognition method or formula or procedure, Having said that, however, one can still get to the same answer from different routes, e.g., saying or recognizing or resulting in: “a red 2-door convertible Ford car”, or the combination of the following features:
<br />CAR→
<br />+RED+(TWO-DOOR+CONVERTIBLE+(FORD BRAND)
The principle mentioned above is applicable for any other recognition or any other subject or object, e.g. voice recognition or music recognition.
Recognition Method in an Image, for Background and Foreground:
First, for example, we find the background in the image, such as sky or water. That also determines the direction and angle or tilt adjustment for the image. See e.g. <figref idref="DRAWINGS">FIG. 141</figref> for such a system. For example, the sky is usually on the top, and the horizon line, separating land/water/ocean and sky, is horizontally oriented, to correct the tilt of the image. For example, the sky is recognized by the specific color or range of colors or patterns (such as cloudy sky or bright sky), and/or the continuity of the region with minor or no features or variations (such as patches of clouds in the sky, or stars in the black or dark sky at night), or using histograms for pixel intensity and variations (or colors) (or peaks and valleys and plateaus and shapes) as signatures for sky (compared to trained samples or many stored in library or database), or using Fourier or DCT analysis (for frequency domain analysis and coefficients, for comparisons or signature or feature detection, for recognition).
In one example, once we know the background, all other objects blocking the background, e.g. ocean or sky, will be foreground objects, e.g. boat or airplane, located or positioned in the ocean or sky, respectively. The foreground objects can be recognized from the database of objects, using object recognition module or device, as boat or airplane, and tagged accordingly after recognition process. The recognition can be based on silhouette or shape or shadow or profile or boundaries of an object with respect to the samples of the database, as the percentage of match, between the normalized objects, for faster and better comparisons, using a vector or chain piecewise comparison, or pixel-by-pixel comparison for the silhouette or shape or shadow or profile or boundaries of an object.
In one example, we remove the foreground, and we end up with patches or regions of background objects. For example, once we distinguish a man on the foreground as foreground object, we can remove the man from the image (ending up with a blank region), and end up with the 2 pieces of sofa that the man was sitting on, on the left and right sides of the image. From the texture and color, or continuity of the border lines or extension/direction of the border lines, of the 2 sides, we recognize that they belong, or most likely belong, to the same object. So, we fill up the blank region behind the man's position in the image with the same texture or color from either or both sides of the image (or use an average or mixture of the texture or color from both sides of the image). So, now, we end up with a whole sofa, which is much easier to recognize as one piece, or single region object.
Also, the fact that we know we are in a home environment or context helps us to narrow down to about 200 objects, for example, in our database, related to possible objects in the house, or belong to a specific person living in Canada (based on the conventional furniture for that part of the world, e.g. a sofa, or e.g., knowing a specific person originally from Middle East, with big traditional pillows on the sofa, as possible choices to search or compare for, from the possible-choice-databases, available or compiled by us, beforehand). See e.g. <figref idref="DRAWINGS">FIG. 142</figref> for such a system.
In one embodiment, we can recognize the two sides of sofa as a single object, i.e. sofa, without filling up the gap or blank region(s) with color or textual patches using copy/paste routine explained above for small unit regions or patches or tiles, which can be square, rectangle, circular, or non-geometrical shapes, repeated until the whole blank region is scanned or filled up or painted. For example, we extend the boundaries or border lines from both sides to connect or complete the whole sofa border line, or approximately find or complete the border line, to find the final shape of the sofa, to recognize the object as possible sofa. The approximate line can be connected and recognized as one single line, when the line is thickened with a thickness of 2 to 10 points, or more points, to produce a continuous line (thick jagged line). See e.g. <figref idref="DRAWINGS">FIG. 143</figref> for such a system.
In one embodiment, we assign a value of “I DO NOT KNOW” to the invisible part of the sofa, in which we try to find the fitting objects based on the visible parts of the sofa, from our library of possible objects, common for a setting, with the condition that on the back (where it is hidden), it can be anything. So, we calculate the reliabilities based on this scenario, and we use fuzzy values to describe this, in one embodiment. In one embodiment, we use Z-web for this purpose, with all corresponding Z-factors.
Adjusting the Tilt or Orientation:
The orientation of an image, such as from horizon line, or water or ocean line far away, or tower in background, which indicate horizontal line or vertical line in the perspective view or expectation of humans, indicate how much an image should be rotated or tilted to get into the right orientation. For example, that normalizes the head or face of a human to be in the right angle or direction or orientation, to pre-process, before the actual recognition of the face or head by the face recognition module. That increases the accuracy of the recognition at the end, for the objects at the foreground.
To Find a Continuous Line:
To find a continuous line, one searches for the next point in the line, e.g. black pixel or dot or similar color pixel, in left, right, diagonal left up, up, down, diagonal left down, diagonal right up, and diagonal right down, i.e., in all eight neighboring directions or pixels, to find any match, which produces continuity in the line, point-by-point, to extend the line.
For small discontinuity e.g. due to bad image quality or a copied image by old copy machine multiple times, the bridge gap of 1-2 pixels can be forgiven or filled up. Thus, the search is beyond the immediate neighboring pixels, going e.g. to the 3<sup>rd </sup>neighboring pixels, to find a match of pixel, to assume continuity for the line, and filling up the gaps with the same pixel or dot, to get a final continuous line. Or, one can defocus or widen the lines, using a filter to reduce the contrast for the edges, to bridge the gap of 1-2 pixels with filled pixels or dots, to get a final continuous line.
To find a narrow boundary or border, from the thick jagged line mentioned above, one can get the average coordinates or select the middle points of the thick jagged line, as the final fine boundary, which defines the object, e.g. sofa, very well, with sharp boundaries, for easier detection or recognition, versus the object with thick boundaries, which is harder to detect, when the small features are hidden or overshadowed by thickness of the line, itself.
Another way is to use skeleton or bare bone shape, to simplify the shapes fast and efficiently, as the first-cut/coarse search and comparison, from database of skeletons or shapes, to name the objects or tag them, which accompanies the objects as comments or tags data from now on, after tagging.
Another way to find or recognize a sofa is to use DONOT CARE or NEUTRAL region assignments for the blank region, for partial matching with test images as targets, to find the similarities between the object and targets based on the visible parts, and treating the invisible parts as having any values possible (or ignore them, as having no or negligible weights), for comparison or recognition purposes. The final match score or probability is only or mostly based on the visible parts, with respect to target or possible-object databases.
Use Images from Different Angles or Perspectives:
To model an object, from a 3-D perspective, one models the object using images taken by a real camera, from different angles. For example, for the recognition of a face or person, one looks at the face from multiple directions, e.g. from side view left, front view, half-side view right, and back side. Thus, we store the multiple views from different camera positions or angles, for the same person, for later recognition of the person, to find an exact match or a match between two or more of these snap shots or images (i.e. using limited numbers of images, as discrete sampling, for continuous matching positions, later on), as interpolation or extrapolation of one or more images, or some weighted average of them, or some average of them.
Use Computer Models of Objects:
Also, one can use a computer generated model for N possible shape of heads for men, women, and children at different ages, for various ethnicities and races, based on the images of shapes of head taken and input them to the model (e.g. artificially rendered or calculated or constructed by a computer), to cluster and classify all possible head shapes on the planet (where N is usually a manageable number, say, e.g. 100). So, starting from a 2-D image of a new person's face or side-view (person P), it can trigger or match approximately the image of one of those N shapes from the head shape library, and thus, call up the corresponding model for the selected head shape from the library or database.
Now, in one embodiment, we have a correction that can make the model more accurate. We change the parameters of the head on the model slightly, to match the image of the face or head for person P exactly, from the 2-D image, using manual adjustments, or computer control or automatic adjustment, e.g. fuzzy rule based adjustment, to morph one to another, so that the contours and/or points on the mesh representing the face or nose or head match exactly with the model. The morphing mechanism details are described elsewhere in this disclosure.
In one embodiment, we have a correction that uses two or more of those N shapes (say, e.g. T number of those N shapes) from the head shape library, and then combine them to get an approximate match, e.g. using a linear combination of them, or weighted average of them, or take an average of them. Then, in one embodiment, we have a further correction, similar to above, to change the parameters of the head on the model slightly, to match the image of the face or head for person P exactly, from the 2-D image, using manual adjustments, or computer control or automatic adjustment, e.g. fuzzy rule based adjustment, to morph one to another, so that the contours and/or points on the mesh representing the face or nose or head match exactly with the model. The morphing mechanism details are described elsewhere in this disclosure.
In one embodiment, we have some or all of the N shapes sub-divided into Q<sub>1 </sub>to Q<sub>N </sub>shapes, respectively, as subcategories, for minor differences between head shapes. Then, we have better matches based on subcategories. However, the overhead for storage and computation is much higher, since we are dealing with much higher number of shapes now. That is, we have now: (Q<sub>1</sub>+Q<sub>2</sub>+. . . +Q<sub>N</sub>) shapes, rather than N shapes.
In one embodiment, we adjust the mesh or points or contours representing the face or head, as an example, using the parameters that change the coordinate of points, or change the formulas for curves or family of contours, in the computer model, and changing those parameters by a small percentage or small relative deviation. Then, we observe the result: If the difference (e.g. sum of square of differences, or sum of absolute value of the differences, as error function) on the match for all points or contours or meshes with respect to the model for the selected shape gets larger (gets worse), then we should change in the other direction or change other parameters. If the difference on the match for all points or contours or meshes with respect to the model for the selected shape gets smaller (gets better), then we are on the right track, and we can continue on the same direction, until we get worse off. Then, we stop at that point for that parameter. Then, we try other parameters, one by one, or in a batch, or bunch together, to optimize for complete match with the model. That is, we use a feedback to adjust the parameters, for complete match, as much as possible.
In one embodiment, to adjust the difference value mentioned above, we may be in a local minima region of the optimization curve for the difference value(s) function mentioned above, and small adjustments may get us only into a local minima. However, to get into an absolute minima of the optimization curve for the difference value(s) function mentioned above, one has to get out of the local minima region. To do so, we need a random adjustment on the parameter(s) or big adjustment on the parameter(s), to land in another part of the optimization curve for the difference value(s) function mentioned above. That will increase the chances of getting out of the trap of being in a local minima region for all optimization adjustments at all times.
Of course, even if we get to local minima, rather than absolute minima, for optimization, we still may have a good result for match process, to stop further search and optimization or adjustments, as mentioned above. That can be checked using a relative or absolute value as threshold, or an incremental improvement analysis, to stop beyond a threshold, for the optimization process, as optimization any further would not worth the cost of more computation power spent on such incremental improvements, if any.
Look for Expected Objects:
For example, in an office environment, one has a list associated with a typical office or law firm office or dental office, which are stored as possible objects in the office, in a web of related objects, or databases, related to an OFFICE or DENTAL OFFICE. So, an object behind a person in an office on the table may be a fax machine, which is a possible target candidate for examination and image recognition comparison, obtained from the corresponding list of related objects for the OFFICE. That increases the reliability, speed, focus, and accuracy of the recognition process.
One can also re-use the related objects from one into another one. For example, an “office” is superset of a “dental office”, for most cases. Thus, all properties of “office” are a subset of (and included in) those of a “dental office”, including e.g., related objects or expected objects or owned objects or property objects. That is, they inherit each other's properties automatically. See e.g. <figref idref="DRAWINGS">FIG. 144</figref> for such a system.
Of course, in one embodiment, these concepts above are all fizzy concepts and sets, with no hard or crisp boundaries, and with qualifications e.g. “for most cases” or “usually”. Please see the discussions elsewhere in this disclosure, regarding the handling and processing of these concepts, values, and parameters.
OCR, as Textual Information, to Help Build the Relationship Web Between Objects:
In the next step, as one example, we look for a text as an object in the image, to recognize, for example, the brand, model number, and the type of the object, e.g. HP printer Model Number 100, written on the object, as text. So, we invoke an OCR (optical character recognition) module to read the text, to find and search for more relationships between the objects in the image. The text in the image can be vertical, slanted, wavy, morphed, or curved, as in a book in a bookshelf, or as in a newspaper on a table at an angle to the camera or frame of the picture or image, or as in a word written as a motto or slogan on a flying flag with the wind power behind it, or as a reflection of some big poster on the side the building or highway reflecting the text image on a wavy water or pool or pond nearby, or as a security word for user authentication (against sniffing search bots) with a slanted or twisted image of a text, usually with no meaning, on the screen or monitor of a computer.
List of manufacturer and model numbers or the like are also listed in separate files or databases for search and matching or recognition or validation, to further limit or focus or specify the identification of the object, such as printer or fax machine in the example above, using the OCR as a tool or as one of the linking methods between the objects.
On the related objects, e.g., once a computer is determined as an object in the image, we can expect a possible mouse or monitor (with some degrees of certainty corresponding to each device), or with some membership function or value associated with a fuzzy membership for mouse as an accessory to a computer, and hence, expecting a mouse as an expected object nearby in the image, and thus, look for it as a target object around a given computer, from a database or list of possible objects in the neighborhood.
The Distance or Size as a Factor:
In one embodiment, the distance to the object is also taken into account, for example, G meter or feet, for estimation, for proximity or location analysis, as the search radius and location estimator, e.g. based on the center of the object, e.g. based on the estimated scale of the object or picture, or relative to the size of the neighboring objects, or typical size of the objects. For example, the mouse's length is about 20 percent, or 20 plus/minus 5 percent, or exactly 20 percent, of a length of a laptop, or a specific laptop, or typical laptop, or an average laptop, or for a range of laptops, obtained from our database for relationships between the related objects, e.g. laptop and expected nearby possible mouse, with its corresponding membership value and reliability value and expectation value, relating the 2 objects, from A to B, as 2 nodes, in the network or web or relationships, e.g. for distances or sizes. Another example is the typical distance between a laptop and a mouse is 1-5 feet, for possible search location possibilities, for the center or the edge of the object, e.g. mouse. See e.g. <figref idref="DRAWINGS">FIG. 145</figref> for such a system.
For some examples, for fuzzy ranges or fuzzy values for distances, we use unfocused or fuzzy lines or fuzzy geometry lines, with fuzzy distances and fuzzy endings and fuzzy thickness, for geometrical representation in Z-web. For some examples, for crisp ranges of distances (or uncertain distances with error values), we use dotted lines around the average value or around the minimum value, for geometrical representation in Z-web. For some examples, for geometrical representation in Z-web, we can draw spheres or circles, for radius of search of a target object, with respect to two or more given objects, and from their intersections of the regions or overlaps of areas, we can further pinpoint the location or distance of the target object.
Note that the size of the object is estimated or determined by comparing to relative size or distances of other objects in the image or video frame, as typical values in the library, or as a value we already know for a specific object, e.g. Fred Jackson's height is 6 feet. It can be based on Fuzzy parameters and values, as well, e.g. Fred. Jackson is very tail. The perspective or depth in the image can be estimated using rectangular objects, such as table, having merging boundary lines for parallel sides, by extending the border lines to the back of the image, so that they cross at an imaginary perspective point I<sub>PP </sub>in the background of the image, which indicates the perspective for the image with a point located at infinity, very far away. Note that I<sub>PP </sub>can generally be more than one point or a line, representing infinity, or far away, in the image, at the horizon. Then, from that, the relative size or distances or angles can be obtained, using simple geometry relationships, e.g. mapping the distances or other lines as a projection on the imaginary lines connection to I<sub>PP </sub>(called L<sub>PP</sub>), or as a projection on lines perpendicular to those L<sub>PP </sub>lines (called T<sub>PP</sub>), which are generally curved or circular shaped lines or family of lines with the center at I<sub>PP</sub>, in the perspective coordinate system of the image. For example, we divide the image into family of L<sub>PP </sub>and T<sub>PP </sub>lines (or curved lines), with some distance between each of 2 neighboring family members, to cover the image like a tilted “floor tile” scheme, and then for each dimension in the image, we try to do the comparison with the dimensions in the same neighborhood with known sizes, e.g. from known objects, e.g. we know that Mark is 6 ft tall, and that gives a reference size for objects in his neighborhood in the image.
See e.g. <figref idref="DRAWINGS">FIG. 146</figref> for such a system. In one embodiment, from <figref idref="DRAWINGS">FIG. 146</figref>, we can get the length of an object, e.g. vector V (with real length and apparent length V), as follows:
<br />b=V cos(E)
<br />a=V cos(G)
Now, we want the ratios, to some known values or objects, e.g. as shown on the highlighted. rectangle in <figref idref="DRAWINGS">FIG. 146</figref>, with apparent side lengths a<sub>1 </sub>and b<sub>1</sub>, and the real side lengths a<sub>real </sub>and b<sub>real</sub>, respectively. Then, we have:
<br /><i>a</i><sub>calculated</sub>=(<i>a/a</i><sub>1</sub>) <i>a</i><sub>real </sub>
<br /><i>b</i><sub>calculated</sub>=(<i>b/b</i><sub>1</sub>) <i>b</i><sub>real </sub>
<br /><i>L</i><sub>v</sub>=√(<i>a</i><sub>calculated</sub><sup>2</sup><i>+b</i><sub>calculated</sub><sup>2</sup>)
In another embodiment, note that for T<sub>PP</sub>, we have to find the distances on the curved lines, e.g. a piece of a circle with a radius on L<sub>PP</sub>, originating from I<sub>PP</sub>, and ending at the point of interest (at the intersection of those specific L<sub>PP </sub>and T<sub>PP</sub>).
In another embodiment, the projection of a line S<sub>PP </sub>with a length G<sub>PP </sub>on the L<sub>PP </sub>line is mathematically given as, P<sub>PP</sub>:
<br /><i>P</i><sub>PP</sub><i>=G</i><sub>PP</sub>·cos(<i>A</i><sub>PP</sub>)
Wherein App is the angle between that specific line S<sub>PP </sub>and a neighboring L<sub>PP </sub>line, to project on the L<sub>PP </sub>line. Once we have the projected lengths on those specific L<sub>PP </sub>and T<sub>PP</sub>, we can compare that with other projected lengths from known objects with known sizes in that neighborhood, as projected on the same nearest specific L<sub>PP </sub>and T<sub>PP</sub>, to get a relative distance or size, or ratio, to get the size of the unknown object (approximately).
In another embodiment, instead of using projection values, as shown above, one simply compares the size of the line piece from the unknown object with the size of the line piece from a known object, in the same neighborhood, to get the ratio, and then, get the size of the unknown object (estimated). Of course, the smaller the meshes associated with L<sub>PP </sub>and T<sub>PP</sub>, on the image, the more accurate this estimate will be.
Note that in the general case, going from A to B may be not the same as, or reversible, with respect to going from B to A, e.g. between mouse and laptop as 2 related objects in the relationship web, with respect to the values of membership value and reliability value and expectation value. Thus, we can show that by two arrows going from A to B, and from B to A, with different strength or thickness or width or length or size, signifying the various valuations of membership value and reliability value and expectation value, in different directions. For example, in some embodiments, the expected value of finding a mouse in a specific region or radius or coordinate in the image (given a laptop is found nearby, as an assumption) is different from its reverse situation, i.e., it is different from the expected value of finding a laptop (given a mouse is found nearby, as an assumption). See e.g. <figref idref="DRAWINGS">FIGS. 147, 132, and 139</figref> for such a system.
In <figref idref="DRAWINGS">FIG. 147</figref>, as an example, we show a recollection of past event using Z-web, as a memory storage function, with Z-factors, including the reliability factor. The Node N is a trigger node, and the events are reconstructed or relationships are traversed backward to Node 1, our original node.
In other embodiments, the two directions are reversible and have the same values for both directions, e.g. for membership value and reliability value and expectation value, between 2 objects, e.g. mouse and laptop.
Now, having specification or range of expectations, for possibilities and probabilities, for example, for distances and sizes, one can search more accurately for the secondary object, e.g. mouse, around a given laptop in the image, or in the universe around us, as the primary object. For example, given a distance between centers of 2 objects, as 0-5 feet, we can design a circle around the primary object, with that radius of 5 feet, to define a region for possible existence of the secondary object, e.g. mouse. That would reduce or limit the search time and criteria, or increase accuracy for a given time and computing power.
The radius can be defined in 2-D or in 3-D space in the image, depending on the fact that the second object has or may have any support for standing in space outside the planes defined by the first object, e.g. having a tripod or legs or support for a camera or mouse. In the 3-D space, it becomes a sphere, with radius R (instead of a circle or projected circle), which has a cross sectional projection or view on the image as an ellipse or oval or curved region, depending on the point of view or perspective view of the camera or image or user. The region defined by circle or sphere, or their projections on the 2-D original image under study, signifies the possible locations allowed for the center for the second object, e.g. for its coordinate(s) or center of mass or corner(s).
Position is also a factor for building relationships between objects, as for example, the 4 legs of a table, with respect to the table, which are usually presumed to be located and also attached at the bottom of the table (unless the table is reversed or broken, e.g. in a fight scene or war scene, as an example, depending on the context or history or assumptions, beforehand, which can change some relationships drastically, as in the case of the image of a war scene or hurricane scene disaster). The position or relative locations are defined using directions or distances, e.g. up, down, diagonal up, 45 degree up left, 5 ft, top, bottom, side, corner, and the like. Note that most of these concepts are fuzzy concepts, useful for membership values, e.g. side of a laptop, or corner of a laptop.
As mentioned above, the context is also very important. Given an image of a war scene or hurricane scene disaster, one may expect to find a table reversed or with broken legs, opposite or contrary to any normal expectation or relationship between normal objects in a normal environment. Thus, the relationship web is very different for those situations, with respect to normal situation. In addition, that is one way to confirm that an image is possibly from a war zone, based on tables with broken legs or houses with no roofs on the top. See e.g. <figref idref="DRAWINGS">FIG. 148</figref> for such a system. This can go both ways. That is, from rules and conditions, we get the context. Or, from context and rules, we get the current condition of the object. The confirmation of assumptions is detailed below.
In one embodiment, when we look at a picture, we focus in the middle or at the main feature(s), first, as e.g. indicated by histogram or contrast map. Then, we Look for other expected objects nearby, using the related objects list with associated probability and associated expected distance (relative or absolute values), which is part of Z-web. In one embodiment, once we find e.g. a face in the image, we can assume that most likely that other faces or other eyes or similar objects, if any, in that image, are in the same scale or distance or order of magnitude, which can adjust the scale or size of the basis functions, such as wavelets, to find the other eyes or faces in the image much fluster, focusing or using only basis functions or filters within similar or same scale for basis functions or object size. In one embodiment, when scaling the basis functions, the lines or curves defining the basis function has the same thickness as that of the original. In one embodiment, when scaling the basis functions, the lines or curves defining the basis function get scaled linearly with respect to that of the original. In one embodiment, when scaling the basis functions, the lines or curves defining the basis function get scaled non-linearly with respect to that of the original, e.g. based on exp(x), log(x), or x<sup>2</sup>.
Going Backward (and Testing or Verifying) on Assumptions:
As we get the input and build our web of relationships between objects or concepts or subjects, e.g. emotions, humans, and tables, we add reliability, truth, credibility, and consistency of the information, which can be addressed by Z-numbers or by fuzzy logic membership or other fuzzy concepts or other reliability calculations, also described in the U.S. Pat. No. 8,311,973, by Zadeh, which addresses Z-numbers and its applications, as well as other fuzzy concepts, plus the “trustworthiness of speaker”, “sureness of speaker”, and “statement helpfulness”, with the analysis for cascaded or network of information sources ending up with a “listener”, e.g. in <figref idref="DRAWINGS">FIGS. 43-46, 66, 68, 69, 78-80, 84-93, 104, and 120</figref>, plus other figures and corresponding text supporting the teachings. We also address some of these issues and solutions in the current disclosure.
Now, in one embodiment, let's start with multiple assumptions, A<sub>1 </sub>to A<sub>N</sub>, and from there, we can get some web connections for relationships between M objects, subjects, words, and concepts, e.g. emotions, humans, policeman, teacher, dog, and car, in this relationship web, as nodes on the network. All the relationships and assumptions have reliability, truth factor, confidence level, and credibility metrics (with their corresponding membership functions or values).
Now, in one embodiment, we start from a node and continue building the network, until we get to a point that inconsistency or contradiction flag is up, in terms of property of a node which gets contradictory results from different sides or routes. Then, we backtrack and clean up the route to the original assumption(s) or node(s) that may have caused this problem, to remove or change the assumption(s). We can change the assumptions one at a time, and see the results again, until “satisfied”, which is also a fuzzy concept (for the degree of “satisfaction”). Or, for N being a very large number, we can change multiple assumptions at the same time, and observe the results, to adjust the assumptions in a feedback loop manner, or based on some fuzzy rules.
In one embodiment, for conditional relationships, or multiple choices, we can continue, until we get to a dead end or conflict, and then, backtrack to eliminate or adjust one or more choices, on the chain going backward, to correct or adjust some assumptions, choices, or conditions, on the way,
In one embodiment, using assumptions on human emotions, one can do behavioral analysis on individuals, or collectively on whole society, e.g. how the people feel or react on a bad news, such as earth quake, using e.g. the sad faces in images, or text analysis on expressed or typed words such as “Disaster!” in the email or texting message on phone. The collection of nodes in a Z-web can indicate that a person is very angry or sad at a given moment.
Of course, as the mood of a human changes, the corresponding Z-web changes accordingly, with new nodes, weights, reliability factors, and the like. So, the Z-web is a dynamic structure which is potentially time-dependent, with a corresponding characteristic time period (T<sub>Char</sub>). For example, a geographical factual Z-web with many constant facts at its nodes has a large T<sub>Char</sub>, because we do not need to update or change that Z-web very often, as most of their values stay the same for a long time (versus some Z-web related to e.g. the stock market, with fluctuations and variations on a daily or hourly basis, which requires daily updates, and thus, has a lower T<sub>Char </sub>value).
Optimization of Quality of Different Aspects of Image:
Consider the line on any line drawing image. The thicker the line, or the wider the tip of the pen used to draw the line, the less features are visible from the line drawings, as the small features are dominated or lost by the thickness of the line, itself. Sometimes, for some applications or situations, we want to increase the width of the lines or boundaries, for the sake of having continuous boundaries or borders between different objects, for better object recognitions or discriminating between neighboring objects, to figure out what is in the picture or image. However, for any image with small tiny features, that increase in the width of the lines or boundaries may cause problems of wiping out or hiding or losing the small features for the borders of objects or regions in the image, if those features are important for any other analysis. So, we have to figure out at the beginning that which one is more important, to preserve one or the other, i.e., in favor of one or the other. Or, we have to figure out at the beginning that to what degree this process should be done, in favor of one aspect, before damaging the other side/aspect.
So, (i) we classify the images at the beginning, and (ii) also see what kind of interest or information or query we need or want from the image(s). These 2 parameters determine how far we should optimize the image, for which aspect, and in the expense of what other aspect of the image. The compromise factor between different aspects of the image and optimization factor for each aspect of the image are also fuzzy parameters, and can be determined using a fuzzy rules engine or a fuzzy optimizer. The fuzzy rules engine or a fuzzy optimizer are explained here in this disclosure, as also explained in U.S. Pat. No. 8,311,973, by Zadeh.
One way to avoid this analysis or compromise is to make 2 copies of the same original image, and then optimize the first aspect on the first copy, and optimize the 2<sup>nd </sup>aspect on the second. copy, and then extract information from each image or copy separately for the 1<sup>st </sup>aspect and the 2<sup>nd </sup>aspect, from the 1<sup>st </sup>image or copy and the 2<sup>nd </sup>image or copy, respectively.
Another way is to make one analysis on the first aspect from the original image (that does not need much optimization or correction on the image), and then change the image to optimize the 2<sup>nd </sup>aspect, for analysis of the 2<sup>nd </sup>aspect, to extract more information about the second aspect. This way, we get somewhat good information about the 1<sup>st </sup>aspect of the image, and excellent/large amount of information about the 2<sup>nd </sup>aspect of the image. Yet, the overhead about computation power or storage of images is not as large as the previous solution, given above. So, it is a kind of middle ground compromise solution, good for some applications, which need some accuracy, but at lower cost for computation and analysis (or shorter turn-around time for analysis and results).
Window for Examination:
When looking at one image, for one embodiment, if the window for examination of the image is too wide, and we get one signal from all of the window, then we may get the average values from all regions of image contributing to the result. Then, in those situations, we may not get some of the features from the image. For example, if the features are based on sinusoidal function (sin(x)), with half of the time negative and half positive, in 2-D space of the image, then the average for all regions, containing a lot of the periods for the function (assuming small periodicity for such sin(x) function, i.e. small T, for this example), would be zero or near zero, for the total average. Thus, the behavior of sin(x) for the feature in the image is not detected at all, in this example.
Now, if the window of examination is too narrow, and the changes are negligible for consecutive windows, in absolute values or relative values, then the process is too slow or expensive for analysis, and we may also miss detecting some of the big scale behaviors in the image. Thus, the optimum window size depends on the periodicity (T<sub>F</sub>) and size (L<sub>F</sub>) of the features in the image, to have both efficiency and accuracy for the image analysis. So, at the beginning, we classify the image based on those parameters (T<sub>F </sub>and L<sub>F</sub>), plus its complexity (C<sub>F</sub>) and concentration of features (M<sub>F</sub>) that we are looking for in the image. Then, the size of the window (S<sub>W</sub>) is determined from all those parameters. Note that all these parameters can be expressed by e.g. real numbers (fuzzy or crisp values) or in terms of human natural language, e.g. “large window” (fuzzy values).
For example, we have T<sub>F </sub>as 2 features per 50 pixels or 2 features per cm<sup>2 </sup>or 2 features per 5×5 pixel square or 2 features per cm of boundary. For example, we have L<sub>F </sub>as 50 pixel or 5 cm or 5.2 times bigger than size of the mouse of the computer or “bigger than size of mouse of the computer” (as fuzzy value).
For example, in one embodiment, we have complexity (C<sub>F</sub>) defined as the number of gray scale used (out of 256, for example) (or available) in this particular image, or defined as number of color values used for components of RGB or CMYK system in the image, or defined as the number of intensity values used (out of Q total values available) for the image, or defined as the percentage of variations, in diagonal or horizontal axis, in the middle of image or passing the center of the image, in the intensity of pixels, plus the directions of those variations in the pixel intensity (which can be large or small positive or negative numbers or percentages or relative values), or expressing any of the above per square pixels or square cm or unit of area, or similar definition as a metrics for the complexity of an image.
For example, we have concentration of features (M<sub>F</sub>) as number of features (or spikes or crosses or knots or curves or small squares (as examples)) per square pixels or square cm or unit of area, as examples, or when the features are confined on a line or curve or boundary, M<sub>F </sub>may also be expressed per pixel or cm or unit of length. For example, we have the size of the window (S<sub>W</sub>) as 100 by 100 pixels, or 2 cm<sup>2</sup>, or twice as big as the mouse of the computer in the image, or “very very large” (as fuzzy value), or 1 percent of the whole image, or “small square”.
For example, in one application or embodiment, for small T<sub>F </sub>and small L<sub>F</sub>, plus high complexity (C<sub>F</sub>) and high concentration of features (M<sub>F</sub>), the size of the window (S<sub>W</sub>) is set to be small, e.g. 3×3 pixel (square).
In general, we have a function F<sub>av</sub>, defining S<sub>ω </sub>as dependent on parameters:
<br /><i>S</i><sub>W</sub><i>=F</i><sub>W </sub>(<sub>F</sub><i>, L</i><sub>F</sub><i>, C</i><sub>F</sub><i>, M</i><sub>F</sub>)
Extracting Clues and Information from Images, to Determine Relationships:
From an image, picture, video, drawing, cartoon, caricature, sketch, or painting, one can guess or estimate or find relationships or find attributes or find the degrees for relationships or find connections between objects, subjects, humans, animals, plants, furniture, emotions (which can be used to predict e.g. social behavior, purchasing behavior, voting behavior, or rating system behavior), ownership, properties, characteristics, or the like, related to, for example, the following:
The age of the subject or person or animal, ethnicity of a person, relationships between subjects (in a picture or painting or image or video frame), picture setting (e.g. at office, official, military, family gathering, class reunion, primary school student picture, graduation from college, prom dance event, black tie event, Olympics medal ceremony, Oscar Academy Awards event/night, or karate class), family membership, happiness (or misery, despair, anger, emotion, or mood), closeness (friendship, or how close the subjects are to each other), intelligence of the person, sophistication of the person, gender of the person, style of the person, location of the picture, year (in which the picture was taken), political affiliation, country (in which the picture was taken), language of the location (in which the picture was taken), time of the day (in which the picture was taken), season or month, special occasion (New Year celebration at Times Square in NY City, Christmas, wedding, or carnival), special location (Disney Land, cruise trip, on the Moon, Grand Canyon, or near Eiffel Tower), temperature of air (in which the picture was taken), humidity (in which the picture was taken), time zone (in which the picture was taken), altitude or location on the planet Earth (in which the picture was taken), height (in which the picture was taken), depth (in which the picture was taken), or environment (e.g. cloudy, rainy, war zone, or foggy), as some examples, or the like. See e.g. <figref idref="DRAWINGS">FIG. 149</figref> for such a system.
The correlation between objects, subjects, and concepts, at nodes in the relationship web or network, as the web grows and gets built up, with more relationships and larger number of nodes, brings more and more objects, subjects, and concepts together, and validates or verifies estimates, guess work, and possibilities, with more accuracy and higher confidence level.
The input to the web of relationships comes from many sources, e.g.: textual information, video, music, noise, voice, still images, pictures, sound bites, expressions, moods, emotions, tags, comments, recommendations, LIKEs on a web site, customer feedback, TWITTER®, FACEBOOK® entries, emails, blogs, votes, political opinions, surveys, summary of data, medical images, weather forecasts, historical data, geographical data, mathematical, physics, and chemical facts, historical monuments, famous quotations, books, slangs, Wikipedia, encyclopedia, dictionary, thesaurus, translation books, county land records, birth certificates, lectures, novels, science fiction, documentaries, history books, magazines, picture albums, databases, private network or storages, class notes, exam answers, dating sites, ancestry web sites, social media sites, petition documents, tax returns (if available), resumes, biographies, biometrics, gene or DNA sequence, medical data, medical history, medical knowledge, chemical formulas, mathematical relationships, physical constants, physical phenomenon, abstract concepts, architecture, psychology, philosophy, proof methodology, inductive reasoning, logic, calculus, hand written notes, scripts, computer program, codes, encrypted message, sign language, alphabet. Internet, search engine, opinion of famous people, opinion of friends, friend suggestions, social media votes or suggestions or opinions, court documents, dockets, or the like.
For example, to find the age of a person in a picture, the number of or concentration of wrinkles on the face or neck or skin can be counted or detected (as the older people tend to have more wrinkles, as an example), or based on the ratio of the size of the head to the rest of the body or height (as the average ratio or ratio changes for different ages, for most people, tabulated based on millions of samples in the database), or features of the face and their dimension ratios (as is different at different ages, within some range, for normal people, stored in the databases, which can be a crisp value or fuzzy parameter), or having bi-focal eye glasses (usually for older people), or having a hearing aid (usually for much older people), or having a bald head or receding hair line (usually for adult people, and usually male subjects), or having only one earring, nose ring, or tattoo (usually for younger people), or having 2 earrings (usually for female, above 10 year old, as an example), or having a tie or bow tie (usually adults in formal settings, and usually male subjects), or having a top hat (usually adults in formal settings, and usually male subjects), or having a baseball hat (usually kids or young adults, and mostly male subjects), or having a beard or moustache (usually 12 years or above, as an example, and almost all male subjects).
Please note that if we have other information about the culture or town or country or the date of the picture, we may be able to determine the age more accurately, for example, in 1960s, a lot of college students in certain countries wear tie in college, but it is not true for college students in US in year 2000. Another example is for Scottish culture or region, we know that Scottish men wear the skirt as tradition, which may tilt the possibility and probability and confidence and reliability of the decision or recognition or classification, one way or another, based on the subject having skirt on, in the picture or image. Thus, the culture and date of the picture and context and traditions and environment may all be influential and factors in the decision making.
Some of the features or criteria or tests mentioned above also apply to gender, as described above, e.g. having a moustache or beard on a person in the image or picture. However, if we know, e.g. that the date of the picture was Halloween, located in US, then the moustache may be fake or on a Halloween mask, or if the location is Universal Studio for a movie, from scene of the movie, then the moustache may be fake. So, again, the context and date of the picture are important to tilt the values or relationship strengths or possibilities or probabilities.
Also, most of the rules stated above are fuzzy rules, for relationships, for various objects and subjects or concepts, such as: “Having hearing aid in the ear, in the picture, usually infers that the subject (the person under evaluation, in the image) is probably an old person”. First of all, “old” is a fuzzy value, and then “usually” plus “probably” can be handled by the Z-number mathematics and algorithms, as explained in this disclosure. In addition, fuzzy rules engine and related algorithms, e.g. backward chaining inference engine and the forward chaining inference engine (for handling a set of fuzzy rules for the relationships that we stated above, for determining the age of the person, as an example), are also explained in this disclosure.
Now, we have more information extracted from the images. For example, the picture setting may be at an office, with indicators such as tie and jackets or formal dresses, as well as desk, round table, water cooler, copy machine, cubicles, partitions, white board, calendar, deadlines on the board, tasks on the board (read by the OCR and understood by the natural language processor, as being tasks with dates in front of them, and possibly some arrows, with time line on horizontal axis), conference room, conference phone, employee award on the wall or on the desk, “men's room” indicated by word or by a “man” symbol on the door to the bath room, rack of coats or hangers, name tags on the desk or wall, room numbers on the door or wall, or the like.
One indicator may not have a high correlation coefficient to a setting, but a combination of multiple indicators has a much stronger correlation coefficient, e.g. some of the indicators mentioned above, with respect to the “office” setting. Also, one “fax machine” may be have a different correlation coefficient or relationship factor with respect to general office, or document processing office, versus dental or doctor office. So, same object in different environments or locations or contexts have different relationship factor, e.g. in day time setting versus night time setting.
To examine a setting, for example: <ul id="ul0071" list-style="none"><li id="ul0071-0001" num="0000"><ul id="ul0072" list-style="none"><li id="ul0072-0001" num="2078">for official setting, we look for jackets and ties,</li><li id="ul0072-0002" num="2079">for military setting, look for guns and uniforms,</li><li id="ul0072-0003" num="2080">for family gathering, look for kids and grand parents or people at different ages,</li><li id="ul0072-0004" num="2081">for class reunion, look for people of the same age and banners stating a university or high school name, plus graduating date, e.g. 1977,</li><li id="ul0072-0005" num="2082">for primary school student picture, look for a lot of kids of about less than 12 years old,</li><li id="ul0072-0006" num="2083">for graduation from college, look for graduation gown and cap,</li><li id="ul0072-0007" num="2084">for prom dance event, look for prom dress and limousine,</li><li id="ul0072-0008" num="2085">e for black tie event, look for black tie dress and jacket,</li><li id="ul0072-0009" num="2086">for Olympics medal ceremony, look for Olympics sign and medals around the neck,</li><li id="ul0072-0010" num="2087">for Oscar Academy Awards event/night, look for Oscar symbol or statue,</li><li id="ul0072-0011" num="2088">for Karate class, look for Karate belt and outfit, and the like.</li></ul></li></ul>
These relationships come from expert humans, or many human voting or inputting, or from trained computer learning machine, or extracted from millions of relationships from a huge observation sampling or history file or database. See e.g. <figref idref="DRAWINGS">FIG. 150</figref> for such a system.
Other examples are: <ul id="ul0073" list-style="none"><li id="ul0073-0001" num="0000"><ul id="ul0074" list-style="none"><li id="ul0074-0001" num="2091">for family membership (look for hugging, kissing, how close people stand in a picture, smiling in a picture, casual dressing, vacation setting in the background, similar faces, similar clothing, at a dinner table at home setting),</li><li id="ul0074-0002" num="2092">for happiness (or misery, despair, anger, emotion, or mood) (look for the shape or expression or size or angle of mouth, face, eye brow, eye, color of face, or lines on the face, based on stick diagram defining laughing or other expressions or moods, or based on formulas defining those expressions, or based on curves defining those expressions, either analytically stored as curves or graphically stored as pixels, or based on thousands of faces stored from real people, tagged for expressions on their faces, for learning samples, as supervised learning),</li><li id="ul0074-0003" num="2093">for closeness (or friendship) (look for how close the subjects are to each other in the picture, as how many people are in between, or how tight they stand close to each other, or how hands hold each other and where they are located with respect to the body, which can be also trained with thousands of already tagged pictures by people or experts, as one way of doing it, or can be understood based on the relationships of objects, es. first person's hand (H<sub>1</sub>) behind (or covered by, as function C<sub>B</sub>) the second person's shoulder (S<sub>2</sub>), indicating hugging, indicating closeness or friendship, or mathematically expressed as, when finding the objects and ordering of objects in the image: C<sub>B </sub>(H<sub>1</sub>)≡S<sub>2</sub>) (Note that all objects in an image can be analyzed, to find which is front and which covers what, with mathematical relationships, as indicated above. Once part of the object, as expected, per our expectation (e.g. from shapes stored in a database for that name or object), is missing in the image, that is an indication (of most likely) that part of that object is behind another object, in that image.),</li><li id="ul0074-0004" num="2094">for intelligence of the person or sophistication of the person (look for book in hand, standing near a library or concert hall or museum, degree near his title or name in text, titles on the door or email, his friends, his/her family members, her job, her SAT score, her GPA, her resume, her publications, or degrees in the frames on the wall or on desk),</li><li id="ul0074-0005" num="2095">for gender of the person (look for dress or clothing, hair cut, shoe, accessories, name, size or weight or height value or ratio, habits, title behind the name (such as “Mr.”), favorite video game or movie or actress, and color of choices) (Note that these are still not deterministic at all, same as other parameters and indicators mentioned above. That is, sometimes, stereotypes and generalization are very misleading. However, using combination of all data and relationships and aggregating them using our analysis on our “Z-web” increase the accuracy and reliability of the recognition.),</li><li id="ul0074-0006" num="2096">for style of the person (look for clothing or hair cut or shoe or glasses or wine choices or drink choices or car or watch),</li><li id="ul0074-0007" num="2097">for location of the picture (look for monuments or famous buildings or names or landmarks or entails indicating the locations of next vacation or tickets for airline or passport stamps),</li><li id="ul0074-0008" num="2098">for year (in which the picture was taken) (look for clothing style, text, objects in the background, such as cars or building, hair style, name of famous actors, name of movies on display, the president of the country, or tags or dates on the picture or image),</li><li id="ul0074-0009" num="2099">for political affiliation (look for tag on the car or bumper sticker or pictures on the wall or affiliations or clubs or friends or geographical area or job or title or essay in school or courses taken in college or food choices or vacation choices),</li><li id="ul0074-0010" num="2100">for country (in which the picture was taken) (look for landmarks, names, tags, signs, street names, architecture, pictures on wall, language on signs, people's faces, stores, cars, license tags, having snow on ground, type of trees, type of foods, politician names, national hero, famous athlete, famous singer or artist, or TV programs),</li><li id="ul0074-0011" num="2101">for language of the location (in which the picture was taken) (look for names, tags, signs, street names, architecture, language on signs, people's faces, stores, license tags, or TV programs:),</li><li id="ul0074-0012" num="2102">for time of the day (in which the picture was taken), season or month, or special occasion (New Year celebration at Times Square in NY City, Christmas, wedding, or carnival) (look for Christmas tree, decorations, snow on ground, trees with no leaves or colortial leaves, big dock on the tower, position of Sun in sky, light or darkness, frozen lake, ice fishing, or winter sports),</li><li id="ul0074-0013" num="2103">for special location (Disney Land, cruise trip, on the Moon, Grand Canyon, or near Eiffel Tower) (look for landmarks, text, or structures),</li><li id="ul0074-0014" num="2104">for temperature of air (in which the picture was taken) (look for steam or fog, rain, snow, ice, people with bathing suit, beach, ice skating, snow man, sweat on face, Sun reflecting on a shiny metal object, thermometer, thermocouple, or weather channel on TV),</li><li id="ul0074-0015" num="2105">for humidity (in which the picture was taken) (look for steam or fog, rain, snow, ice, sweat on face, mold, green and dense vegetation, or rusty cars in the street),</li><li id="ul0074-0016" num="2106">for time zone (in which the picture was taken) (look for location landmarks, country, city, names, text, clock, region, marker on the map, flag of the country, or email time record),</li><li id="ul0074-0017" num="2107">for altitude or location on the planet Earth (in which the picture was taken), height (in which the picture was taken), or depth (in which the picture was taken). (look for landmarks, signature characteristic, perspective view, or indicators of coordinates or locations, such as cloud in sky or fish in deep sea),</li><li id="ul0074-0018" num="2108">or for environment (e.g. cloudy, rainy, war zone, or foggy), as sonic examples, or the like. (look for indicators or signatures, such as fog, cloud, wet street, tanks, soldiers, and ruins in a war zone).</li></ul></li></ul>
In one embodiment, the information on the camera phones (on its memory, processor, or controller module), or on image (as text), or tagged as a header or file or comment to the image, e.g. GPS (location), date, lens data, focus information, and the like, are used for location of the picture, e.g. specific city and monument, or date, e.g. Jul. 4, 1999, 4:30 pm, or focal length, or estimate of distances in the image, or the like. These can be used for correlation with other objects and within themselves. Thus, we can input this information into our Z-web, as new nodes and Z-factors, for recognition purposes or reliability analysis.
Different Components of Recognizer:
The recognizer module has many sub-components, to do analysis on text, e.g. OCR, image (e.g. image recognizer), video (e.g. video analyzer), voice (e.g. voice analyzer), music, taste, numbers, patterns, texture, faces, names, records, tables, lists. “big data”, and the like, as input modules, to gather, analyze, and aggregate, to find the relationships between objects and concepts, based on the reliability, confidence, truthfulness, probability, and possibility, as discussed elsewhere in this disclosure, to build the “web of relationships”, which we call “Z-web”, and to find or recognize or validate or confirm other or same objects or concepts or relationships. See e.g. <figref idref="DRAWINGS">FIG. 151</figref> for such a system.
For constructing the Z-web, we can use various types of input, to build up relationships as described above, e.g., but not limited to: image, video, text, sound, voice, music, biometrics, table or list, tag, comment, metadata, multimedia or movie, link to information or web site, header, summary or abstract, record or database, listing, matrix, geometrical shapes, symmetrical shapes, patterns, symbols, abbreviations, encyclopedia or dictionary, personal data or preference, historical or geographical data, physical or chemical data, and/or mathematical facts, or the like. <figref idref="DRAWINGS">FIG. 172</figref> is an example of such a system.
Adjusting Colors:
All colors look the same in a dark room, or in a picture with low light intensity, e.g. picture taken at night with no flash on the camera. So, in terms of recognition of a face, a normalization or adjustment is needed to convert the color or intensity of the pixels for a face in a dark image, to correct the color and intensity, toward the original normal color, toward real color, as a pre-processing, before recognizing the face, by face recognition module, to increase the accuracy of such recognition. The adjustment is based on the environment and background, so that color and intensity of pixels of the face is changed or corrected, such that the background becomes corrected to the normal or expected background, as if it were with/under enough light illumination,
Contrast Correction or Adjustment:
Let's assume that the intensity of a specific pixel P<sub>1 </sub>is I<sub>1</sub>. If P<sub>1 </sub>is in the middle of patch of low intensity pixels I<sub>2 </sub>(as the first environment), it (i.e. the apparent intensity, I<sub>12</sub>) looks much brighter than to the average human eye, compared or with respect to the situation when P<sub>1 </sub>is in the middle of patch or region of high intensity pixels I<sub>3 </sub>(as the second environment), where I<sub>1 </sub>looks darker, with low intensity (i.e. the apparent intensity, I<sub>13</sub>), to the human eye. That is, the perception of intensity, for recognition, by human eye, is dependent on background or context or contrast to the surroundings. Mathematically, it means that, for intensity, for human perception:
<br />I<sub>13</sub><I<sub>12 </sub>
Now, the machine (measuring the exact intensity) does not make such a mistake, and measures the exact intensity, regardless of contrast to the surroundings. So, to normalize the machine or real measurements with human perception, to adjust for such perception difference, one has to adjust for the ratio (I<sub>R</sub>) of (I<sub>13</sub>/I<sub>12</sub>), between the given image in the first and the second environments (2 different environments). Thus, the number I<sub>R </sub>is our correction factor. So, starting from real intensity measurements, to go to the human domain or perception, one has to adjust the intensity by I<sub>R </sub>as our correction factor, to get the perception values or apparent values, relevant to the human perception. To go in the reverse direction, i.e. from human perception to the real intensity values or measurements, one does the correction or modification based on the inverse of value I<sub>R </sub>or (1/I<sub>R</sub>), After the adjustment, or pre-processing, the face recognition or any recognition is performed, resulting in better accuracy and reliability for recognitions.
Searching and Extracting Information from the Images or Other Data, Using Z-Web:
In one embodiment, for pictures or images from the Internet, or other data, we find e.g. the web site by search bot or robot, and then extract the relevant information and tag them or put a summary of that image or web site or list the extracted information in a database or put the relationships and relevance and reliability factors (and other Z-factors mentioned above) into our Z-web or on our own server(s) or computer network or server farm (called Q<sub>store </sub>storage or module or computer or server). Now, a third party user can look at our Z-web, or other information mentioned above and stored on our Q<sub>store</sub>, to use or extract or search or download those data, for a fee or for free, based on different business models, such as ad revenue on our web site.
Basically, in one embodiment, the data extracted and collected and aggregated by us for our Z-web or our Q<sub>store</sub>, based on an image on a web site (as an example), is sitting as an extra layer on top of the web site, so that the user can access and get more information from the web site, through our Z-web or our Q<sub>store</sub>. There are many ways to do this process. In one embodiment, the user U is at his PC (or mobile phone or device), with a browser, which goes to a web site W<sub>site </sub>and is interested in a data D<sub>site </sub>on W<sub>site</sub>, e.g. an image or text data or tel. number. Since W<sub>site </sub>was previously scanned by search bot, and all the relevant information regarding D<sub>site </sub>was extracted, analyzed, and stored in our Q<sub>store </sub>(e.g. in a remote location), then the user U can manually go to Q<sub>store </sub>to get more information about D<sub>site</sub>, as one embodiment. In one embodiment, the user automatically goes to Q<sub>store </sub>to get more information about D<sub>site</sub>. In one embodiment, the user optionally goes to Q<sub>store </sub>to get more information about D<sub>site</sub>.
In one embodiment, the information stored in Q<sub>store </sub>is also stored in W<sub>site</sub>. In one embodiment, the information stored in Q<sub>store </sub>is instead stored in or moved to W<sub>site</sub>, as an extra layer or shell or attachment or tag-along file. In one embodiment, the information stored in Q<sub>store </sub>is also stored in multiple places for easier or faster access, e.g. server farm or mirror server or backup server or redundant server, e.g. in another location. In one embodiment, the information stored in Q<sub>store </sub>has an expiration date, after which the information extracted from or related to D<sub>site </sub>is updated or re-extracted. In one embodiment, the network including W<sub>site </sub>is the Internet. In one embodiment, the network is a private network. In one embodiment, the user can e.g. do a search or query and look for some object on Internet, using a plug-in and a browser, to go to the web site W<sub>site</sub>, and then from that web site, go to our database or Z-web or Q<sub>store</sub>, to get the information extracted from the web site, automatically. Alternatively, the user can go directly to Q<sub>store</sub>, using a plug-in and a browser, to get the information extracted from the target web site W<sub>site</sub>.
In one embodiment, the process above is done with no plug-in. In one embodiment, the whole process is done automatically. In one embodiment, the whole process is done with the input from the user, or partially by user, or optionally chosen by user. In one embodiment, when the mouse is over an object or hover over it, the whole process is initiated automatically, e.g. a picture in a web site or name in a text is selected (e.g. by mouse or pointer or user's finger on touch screen, or on monitor or display or pad or input pad or device, or hovered over by finger or mouse without touching or touching, or by magnetic proximity or heat proximity from body, or capacitance changes or by electrical resistivity changes or pressure or piezoelectric changes, or RFID tag proximity, or image of finger recognition or fingerprint recognition or biometrics validation, or car key holder or ring proximity, or finger gesture or face gesture recognition, or finger stroke or sign recognition, or series of finger strokes pattern recognition). Then, the relevant information is obtained from Q<sub>store </sub>about that text or image, and automatically shown or presented to the user, which is very convenient and useful for the user on Internet or any private network.
In one embodiment, the web site W<sub>site </sub>can also request, generally or per usage, to have the information on Q<sub>store</sub>, be also displayed on their web sites, or added or stored or tagged or linked or shown in their menus, based on another plug-in or code or predetermined arrangement with Q<sub>store</sub>, for direct usage of their users or visitors. So, it would be a value added for them (W<sub>site</sub>), for convenience of their users or visitors. Thus, it would be a source of income for the operator of the Q<sub>store</sub>, as a service to W<sub>site </sub>or licensing the software or increased traffic for W<sub>site</sub>, e.g. for ad money or income, to benefit the operator of W<sub>site</sub>, e.g. as the client or customer for Q<sub>store </sub>operation, e.g. as its business model. In one embodiment, the information from Q<sub>store </sub>is supplied to the user directly, e.g. for mobile users or phone owners, per usage or per month or per subscription, for a separate business model or income source. In one embodiment, due to the value of the information from Q<sub>store</sub>, the Q<sub>store</sub>, itself, can have its own web site and direct visitors, for its own ad revenue, traffic, and referral income. In one embodiment, the web site includes text, image, tel. numbers, links, video, voice, music, and the like. See e.g. <figref idref="DRAWINGS">FIG. 175</figref> for such a system, for one of the embodiments.
In one embodiment, an informational/graphical reader or renderer process (e.g., a web browser or a software application to view files or content such as a PDF reader or a word processor) runs on a device (e.g., a user device) that takes the content deliver from network (e.g., from a web server, file server, document or content server, web service, or an on-line application running on Cloud or distributed network of servers). In one embodiment, the reader/renderer process receives data (e.g., Z-web data for the annotation of an image identifying people on the image) related to a resource (e.g., the image) referenced or provided by the delivered content, based on (e.g., an automatic) query from the reader/renderer process (or a plug-in or another process running on the user device) to Q<sub>store</sub>, related to (e.g., identifying) the resource (e.g., by its URI, identification or location within content or document, and/or metadata such as date). In one embodiment, the reader/renderer process modifies/overrides/supplements the display/play back or presentation of the resource (e.g., on the user's device), by using the received data (e.g., from Q<sub>store</sub>) including the user interface interaction (e.g., by creating links and displaying annotations on the image). In one embodiment, further user interaction with the modified user interface based on the received data, invokes further queries to Q<sub>store</sub>, to fetch more data about the item selected (e.g., information about the person so annotated in the image). An embodiment makes the content (such as images) whether in web page or a document link to other knowledgebase entities by fetching the content in an automatic search (e.g., by bots or background processes), analyzing the content within a context and/or by using feature detectors/classifiers, importing the features of the content into Z-web, using the knowledgebase to automatically annotate the content and associate such annotation with the content (for a later search), e.g., via indexing.
In one embodiment, the network entity delivering the content does not include a reference to Q<sub>store </sub>(e.g., resources, API, or query) embedded with its delivery content to the reader/renderer, and a query (e.g., automatic) is initiated be a process in the user's device (e.g., reader/renderer process) to fetch data related to the resources in the delivered content. In one embodiment, the network entity (e.g., a web site, W<sub>site</sub>) has the content embedded with resources, API, query, or tags referencing Q<sub>store </sub>and the renderer/reader uses such embedded resources to fetch data from Q<sub>store </sub>or to display/playback the content (e.g., included the use of scripts such as Javascripts).
In one embodiment, the reader/renderer sends information to Q<sub>store </sub>or a server, when for example, the user enters annotation on a resource such as a portion of the image. In one embodiment, the information is tagged with the user's ID (e.g., is logged in). In one embodiment, the sent information is queued for analyzer to incorporate into Z-web. In one embodiment, the plug-in provides the user interface to enter/edit annotations on the user's device. In one embodiment, a local service or process running on the user's device provide a local Q<sub>store </sub>or Z-web on the user's device, e.g., giving local access to the user's auto-annotated photo albums, using other database (e.g., email or contact) to automatically build the relationship links between people appearing in the photos and appearing in the email to/cc lists. In one embodiment, the local Q<sub>store </sub>or Z-web may be synchronized with those on the network (or Cloud). See e.g. <figref idref="DRAWINGS">FIG. 175</figref> for such a system, for one of the embodiments.
Partial Matching:
In one of our embodiments, we have a partial matching on objects hidden or covered behind others, or partial understanding or recognition of patterns hidden or covered by other objects, or not fully visible for any other reason, such as bad or dirty or foggy lens on camera. We compare the partial pattern or image of the first object to the library of all possible objects in that setting or environment, for partial match, with assigned reliability, based on the estimated percentage of the visible part of the first object, to put or incorporate it in the Z-web, where the recognition is enhanced based on the multiple inputs from other sources to cross-verify and cross-recognize, as described elsewhere in this disclosure, even using partial recognitions with not full reliability, per object, or node on Z-web.
Here, we give an example for partial matching for image, but this method can be used for recognition or verification of text, sound piece, series of music notes, signature, fingerprint, face, or any other feature or object or pattern, that is partially lost, obscured, hidden, erased, or not detectable/visible.
In one example, we have the first object being partially-matching with η objects in our target library (e.g., T<sub>O1</sub>, T<sub>O2</sub>, . . . , T<sub>On</sub>). with different overall reliability factors, R<sub>F1</sub>, R<sub>F2</sub>, . . . , F<sub>Fn</sub>, respectively, for the full match. For example, part of the first object matches with part of n objects in our target library. For example, a “handle” (or an object which looks like a handle), as a part of the first object, may be a part of (a handle for) a kettle, as first target, or part of (a handle for) a bottle, as a second target. First, we determine how much the handle of the first object matches the handle of the kettle, and matches the handle of the bottle, and so on, as denoted by M<sub>O1</sub>, M<sub>O2</sub>, . . . , M<sub>On</sub>, respectively (for example, using matching or recognition confidence or score). Then, we determine the percentage of size or importance or contribution or dimension or ratio of a handle with respect to kettle, and with respect to bottle, and so on, as denoted by P<sub>O1</sub>, P<sub>O2</sub>, . . . , P<sub>On</sub>, respectively (for example, using the ratio of the sizes or dimensions or number of pixels).
Now, in one embodiment, the overall reliability factors, R<sub>F1</sub>, R<sub>F2</sub>, . . . , R<sub>Fn</sub>, for the full match, is based on (P<sub>O1</sub>M<sub>O1</sub>), (P<sub>O2</sub>M<sub>O2</sub>), . . . , (P<sub>On</sub>M<sub>On</sub>), respectively. (In one embodiment, the relationship can be more general, i.e. as a function of those values (F<sub>f</sub>), or written in terms of: F<sub>f</sub>(P<sub>O1</sub>, M<sub>O1</sub>), F<sub>f </sub>(P<sub>O2</sub>, M<sub>O2</sub>), . . . , F<sub>f</sub>(P<sub>On</sub>, M<sub>On</sub>), respectively.)
So, the maximum or optimum reliability factor corresponds to (as a Maximum function, for taking the Max values on multiple parameters):
<br />Max ((P<sub>O1</sub>M<sub>O1</sub>), (P<sub>O2</sub>M<sub>O2</sub>), . . . , P<sub>On</sub>M<sub>On</sub>))
Let's assume that the Max function above yields (P<sub>Ok</sub>M<sub>Ok</sub>), as the k-th term in the series above. That is:
<br />Max ((<i>P</i><sub>O1</sub><i>M</i><sub>O1</sub>), (<i>P</i><sub>O2</sub><i>M</i><sub>O2</sub>), . . . , (<i>P</i><sub>On</sub><i>M</i><sub>On</sub>))=(<i>P</i><sub>Ok</sub><i>M</i><sub>Ok</sub>)
Thus, the k-th object is the best target object for the full match.
Now, in addition, we can construct the relationships, to put all n objects in our target library into the Z-web, as described elsewhere in this disclosure, to find or recognize the best target object(s).
In one example, the problem is generally false positives, for recognition of target objects, but in one embodiment, with keeping track of reliability in our Z-web, we can tame that false positive rate to a reasonable quantity, making Z-web an extremely useful tool and technique for this type of situations.
Tags and Comments for Pictures and Images:
Picture annotation and caption is useful for recognition of people in the image, e.g. looking for phrases such as “from left to right”, or “top row”, to find location of faces or people in the image, and order them in rows or columns, and then call or label them as objects or persons P<sub>R1</sub>, P<sub>R2</sub>, . . . , P<sub>RN</sub>. as placeholders for names, and then compare them with the names coming after the flagged phrases such as “from left to right”, to get names matched with placeholders P<sub>R1</sub>, P<sub>R2</sub>, . . . , P<sub>RN</sub>. For recognition of names and flagged or pre-designated phrases, we use OCR and then basic or full natural language processor module.
In one embodiment, we can simply look for specific words such as “left”, as flagged words, and if successful, then look for specific phrases, such as “from left to right”, as flagged phrases, from our library of flagged phrases and words, pre-recorded and stored, or dynamically adjusted and improved through time, without actually understanding the meaning of the full text and sentence, for fast picture analysis and matching names or tags or comments related to the pictures.
In one embodiment, we can ask the user or third party, e.g. friend or public, to tag names or objects, or as crowd-sourcing effort or by voting scheme, e.g. paid service or free, or they do it on their own, because e.g. the (assuming unbiased) people familiar with a person may be the best or most reliable people to tag the album or pictures of that person, as an example. In one embodiment, the indicators can be used for approval, confirmation, or increase of reliability factor, such as “Like” for a picture or comment on FACEBOOK®, as an indicator of approval by a friend or third party. In one embodiment, the voting or survey is used for measuring approvals. In one embodiment, the comments after a video or picture is used, e.g. as overall positive or negative, e.g. “Great picture!” indicates approval and conformation of a third party.
In one embodiment, the number of comments, number of views of a video, minutes watched for a video, length of comments, frequency of comments, date of recent comments, number of independent commentators, traffic of a web site, number of independent visitors to a site, number of followers on TWITTER® or other sites, number of connections, number of links, size of linked sites, quality of linked sites as rated by a third party, e.g. family-approved. sites, number or size of advertisements or advertisers, marketing budget, income, revenue, number of cited references by other sites or parties, e.g. for a research paper or patent or case law, or the like, might be indications for approval or reliability of source e.g. news, e.g. CNN-TV channel.
In one embodiment, the system automatically tags the pictures, and in another embodiment, it asks the user for verification. In one embodiment, it searches for a person in the album and sort based on that person(s).
Images from Different Angles or Views:
For example, we take pictures of the Eiffel tower from different angles, for training purposes, and store them, e.g. from top view and side view or from underneath. Some of the views are not common, and thus, unfamiliar to average human or eye. For example, if a picture of the Eiffel tower is taken from an airplane from exactly the top, the shape from the top may look like a square inside a bigger square, which does not look the same as a regular tower at all (or our average expectation or view of the tower). Various views help the recognition of the tower or object, as they can correlate or refer to the same object, which increases the reliability factor of the recognition or the recognized object.
In one example, given a picture, which includes a square inside another bigger square, the picture may also resemble another 2<sup>nd </sup>object, other than the Eiffel tower, in our library of the objects in the universe or at the specific location or city. Thus, other input information in the Z-web is used to increase the reliability of the data, and recognize the object, e.g. text or voice associated with the image.
In one example, given a picture, which includes a square inside another bigger square, one has to find the orientation of the image, from some templates in the library, or from thousands of training samples of many objects tagged versus direction and view by human or expert. The images in library can be real pictures or computer generated or drawn models, which compares shapes with each other, to find the best match, which indicates the view, e.g. “view from the top”. Once the direction or perspective of the view is determined, we can store that information into Z-web, to integrate with the rest of the information about the tower or object.
Pixel Patterns, as Feature Vectors:
For an image, we define the square cells, e.g. 32×32 pixels or 8×8 pixels. Generally, each pixel has 8 neighbors, such as top-left, top-straight, and so on. We start from one neighbor and go around all neighbors, e.g. in the clockwise direction. We compare the center pixel with each neighbor. If the difference of the center value minus a neighbor value is above a threshold, e.g. 30 points in pixel value, or above a relative size, e.g. above 35 percent, then we put “1” for that position. Otherwise, we put “0” for that position.
In another embodiment, we can do this with bigger range of assignment, instead of assigning only 0 and 1. For example, we can use 0 to 3 (or 0 to 7 range), to classify for finer differences, for difference between the center pixel and the neighbor pixel. Of course, we have a bigger overhead in this case, for computation power needed and for storage.
In either case, we end up with a cell with a bunch of numbers assigned for each pixel. These numbers indicate the local pattern of differences between neighboring pixels. In another embodiment, we can represent those assigned numbers in binary format for easier comparisons, as comparing 0 and 1 per position in digit order is very simple, using e.g. XOR logical operation. Now, we can use a histogram for over the cell, for the frequency of each assigned number in the cell, as an indication of the frequency of that difference or pattern in the cell, and also in the whole image. In one embodiment, we can normalize the histogram, for comparison of different histograms, based on the average values or median values or based on the ratio to the maximum value, i.e. ending up with fractions less than 1 for all values, which is more computing intensive. The histogram for all cells is an indication of the pattern in the image or feature vector, e.g. bar code black and white lines, or patterns or checkered or striped shirt or tie or fabric.
Now, the support vector machine and other classification methods can be used to classify the patterns or recognize the patterns or textures, such as for face or fingerprint recognition. The face recognition, as an example, can have multiple target people for comparison in the database of faces. If the new face is matched with one of the faces in the database, nothing new is created in the database. Only, the new face is tagged along or referenced, e.g. with a pointer, with the matched face in the database, as the variation of the person's face already in the database. However, if there is no match, a new account is created for a new person. if there is no name yet available, we add it under NO NAME category, using generic names of NONAME1, NONAME2, NONAME3, and so on, until we find a name match later on, which replaces the placeholder in every instance. For example, “John Smith” replaces NONAME3 in our Z-web configuration. Placeholder is also useful in the Z-web for names with low reliability, as “John Smith” does not replace NONAME3 in our Z-web, in this example. Instead, it creates another node, as a property of NONAME3, as a new node connected to NONAME3 node, with the value of assigned “John Smith” for the new node.
In one embodiment, we classify the faces already in N<sub>face </sub>categories, e.g. 105 major types, based on regions of the world or shapes of faces, as a first level coarse classifier, so that the second level is a finer classifier to find a person. Or, if the number of faces in target database is huge, then we may need a third super-fine classifier, or even more levels of hierarchy for classifiers, feeding each other in multiple levels, for more efficient and faster classifications. In one embodiment, a human or expert or an already learned machine helps the training of a set.
Rule Templates Database:
In one embodiment, we have an image and we extract multiple objects from it, e.g. table and bottle, in which part of table is hidden or covered by bottle, which means table being behind bottle, referring to the positional situation of (from our position or relative location library): “bottle on the table”, or in general, object A located on object B, or also, meaning that object A closer to camera position than object B, which are stored in our Z-web. Then, later on, one can search or query about the position of the objects and their relative locations, to extract these relationships. One advantage is that in Z-web, if object A is behind B, and B is behind C, then on the relational position between objects, one can conclude that A is probably behind C, for which such a template of rules are stored to support the Z-web, to help relate objects or simplify relationships, with the rule in a database of rules for Z-web, under category for positions of objects. Mathematically, the rule can be written as, where the function BE is the “Behind” function or operator:
<br />If [ [<i>B</i><sub>E </sub>(<i>B</i>)=<i>A</i>] & [B<sub>E </sub>(<i>C</i>)=<i>B] ]</i>
<br />Then [<i>B</i><sub>E </sub>(<i>C</i>)=<i>A]</i>
In general, the other logical relationships can be stored the same way in Rule Database engine (library), such as for “time”, or “over”, or “more”, or “before”, or “stronger”, or the like. For example, for “time” operator, if time A is before time B, and time B is before C, then A is before C. This can also be written similar to “Behind” function, in mathematical form, for template, for Rule Database. If the template is very similar for time and space, one can use a single super-template, as generic template, for both situations, to reduce the number of templates and increase efficiency, in some embodiment. See e.g. <figref idref="DRAWINGS">FIG. 173</figref> for such a system.
Rule database and templates can also have their own Z-web, relating the concepts, logic, relationships, and formulas, which can simplify the templates or get rid of the contradictions or inconsistencies. As an example, if we are not sure about a formula, we can store that as a rule in rule database, as a node with low reliability, which can be fixed, modified, or eliminated later on, on the rule database Z-web, which can be handled separately from our original Z-web structure. Alternatively, the 2 Z-webs can be combined as one super-Z-web, as explained elsewhere in this disclosure, with a common node being the object under study, such as “time”.
Image Analysis:
In one embodiment, architectural building signature is an indication of a region or culture, e.g. mosque arches in the Middle East, or white buildings near beach on the cliff, as Mediterranean style near Greek islands. The databases of famous people, pictures, paintings, locations, historical buildings, monuments, books, authors, architecture of cities and locations, and the like are incorporated with our analytics engine. In one embodiment, using OCR, we can extract the name of the book on the bookshelf in the picture from the library or book store, or name of the store, or name of the street, or name of the person on the door, or name on the business card, to find the person, address, business, or taste, or correlate them together, as some examples.
In one embodiment, the facts may dictate some limitations in the universe of possibilities. For example, the “snow” in “July” may indicate that we are in the Southern Hemisphere (of planet Earth), or the picture was taken from such a location, limiting all possible locations on the planet for candidate for picture location. See e.g. <figref idref="DRAWINGS">FIG. 152</figref> for such a system.
In one embodiment, travel guide is a good source of data for geography or history or facts. In one embodiment, the picture of an article either relates to the author or the subject of article. So, the face or person or author's name from caption or article or title or footnote should be extracted for comparison and classification or recognition of the picture or image. In one embodiment, the picture of an article in a web site is just an advertisement, i.e., nothing to do with the article itself. In that case, we have to figure out that it is an advertisement, from the caption or from subject matter or title or position on the web page or frequency of updates or functionality of the image. So, we have to partition the web page accordingly. In one embodiment, the GPS data or location data or time data. or metadata, associated with a picture in a phone or camera, are used for data for Z-web for that picture.
In one embodiment, wax museum or movie setting is an indication of non-real people, even if the person looks like a famous people in the database. In one embodiment, a picture in a picture is analyzed, e.g. a picture in a movie or video frame, whereas the movie frame represents live humans in 3-D, but the picture frame on the table in the movie represents a 2-D image of a picture of a person, not a real person in the movie or video. Because to analyze the video, the 2-D image and the 3-D image may have different consequences and interpretations, e.g. as to who is related to who in the video. The 2-D picture frame on the table has specific signatures, e.g. it does not move around with respect to the other objects in the video, and has a constant coordinate.
In one embodiment, we have a database of famous people or US Presidents, e.g. George Washington, and database of famous places, e.g. Mount Vernon Estate, relating the two subjects or objects, as one being home of the other object. So, if we get a recognition of one object, automatically, the system looks for the other object in the vicinity, in terms of text or location or time or related objects or concepts, as expectation for other object(s) to be around. That also helps confirmation of validity of the recognition. That also helps building up reliability factors for the Z-web structure, and expanding the Z-web.
Street Scanners:
In one embodiment, we have satellite or aerial images from buildings and streets, and if a new building is shown in a new image from this year, compared to last year's photo, then we send the “street car 3-D photographer street scanner” back in that street, to scan the new building and scene, as an update (using multiple cameras from different angles and views, on the car, plus scanner, on a rotating table, with UPS or location determination module, plus calibration images or data, to adjust for coordinates and views, with redundancies on images or data, to glue pictures together seamlessly, and to correct the fringes in images or corners, or to correct mistakes in images or coordinates or 3D views). If no new feature or building is detected, no new update on street level for street view is needed for the city map on the computer or web site. So, we are looking for features or deltas or differences, with respect to last year's or previous picture(s). Thus, we compute the difference between 2 images, from this year compared to last year, e.g. using simple difference or subtraction of values, pixel by pixel.
In one embodiment, from the amount of the differences in images, the system determines how often or when next time the street scan is needed or proper, to be dispatched or scheduled, based on importance of the city map for the users, and being up-to-date as much as possible or to what degree, in terms of financial value for the users or advertisers or local businesses or city hall or tourists or residents. If they have a fleet of those scanning cars, then the schedule is set to optimize the usage of those cars in different neighborhoods or cities, so that they get the best value for the users, based on differences in images in terms of amount and its frequency, user base and value per city or neighborhood, cost of operation of those scanning cars, and distances between the neighborhoods, to get most coverage and value, with minimum cost or mileage on the cars, or smaller number of scanning cars used.
Camera Corrections:
In one embodiment, the lens of the camera. is scratched or dirty (e.g. with dust on the lens or oily lens, diffracting the light) or defocused or otherwise foggy and degraded (e.g. as if the transformation of F<sub>image </sub>(x) is applied to each pixel). Then, the picture does not come out very well, and the recognition of murky objects in the image is very difficult and with a high error rate. So, we filter the image, first, as a pre-process, to focus the image, as the reverse of the lens problem, as a reverse transformation on the image, or F<sub>image</sub><sup>−1 </sup>(x), applied to each pixel, to produce the corrected image. Then, we perform the recognition step, on the sharper or clearer objects or images, for improved recognition rate.
In one embodiment, for a camera taking pictures of an object, we have a family of transformations of F<sub>image </sub>(x) on the image or pixels, separately designed for each of these situations, to mimic the situation or effect on pixels or image: e.g. camera shaking, camera tripod shaking, object shaking, object moving in linear fashion, object rotating, blurred lens, dirty lens, scratched lens, oily lens, defocused lens (e.g. too far or too short for focal length), off-axis lens (e.g astigmatism or refractive error of the lens), dust on the lens of camera, and the like, which are the common reasons for blurry or degraded or defocused pictures by a camera. All the family of transformations F<sub>image </sub>(x) are stored in a library or database, for future access. The transformations F<sub>image </sub>(x) are designed or derived based on the optics or physics of the lens or theoretical formulation or analytical or pure experimental or simulation or optics model or physical model or pure curve or pure listing or table or closed form formulation or equation or combination of the above or the like.
Then, for each of these transformations F<sub>image </sub>(x), we derive reverse transformation on the image, or F<sub>image</sub><sup>−1 </sup>(x), applied to each pixel or image, analytically, experimentally, theoretically, in-closed-form, by mapping numbers, by table of numbers, by simulation, or the like. Since we may not know the cause of the problem, or even if there is any problem in the first place, in a given image, we try all or some of the family of reverse transformation (F<sub>image</sub><sup>−1 </sup>(x)) on all images, or on blurry images with bad recognition rate, or only on one or few sample images, to see if the recognition (e.g. recognition rate or reliability, e.g. on some samples) is improved or the blurring is reduced (e.g. based on sharpness of lines or borders). If so, then we know what the problem was for the camera, and we use that specific reverse transformation for all images from that specific camera or lens. If there are 2 or more problems e.g. with the camera, then we need 2 or more (e.g. N) corresponding reverse transformations (F<sub>1image</sub><sup>−1 </sup>(x), F<sub>2image</sub><sup>−1 </sup>(x), F<sub>3imge</sub><sup>−1 </sup>(x), . . . , F<sub>Nimage</sub><sup>−1 </sup>(x)) on the images, applied to the images in the reverse order, to compensate for the problems e.g. with lens or camera. After the images are corrected, then the recognition steps are done, which yield improved results.
If we already know or guess what the problem(s) is, then we just try that corresponding specific reverse transformation F<sub>Mimage</sub><sup>−1 </sup>(x), first. For the improvements, on recognition or blurring, we can have a threshold or rule or criteria or fuzzy rule or rule engine, to stop the process at that point, if we reach the threshold. The threshold can be fuzzy value, or crisp number, or percentage, or relative value or ratio, or absolute number, or the like, as the criteria for optimization.
Let's look at one example. For a defocused image with a defocused lens, we have a situation that e.g. the proper image is not formed on the plane of the film or photosensitive detector. Let's assume that the proper image would have been formed on an imaginary plane behind the current actual plane for the film or photosensitive detector or sensor. Let's also assume, from the geometry of the imaginary plane and the actual plane, the distance between those 2 planes produces e.g. approximately 2 pixel shift, on the actual data, for the current actual plane, because the optical beams or rays or photons hit the actual plane sooner than they should have, due to the defocusing effect of the lens. Thus, in this example, for a pixel (i, j) on the actual plane, to get the corrected value for the pixel, V<sub>C </sub>(i, j), based on the original pixel values, V (i, j), we have approximately the following relationship, based on the neighboring pixel values, from 2 pixel away, e.g. in one embodiment, on each of the 4 directions, e.g up, down, left, and right sides, having 4 component contributions, as the sum of all 4 contributions:
<br /><i>V</i><sub>C</sub>(<i>i, j</i>)=<i>V</i>((<i>i</i>+2), (<i>j</i>+2))+<i>V</i>((<i>i</i>+2), (<i>j</i>−2))+<i>V</i>((<i>i</i>−2), (<i>j</i>+2))+<i>V</i>((<i>i</i>−2), (<i>j</i>−2))
To normalize, we get the average of 4 contributors above, by dividing by 4:
<br /><i>V</i><sub>C</sub>(<i>i, j</i>)=[<i>V</i>((<i>i</i>+2), (<i>j</i>+2))+<i>V</i>((<i>i</i>+2), (<i>j</i>−2))+<i>V</i>((<i>i</i>−2), (<i>j</i>+2))+<i>V</i>((<i>i</i>−2), (<i>j</i>−2))]/4
Or, in another embodiment, we use 8 directions, including the diagonal directions, for neighboring pixels, with 8 component contributions. The method above for calculating the values can be applied to the intensity values, or each color component values, or each property value of pixel, e.g. RGB values or YMCK values or grayscale values. Now, we have the corrected values for pixels which correspond to the inverse transformation mentioned above.
The formulation above applies to all pixels in rows and columns, for all values of i and j. So, we have to scan the image. However, for pixels near the corner or boundaries, which do not have e.g. any neighboring pixel to the top or left, then we repeat the same value again for missing pixels, so that the formula above is still applicable. In summary, at the end, we can correct the image, to reduce or eliminate the defocusing effect, and then apply the recognition module on the corrected image for better recognition.
In one embodiment, we use convolution with a radial function, e.g. Gaussian function, with the variance of e.g. 2-4 pixels (or more), and move it around, to scan the whole image, to get the same effect as above.
Geometrical Analysis:
In one embodiment, homography and projective transformation can be used to compute camera rotation or translation, to account for a new point of view for a person or object, e.g. to match 2 views of the same face, from front and side, from 2 pictures, to match faces or recognize them.
In one embodiment, using filters for sharpening the edges as preprocessing, and then using contrast analyzer, between values of neighboring pixels, as their absolute or relative difference, versus a threshold or percentage, one can find the boundaries of objects (or using any other boundary analyzer). From the boundaries, one can find the corners of the objects, as their intersection of 2 boundary lines, or as the points in which the derivatives or slopes of boundary lines or curves change too much or abruptly or above some threshold. Corner points or boundaries are categorized as interesting points for the purpose of the feature extraction form the image, which collectively make up a feature vector in our feature space. Also, having all the corner points, the shape of the object can be found or named, from the geometrical shapes in the database.
Sorting & Analyzing Data:
In one embodiment, having “big data” coming in as input, we distinguish images in the first cut, very coarsely, e.g. text, medical images, satellite images, human faces, numbers, tables, computer codes, and the like, from their respective signatures and features, in training schemes or against databases already tagged. One example is text in different languages, as a sub-category, in later filtering or narrowing the class further, or typical street maps, which can be trained or learned using millions of samples, from that class or subclass. The learning machine generally works better with more training samples, as long as the samples are reliable (e.g. with high reliability factor, which can be extracted from their corresponding Z-web values).
In one embodiment, when analyzing a Big Data, the system comes up with or extracts some patterns or relationships at the beginning. Then, we store the patterns or relationships as templates for future use. As the time passes, the number of generated templates increases, increasing the value of the library of templates, and increasing the choices and possibilities for templates to fit in. Thus, at the end, we have some templates, from history, as educated guesses. For example, we can offer this as a service on the cloud, with all the templates generated so far, to analyze the data. In one embodiment, we export the templates from another system, into the first system, to add value to the template library. In one embodiment, our system buys or sells the templates from/to another system or source or entity. In one embodiment, the system uses the templates to analyze the data or extract information or data mine the data.
The examples of Big Data or data analytics are on the following data types: unstructured data, structured data, machine generated data, tables, listings, databases, collections, records, financial history, employment history, resume, business process logs, audit logs (file or database), packet data, industrial control system data, network state or status data, web proxy logs, system events, applications logs, click information (e.g. on Internet, web pages, buttons, menus, objects, figures, and the like), database logs, logging API, operating system status, information obtained from sensors or meters or detectors or cameras, web access or network access logs, texting, records, SMS records, call records, TWITTER® records, configuration files, management API, message queue, operating system performances, data from control and data acquisition module, satellite images, input from airport cameras, movie scans, music scans, speech scans, text scans, medical images, library scans, database scans, or the like.
The analysis of the above data e.g. can be used for predicting customer behavior, finding correlations among sources, forecasting sales, catching fraud, finding computer security risks, processing sensor data, social network analysis, feedback analysis, emotion analysis, web click streams analysis, or the like.
Recognizing Objects for Various Applications:
In one embodiment, we identify people in the picture in album or by camera or video recorder, and automatically as default (unless chosen otherwise from the menu), email to all people involved or recognized through the album or from camera or from each picture, from their contact list, if desired, or to all in the event, or share through link or FACEBOOK®. The scope of distribution is set beforehand, for list of recipients. For example, if three people are in one picture, namely John, Amy, and Fred, then that picture is emailed to those 3 people, only. However, the next picture has e.g. 4 people in it, namely, Ted, John, Amy, and Fred, and the next picture goes to all 4 people, including Ted, and so on. The preferences are chosen beforehand for templates or single picture or batch processing, for all or subset of pictures or data or video.
For example, there are 2 people recognized, out of 10 people in the video, from our library. The other 8 people were not in our library or recognition was not successful. Then, a copy or link or track or frame number or pointer or position of the video or web site or storage for the video or specified frame of video is sent to the 2 friends that are recognized from the searched video. That can help for social networking sites and professional settings for a conference call between some co-workers, automating distribution of relevant data, including voice, text, video, or image, that include the name of specific people or image of the person or any related object to that person, found in that text or sound piece or video or image, to be sent to that person automatically. See e.g. <figref idref="DRAWINGS">FIG. 153</figref> for such a system.
This can be used for example for copyright or trademark protections, in which the image including a person's copyright or trademark is sent automatically to the person for review, out of millions of web site pages scanned on the Internet, to find infringers or verify licensee payments, if any. Or, one can send the list of web sites using a specific logo or trademark or patent to a comparison module, to verify against the list of legitimate or paid or permitted licensees in its database, automatically, to approve or warn the related people, by email, pre-recorded voice message, texting, SMS, mail, vibration warning on the phone (e.g. specific vibration or cycle or sequence or variable magnitude or variable frequency), any communication means, or the like. So, it is a useful tool for sending information to relevant people, automatically, by email or tel. (via text, voice, or image) or any other communication means, once the object is recognized in the content under review, and the object is linked to an entity that subscribes to our services, such as friends or corporate legal department, for fee or for free, depending on the business model or purpose of the service.
For example, if I am interested in movies by director A, then any new or old movies found for her name can be automatically sent to me, even if the mention was on text or verbal (sound/voice) at the end of the movie, with no tags or comments. Of course, any tag or comment on the movie regarding that information makes it easier for such a process. Alternatively, those tags and comments can be verified based on the other data extracted from the video directly by Z-web engine, e.g. text or sound naming the director at the end of the movie. For those, we use OCR or voice recognition modules to recognize and convert information for comparisons.
The picture or sound albums or videos can be classified and archived this way, in a cross classification way, using a relational database, for relating e.g. objects, videos, and people together, in a final Z-web structure, and to be searched by the user later on, as a query, or question, about any subject, starting from one node and going to other nodes, even if the user does not know that the second node is related to the first node at the beginning. This is also a powerful search engine and archive, which is expandable by its knowledge base through expanding Z-web size and making more reliable and consistent and truthful branches and relationships on the Z-web, increasing the total value of the Z-web. For example, the same picture or video or voice speech may be referenced in multiple places for multiple reasons for multiple objects or nodes or branches, which can be queried or searched independently, through Z-web.
In one embodiment, we identify objects in the video or images for advertisement purposes, or for consumer purposes, to send ad notices or notify the potential buyers or notify new consumers or notify about new products or requested types of products or products of interest. The object in video, for example, has some relationship with the recipient of the email or communication or texting or notice or telephone call or fax or ring tone or the like, as a way of notification. For example, the relationship came from the Z-web, or the object was chosen by the user, or the class of objects was chosen by the user or third party or randomly by computer, through the menu or the user interface or GUI or tablet screen or tel. screen or by voice recognition command. So, the extracted object can be the subject of an ad, or suggested product, or put into a cart for purchase on web site, or sent to a reviewer, or stored in a database, or broadcasted to many people, or the like.
One can also search using a query for the album, e.g. using a text, to find an object. One example is to find out that, for the identified person in video, what kind of food or drink does he like? Those could be found through the other objects in frames (nearby) in video, e.g. on or near the person's desk or in his hand, holding the drink or bottle. Or, if somebody enters a textual or voice question for the system, as what kind of food or drink he likes? Then, we can use OCR or voice recognition or analysis to get the question, and then use word search or natural language processing or specific flags for key words, to get the meaning of the question, or approximate meaning of that. Then, we apply the method mentioned above, to answer the question(s) or find an approximate answer.
In one embodiment, we identify an object in the video or images, then we remove or edit it, or replace it with another object, e.g. for advertisement or localization purpose. For example, in different countries, different beer (local beer) is used in pictures or movies or ads, for better acceptance as a local favorite or for marketing and higher sales, by replacing one object on the table with another one from library for local objects, e.g. beer bottle, to be put on table, seamlessly and automatically. See e.g. <figref idref="DRAWINGS">FIG. 154</figref> for such a system. However, we may need some adjustment on the background color and texture, if the size and shape of the beer bottles are not exactly the same, for the gaps that have no overlap between the 2 beer bottles. One correction is blurring or averaging or filtering the neighboring pixels around the gaps, or using the neighboring pixel color and texture, to extend inside the gap region(s), to cover the gaps with more or less same or similar color and texture nearby, as extrapolation and interpolation methods.
In one embodiment, we recognize a partial object (1<sup>st </sup>object), which is behind another object (2<sup>nd </sup>object), and for editing purposes, in the image or for movie (for all frames including that object), we bring the full image of the 1<sup>st </sup>object in front of the 2<sup>nd </sup>object, to block the 2<sup>nd </sup>object partially, by the 1<sup>st </sup>object, in effect reversing the order of the objects in the still image or video frames, in any order we wish. The image of the 1<sup>st </sup>object is in our library of objects, which can be obtained from there. Then, the size or color or intensity is normalized to the one in the image, so that we do not feel any abrupt change in size or color or intensity, based on the ratio to the values in the neighboring pixels, or average in a region, or value of pixels near border lines or boundaries. For the perspective, if the 1<sup>st </sup>object is tilted, then either we use the tilted version of the 1<sup>st </sup>object from library (if available), or we morph the image of the 1<sup>st </sup>object in the library slightly, based on translation, rotation, lens, or similar image transformation matrix, to look similar to the tilted image of the 1<sup>st </sup>object, to be replaced, for editing purposes.
In one embodiment, we recognize faces in an album, and find the incorrect tagged ones, or edit and correct them automatically, with or without the user's or owner's permission or review, as multiple options in the software.
In one embodiment, we recognize faces in the album and insert it automatically in the phone display or screen, when the person calls in, to be displayed, with a specific ring-tone, or mentioning the person's name, in voice or text, to inform the receiver regarding the identity of the caller. In addition, the mute vibration mode can have different frequency of vibrations, set for different users or callers, so that they can be recognized by a mix of vibrations at single or multiple frequencies, or using notes or music style beats or vibrations, or using modulated waveforms as vibrations lasting a few seconds, for example.
In one embodiment, we recognize faces in the album and insert it automatically in the email, for sender or receiver, so that it would be easier to recognize the people in the email list, and fewer mistakes will happen for sending an email to unwanted or unintended people. The reverse can also be done. That is, we select pictures from the album, and the email list is generated automatically, from person's identity, which relates to the person's contact information, e.g. email addresses or telephone or fax numbers, which all can be part of the person's Z-web, as the related information to the person's node, represented by neighboring nodes.
Data Extraction, Including Emotions and Taste:
In one embodiment, the signature of the cell phone or ID number for camera relates the picture to the person who took the pictures or owner of the camera, which relates the picture to the friends of owner, which relates the picture to possible targets for people in the picture(s), for recognition. In one embodiment, the pictures from nature or mountain or cities relates to the taste or preference of the owner of the camera or cell phone camera, which relates her to the possible destinations for the next trip, which is helpful for marketing for travel agencies or local ads for products or services for those destinations, such as local rental car companies. In one embodiment, the pictures from a house in camera are used for extracting the taste of the owner of the camera, for the house setting and environment, such as in suburb or wooded area, for future house hunting for the new home buyer (camera owner), which is helpful to the real estate agents, for the preferences of the home buyer, for marketing or efficient house hunting.
In one embodiment, “smiling” in a picture is used to find emotions for the people in the picture or the situation in the image, such as celebration and birthday ceremony, as opposed to sad situations such as funerals. In one embodiment, smiling is recognized using the big library of smiling pictures of real people for comparison or training samples. In one embodiment, smiling is recognized as a symbolic (caricature) basic shape of the mouth versus the general shape of the face, in relation (or with respect) to each other. For example, smiling is defined as a curved mouth with both ends going upward, or a strike similar to a “U”. That is, as long as we can distinguish such a relationship for the mouth with respect to the face, or such a general shape for the mouth, we can tag that as a smiling picture or person. This can be done for any emotions, such as angry, crying, shouting, and the like, for various contexts, for example, a sad situation, for example, for funeral, to relate the black dress and sad situation to family members in the picture or scene, for common loss of a family member, who is possibly the one of the few people missing in the scene or pictures, as extracted from the family tree or family album or family names tagged in the album or FACEBOOK® or similar social web sites, for all names in the whole family. See e.g. <figref idref="DRAWINGS">FIG. 155</figref> for such a system. Thus, missing people in the picture has some significance, as well, when the universe of all people in the family is known, as a complete set. In one embodiment, we have a crisp set with well-defined boundaries and members, and in another embodiment, we have a fuzzy set, with fuzzy boundaries and fuzzy memberships and fuzzy members.
In one embodiment, the emotion is related to the character of the person, mood, intention, future action, state of mind, or psychology, e.g. one person being angry at some event may indicate his sad mood or his intention to spoil the event. These can be modeled through Z-web and Z-nodes.
Another example is when we have e.g. a total of 5 friends in the album for the trip or vacation to Miami Beach in 1995, which means that the universe of all buddies in that trip is 5 people, which is extracted as our system reviews all the pictures from that trip, with maximum 5 distinct faces recognized there, at the end of the evaluations. So, e.g., some pictures have 2 people and some have 4 people in them. For example, the missing person in a picture with e.g. 4 people in it might be the person who took that picture, and he might be the camera owner, as well, if most of the pictures are like that (i.e. him being missing from all or most of those pictures, in that camera).
In one embodiment, we find all objects in a picture and summarize them as data, templates, tags, comments, numbers, and the like, which can also be used for trainings for signatures or features of other images for future. In one example, we have about 5000 different objects in our library, for most often used objects in everyday life, such as shoe and door, which can be sub-classified for fast search and retrieval, such as office furniture. These objects are also represented in a Z-web, as related objects, e.g. computer and mouse.
In one embodiment, the type of beverage, wine, suit, car, fruit, clothing, cigar, and the like are also some examples of taste of a person. In one embodiment, when get some value for an object, then we instantiate all instants of the object with that value, e.g. object in a satellite image is a tank, or in a medical image is a cancer cell or tissue. Meanwhile, we can put a placeholder name for that object, until it is recognized.
In one embodiment, we do multiple steps hierarchy recognition, to get many images and analyze coarsely to put them in the right bins or classes (e.g. picture of people), as preprocessing, and then, go finer and finer analysis or filtering, to get into specific data, e.g. find or locate faces, and then face recognition. Another example is for recognition in different levels, e.g. starting from finding all radiology x-rays, then bone in image, then foot as the subject of the image, then broken foot as the property of the foot, or age or sex of the subject, from the parameters of the image, based on expected values in the medical databases, e.g. for our prior samples or training samples for neural networks.
In one embodiment, we have a face recognition based on the chunks or pieces of face, e.g. recognizing nose or lips, individually and with respect to each other, to confirm that they constitute a face, e.g. with respect to relative position or size. The parameters are all fuzzy parameters, in one embodiment. The relationship and relative position or size can be expressed through our Z-web, as a method of recognition of an object, with all its components, to first see that it is actually a face, and if so, whose face it belongs to, i.e. recognize the person in the next step. The shape and size of the components of a face or object are expressed in fuzzy relationships or fuzzy rules, in one embodiment. Or, it can be stored as a target object or training sample in a database or library or storage, for recognition, training, and comparison purposes.
In one embodiment, from a picture of food plate, the system extracts the objects and recognizes them, e.g. peanut, and from the library, the system gets all the nutritional facts, for proper diet for the user, per day, as accumulated and compared with the special or recommended regimen, for general or for a specific person or patient, to limit or warn the user or to recommend or remind a user, e.g. for deficiency of calcium or for allergy to an ingredient or for conflict between foods and drugs, stored in library for general knowledge and also on a separate database for a specific person, as customized, on her laptop or smart phone or mobile device. In one embodiment, such information is integrated into the routine for exercise for the same user, for scheduling and count and statistics and progress report. See e.g. <figref idref="DRAWINGS">FIG. 156</figref> for such a system.
In one embodiment, for any picture that does not come out right (e.g. no smile, rotated head, or closed eyes), the system tags the pictures for review by the user, or in one embodiment, optionally, the system automatically deletes them from the photo album or frames, or exchanges them with the approved ones or good pictures or neighboring pictures or similar pictures, or leaves them as blank.
Cost of Search:
The cost of search in terms of computational power and delay time is a factor, as how far we want to go deep to get to other related nodes to find other related objects for more complete search, in our Z-web. For example, as one detects a computer mouse, then the system looks for a computer nearby, within the expected radius of proximity between 2 given objects, which is stored in a database or in a Z-web, as a parameter shared between computer and mouse nodes, as explained elsewhere in this disclosure. Thus, for a given computing power and time, one can estimate how deep and wide the search for related nodes is, and what and how many related objects can be obtained or analyzed.
The search or traversing the nodes can be directional or biased intentionally, for example, for one embodiment, for a geographical issue, one may expect more geographical or location related nodes. So, we follow the nodes that are more inclined or related to locations, such as “restaurant” or “coordinate values of a location on GPS or planet Earth”. The selection of branch can be optimized, to go deeper in one branch versus another one, in a Z-web structure, to find related objects or nodes. With a parallel processor, the selection of multiple branches can be done simultaneously.
Another Way of Calculating “Z-Factors”, Including Reliability Factor:
Please note the reliability factor can be calculated based on the other methods mentioned in this disclosure. This can be also calculated and addressed by Z-numbers or by fuzzy logic membership or other fuzzy concepts or other concepts, such as the “trustworthiness of speaker”, “sureness of speaker”, and “statement helpfulness”, which deal with the source of information, where the information propagates through one or more sources to get to the listener or user, as the final destination, to analyze the information and its quality, including reliability factor, confidence factor, truth factor, bias factor, expertise factor, validity factor, expiration date (if any, to declare the information void after a certain date and time, such as stock market quotation), and the like (collectively called Z-factors, for factors used in Z-web).
For example, for reliability factor analysis, in another embodiment, we have e.g. for 3 nodes N<sub>1</sub>, N<sub>2</sub>. and N<sub>3</sub>, where the information is moved from N<sub>1</sub>, to N<sub>2</sub>, and then to N<sub>3</sub>, with reliability factors R<sub>F1</sub>, R<sub>F2</sub>, and R<sub>F3</sub>, respectively. For example, assuming all being normalized to maximum the value of 1, then all R<sub>F1</sub>, R<sub>F2</sub>, and R<sub>F3 </sub>are less than or equal to 1 (or it can be done in the percentage scale to the maximum value of 100). So, in one embodiment, we will have the total reliability factor R<sub>FTotal </sub>as the multiplication of all factors in the series of nodes:
<br />R<sub>FTotal</sub>=R<sub>F1 </sub>R<sub>F2 </sub>R<sub>F3 </sub>
In one embodiment, we will have the total reliability factor R<sub>FTotal </sub>as the intersection of all reliability factors in the series of nodes, or minimum of those values:
<br /><i>R</i><sub>FTotal</sub>=Min (<i>R</i><sub>F1</sub><i>, R</i><sub>F2</sub><i>, R</i><sub>F3</sub>)
In one embodiment, we will have each reliability factor is compared to a threshold, in the first case as being larger than a threshold to get a value of 1, and in the second case as being smaller than another threshold to get a value of 0. which makes the calculations simpler for calculations of formulas above for large number of nodes, because we end up with lots of 0 and 1 in the node factor assignments.
For parallel nodes situation (as opposed to series), we will have the corresponding formulation for the total reliability factor RFrotat, for example, for 3 nodes (N<sub>1</sub>, N<sub>2</sub>, and N<sub>3</sub>), going to a final 4<sup>th </sup>node, N<sub>4</sub>, as parallel inputs. If the information coming from all 3 nodes (N<sub>1</sub>, N<sub>2</sub>, and N<sub>3</sub>) are not related, then they have no impact on each other in terms of reliability. However, if they are related to the same subject, then we will have, in one embodiment:
<br /><i>R</i><sub>FTotal</sub><i>=R</i><sub>F1</sub><i>+R</i><sub>F2</sub><i>+R</i><sub>F3 </sub>
In one embodiment, we will have the total reliability factor R<sub>FTotal </sub>as the union of all reliability factors in the parallel configuration of nodes, or maximum of those values:
<br /><i>R</i><sub>FTotal</sub>=Max (<i>R</i><sub>F1</sub><i>, R</i><sub>F2</sub><i>, R</i><sub>F3</sub>)
Again, in one embodiment, we will have each reliability factor is compared to a threshold, in the first case as being larger than a threshold to get a value of 1, and in the second case as being smaller than another threshold to get a value of 0. which makes the calculations simpler for calculations of formulas above for large number of nodes, because we end up with lots of 0 and 1 in the node factor assignments.
If we are dealing with fuzzy numbers, then we can use the operators max. MAX, min, MIN, and sup, as commonly known in Fuzzy Logic, and e.g. as defined and shown by FIG. 4.6 and pages 111-112 of the book by Klir et al., “Fuzzy sets and fuzzy logic”, published in 1995, by Prentice Hall. These are more general versions of Max and Min operations we mentioned above. Thus, the reliability factor will also be in Fuzzy domain and as a Fuzzy parameter, as an example.
All of these methods in this disclosure can also apply to other factors mentioned elsewhere in this disclosure, e.g. confidence factor, truth factor, bias factor, expertise factor, trust factor, validity factor, “trustworthiness of speaker”, “sureness of speaker”, “statement helpfulness”, “expertise of speaker”, “speaker's truthfulness”, “perception of speaker (or source of information)”, “apparent confidence of speaker”, or “broadness of statement”. The mathematics and vehicle to apply to Z-web nodes (also called “Z-node”) or objects are the same for each of those factors (collectively called “Z-factors”, for factors used in “Z-web”). The collection or aggregation of Z-web with all the associated factors mentioned above makes it the most reliable and most powerful search engine tool in the market, for data analytics or analysis of images, “big data”, text, voice, moods, facial expressions, emotions, personality, character, characteristics, concepts, and the like. Of course, the bigger Z-web gets, the more valuable it becomes, with more nodes and factors and branches and other parameters, as mentioned above.
In one embodiment, “trustworthiness of speaker” (A<sub>trust</sub>) depends on (as a function of, or Function(x)) at least 4 other factors (variables): “apparent confidence of speaker” (A<sub>confidence</sub>), “speaker's truthfulness” (A<sub>truth</sub>), “expertise of speaker” (A<sub>expertise</sub>), and “perception of speaker (or source of information)” (A<sub>perception</sub>), with each can be both fuzzy and crisp values, in different examples. In one embodiment, the “trustworthiness of speaker” is “high”, only if all of its 4 factors are “high”. So, mathematically, we have:
<br /><i>A</i><sub>trust</sub>Function (<i>A</i><sub>confidience</sub><i>, A</i><sub>truth</sub><i>, A</i><sub>expertise</sub><i>, A</i><sub>perception</sub>)
If we assign the value of 1 to “high” and 0 to “low”, in one embodiment, then we can write this in a short form as, based on AND logical operation:
<br /><i>A</i><sub>trust</sub>=(<i>A</i><sub>confidence </sub>AND <i>A</i><sub>truth </sub>AND <i>A</i><sub>expertise </sub>AND <i>A</i><sub>perception</sub>)
Or, in another presentation, in one embodiment, we can write it as, using intersection operator ({circumflex over ( )}):
<br /><i>A</i><sub>trust</sub>=(<i>A</i><sub>confidence</sub>{circumflex over ( )}<i>A</i><sub>truth</sub>{circumflex over ( )}<i>A</i><sub>expertise</sub>{circumflex over ( )}<i>A</i><sub>perception</sub>)
Or, in another presentation, in one embodiment, we can write it as, using minimum operators (e.g. min or MIN, as commonly known in Fuzzy Logic, and e.g. as defined and shown by <figref idref="DRAWINGS">FIG. 4.6</figref> and pages 111-112 of the book by Klir et al., “Fuzzy sets and fuzzy logic”, published in 1995, by Prentice Hall):
<br /><i>A</i><sub>trust</sub>=min (<i>A</i><sub>confidence</sub><i>, A</i><sub>truth</sub><i>, A</i><sub>expertise</sub><i>, A</i><sub>perception</sub>)
or
<br /><i>A</i><sub>trust</sub>=MIN (<i>A</i><sub>confidence</sub><i>, A</i><sub>truth</sub><i>, A</i><sub>expertise</sub><i>, A</i><sub>perception</sub>)
So, we can calculate or obtain A<sub>trust </sub>from its components or variables, based on fuzzy rules, set rules, logical operations, Venn diagram, or the like, for their respective domains of analysis.
Note that for any intersection operator or logical or fuzzy operations, mentioned here, we can use different logic domains and operations, e.g. Lukasiewicz logics, Bochvar logics, Kleene logics, Heyting logics, Reichenbach logics, or the like (see e.g. Table 8.4 of Klir et al. (on page 218 of the book mentioned above)). In addition, for the Generalized Modus Pollens, Generalized Modus Toliens, and Generalized Hypothetical Syllogisms, we can use the following conventions, as an example: Early Zadeh, Gaines-Rescher, Godel, Goguen, Kieene-Dienes, Lukasiewicz, Reichenbach, Willmott, Wu, or the like (see e.g. Tables 11.2, 11.3, and 11.4 of Klir et al. (on pages 315-317 of the book mentioned above)). In one embodiment, to be consistent, once we are using one logical domain, we have to stay in that domain for all operations.
In one embodiment, “sureness of speaker” (A<sub>sureness</sub>) depends on at least 4 other factors: “apparent confidence of speaker”, “speaker's truthfulness”, “expertise of speaker”, and “perception of speaker (or source of information)”, with each can be both fuzzy and crisp values, in different examples. In one embodiment, the “sureness of speaker” is “high”, only if “speaker's truthfulness” is either “high” or “low”, and the other 3 factors are “high”. So, mathematically, we have as a function of:
<br /><i>A</i><sub>sureness</sub>=Function (<i>A</i><sub>confidence</sub><i>, A</i><sub>truth</sub><i>, A</i><sub>expertise</sub><i>, A</i><sub>perception</sub>)
If we assign the value of 1 to “high” and 0 to “low”, in one embodiment, then we can write this in a short form as, based on AND and OR logical operations:
<br /><i>A</i><sub>sureness</sub><i>=A</i><sub>confidence </sub>AND <i>A</i><sub>expertise </sub>AND <i>A</i><sub>perception </sub>AND (<i>A</i><sub>truth </sub>OR <i>Ã</i><sub>truth</sub>)
Wherein Ã<sub>truth </sub>is a logical complement to A<sub>truth </sub>. In fuzzy logic, please note that, due to overlapping membership functions, (A<sub>truth </sub>OR Ã<sub>truth</sub>) is not equivalent to 1.
Or, in another presentation, in one embodiment, we can write it as, using intersection operator ({circumflex over ( )}) and union operator (V):
<br /><i>A</i><sub>sureness</sub><i>=A</i><sub>confidence </sub><i>{circumflex over ( )} A</i><sub>expertise </sub><i>{circumflex over ( )} A</i><sub>perception </sub>{circumflex over ( )} (<i>A</i><sub>truth </sub><i>V Ã</i><sub>truth</sub>)
Or, in another presentation, in one embodiment, we can write it as, using minimum and maximum operators (e.g. max, MAX, min, MIN, and sup):
<br /><i>A</i><sub>sureness</sub>=min (<i>A</i><sub>confidence</sub><i>, A</i><sub>expertise</sub><i>, A</i><sub>perception</sub>, (max (<i>A</i><sub>truth</sub><i>, Ã</i><sub>truth</sub>)))
or
<br /><i>A</i><sub>sureness</sub>=MIN (<i>A</i><sub>confidence</sub><i>, A</i><sub>expertise</sub><i>, A</i><sub>perception</sub>, (MAX (<i>A</i><sub>truth</sub><i>, Ã</i><sub>truth</sub>)))
Or, we can use any of the combinations of the similar operators, listed above. So, we can calculate or obtain A<sub>sureness </sub>from its components or variables, based on fuzzy rules, set rules, logical operations, Venn diagram, or the like, for their respective domains of analysis.
In one embodiment, “statement helpfulness” (A<sub>helpfulness</sub>) depends on at least 2 other factors: “sureness of speaker” (A<sub>sureness</sub>) and “broadness of statement” (A<sub>broadness</sub>), with each can be both fuzzy and crisp values, in different examples. In one embodiment, the “statement helpfulness” is “high”, only if “sureness of speaker” is “high” and “broadness of statement” is “low”. In one embodiment, “statement helpfulness” indicates the parameter that is very useful for analysis of many pieces of data from multiple sources, such as Big Data or Internet. So, mathematically, we have A<sub>helpfulness </sub>as a function of:
<br /><i>A</i><sub>helpfulness</sub>Function (<i>A</i><sub>sureness</sub><i>, A</i><sub>broadness</sub>)
If we assign the value of 1 to “high” and 0 to “low”, in one embodiment, then we can write this in a short form as, based on AND logical operation:
<br /><i>A</i><sub>helpfuness</sub><i>=A</i><sub>sureness </sub>AND <i>Ã</i><sub>broadness </sub>
Wherein Ã<sub>broadness </sub>is a logical complement to A<sub>broadness</sub>. In fuzzy logic, please note that, due to overlapping membership functions, (A<sub>brodness </sub>OR Ã<sub>broadness</sub>) is not equivalent to 1.
Or, in another presentation, in one embodiment, we can write it as, using intersection operator ({circumflex over ( )})
<br /><i>A</i><sub>helpfulness</sub><i>=A</i><sub>sureness </sub><i>{circumflex over ( )} Ã</i><sub>broadness </sub>
Or, in another presentation, in one embodiment, we can write it as, using minimum and maximum operators (e.g. max, MAX, min, MIN and sup):
<br /><i>A</i><sub>helpfulness</sub>=min (<i>A</i><sub>sureness</sub><i>, Ã</i><sub>broadness</sub>)
Or
<br /><i>A</i><sub>helpfulness</sub>=MIN (<i>A</i><sub>sureness</sub><i>, Ã</i><sub>broadness</sub>)
So, we can calculate or obtain A<sub>helpfulness </sub>from its components or variables, based on fuzzy rules, set rules, logical operations, Venn diagram, or the like, for their respective domains of analysis.
In one embodiment, the information comes from multiple sources or speakers (or originator or gatherer or reporter) and goes through more sources, and may get modified in there, based on the same parameters described above. Then, the information may get merged, edited, combined, aggregated, or modified by some sources, or otherwise, just goes through an intermediate source with no modifications, just as a conduit, with no effect on the data. Finally, one or more pieces of data reach a listener (or receiver or evaluator or user or computer or collector or public or third party entity), through those many possible routes (from one or more original sources of information). Then, the listener should gather all data, with all the factors mentioned above, from all sources and routes, and digest and evaluate, to make a conclusion from all of the above. Here, the Z-web is applied, because the whole propagation of data through all the nodes or sources can be modeled with the Z-web, from one part of the Z-web to another part or section or node of the Z-web, with all the reliability factors and other factors included in the Z-web. This is a very powerful tool for analytics e.g. for Big Data or Internet, with many sources of information, and many intermediate nodes, each having its own reliability, truthfulness, bias, expertise, addition, edit, and similar factors, e.g. as mentioned above, on the original data.
Of course, when we have a complex node structure for Z-web, we will have a multiple parallel and series situations, broken down as imaginary smaller units, which we can use the methods above or as explained elsewhere in this disclosure, to analyze for the Z-web. In addition to the above formulations, any similar formulations and combinations can also work in different embodiments. For example, the Z-factors can be based on tables, curves, formulas, analytical relationships, equations, Fuzzy rules, rules engine, conditional statements, or the like.
Processing & Mathematical Methods:
In one embodiment, root-mean-square error (RMSE) or ArcTan function (an inverse trigonometric function) can be used to reduce the effect of the large errors or dampen the big variations, because of their behaviors at large numbers.
In one embodiment, for optimization, the method of Lagrange multipliers is used for finding the local maxima and minima of a function subject to some constraints, which is equivalent to finding some optimum point on a surface, subject to a cross section of that surface, which is equivalent to tangent vectors of the 2 corresponding contour lines being parallel, which is equivalent to gradients of 2 functions (e.g. f(x,y) and g(x,y)) being parallel, subject to a constraint for g(x,y), e.g. being a constant value. So, we will have the following relationship for the gradients of the 2 functions (with the gradient being taken with respect to x and y (the 2 coordinate axes), and k representing a coefficient of proportionality):
<br />∇f=−k∇g
We use this for any optimization, e.g. in our image processing method or recognition routines or image enhancements or optimization of one Z-factor in Z-web, subject to another Z-factor (as a constraint), e.g. reliability factor.
In one embodiment, for fuzzy system reasoning, for aggregation and implication techniques, e.g. we use Min/Max Aggregation method, in which we get the membership value from the 1<sup>st </sup>curve or membership function, and trim the top of the 2<sup>nd </sup>membership function or curve (as flat cut-off) with the first membership value (as the maximum value allowed on that 2<sup>nd </sup>membership function or curve). In one embodiment, we use Additive Aggregation method, in which we get the membership value from the 1<sup>st </sup>curve or membership function, and scale or normalize the 2<sup>nd </sup>membership function or curve (usually reduce the peak height of the curve) based on the first membership value (as the maximum value or peak allowed on that 2<sup>nd </sup>membership function or curve).
In one embodiment, for aggregating the correlated fuzzy sets, for the additive aggregation method, we can get the final membership value, μ<sub>final</sub>, based on the individual membership values, and μ<sub>2</sub>, as (where index i runs from 0 to n):
<br />μ<sub>final</sub>=∀<sub>i </sub>min ( (μ<sub>1</sub>+μ<sub>2</sub>), 1)
In one embodiment, for aggregating the correlated fuzzy sets, for the Min-Max aggregation method, we can get the final membership value, μ<sub>final</sub>, based on the individual membership values, μ<sub>1 </sub>and μ<sub>2</sub>, as (where index i runs from 0 to n):
<br />μ<sub>final</sub>∀<sub>i </sub>max (μ<sub>1</sub>+μ<sub>2</sub>)
Thus, we can aggregate and find the resultant membership functions. Then, if we have to defuzzify at one point, to get a crisp number for some applications, e.g. acting or not acting on some function, e.g. turn off the light, as a binary decision or output, then for that case, we get the center of mass coordinate, or the coordinate of where the membership curve bends (going down from its maximum value or plateau or flat region on the top), or the coordinate of the center of the highest plateau or flat region of the membership curve (if any), or any averaging or weighted averaging or the final membership curve, or any computation for the area under the membership curve to find a compromise value or middle point or median point or coordinate, or the like. However, if the crisp value is not needed, we keep the values as fuzzy values, stored or sent to the next step of the process, because when we defuzzify, e.g. to get a point or crisp value, we usually lose some information stored in the membership curve. So, we want to avoid that, if possible, or as much as possible.
In one embodiment, for fuzzy rules, e.g. rules engine, e.g. for control system applications, e.g. when we have a bunch of rules in terms of e.g. IF-TILEN rules, or conditional statements, then we can apply the rules or policies based on fuzzy backward chaining, to resolve the rules backward, to fire or activate the rule(s), in our inference engine. Here, we start from a goal, and then find out which rules have that goal as output, and from those extracted rules, we find out what input parameter values we need to know to evaluate those extracted rules. Those input parameter value(s) now become our sub-goals), which is (are) similar to our goal above, which we repeat the same routine above again, recursively, until we get to an input value that we already know the value for, and we can plug in the value for that corresponding rule, as the input, to get the output (of that IF-THEN rule). Then, recursively, we use that output that we just got as the input of the previous rule(s), concerning that parameter, in our chain, to get the result or output of the previous rule(s). Then, we continue this recursively, until we get to our first goal at the top of the chain, in the beginning. <figref idref="DRAWINGS">FIG. 157</figref> shows a backward chaining inference engine. <figref idref="DRAWINGS">FIG. 158</figref> shows a backward chaining flow chart.
In one embodiment, for fuzzy rules, we use forward chaining inference engine, to fire the rules in forward manner, as the input part of the rule has some available value, to trigger that rule, and instantiate some variables. So, we go through all rules that can be fired, until the list is exhausted. So, here, we do not require a goal. <figref idref="DRAWINGS">FIG. 159</figref> shows a forward chaining inference engine. In one embodiment, we add a RETE algorithm to our method above, for better performance.
In one embodiment, based on both approaches mentioned above, to take advantage of our gathered knowledge in each step, we combine both methods, as an opportunistic forward firing, added to our backward chaining engine, for better performance. <figref idref="DRAWINGS">FIG. 160</figref> shows a fuzzy reasoning inference engine. In one embodiment, all of the above are used as methods of handling data for our Z-web, with its corresponding Z-factors.
In one embodiment, we (i.e., our system or computer or processor or microprocessor or CPU or computing unit or the like) perform parallel processing for each signature for each object in the picture, to get the result faster, to extract and distinguish all objects in the image.
In one embodiment, we can combine our method with Adaptive Boosting, as a machine learning algorithm, designed by Yoav Freund and Robert Schapiro, to improve the performance (AdaBoost algorithm). The subsequent classifiers are adjusted in favor of those instances misclassified by previous classifiers. In one embodiment, it is sensitive to noisy data and outliers. In one embodiment, it is less susceptible to the “overfitting” problem (which is a well-known problem in machine learning). The system generates and calls a new weak classifier in each cycle, with updated weights, based on the importance of examples in the data set. Then, repeatedly, the weights of incorrectly classified examples are increased, and those of correctly classified examples are decreased, to zoom in to the missed examples.
In one embodiment, we can combine our method with the following method, for classification, such as face recognition, to consider both the error and time for the final decision, based on sequential decision-making. When the false positive and false negative error rates are given to us, then we want the shortest average time to decision (number of measurements). We use a method called Wald's sequential probability ratio test (SPRT), or WaldBoost. We use both a priori ordered measurements and known joint probability density functions, for time and error rate trade-off, with the joint probability density estimation using the optimal SPRT decision strategy, which has a good detection rate in a reasonable amount of time,
In one embodiment, we can combine our method with the c-means clustering algorithm, which produces input pattern groups with corresponding cluster centers. To learn fuzzy functions, one can use adaptive vector quantization (AVQ) (using unsupervised AVQ competitive learning) to estimate the local centroids (and covariance matrices) of clusters in the input-output space. From the resulting ellipsoid, one can derive the fuzzy rules and fuzzy patches). In one embodiment, one can use the Kohonen self-organizing map (SOM), with unsupervised learning algorithm, to change weight vectors for a network (for modeling the features in training samples),
In one embodiment, for thresholding in image processing, we use a statistical decision theory, using statistical decision rules. In one embodiment, we use Otsu's thresholding technique, which uses discriminant analysis, which maximizes the class separation. In one embodiment, we use fuzzy threshold algorithm, using fuzzy membership functions (by the method suggested by Huang and Wang). In one embodiment, the selection is made using a fuzzy parameter, with entropy measure as the criteria function, to get the threshold for the optimal image. In one embodiment, we introduce a cost function. In one embodiment, we apply the multi-level thresholding. In one embodiment, we apply a model fitting method. In one embodiment, we apply the above to segment the document images, face, text, or the like. In one embodiment, we use the grey level histogram for thresholding and segmentation purpose. The histogram (and its peaks or its transition phases) is a good indicator of the multiple classes or clusters involved in the samples.
In one embodiment, we use a fuzzy rule based system to find the background in the image. For example, we have the following IF-THEN rule(s), using Z-numbers: <ul id="ul0075" list-style="none"><li id="ul0075-0001" num="0000"><ul id="ul0076" list-style="none"><li id="ul0076-0001" num="2242">If, for a given pixel, the pixel's neighbors have small contrast and small variance with respect to the pixel, then the pixel is probably in the background of the image.</li><li id="ul0076-0002" num="2243">Otherwise, the pixel is the foreground, representing one or more objects in the image.</li></ul></li></ul>
In one embodiment, for learning from samples or examples, we have the following steps: First, we fuzzify the input space. Then, using data, we produce fuzzy rules. Then, for each rule, we assign a degree, followed by the creation of the combined rule library. Finally, we use defuzzification to set the mapping.
In one embodiment, for recognition, we use decision tree method, with nodes and branches which can represent the rules. For example, we have: “If D<sub>1 </sub>has a value of d<sub>13</sub>, and D<sub>2 </sub>has a value of d<sub>21 </sub>(on the second level of branching out), then the class is C<sub>2</sub>”, as shown in <figref idref="DRAWINGS">FIG. 161</figref>. Note that “D<sub>j</sub>” stands for a decision making node, and “d<sub>jn</sub>” is one of the choices for that node (the n-th choice). “C<sub>i</sub>” is the resulting class at the end of the last branch on that section of the tree, which classifies the object based on the rules stated on the decision tree. e.g. IF-THEN rule stated above, or a collection of such rules and branches and classes. By the way, the example above can be stated in another format, as well:
If D<sub>1</sub>(d<sub>13</sub>) is TRUE, and D<sub>2</sub>(d<sub>21</sub>) is TRUE,
Then the class is C<sub>2</sub>.
In one embodiment, we assume the decision tree classifies the objects with the same proportion as the samples in our universe of objects, i.e. with the same probability. In one embodiment, if we look at the decision as a source of message, then we can relate that to the entropy formulation for the information (I) (with summation running on variable “j”, and P denoting the probability):
<br /><i>I=−Σ</i><sub>j </sub><i>P</i>(<i>a</i><sub>j</sub>) log (<i>P</i>(<i>a</i><sub>j</sub>))
In one embodiment, we use fuzzified decision rules based on membership functions, which have values between 0 and 1, which is sometimes modeled based on a linear slope or transition or line segment from 1 to 0, or vice versa.
In one embodiment, we use neural network on our Fuzzy system, in multiple different ways, e.g. using neural network to get the rules, or using neural network to do fuzzy logic inference, or using neural network to find and edit the membership functions or values for an object, or using neural network to construct a node combination structure based on fuzzy set connectives, e.g. union, intersection, and compensative connectives. In one embodiment, we use different aggregation operators to integrate membership values.
In one embodiment, we minimize the number of fuzzy rules, for efficiency, e.g. using rule pruning, rule combination, or rule elimination. In one embodiment, we eliminate the rules with low number of training samples or low reliability. In one embodiment, we use Karnaugh map to simplify the logic, including fuzzy rules. In one embodiment, we use data clustering to minimize fuzzy rules. In one embodiment, we use optimal defuzzification methods, e.g. using 2-layer neural network, or maximum matching, or centroid defuzzification, or maximum accumulated matching. These can be used e.g. for analyzing or recognition of maps, text, or handwriting.
In one embodiment, for learning machines, we use linear regression, least square, ridge regression, Widrow-Hoff algorithm, Support Vector Machines (SVM), Gaussian processes, Generalization technique (bounds on luckiness), or Kernel functions (to have a more general function for classification or cluster analysis), with SVM (and Kernel functions) at the center of our technique. Basically, in one embodiment, for the hyperplane separating the classes or clusters in the N-dimensional feature space, we want the largest distance from all neighboring points to the hyperplane, in average, as much as possible, as an optimization constraint. Or, in one embodiment, the separating hyperplane is defined as the plane that fits in between the growing neighboring points, as the growing neighboring points (from different clusters or classes) grow gradually in size or radius, as a point or sphere in the N-dimensional feature space, until there is no more room for their growth (and the growth stops at that point), with the separating hyperplane fitted in between the already-grown neighboring points (e.g. from the opposite clusters on two sides of the separating hyperplane).
In one embodiment, we use Vapnik's support vector machines (SVM) to classify the data or recognize the object. In one embodiment, in addition, we use kernels (e.g. using Gaussian processes or models) to be able to handle any shape of data distribution with respect to feature space, to transfer the space in such a way that the separation of classes or clusters becomes easier. In one embodiment, we use sparse kernel machines, maximum margin classifiers, multiclass SVMs, logistic regression method, multivariate linear regression, or relevance vector machines (RVM) (which is a variation of SVM with less limitations), for classification or recognition.
In one embodiment, for machine learning, the system starts with experiment generator describing the problem in hand. Then, the performance system (based on the history) feeds an analyzer, which provides the training examples to a generalizer module, which produces hypothesis for experiment generator, to complete the loop. In one embodiment, for machine learning, we use unsupervised learning or supervised learning or in combination, for different aspects of components of some data, es, in an image, with many objects in it, for each object recognition, using different technique.
In one embodiment, for designing the learning program, the system first determines the type of training experience, followed by identification of target function, followed by determination of representation of learned function, and followed by learning algorithm, to complete the design.
In one embodiment, based on “Occam's razor” statement, we prefer the simplest hypothesis that fits the data. For example, a 10 node decision tree that fits the data completely is preferred over a 1000 node decision tree that fits the data completely, as well (due to the fact that it is less statistical coincidence, and more chance to fit or generalize correctly to future data).
In one embodiment, for machine learning, we use neural networks, perceptrons, including gradient descent and delta rule, back propagation algorithm (including convergence and local minima problem), feedforward networks, hypothesis space search and inductive bias, with “Generalization” and “Overfitting” considerations, Q learning algorithm, or reinforcement learning, which all can be combined with our methods in this disclosure, as a complementary method, for improving the performance or efficiency.
In one embodiment, for classification, we may not be looking at enough dimensions for our feature space. So, randomly or based on historical data, the system guesses at the possible one or more extra dimensions to be added as new dimension(s) of feature space, and then tries to classify based on the new dimensions. If the result is better, based on separability of the clusters (or from their overlaps (which is generally an indication of not a good separation)), then we continue on that basis. Otherwise, we drop the new dimension from our space, and optionally, try another new dimension possibility, later on.
In one embodiment, for learning application, we use social collaborative filtering or adaptive lenses, to benefit from other people's experience, and to adapt to fluid language use for human language processing, which can be very dynamic these days, as new words or slangs or abbreviations enter a language in a fast pace, every year.
In one embodiment, for data fitting, we input data to adaptive system, which feeds into cost analysis module, with desired or goals input to cost analysis module, as well. Then, the cost analysis module feeds the error to training algorithm module, which feeds the changed parameters back to the adaptive system again, as a complete loop. In one embodiment, for linear models, we search for the performance surface with steepest descent, using gradients and LMS (least mean square) algorithm. In one embodiment, for pattern recognition, we use multilayer perceptrons with sigmoidal nonlinearities (functions), e.g. in (tanh(x)) or (1/(1+exp(−x))) forms. In one embodiment, for training networks, we use backpropagation method, to go backward to get the weights set, from the last layer, based on desired response and error backward. In one embodiment, to optimize, we derive energy function and surface, with attractor point on the minima of the surface, to analyze system state with respect to the attractor, which can be local or global minima (which we prefer to get into the global minima).
In one embodiment, to model the activity of a person in a computer, and learn from it for future simulation, based on learning from the actual real human action or activity measurements, we use cameras or sensors, e.g. attached to a person, to track the coordinates of parts of the person doing those activities, e.g. dancing (for doing different tasks, in real life). To get the 3D coordinates of those points, for the person, we put the sensors at her joints or major points on the body, e.g. position of knee, for a total of about e.g. 30-50 points on her body, to track all movements, based on the anchor points, and then interpolate the other points in between the anchor points. So, all the movements and series of movements are stored and fed into a learning machine, along with the tags naming the activities, for the machine learning those activities, to be able to generate those later, on its own, or mix the activities together. The mixing can be based on percentage or crisp number, or based on fuzzy parameter, e.g. “slightly” dancing (activity). Once the machine learns the specific activity or activities, it can be used for recognition of video, later on, for a person's activity in different frames.
In one embodiment, we use cameras, sensors, detectors, scanners, CPU, processor, color processor, color adjusting module, transformation image module, translation image module, rotation image module, tilting image module, memory units, storages, RAM, ROM, cloud computing, distributed storage, server farm, PC, user interface. GUI, FFT processor, DCT processor, Fourier analyzer, matrix manipulation processor, convolution operator processor, filters, comparators, subtractors, integration modules, neural nets, training sets, voice-to-text convertors, text-to-voice convertors, OCR, email system, fuzzifier, defuzzifier, center of mass determination module, rules engine, fuzzy rules engine, relational database, RETE, and the like, to implement the system and methods taught here in this disclosure. See e.g. <figref idref="DRAWINGS">FIG. 174</figref> for such a system.
With our invention, as discussed in this disclosure, in one embodiment, we can use in or with any learning paradigms, e.g. supervised learning (which is very powerful and useful), unsupervised learning, semi-supervised learning, reinforcement learning (e.g. telling the machine if it is in the right track or not, using punishment or rewards, so that it can adjust based on an algorithm), active supervised learning (in which we query about the data, actively), active reinforcement learning, or online learning (in which we get the dataset in small chunks, due to storage or computation limitations, and process them gradually, as in Big Data or in Internet, with limited computing power or memory).
It also can be used in or with any learning theory, e.g. VC theory (including VC dimension and VC bound), Bias-Variance theory (for learning curve analysis), Complexity theory (for computational complexity, with asymptotic results, e.g. if we can do the task in polynomial time), or Bayesian theory (in terms of probability distribution and joint distribution, e.g. in handwriting or voice recognition).
It also can be used in or with any learning techniques, which are separated as models and methods. For models, we have algorithm, hypothesis, and test, e.g. linear transform (which is simple and at low cost), neural networks, SVM (e.g. with Kernel), nearest neighbors (which categorizes according to the nearest neighbors), RBF (or “radial basis function”, which is a real-valued kinction, which depends on the distance from the origin, e.g. Gaussian form or multi-quadratic form), Gaussian processes (which is similar to Bayesian, with full probability distribution, related to random process, random function, and probability distribution over different functions, with distribution being jointly Gaussian), SVD (or “singular value decomposition”, which e.g. matches 2 things, as a 2 set of factors, using 2 matrices), or graphical model (with target joint probability distribution, related to computation, graph algorithm, and simplifying the graph, to model the joint probability distribution).
For methods, we have high level entity that is superimposed on anything we use. For example, we have the regularization method, the validation method, the aggregation method, or the input processing method (e.g. for real data and practical considerations, e.g. to normalize or decorrelate).
For the aggregation method (also called ensemble learning, or boosting, or mixture of experts), we have a learning which tries to replicate the function independently (not jointly), and then combine and put them together later, e.g. combining different solutions, e.g. detecting eye and detecting nose, so that in combination, we can reliably detect the face later, which is useful for reliable computer vision applications with fast or real-time results. For the aggregation method, for regression or real number cases, we take an average or weighted average, and for classification or binary cases, we take a vote or weighted vote. For the aggregation method, we have 2 types: (a) After-the-fact situation (where we already have the solutions, and then we combine them). and (b) Before-the-fact situation (where we get solutions, with the view or intention or assumption to blend or combine them together later). For the aggregation method, as one example, we have the Boosting method, where we enforce the decorrelation (not by chance), e.g. by building one hypothesis at a time, for a good mixture, sequentially.
Fuzzy Database and Controller:
In one embodiment, for fuzzy databases or information retrieval, for COMPLEMENT, UNION, INTERSECTION, and JOIN, we use the operators commonly defined in fuzzy logic (e.g. see Klir et al. book, mentioned elsewhere in this disclosure, Table 8.3 page 215, Table 8.4 page 218, Formulas 8.3 pages 218-219, m(X) relationships defined on page 273, Tables on pages 309, 315-317, and FIG. 11.3 page 319), e.g. for the following operations (for the regular operations on the databases):
à for COMPLEMENT
(A v B) for UNION
(A {circumflex over ( )} B) for INTERSECTION
(A v B) for JOIN
For example, for combining the indexes after multiple scanning the database based on multiple criteria, we can use the operation JOIN on the index lists from multiple scans. For example, for search, we can have the following for house hunting or purchase for a buyer, based on the criteria of the houses in the market, in the real estate database:
Houses: [location: “Washington D.C.”; <ul id="ul0077" list-style="none"><li id="ul0077-0001" num="0000"><ul id="ul0078" list-style="none"><li id="ul0078-0001" num="2275">number of bedrooms: “usually preferred” “between 3 to 5”;</li><li id="ul0078-0002" num="2276">price range: from “about 200,000” to “about 250000” US$;</li><li id="ul0078-0003" num="2277">structural quality: “at least good”]</li></ul></li></ul>
The criteria for the statements above are based on fuzzy values, e.g. “from about 200,000 to about 250000” or “at least good”. The criteria also include “usually preferred between 3 to 5”, which is a Z-number. Thus, the search and query include fuzzy values and Z-numbers. Therefore, the fuzzy search in database is based on membership values between 0 and 1, e.g. for indexing the database based on any of the criteria with a fuzzy threshold, which produces fuzzy ranges (or index listing with fuzzy edges or boundaries). So, for example, if a house is found with a structural quality rated as “good”, then it would satisfy that criteria (i.e. “at least good”) with a membership value of e.g. 0.95 (which is a “high” membership value).
In one embodiment, we put a threshold for the membership values, e.g. a minimum low threshold to get rid of very low membership values as zero, or a high threshold to e.g. set very high values (such as 0.99) to 1, for ease of calculations. In one embodiment, we keep the membership values as real numbers, e.g. 0.95 and 0.3, e.g. limited to 1 or 2 decimal points. In one embodiment, we keep the membership values as fuzzy values, e.g. “high” membership value, in our index listings, which in some applications, is a preferred method, due to the higher speed of processing and low storage requirements, as the fuzzy classes for indexes can be manipulated faster (in some applications), compared to those of real numbers.
In one embodiment, we use the relevant documents (or relevancy factor for document, It.), as a fuzzy parameter (which is also a Z-factor in our Z-web), for information retrieval. For example, for a given index terms X (which includes x<sub>i</sub>) and relevant documents Y (which includes y<sub>i</sub>), we define a fuzzy relationship G (also called Fuzzy Thesaurus) which expresses the degree of association of x<sub>i </sub>and x<sub>j </sub>(both belonging to X). We also have the grade of relevance for index term x<sub>i </sub>in the document y<sub>j</sub>, or , y<sub>j</sub>), as a membership value, set between 0 and 1.
In one embodiment, we find the membership value objectively or subjectively or both, for example, using author's tagging or commenting or indexing or summarizing or putting keywords or putting title, or using user or community for tagging, or using machine learned expert for tagging, or using algorithms e.g. giving less weights to older documents, as less relevant), or using number of occurrences of a word, or finding and using the type of article or document, or the like, or all or any of the above in combinations.
Then for a fuzzy set for inquiry S<sub>Inquiry</sub>, we define the “augmented inquiry” (augmented by associated index terms), S<sub>AugInquiry</sub>, as (based on operator “o”):
<br />S<sub>AugInquiry</sub>=S<sub>Inquiry </sub>o G
Which the operator “o” is defined as “max-min” composition, or:
<br /><i>S</i><sub>AugInquriy </sub>(<i>x</i><sub>j</sub>)=max min <i>x</i><sub>i </sub><i>[S</i><sub>Inquiry </sub>(<i>x</i><sub>i</sub>), <i>G </i>(<i>x</i><sub>i</sub><i>, x</i><sub>j</sub>)]
Then, for the fuzzy set W for retrieved documents, we will have:
<br />W=S<sub>AugInquiry </sub>o R.
Or, based on “max-min” composition:
<br />W=max min [S<sub>AugInquiry</sub>, R]
So, we have obtained the fuzzy set W for retrieved documents, Nov, in one embodiment, all of these, including the retrieved documents and reliability factors and relevance factors and other Z-factors, are put into our Z-web. Please note that for fuzzy sets, each member of the set has a membership value or function.
In one embodiment, we use the same concept about fuzzy values and Z-numbers mentioned above on conditional statements or rules engine, e.g. for control systems or controllers to launch a spaceship based on multiple fuzzy rules. For example, for house buying, we have:
If for a house: [price range: from “about 200,000” to “about 250000” US$; <ul id="ul0079" list-style="none"><li id="ul0079-0001" num="0000"><ul id="ul0080" list-style="none"><li id="ul0080-0001" num="2289">And structural quality: “at least good”]</li><li id="ul0080-0002" num="2290">Then Action: <ul id="ul0081" list-style="none"><li id="ul0081-0001" num="2291">“buy” the house</li></ul></li></ul></li></ul>
In one embodiment, we join the rules and results as an aggregate. In one embodiment, we use the conventional fuzzy rules engine. In one embodiment, if the result of THEN is an ACTION which is binary, then we have to defuzzify the result (to do the action or not to do the action). In one embodiment, if the result of THEN is a value, we can still remain in fuzzy domain, especially if the result of THEN feeds another system as an input (which can be a fuzzy value). The rules can be generated by expert human, or expert machine (with similar knowledge base or rules, or searching for exact answers in the universe or on Internet), or training neural network based on history or training samples.
<figref idref="DRAWINGS">FIG. 162</figref> shows a typical fuzzy controller, and <figref idref="DRAWINGS">FIG. 163</figref> shows a typical fuzzy expert system. In one embodiment, we have multiple experts, each for a separate task. In one embodiment, we have hierarchical experts to go more in depth in one task or analysis. In one embodiment, we associate each expert's result to a Z-factor in the Z-web, as the expertise factor, or also involving the reliability factor. In one embodiment, we have expert from a trained machine or neural network. In one embodiment, we have a human expert entering input in the system, through a user interface. In one embodiment, the expert systems are in parallel. In one embodiment, the expert systems are in series or cascaded or feeding each other. In one embodiment, the expert systems vote together for a decision. In one embodiment, the expert systems have different weights or veto power for voting for a decision. In one embodiment, the expert systems ORed (or ANDed or XORed or other logical operators) together for a decision.
Ordering or Processing Data, Files, and Z-Web:
In one embodiment, the system orders or processes our data, files, and Z-web, including updating the parameters and weights, including reliability factors for nodes, and also taking care of the queues, during low computation time periods or low loads or idle modes, to be more efficient. However, in one embodiment, instead of spending H hours in every P hours of time interval, to order or process our data, files, and Z-web, the system spends (H/n) hours, in every (P/n) hours of time interval. Thus, still, the ratio of ordering or processing period to the total period remains the same, as (H/P), but ordering or processing happens more often, with shorter periods or intervals. This way (i.e. more often, with shorter periods), the ordering or processing or updating the data, files, directories, queues, and Z-web becomes more efficient. So, the idle time or sleep time or slow time or recovery time or reboot time (for computer, processor, electronic device, tel., CPU, instruction processor, database arranging device, library ordering device, queue processor, waiting scheduler module for any processor or process, or any memory management module) is shorter, but more often, for higher efficiency of the process and more accuracy, in this example.
A Note about Bayesian Approach:
For situations and applications mentioned in this disclosure, one can also use or add Bayesian probability, Bayesian theory, and Bayesian inference (including prior and posterior discussions). However, one must be aware of the following important point and discussion.
In machine learning, we have a method of putting the brakes on fitting the noise (e.g. using hard and soft constraints), which is called “Regularization” method, which is well-known in the art.
Now, if we use the Bayesian approach, then we are actually applying a Regularization method to the system. There are at least 2 reasons for that: The first reason is that, by using the Bayesian approach, we assume that the summation of all probabilities is one, but for all samples in our situation may not be covering all situations, and thus, the total probability may be less than 1. The second reason is that, by using the Bayesian approach, we assume that we have related probabilities, which may not be true. Therefore, the Bayesian approach is actually a method of Regularization for the system. So, if one applies the Bayesian approach to the system, one has to be aware of the applied Regularization to the system.
More on Z-web & NLP & Image Recognition:
In one embodiment, we define unusual properties and usual properties for a given object, with associated probabilities and possibilities. In one embodiment, we define superclass, subclass, and class for a given object. In one embodiment, we define first order properties, 2nd order properties, . . . , and n-th order properties for a given object, e.g. height of a person as a first order, nose shape as a second order, and color of the eyes as the 3rd order. In one embodiment, we define default properties for a given object, so that they are applicable in the absence of any other data. In one embodiment, we define general knowledge and contextual knowledge, for specific situations. In one embodiment, having a large knowledge base and large training samples are very helpful for learning and recognition purposes.
In one embodiment, in Z-web, we find and isolate the irrelevant information, as the data with long period of no usage, or no or weak links to other nodes, to reduce the size of the Z-web, for efficiency. In one embodiment, in Z-web, we have a knowledge structure hierarchy, with nested information.
In one embodiment, in Z-web, to model a rich language, e.g. Persian, which has lots of poems and slangs with many philosophical or multiple or reversed meanings (or sarcastic language or idioms or proverbs or abbreviations or catch phrases or jokes or punch lines or abstractions or abstract ideas), for natural language processing, to understand the meaning of the sentence or voice recording or text statement, one needs more dimensions and nodes with more branches and connections. So, translating from English to Persian, for word-by-word mapping, per node, we need much more branches and nodes connecting to each other. Thus, we need more complex Z-web constructed, after translation to Persian, to accommodate the extra complexity and various meanings of the translated language (or remove inconsistencies or contradictions or false meanings in the larger context, or loop back to do the same from the beginning).
In one embodiment, Z-web also helps us understand the meaning of the proverbs and sarcastic language, as they refer to the related objects, in different contexts, based on different regions of the Z-web, initiating from the same node, with multiple meanings or interpretations. So, each region of the Z-web represents a context or environment, for a given node, in common. Thus, Z-web is a useful tool for natural language processing, as text or voice or any other form of communications. B<sub>Y </sub>the way, human natural language is generally based on Fuzzy logic and Fuzzy parameters, e.g. “big” or “usually” or “maybe” or “truth” or “relatively” or “soon”,
For NLP, for erased parts or ambiguous parts of the message, one can replace with a temporary placeholder, until the real or final meaning is found or resolved, between many choices, or by the process of elimination, to find out which cannot be, by reasoning, one-by-one, in the context, or interpolate or extrapolate between the meanings from the environment/context, or by inference or experience from past or statistically or by combination of above.
For summarization, one can use the frequency of words or concepts or verbs or adjectives to summarize the message or passage, with relationships between the histograms and location of those words, to shorten the text. The same can be done for the images or videos, or objects in those, when tracked from frame to frame, to tag and extract features and objects from video and multimedia, or for still image, to give the story about what is happening in the still image, e.g., “a plane is flying/in the sky”, coming from the recognition of a plane, with the background resembling the sky, or as it is reasoned that way. This is addressed/discussed further in other parts of the current disclosure.
Using General-AI, one can learn from other context/environment, without any training for that purpose, i.e., learn how to learn, or how to reason, or infer, e.g., for solving a classical geometry problem, without using any algebra or equation of lines or angles or trigonometry, by using simple classical geometry rules and assumptions, to attack a complex problem, or learn how to accumulate experience and knowledge, and how to resolve the inconsistencies, and how to apply the result at the end in a new context or new problem, never encountered/trained before. This can apply to language and images, or the like, for analysis and recognition of new objects/concepts/meanings/topics/classes/species.
In one embodiment, the fact that a specific person is uploading the picture, or tagging the picture, or owns the picture or album, is an indication that that person has some familiarity to the subjects or objects in the pictures, including the monuments and people. That assumption for relationship produces a link or branch between the nodes for those two objects in Z-web, which helps reliability and recognition of the faces, people, or objects, in those pictures or albums.
In one embodiment, to reconstruct an object or an event from memory, one object triggers another one or a chain of objects, which constructs the environment that happened before, using the Z-web nodes and branches, to follow the links. For example, I went to a gas station last Thursday, which was my birthday, and there was a gasoline leak and gasoline smell in the gas station. So, we input those data in the Z-web, as related objects, defining an event, as a memory unit for recollection of past events. Now, I smell some gasoline one week later in my garage. The trigger event is “smelling gasoline”, which brings up the node “smelling gasoline” in my Z-web , which was populated before. Then, it links to other nodes, e.g., “gasoline leak”, “gas station”, “last Thursday”, and “my birthday”, in that order, to remember that I had a birthday last Thursday or recently. Then, it can branch out further to other nodes and past events.
Now, in one embodiment, if we remember an event from memory or Z-web, the weights for reliability for those nodes are increased, as reinforcement of the memory for a recent recall. In one embodiment, this increase in reliability values is a percentage of the original values (e.g. 10 percent increase), or an absolute value added to all original values. This way, the recalled events are getting stronger in reliability in the Z-web.
In one embodiment, we have other notes or data added for reminders to the past event, as extra nodes and connections added to the original Z-web (i.e. before recall or recollection). For example, we may add another related node that “Last Thursday was also a Federal holiday”. So, we connect that “last Thursday” node to the node “Federal Holiday”, as an extra information or data (such as image, which can add a lot of other nodes from its own connections to the original Z-web), for future reference, to make the Z-web more complete and expansive and useful.
In one embodiment, we have a bunch of objects in the image or in an environment, and we are looking for an odd or surprising object, e.g. in a picture, in an airplane setting, there is a big snake in the airplane, which is very unusual in that setting. Now, we look at the Z-web corresponding to the “airplane”, and all related objects around that node, but “snake” is not in any of them. So, we can conclude that having snake in an airplane is odd (or out of place or surprising or unexpected). Thus, Z-web can help us finding odd objects, with respect to other objects. That also indicates the probability of existence or position of an object, with respect to other objects, in one setting or environment. Having an unusual object in an environment is a feature by itself in that environment. For example, noticing a gun at the airport (with no uniform on the person holding the gun), in an image or video frame, in a security camera, is a red flag or feature, for further investigation, as it is an unusual object in that setting. So, it is a useful tool for analytics for counterterrorism and security purposes, or for analytics for “big data”.
In one embodiment, we have a document, text, or object, and it is related to multiple other objects, with some reliability factor, truth factor, confidence factor, expertise factor, or the like (as described in details in this disclosure, and collectively called “Z-factors”). The Z-factors can be fuzzy or crisp values. The Z-factors are properties or characteristics of Z-nodes and Z-branches in the Z-web. The values of Z-factors can get propagated or calculated from one node to another in the Z-web, to evaluate the overall relationship between 2 nodes. When using the Fuzzy parameters in the Z-web, we can use the membership function or value to express the Z-factors. In addition, to express the context(s) for a node, we can use the membership function or value, to express how much the node belongs to that context or multiple contexts. Using the Z-web, we can classify the object, such as text or book or image, based on the related objects and Z-factors.
In one embodiment, when comparing 2 Z-webs, we can coincide the common nodes, if any, and then see how many related nodes connected to common node(s) are the same. For example, based on the percentages of matches, we can have a metrics for similarity of those Z-webs, with respect to one or more of the common nodes.
In one embodiment, the Z-web is used for finding a preference of a person, based on food, music, type of face he likes, and the like, through related nodes, so that it can be used for finding friends or dates or people of similar interest, or matching people or suggesting people, e.g. in the same area or store or street or neighborhood or school, by mobile phone or computer based software or a web site. The whole social network can also be mapped on to a Z-web, with fiends on the nodes, connected together.
In one embodiment, since Z-number and Z-web deal with fuzzy and natural language (e.g. “about 4 pm” or “heavy traffic”) and its reliability and other Z-factors (e.g. “usually”, “maybe”, or “not sure”), they can be used for the trip-planner and meeting schedule module or software, to optimize the schedule and resolve or minimize the conflicts. Each node can represent an event, where 2 nodes cannot have the same exact time, which means that the branches with conflicting time are broken or are weak branches, in the Z-web.
In one embodiment, crowd searching or group searching by multiple users helps improving the search results, and also builds up the Z-web at a faster pace, for the group, with respect to that of one individual user alone. In one embodiment, genealogy and ancestry type information are modeled on the Z-web, connecting people or families or objects together. In one embodiment, Z-web handles the vagueness in information, context, language, and logic, through application of Z-factors.
In one embodiment, while we gather information from a source, we keep track of the pieces, so that collectively the pieces can form a specific context at one point, which would be useful information for all pieces to have, at a later time. The pieces can get mapped to nodes of a Z-web, for storage and relationship presentation between the nodes. Thus, Z-web inherently can keep track of such context, as it evolves further in time.
In one embodiment, the Z-factors include factors for uncertainty, ambiguity, non-specificity, and discord, which can be associated with the Z-nodes or objects in the Z-web structure. In one embodiment, for linear regression or classification, the reliability factor of input values comes in, which is a Z-factor in our Z-web. In one embodiment, both the stochastic noise and deterministic noise are the properties of each node in Z-web. In one embodiment, exaggeration or bias or lie is a part of Z-factors, e.g. bias factor, which is associated with each node in Z-web. In one embodiment, all the properties of Z-web and Z-factors are expressed in terms of fuzzy parameters, or mix of fuzzy parameters and crisp parameters. In one embodiment, they are all crisp numbers or ranges or values.
In one embodiment, we have multiple documents, and from them, we get summary or abstract or title or key words or tag words or word phrases, which relate to topics, which relate to the context, using Z-web. In one embodiment, we use membership and fuzzy values for relationship between words to topics, and from topics to context. In one embodiment, we use tables or mapping tables to correspond the words to topics, and from topics to context.
In one embodiment, when training a learning machine, we may know a specific training sample is not good quality or good version or representative of the class or subclass, e.g. from an outside source, or another training machine, or from a human or machine expert, or from the samples being at the boundaries of the cluster for that class (i.e. neighboring and close by another cluster or class). In that case, we may give them less weight, or enter the other (good) training samples multiple times (to have more relative weight as training sample), or assign a separate value to the training samples for this extra information, e.g. reliability factor for training samples, which is a Z-factor, which is a part of the Z-web for training samples universe or domain.
Search for Text or Concept, Based on Fuzzy Memberships and Boundaries:
In one embodiment, to search through some articles or text, we have 3 types/levels of categorization or steps for search: (1) abstract/title/tag/keyword, then (2) summary, and then (3) specification or body of article (e.g. for a patent search engine). The owner of the article can do the first 2 steps above, beforehand, and store them along the main article or file. In one embodiment, to search for a word, we have multiple levels/steps: Level 1: pure word, extracted as a list; Level 2: connection of similar or related words; and Level 3: context of words. These methods can be done using crisp logic, or Fuzzy logic, or combination of both.
In one embodiment, to search for a topic or concept, since most concepts and natural language is Fuzzy in nature, we use the search based on Fuzzy sets and boundaries, with the topic belongs to or related to a class or another topic based on membership functions and membership values. So, the first item is related to the 2<sup>nd </sup>item, with a membership value describing their relationship. To limit the computation to relevant results, one can set a lower bound for threshold, say, e.g. 0.1 for membership value, below which we can set the value to zero, effectively ignoring those values, as being practically non-contributing or non-relevant. For example, 0.05 value is set to zero, to reduce the amount of calculations or memory needed, for membership values and their manipulations.
In one embodiment, to search for a topic or concept, we use Fuzzy questions or queries, based on Fuzzy terms and language, and look into Z-web, based on Fuzzy parameters, to get a node and follow that node on different branches to get the related concepts or objects or answers. For example, a node is CAR, and the related nodes are PRICE, WHEELS, and HOOD. Another example is a node for AGE, and the related nodes are PERSON, STONE, and BUILDING. For example, the value of PRICE is “high”, and the value of AGE is “old”, which are all Fuzzy values,
In one embodiment, the system uses the queries or type of queries as a method of feedback to modify the weight or importance of the original data or the training samples in hand. That is, the queries indicate e.g. what majority of users are interested in or what is a hot topic today, which, by itself, is a feedback to the system, to adjust itself accordingly, as a collected, aggregated, statistical distribution, median, or average opinion or feedback or vote from the society, users, concerned citizens, or social network.
In one embodiment, we have a fuzzy database, in which we index and order the data or numbers, based on fuzzy values and thresholds, e.g. “small” or “big”, rather than 2 and 200, as crisp values. For query, we have fuzzy query, which looks for entries based on fuzzy indexes or criteria, such as “much bigger than 100”, to order the entries and filter or select entries or rows of data. For fuzzy criteria, we can use the membership functions and values of the objects. To speed up the calculations, we can use centroid or center-of-mass of the regions under the curve, for expected values. Fuzzy query is the most natural way to access or relate to the humans, human thinking, human language, human reasoning, majority of Internet data, and natural language processing, e.g. one asks “What is the best company to invest in?”, in which “the best” is a fuzzy concept and parameter, and “being good or best” is a contextual concept (depends on the context or environment) which can be handled with Z-webs, with originating 2 or more branches from the same node, each representing one context, as explained in this disclosure.
In one embodiment, for ambiguous context, the system asks the user, with extra questions to figure out the context or limit the context, e.g. if an abbreviation may refer to medical field and also to IT field, as context, then the system directly asks the user if she is interested in medical field or IT field context or discussion, to limit the context, from start.
In one embodiment, the relevance for a search engine is determined based on: term relationship, probability, proximity, vector space, user or link popularity, domain or server information, or the like. In one embodiment, we use the fuzzy searching, using the operators AND, OR, XOR, and the like, in fuzzy domain, to relate the words in the query together in the search, based on their respective membership functions and values, through the logical operators, e.g. search for: (image OR picture), as a search term.
In one embodiment, the information included and extracted from email (or texting or text or TWITTER® or SMS or the like) provides an indication of emotions for people, used for sentiment analysis and behavioral predictions, e.g. for fashion or political opinion or voting.
In one embodiment, the hierarchical model is used in fuzzy domain, using flexible hierarchical relationships, with no rigid structure, using the membership function and value to express the hierarchy relationship between 2 objects A and B in the structure, which has value between 0 and 1. In one embodiment, the hierarchical model is used for the ancestry relationships or family tree.
Editing Still Pictures or Frames in Video:
In one embodiment, multiple pictures of camera or an album on a web site are scanned for face recognition, and if during the scan, having focused on eye and eye brow and mouth and face, it turns out that the person in the picture is blinking or not smiling or closed eyes or otherwise having not a good gesture for the picture or tagged for any other reasons, then the system or controller removes that picture or frame of video from the video, album, or collection, automatically, as a default.
In one embodiment, the system asks from the user if the system should or the user desires to do so, or what to do, or gives an option to move away from set default, or gives an option to set default, or default set by service provider, or default set by manufacturer, or set by camera owner, e.g. using a menu of choices on screen or GUI or user-interface, e.g. to eliminate the picture or frame, or keep them as-is, or correct them with an exchange or substitute picture as supplied by the user, or as supplied by the system automatically from the rest of the album or collection, randomly, or based on similarity with the original picture, e.g. based on the people in the picture, e.g. using or replacing with another picture with the same exact same e.g. 4 people in the picture, or at least e.g. 3 out of 4 people (as a maximum number of matched people available in the album, if another 4-people combination picture is not available in the album), or same 4 people standing in the same order as the original picture e.g. from left to right, in terms of position in space or relative position in picture or relative to an object, such as waterfall, in the background, or relative to another person in the picture, e.g. 2 persons away from Fred, or on the left side of Fred, or about 5 ft away from Fred, or far away from Fred (which is a Fuzzy term, as a natural language spoken or thought by humans everyday). See e.g. <figref idref="DRAWINGS">FIG. 164</figref> for such a system.
In one embodiment, for video situation or movie or multimedia case, the frame of videos are replaced or exchanged by simply interpolation or extrapolation from neighboring frames, or just simply replaced with one of the neighbors, or just simply replaced with the closest neighbor in terms of similarities of the 2 frames, e.g. in terms of motion vectors as a metrics for comparison, or in terms of object tracking as to how much it has changed from the last frame.
In one example, in one embodiment, for video situation, for video compression scheme, we have video I-frame (Intra-coded picture, fully specified, like a single static image), P-frames (predicted picture, or delta or difference to previous frame), and B-frames (Bi-predictive picture, or bi-directional from past and future, or differences from both sides./frames). Then, we use I, P, and B frames to get the missing frame, to be the best in terms of continuity to the human eyes or perception, or in one embodiment, just simply skip the frame, as it may not do much to the quality of the video anyway, or in one embodiment, blur or average or un-sharpen filter the pixels of the region of the frame that has the problem, e.g. the blinking eyes blurred out, so that it is not visible anymore.
Objects in Video or Movies:
Let's assume we have a series of frames in sequence. As soon as we find a big change in the scene (e.g. by comparing to the previous one, as percentage of changes in the new frame, or using motion vectors), we mark that frame as major delta or change, as a marker in the sequence. Then, for a sequence between 2 major deltas or changes or differences, we look for and extract all objects in the frames. For example, we find a red shirt in many of the frames of the 1<sup>st </sup>sequence. In a couple of frames, we see and extract a logo or name brand, e.g. POLO written on the shirt. So, in those frames, we associate RED and POLO to the “shirt”. So, we conclude that the red shirt is a POLO brand, for all sequence 1, even though we do not see or extract the brand or cannot verify that in all frames. The other neighboring sequences may also contain a red shirt, in which case, we can guess that it is also a POLO shirt, with a high probability or as one of the possibilities to investigate further.
In one embodiment, one can use a brand for ads or marketing, by editing, changing, or adding a brand or name or logo on a blank object, such as a shirt, in a sequence of frames, as explained elsewhere in this disclosure. In one embodiment, the system can select some of the frames or some of the directions of the view of the shirt, e.g. for adding the logo. Or, it can be done by a human user or expert. For example, the logo is appropriate to be added to the front of the shirt, as it is set in the library, not on the side or back of the shirt, for this particular brand. So, those frontal shirt views are selected and distinguished as a separate object, and the frames containing those frontal views are marked or flagged for addition of logo, later on, e.g. on the upper part of the shirt, as is described or specified in the library, by the manufacturer or expert or user. So, the proper frames are flagged, and only the shirts in those frames are edited, according to the library or rule collection or specifications.
Finding a brand or branding or re-branding has a lot of marketing and sales benefits. In addition, it will find the potential infringers or fake brand names, which copy or attach the brand name without permission or licensing, through image analysis on pictures or albums or on Internet web sites, using web search robots. One can use API (application programming interface), software development kit (SDK), metadata, tag, comment, or the like, for user interface or GUI or programming or specification of the objects.
For ads, once the user clicks on some object on screen, which is traceable, as an input device (such as screen of APPLE® IPHONE), the system can find what object is chosen by the user, based on extracted objects or based on the coordinate of the objects on screen, and send or connect or refer the user to the right or preferred or paid dealer or merchant(s), by email, web browser, give link, hyperlink, jump to address, fax, tel., mail, text message, or the like, with any communication means, to connect or inform or persuade or encourage the user to buy or at least learn about the object on the screen or image or video, for more sales, and to collect finder's fee, ad income, ad sharing, percentage income or revenue, partnership percentage, fees per click, traffic from ads, fees per links, fees per visit, fees per minute, fees per unique visitor, fees for actual purchases or transactions, fees for recommendations or feedback, fees for referrals, or the like, as a business model, to generate income for our system or web site.
In an embodiment, if the user puts the mouse or selector or menu option selection on an object on screen image or frame of a video, the system will understand what the user wants to select from its screen coordinate and location of the objects, and then the system gives all info, docs, specs, links, web sites, history, dictionary, encyclopedia, merchants, manufacturers, agents, characteristics, related objects, suggested objects, suggested similar or replacement or complementary objects by other users or bought by other users or reviewed or viewed by other users, from its library or databases or through its knowledge base or through its Z-web knowledge, starting from a node. In an embodiment, the user can automatically (using the system) send a TWITTER® or email or text or comment or SMS or vote or feedback or ask for opinion from all or close friends in her list or ask information about the object or express “LIKE” about the object or service or concept, based on the keywords or extracted descriptions of the object, e.g. car or TOYOTA.
In an embodiment, if the user selects an object, in an image (or frame), or the system selects an object for the user randomly, or from the list of the objects ordered in some fashion or reason (in the ordered list), then the system compares that object to the library, to figure out what type it is, e.g. tel. set, and then dig in more from other objects or attributes extracted from the image, e.g. brand name written or placed on the phone set as text or logo, e.g. APPLE, or the model number from its shape or size, versus rules and library information and Z-web, to figure out more details about that object, and build up Z-web even more.
In an embodiment, for marketing or sales purposes, the system uses sponsoring merchant's real or virtual store fronts on screen, to show 2D or 3D images of shelves and objects or services for sale or offer, for user to visit and select or review, to increase traffic and sales. This can be combined with the map of the city, for a virtual man walking in the 3D space of the city, visiting store-by-store, asking questions from store owner, robot, or other users, about the quality or spec of the object or service (on-line, by email, texting, SMS, IM, through dialog window, tel., or the like), meeting other people on-line in virtual store or street (e.g. setting a date or appointment to meet others on-line, for chat or common shopping experience or social networking or any other gathering), or the like.
In an embodiment, for marketing or sales purposes, at the store front, the objects or merchandise is shown in cartoonish or drawing format, or based on real pictures, on the screen, and the recognition or classification of the objects are done based on the teachings mentioned in this disclosure, through Z-web.
In an embodiment, for example, once we recognize a person with a red shirt in a video frame or in a vacation photo album for a specific date, then for any other person in that neighborhood of search in other frames or other photos, we can assume a person with the red shirt or same property is the same person, without checking his/her face, or minimally checking the face, for verification only. That speeds up the recognition process. In an embodiment, for example, we can assign a lower reliability factor value to the no-checking or minimally-checking face, mentioned above, which is a Z-factor in our Z-web, which can be improved by other neighboring nodes in our Z-web.
In an embodiment, for example, we can empirically or experimentally get the reliability factor value or other Z-factors for a set of recognition on e.g. some pictures, using a human or machine expert, to verify some or all of the samples e.g. after the recognition process, with the percentages recognized correctly, or membership values in fuzzy domain, as the metrics for the reliability factor values or parameters (or as scaling or normalization ratios for them). In an embodiment, for example, the same thing can be done for the bias factor or expertise factor, as other Z-factors, using people to tag or give opinion on the test samples, to show the bias or expertise and their degrees or values or fuzzy parameters, “highly expert” designation, e.g. for a human or machine.
Face Locating Module:
In one embodiment, we want to track, find, locate, or recognize faces in videos or frames or images. For a given type or class of face, we can get the histogram of colors of the face, obtained from our library, es. for faces or for histograms. Then, for a given picture, we define a window of examination, which can be scanned and shifted throughout the image, from one side or corner to the other side/corner, e.g. to the other diagonal side corner. In one example, the size of the window is 2×2, or 4×4, or 8×8, or 32×32, or 64×64, or the like (pixels). As the window moves and scans the image, we calculate the probability of the pixels belonging to histogram, for each instance of the window, per pixel within the window. Then, from the total probability per instance of window, we conclude which the most likely position or coordinate of a face in the image is, which corresponds to that specific window(s). In one embodiment, the total probability is defined as the sum of all probability values added, for pixels in that window. In one embodiment, the total probability is defined as the average or normalized value or median of all probabilities for pixels in that window. We compare the total probability versus some threshold, for such a determination, with binary decision or probability decision, as outcome.
In one embodiment, the threshold depends on the size of the window. In one embodiment, the threshold is obtained after scanning thousands or millions of faces, within some known or tagged training images or samples, with known histograms, for our basis or for comparison. In one embodiment, the threshold values are also stored in our libraries or databases, for various faces, images, and window sizes, beforehand. In one embodiment, the training is done by a neural network. In one embodiment, the threshold(s) is a Fuzzy parameter, and determination of a face is a Fuzzy determination, based on a Fuzzy set of faces. In one embodiment, the size of the window is chosen or set comparable with a typical size of a face in that scale in the image, or with respect to the average or estimated or expected size of the face of people in that scale of image. In one embodiment, from histograms and windows the potential for one or more positions or centers or regions for faces are obtained, which indicates how many faces are in the picture (and where in the picture, in terms of position or coordinate in the picture, e.g. in pixel values, in 2-D space, for picture frame axes).
In one embodiment, the threshold and histogram spectrum depend on the type of the faces, and so, the determination of existence of a face in an image depends on the type of the faces under examination. For example, if we are looking for a Chinese face signature, the signature is different with respect to that of a Middle Eastern face type or class signature, coming out of or extracted from the millions of samples from that type of face, beforehand, for calibration or learning or statistical analysis.
In one embodiment, the threshold and histogram are obtained from the size and direction of the faces, e.g. from millions of faces. The size of the face can be based on rectangle of (N×M) pixels. The direction of a face is e.g. frontal view, side view, half-way side view, and the like, which have different signatures, e.g. in terms of histogram shape and peaks. So, from this analysis, the size of the face and angle of view of the face are also determined.
In one embodiment, various histograms are generated and analyzed, e.g. for color (e.g. based on RGB or YMCK components), intensity, grey scale, frequency of any periodic function in image, wavelength of color, pattern in image, or the like. Of course, in general, the more histograms (including the data related to its general shape, position of peaks, and relative size of peaks), the better analysis for the image and better recognition or locating the face.
In one embodiment, various histograms are generated and analyzed for other kinds of images, such as sea or ocean pictures, or forest images, or outer space images, which have their own signatures and characteristics, e.g. to recognize forest images. Furthermore, the forest also has some subcomponents, e.g. trees or birds, with their own signatures and histograms, for locating or recognition purposes, e.g. to recognize trees the picture or painting or frame or video or image), Thus, generally, the method mentioned here can be used to find the types of images in a big scale, such a s “big data” analysis, classification, or filtering, and also, it can be further used for a deeper analysis, to find objects in the images, such as trees or birds or animals in a forest setting. Therefore, face recognition is just an example, and the method is more comprehensive (and applicable to other objects, as well).
In one embodiment, for edge linking or boundary detection, we use local area processing, with magnitude and direction of the gradient vector, with respect to a threshold. In one embodiment, we use a global approach, using Hough Transform, by changing the parameter space, e.g. for a line equation, and then quantize the parameter plane with a counter or accumulator), from which the edge linking for pixels is obtained. In one embodiment, we use region splitting and merging to connect and match similar regions, for segmentation purposes. In one embodiment, we use a chain code or vectors to express the boundaries. In one embodiment, we use histograms and similarity between its peaks and valleys (or its curve signatures or features), to classify the histograms, classify the objects, give a degree of similarity, or recognize the types or objects. In one embodiment, we use operations on regions of pixels, as sets (e.g. union or intersection or XOR), to merge or separate regions e.g. for continuity analysis for regions, e.g. for object recognition. In one embodiment, we use morphology operations, e.g. opening or closing operations or filters, for continuity analysis for regions or boundaries, e.g. for object recognition.
In one embodiment, we use pose, structural components, facial expression, image condition, or image orientation for the properties of an image of a face. In one embodiment, we use knowledge based (e.g. top-down method), template matching (e.g. predefined face templates or deformable templates), feature invariant (e.g. facial features, texture, skin color, or combination of multiple features, e.g. using color coordinates or histograms), feature based (e.g. bottom-up method), inductive learning (e.g. using decision trees, with positive and negative examples for face patterns), or appearance based technique (e.g. eigenface, distribution based, neural network, Bayes classifier (e.g. to estimate the joint probability of e.g. local appearance and position of patterns), Markov model (HMM, which relates to and depends on the probability of the prior state, for the chain of related events or objects, such as components of a face, e.g. eves and nose, as related objects, with known or expected relationships or distances), SVM, or relative information), to recognize a face.
In one embodiment, we use knowledge based for human knowledge or rules e.g. for intensity distribution or difference values for regions of the face. In one embodiment, we use knowledge of the peaks in the profiles of horizontal and vertical scans e.g. for intensity or color values, to find a face. In one embodiment, we model a face as a plane with multiple oriented facial features, e.g. eyes and nose, using pairs of edges or short curves (as our basis or basic elements to build a face), starting with detecting interest points, then detecting boundaries or edges and linking them, and then testing the results with a statistical model, to verify.
In one embodiment, we use face and non-face clusters for estimation of density functions (using Gaussian functions) for patterns for face and non-face situations. In one embodiment, we use distribution based, with patterns grouped in multiple face and nonface clusters, with each cluster represented by a multidimensional Gaussian function (with a mean image and covariance matrix). In one embodiment, we use one of the distance metrics, e.g. Euclidean distance between 2 points in N-dimensional feature space, to find the distances between the input image and the prototype in library (in cluster), or use Mahalanobis distance between test pattern and cluster centroid or center of mass or average value (which includes the correlation of the data set (also related to Hotelling Transform used for multivariate statistical testing)). In one embodiment, we use Kohonen Self Organizing Map (SOM), e.g. for eigenfaces, with each prototype representing a center of a cluster. In one embodiment, we use information approach, with spatial property of the face and contextual constraints.
In one embodiment, we have a method for recognition of faces from a still image or video frame, in which the system receives a still image or video frame through an input interface. Then, it preprocesses the still image or video frame. Then, it recognizes a first class of image for the still image or video frame. Then, if the first class of image for the still image or video frame comprises face or human, then it sends the still image or video frame to a face recognizer module. The face recognizer module accesses a first basis function from a first library of basis functions, stored in a first basis function storage, corresponding to a first component of face, e.g. eyes. The face recognizer module accesses a second basis function from a second library of basis functions, stored in a second basis function storage, corresponding to a second component of face, e.g. nose. A computing processor applies the first basis function across the still image or video frame to detect the first component of face. The computing processor applies the second basis function across the still image or video frame to detect the second component of face. The computing processor accesses a relationship between the first component of face and the second component of face. Then, the system assigns a first Z-node and a second Z-node on a Z-web to represent the first component of face and the second component of face, respectively. Then, it assigns a first branch connecting the first node and the second node on the Z-web to represent the relationship between the first component of face and the second component of face.
Then, it assigns a Z-factor as a mathematical set of factors related to reliability, confidence, truth, expertise, bias, knowledge, usefulness, and relevance, or the like, for those objects. Then, it assigns a first Z.-factor, a second Z-factor, and a third Z-factor to the first node, the second node, and the first branch, respectively. Then, the computing processor analyzes the first Z-factor, the second Z-factor, the said third Z-factor for the first node, the second node, and the first branch. Then, the computing processor detects one or more faces in the still image or video frame, with a fourth Z-factor, based on the above analysis step. Then, the computing processor compares the detected one or more faces with the fourth Z-factor against a library of faces, each with its own Z-factor, stored in a first face storage. If the detected one or more faces matches or corresponds to a first face in the library of faces, then it outputs the identity or identification number of the first face, as identification for the detected one or more faces from the still image or video frame, along with a fifth Z-factor corresponding to the matching or correspondence to the first face.
In one embodiment, in addition, it (i.e. the system) determines one or more contexts for the still image or video frame. In one embodiment, it (i.e. the system) determines a partial matching of an object. In one embodiment, it (i.e. the system) determines a match of an object partially shown in the still image or video frame. In one embodiment, it (i.e. the system) looks for a related object in vicinity of the first object in the still image or video frame, or in other related images or video frames, or looks for an expected object from a list of expected objects within a radius of search of the first object, looks for an expected object from the Z-web, with its corresponding nodes and Z-factors, with respect to a third node representing the first object. In one embodiment, it (i.e. the system) applies a rule for recognition, or a rule template for recognition. In one embodiment, it (i.e. the system) emails or communicates a file or data or recognized image or video to all or subset of people recognized in the still image or video frame, or video conferences among all people recognized in the still image or video frame, or coordinates calendar or meeting time among all people recognized in the still image or video frame, or sends notification or warning to all people recognized in the still image or video frame. In one embodiment, it (i.e. the system) edits, replaces, erases, covers, or exchanges one, some, or all people recognized in the still image or video frame. In one embodiment, it (i.e. the system) warns or notifies an authority or police about one, some, or all people recognized in the still image or video frame.
Compressing Text or Voice:
Sometimes, we have some text or voice recordings, e.g. some words, that rhyme together, e.g. “bank”, “tank”, and “sank”, e.g in a poem or in a sentence. Then, due to the pattern existing in the rhyme, one can reduce or compress the size of final data, and take advantage of redundancies or patterns existing in poems or rhymed phrases or sentences. For example, one can describe the pattern for the example given above as (which is a compressed version of the data, for more efficient storage or faster retrieval):
<br />{“b”, “t”, “s”} +“ank”
The same thing can be done with notes, voices, music, or other modes of communications or data, which may have inherent patterns, to use redundancies for compression of data, to increase efficiency for storage or retrieval. The recognition of the pattern or comparison of data or building up the library or using training sets can also be done more efficiently, using the patterns or redundancies in data., in different levels, e.g. at word-level or at letter-level or at sentence-level, for the text. The redundancy or pattern also relates to the entropy of data (measure of disorder and unpredictability), which relates to the amount of information, and also, relates to the minimum storage needed to store the data.
Programming by AI Tools & Other Applications for Robots:
With General-AI and its application for voice recognition or text recognition, discussed elsewhere in this disclosure, one can just say the purpose or action in simple English/other languages, and the processor converts that into the software codes/instructions. For example, the user can say: “I want 100 times doing the function F”. Then, the processor converts the command or voice instructions into the following summary/abstract/intermediate instructions:
Loop 100 times, F(x)
which can then convert it into assembly language, machine language, or other computer languages, e.g., as:
<tables id="TABLE-US-00001" num="00001"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="offset" colwidth="49pt" align="left" /><colspec colname="1" colwidth="63pt" align="left" /><colspec colname="2" colwidth="105pt" align="left" /><thead><row><entry /><entry namest="offset" nameend="2" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry /><entry>For i = 1 to 100</entry></row><row><entry /><entry /><entry> Begin</entry></row><row><entry /><entry /><entry> Call F(x)</entry></row><row><entry /><entry /><entry> End;</entry></row><row><entry /><entry namest="offset" nameend="2" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>
So, the programming a computer can become much easier, even for non-technical people. Using these interfaces, anybody can become a programmer/coder/developer, increasing the flexibility of devices as programmable units at home or office or car, e.g., for IoTs and smart phones. This can increase the productivity of people, which can use the various talents of people more efficiently at home or office or elsewhere.
This can also find bugs or inconsistencies or infinite loops or mistakes automatically, and fix them, or show them to the user for clarification or correction. For example, if the loop can never exit, as an infinite loop, it can self-diagnose and self-correct that. The self-diagnosis can be done for hardware, too, e.g., for robots, by sensors/self-testing, e.g., if they sense a faulty/unusual voltage or current or temperature, they can sense a possible pattern or fault or error or malfunction in a piece of hardware, e.g., a capacitor or wire or processing unit, to suggest to a user to change that part, or the robot itself can go and grab a spare part and replace the faulty part, from its own toolbox and spare parts section. For this to happen, the robot has to have hardware and software redundancies, e.g., for processing units and memory and its arm and its brain and the like, e.g., to be able to cut/replace a circuit open without shutting down itself simultaneously. So, it has to have a parallel path(s) for various tasks/connectivity (e.g., for commands and electrical current) that can overlap and use the common areas between the resources, to be able to “cut” itself or its components. Otherwise, it can only warn the user to do the task and change the part manually.
The use of General-AI for self-diagnose and self-correction is very important for autonomous vehicles, boats, space ships, and drones, as an example, which may not have any access to, e.g., any human/technician/engineer on Mars or outside Solar System, for any simple or complex repair.
These can also apply to surgical robots, deciding about the diagnosis and best ways to do the operation, e.g., on a knee surgery, using the images from the knee, all automatically or with the help of a surgeon, to cut or connect body parts during surgery, with delicate tools which can be much smaller than surgeons' hands, and thus, can easily access inner parts of body without damaging the tissues, with cutters and cameras/light sources.
<figref idref="DRAWINGS">FIG. 268</figref> shows an embodiment for robots for self-repair, cross-diagnosis, and cross-repair. It can include temperature sensors for failure detections, current or voltage or power measurements and meters for calibrations, drifts, and failures detections/corrections/adjustments, microwave or wave analysis and detection, e.g., frequency, for failures detections/corrections/adjustments, and the like. It can use AI for pattern recognition to detect or predict the failures on software and hardware sides or virus detection or hacking detection. It can talk to another/sister robot to fix or diagnose each other or verify or collaborate with each other, with data and commands.
<figref idref="DRAWINGS">FIG. 283</figref> shows an embodiment for redundancies on both system and components-level, for a system, so that if any part is disconnected/failed/replaced for repair, the other system or component will take over, so that there will he no interruptions in the circuit/system/operation/software performance, used for diagnosis and repair procedures, e.g., for robots or AI systems.
Data Type:
Let's look at one example: Let's assume that we have two integer numbers: 86886668 and 86868668. The only difference between these series or combinations of digits is the position exchange of the following 2 digits: 86886668 versus 86868668. However, since the other digits located at the left side or fight side of the difference digits are very similar to the difference digits (consisting of digits 8 and 6, only), the difference is not very visible to the human eye or perception. Thus, if the difference or feature is very similar to the background or environment, then the difference or feature is lost (for recognition or classification purposes). This may not be a big problem for a color photograph or picture from a family vacation in Italy, as the neighboring pixels or patterns or data can be mixed or exchanged or averaged, with not much problem for overall analysis or recognition of objects. However, this may be a major problem for cases dealing with numbers, such as integers, as the numbers may be very different in values, just e.g. by exchanging two digits, as shown in the example above.
Thus, depending on the data, as is the case with integers in this example, we may want to be more careful on the position and ordering of the pieces of data, such as position of digits in an integer value or data. Therefore, as the first filter or scan or pre-process, we want to separate the data in their format or usage or header or type, e.g. image, photograph, text, number, table, list of numbers, and the like, to treat the data accordingly in the next steps, e.g. separately and optimally, depending on its type. In this example, for integers, the window of examination for digits should be small, with focus on each digit, so that we do not miss or overlook or mix any digits, in the image under study.
Text Templates:
In one embodiment, we get statements or questions or sentences as inputs, and then we process them with respect to the templates in our library, based on grammar or other rules in language, to find the meaning of the sentence, or break it down or parse it to pieces for understanding the words and ultimately the sentence. For example, we have “Jim is 20 years old.” as input. Then, we compare it with the template: [NAME+VERB+NUMBER+“years old”]. Of course, it may match multiple templates in our library, and all give the same meaning at the end to the user. The templates may have their own Z-web, so that we can get related templates for comparison and natural language processing. In one embodiment, the Z-web is based on Fuzzy nodes and Fuzzy reliabilities and Fuzzy boundaries and Fuzzy relationships and Fuzzy templates and Fuzzy definitions and Fuzzy sets and other Fuzzy parameters, including branch strength, length, and the like.
Since the system finds that VERB is a “to be” verb, namely, “is”, the template is simplified as: [NAME+NUMBER+AGE], or [name/age/number], or [Jim/age/20]. The age attribute of Jim is stored in Z-web, next to JIM node, as a new node, or as an attribute or property of the original node, i.e. JIM node.
In one embodiment, many different inputs give the same result, namely, [Jim/age/20], at the end of analysis. For example, other inputs (with the same conclusion or result) are (using other similar templates): <ul id="ul0082" list-style="none"><li id="ul0082-0001" num="0000"><ul id="ul0083" list-style="none"><li id="ul0083-0001" num="2371">Jim is a 20 year old kid.</li><li id="ul0083-0002" num="2372">Jim was born 20 years ago.</li><li id="ul0083-0003" num="2373">Age of Jim is 20 years</li><li id="ul0083-0004" num="2374">Jim is 20.</li><li id="ul0083-0005" num="2375">Jim is 20 years of age.</li><li id="ul0083-0006" num="2376">Jim is 20 years young.</li><li id="ul0083-0007" num="2377">Jim is twenty years old.</li></ul></li></ul>
In one embodiment, the system instantiate the meaning based on the template. For example, at the time of the statement (e.g. year 2010), we set the age of Jim as being at 20 (as the set age for Jim), or in template form, we have e.g.: [2010/Jim/age/20], adding the time of the statement to the format of presentation of data, for completeness. Then, after 2 years, after the statement date, i.e. 2012, we add 2 years to the set age, namely, (20+2.) or 22, as the current age for Jim, or in the template format: [(2010+x)/Jim/age/(20+x)], with (x=2), or [2012/Jim/age/22], wherein x represents the delta or difference in years. Also, see other parts of the current spec, for other methods for natural language processing and text parsing and understanding or converting sentences into templates or easy-process data formats.
Feature Space:
In one embodiment, when we have a “big data”, we can define e.g. a few hundred parameters, No, for dimensions of the space characterizing such a data (related to components of such data). For example, for face recognition, for images containing faces, the parameters can be the length of the nose, width of the nose, ratio of the width to the length of the nose, and angle of the nose (with respect to the vertical plane in front of the face). As long as N<sub>D </sub>is large enough and comprehensive enough, we can analyze, sort, classify, or recognize such data, using N<sub>D</sub>-dimensional feature space. Each instance of data is a point in the N<sub>D</sub>-dimensional feature space. So, we can define the Cartesian distance between 2 points, in that space, as the measure of similarity (with each point representing a vector of N<sub>D </sub>dimensions). The closer the points, the more similar they are to each other. We can define the distance between points 1 and 2 as the conventional distance between 2 points in space, namely, the square root of the summation of square of all of the differences in coordinates of 2 points in different dimensions, or (wherein i (index) runs from 1 to N<sub>D</sub>):
<br />√Σ<sub>i </sub>(x<sub>i2</sub>-x<sub>i1</sub>)<sup>2 </sup>
Any other mathematical distance metrics used in the industry can be used for this analysis. We can also cluster similar points into same class or subclass in that space. Now, we can compare different instances of data very easily. For example, we can say one image is very similar to the 2<sup>nd </sup>image, without even knowing what is in the image, per se, or what is in the text, specifically. The longer the data or document, the better statistical analysis one can do on the data, for classification.
In one embodiment, furthermore, for example, to cross between English and French textual data, for comparison, we can normalize one language to be comparable to the other language. For example, after normalization, a NOVEL or HISTORICAL or SCIENCE-FICTION category for books, as a class of textual data or books, from English language, has similar coordinates as those of the French language, making the comparison or classification between multiple languages possible. So, even if we do not know what the French book contains, we still can say it is a HISTORICAL book, by just looking at the normalized coordinates of the book, compared to those in English language, as being located in the same cluster or class in the feature space. This method is useful e.g. for email or image analysis, which is useful for security, summarization, e-discovery, medical data, marketing, prediction, pattern analysis, or the like.
Storage and Retrieval:
In one embodiment, for storage or retrieval of a data, we can use different versions of that data. For example, let's assume that somebody's (Jim's) salary is 104,322.34 US$ per year. Then, we can store that as “104,322.34”, as a real number in the 1<sup>st </sup>memory unit or module or storage or region or section, or as “about 100 K” in a 2<sup>nd </sup>memory (as we classify that coarsely, or quantize that more coarsely, or fuzzify that value, or classify them in bigger bins or buckets, or classify them in less number of classes or types, or define bigger clusters to include multiple clusters), or as “low 6 figures” in a 3<sup>rd </sup>memory, or as “average high salary” in the 4<sup>th </sup>memory. The first memory is more accurate, but it has larger requirement for storage and slower retrieval time and slower search and query time. The 4<sup>th </sup>memory, on the other extreme or spectrum, has smaller requirement for storage size and faster retrieval time and faster search and query time. The other memory units fall in between these two extremes or opposite performances (in the spectrum of performances or requirements or cost or constraints or usage or applications). Of course, we can expand the concept for n-th memory unit, as well, e.g. n=20 or 40. See e.g. <figref idref="DRAWINGS">FIG. 165</figref> for such a system.
In one embodiment, based on the discussion above, the 4<sup>th </sup>memory is better for long term storage or memory, and the 1′ memory is better for short term storage or memory, which can be erased and updated more often, e.g. when we are out of space or when we want to keep the size of the first memory low, for retrieval purposes, to focus on more urgent matters or data, So, the more fuzzified data is stored in the longer term memory. So, if the degree of fuzzification is shown as F<sub>Fuzzy</sub>, and the degree of long term memory is expressed as T<sub>memory</sub>, which both of them can be both fuzzy and crisp parameters, then, in one embodiment, we can say that F<sub>Fuzzy </sub>monotonically increases or decreases, as T<sub>memory </sub>increases or decreases, respectively. In one embodiment, we have T<sub>memory </sub>as a function of F<sub>Fuzzy</sub>. In one embodiment, we can have those two parameters (values or degrees) as roughly proportional (linearly), or (with K<sub>memory </sub>as the coefficient of proportionality) (just as an example, and not limiting at all):
<br />T<sub>memory</sub>=K<sub>memory </sub>F<sub>Fuzzy </sub>
In one embodiment, we store the data in all 4 memory units. In one embodiment, we store the data in memory units 1-3, but not 4. In one embodiment, we store the data in memory units 2-4, but not 1. In one embodiment, we store the data in memory units 2-3, but not 1 and 4. In one embodiment, we store the data in one of the memory units, only. In one embodiment, we store the data in 2 of the memory units, only. In one embodiment, we store the data in 3 of the memory units, only, and so on. In one embodiment, we store the data in some (N) of the memory units, only, out of M total available. In one embodiment, the N units are sequential units, one after another. In one embodiment, the N units are not sequentially ordered units, i.e. not one after another, e.g. skipping every other units (e.g. starting from one of the units, going in one or both directions, until N is exhausted), or e.g. skipping every other 2 units, or e.g. N units randomly or semi-randomly or pseudo-randomly distributed between M units, or e.g. distributed between M units within or by any pattern or rule of distribution. Thus, e.g. based on the usage or need or requirements, one chooses one of the schemes above for the storage of the data., some of which have some partial redundancy for storage of data.
In one embodiment, as the time passes, the shorter term storages are erased more often, thus, reducing the redundancies gradually. Even the longer term storages can be erased or edited or updated, as the system becomes aware of the bad data or expired data. In one embodiment, for search and retrieval of Jim's salary or data, we start from the unit K-th memory, and go in one or both directions, toward 1<sup>st </sup>and M-th memory units, until the system finds one or more values for Jim's salary, from one or more of the memory units. In one embodiment, for search, we can skip some of the units, randomly or in order or in a pattern, very similar to any of the variations of methods described above for the storage of data. So, basically, the search can be in any order we wish.
However, in one embodiment, we may already know that we have only stored these kinds of data in the long term memory, or only long term memory unit(s) has a substantial probability of having any information, if any at all, then we limit ourselves in those units or regions or range of units, for search, e.g. only look at units 3 and 4. So, in those situations, we just go directly to those units, to save time and resources, for efficiency. In one embodiment, we are looking for one value, only, and thus, we stop the search, once one value is found for Jim's salary. In one embodiment, we are looking for R separate values, and thus, we stop the search, once R values are found for Jim's salary, or until N is exhausted, or until the search pattern is exhausted. In one embodiment, we know the storage rules and patterns, so we can optimize the retrieval, e.g. in reverse of the storage rules and patterns.
In one embodiment, we have an indexing table between the memory units for mapping the data between those units. These search, retrieval, storage, query, and fuzzification or quantization methods, explained above, are very efficient techniques for large amount of data and analytics, and for long term storages, which are expensive or impossible for all data in our universe or set, e.g. Internet or Big Data.
One Example for Adjusting the Ranking:
In an Internet search engine, in one embodiment, when it presents the data or links to a user and the user goes to e.g. 5<sup>th </sup>page on her screen and clicks on a link there, as the hit number 46 (ranked 46 for display to the user, or N<sub>rank</sub>=46), skipping the first 4 pages or first 45 hits or links or web sites on display, that indicates that that selected link is very relevant to the user's search, as a feedback to the system, to adjust the weights or results for future similar searches, to reorder or re-rank or replace or exchange the list or items or importance or weights, based on a correction factor. Note that normally, most people would not go more than few pages or few hit lists in the ranking, if they cannot find good result soon (which is an inherent bias in the system). They would rather re-write their search query, instead. So, in one embodiment, the probability of selected items from bottom of the list goes down e.g. exponentially, as we go further down the list or ranking. So, in one embodiment, we can model that with an exponential function, as an example. So, e.g. if an item selected from the bottom, that indicates that the search engine was very off, and the error was high, and the correction is a major correction (C<sub>rank</sub>). So, in one embodiment, we can write the correction (C<sub>rank</sub>) based on a function of (N<sub>rank</sub>−1), as:
<br /><i>C</i><sub>rank</sub><i>=F</i><sub>rank </sub>(<i>N</i><sub>rank</sub>−1)
Note that in one embodiment, for (N<sub>rank</sub>=1), there is no correction needed (or correction is zero), and the difference (N<sub>rank</sub>−1) is the parameter that we are interested in, as the distance to the first hit or link. In one embodiment, we have the exponential relationship, with the normalization or adjustment factor K<sub>rank</sub>:
<br /><i>C</i><sub>rank</sub><i>=K</i><sub>rank</sub>[exp (<i>N</i><sub>rank</sub>−1)−1]
Then, we use C<sub>rank </sub>to adjust the list or ranking, as a feedback to the system (which, in one embodiment, generally is not a linear function of or proportional to C<sub>rank </sub>at all). Of course, in one embodiment, this function grows very fast, and to dampen its growth, in one embodiment, we can add a denominator, D<sub>Damp</sub>, to make it more manageable for our system and normalize the exponential function. So, in one embodiment, we will have:
<br /><i>C</i><sub>rank</sub><i>=K</i><sub>rank</sub>[exp ((N<sub>rank</sub>−1)/<i>D</i><sub>Damp</sub>)−]
Of course, this is not the only way to make any adjustment on the system and ranking, and based on the purpose, other similar methods or corrections can be used, as well (like the ones currently used in industry, e.g. GOOGLE®'s PageRank algorithm). For example, in another embodiment, we have multiple pages of ranking for search on Internet web sites, and the system randomly selects a hit number from lower ranking, to highlight and bring up to show to the user, to see if the user selects that, as a feedback, which means that if selected by the user, the criteria should be changed to favor that randomly selected hit number, to come up in ranking for future searches. So, that would be our training sample or adjustment sample for scoring, relevance, or ranking. The scoring, relevance, or ranking can also be handled using Z-web, to build up or adjust, as time passes.
Finger Prints:
In one embodiment, for fingerprint recognition (or other similar biometrics or pattern recognition situations), we look for the features such as cusps (where 2 curves meet), grooves, curves, curvatures, angles, slopes, or fingerprint minutiae (e.g. splits, loops, “Y”-shapes, short curves, or the like). Then, we define multiple basic building blocks from which (or combination thereof) we can get all the features above in any fingerprint in our library. Then, we codify or symbolize the curves, cusps, fingerprint minutiae, or other features, based on those basic building blocks (or basic alphabets). For example, we have a shorthand notation, with the following grammar or rule:
<tables id="TABLE-US-00002" num="00002"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="4"><colspec colname="offset" colwidth="28pt" align="left" /><colspec colname="1" colwidth="56pt" align="left" /><colspec colname="2" colwidth="56pt" align="left" /><colspec colname="3" colwidth="77pt" align="left" /><thead><row><entry /><entry namest="offset" nameend="3" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry>Y [left]</entry><entry>Y [right]</entry><entry>SHORTLOOP</entry></row><row><entry /><entry namest="offset" nameend="3" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>
For example, for the above notation, we have a split curve, in the shape of “Y”, which on the left branch of split, ends up with another split, in the shape of “Y”, which on the right branch of split, ends up with a short loop (or circle or closed curve or oval). For example, the short loop is defined in our library, as a range or fuzzy parameter or crisp values or thresholds or sample training shapes from actual fingerprints. The qualifier or characteristic or adjective “Short”, by itself, is a fuzzy parameter or value, as well. See e.g. <figref idref="DRAWINGS">FIG. 166</figref> for such a system, for a general pattern recognition situation.
Now, in one embodiment, if we want to express the other side of the first split (the “right” side, in this example), we can it write as:
<tables id="TABLE-US-00003" num="00003"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="4"><colspec colname="offset" colwidth="28pt" align="left" /><colspec colname="1" colwidth="49pt" align="left" /><colspec colname="2" colwidth="70pt" align="left" /><colspec colname="3" colwidth="70pt" align="left" /><thead><row><entry /><entry namest="offset" nameend="3" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry>Y [left]</entry><entry>Y [right]</entry><entry>SHORTLOOP</entry></row><row><entry /><entry> [right]</entry><entry>LONGLOOP</entry></row><row><entry /><entry namest="offset" nameend="3" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>
In this example, the right side ends up with a “long loop” feature, as defined in our library. The other splits and branches are also written in the same way, with the same grammar. Alternatively, we can write the same notation above this way, with a slightly different grammar:
<tables id="TABLE-US-00004" num="00004"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="4"><colspec colname="offset" colwidth="21pt" align="left" /><colspec colname="1" colwidth="56pt" align="left" /><colspec colname="2" colwidth="70pt" align="left" /><colspec colname="3" colwidth="70pt" align="left" /><thead><row><entry /><entry namest="offset" nameend="3" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry>Y1 [left]</entry><entry>Y2 [right]</entry><entry>SHORTLOOP1</entry></row><row><entry /><entry>Y1 [right]</entry><entry>LONGLOOP3</entry></row><row><entry /><entry namest="offset" nameend="3" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>
Here, we labeled the Y-shapes and other features, such as the SHORTLOOP, with an added counter or integer, attached to the name, so that we can keep track of which one we are following, e.g. when we have hundreds of them in our notation, describing a complete set of fingerprints from a person. Other useful descriptors for fingerprints are, e.g.: SHORTLLNE, SHORTCURVE, SHARPANGLE, WIDEANGLE, and the like.
Once we map or codify our fingerprints in one of the grammar notations, we can store or compare them with others very easily, from library or database, for recognition or percentage or probability of match or verification of a person. This method can be used for iris recognition and the like, with components of iris or eye described this way, with its own vocabulary or building blocks and corresponding grammar to connect them together, in a compact way, for storage, comparison, training for neural networks, retrieval from database, matching, and scoring.
Note that curves, cusps, or Y.-shapes can also be modeled with Z-nodes and Z-branches, as a Z-web, for storage, comparison, or manipulation, plus reliability factor and other Z-factors, when e.g. sonic of the curves are not very visible or erased partially or not available, which can be handled or modeled with reliability factor and other Z-factors.
Skeletons:
In one embodiment, we can use the skeletons method for the objects. For example, the Eiffel Tower can be simplified using the operator skeletons on the object or pixels, which is a well-known operator for image processing. For example, see page 545, of book Gonzalez et al., “Digital image processing”, published 1993, by Addison-Wesley. Then, we can compare the skeleton of the unknown object with skeleton of the known objects or classes in the library, in a very fast and efficient way, to first find that the object is generally a “tower”. Then, once we know it is a tower, then we can compare the full version of the object with those in the library or our knowledge base, in the “tower” category, which is a very limited class with limited number of members, which means more efficient search and faster search results, which is good for Big Data analytics or Internet, e.g. to find famous objects, figures, people, cities, or monuments.
The skeleton of an object can be described by mathematical formulation, simple geometrical figures (e.g. inverted “Y” shape, for the tower), or textual description (e.g. “inverted ‘Y’ shape”), as some examples. In one embodiment, we can describe the skeleton as a fuzzy parameter or description, which takes less space in memory and also may make the search narrower much faster, in a multiple step process for search. See e.g. <figref idref="DRAWINGS">FIG. 167</figref> for such a system.
In one embodiment, we use fuzzification, or use low resolution version, or use small version (in size), such as thumbnail version of image, or use one of the components of its wavelet expansion, or use one of the components of its Fourier expansion, or use one of its filtered version, e.g. based on frequency filtering or spatial filtering, or use one of its averaged versions on neighboring pixels in image (instead of skeleton operator, method, or filter, above).
Music Recognition:
In one embodiment, for music recognition, or for sound, or voice, or lectures, or humming or whistling or beating sound (e.g. from mouth or by tapping on a desk by hand), or series of notes or harmonics or modulated waveforms or sinusoidal functions, we can identify the music or the notes or the like, using the sound bites or pieces, extracted from the original piece (e.g. from sound waveform, broken down to pieces when there is a relative silence or low intensity in the waveform, or we can do it in frequency domain, based on frequency analysis, as frequency components and their weights, e.g. by Fourier analysis), as its building blocks, to compare to the pattern or series of notes in the library, to match or find the fight one. If other data, such as artist or singer is known, the Z-web can find that song easier or faster.
The patterns of sound can be represented by beating sounds or regular music notes, e.g. to mimic a famous song or music, e.g. “BEE-BEE-BEEM-BAM-BOOM-BEE-BEE-BEEM-BAM-BOOM”, where symbol “-” denotes the unit of time for pause between sound pieces, which can be e.g. a fraction of a second. Then, the unit blocks used here for our dictionary of our basic sound pieces are: BEE, BEEM, BAM, and BOOM. Then, for all of our library of songs or music, we generate these pieces, to harmonize or normalize, to gather all possible basic sound pieces, to complete our dictionary of our basic sound pieces. The recognition for these series of codes or notes are done very similarly by other pattern recognition methods we mentioned in this disclosure.
That is an efficient way of generation, classification, recognition, and retrieval of original songs or music, from library or database, through these converted patterns, with relatively simple dictionary. The connection or series of these patterns can be mapped to a Z-web, as well, for recognition purposes. One application of this is for higher sales, encouraging more sales, introducing to friends, introducing similar songs, finding copyright infringers or trademark infringers on similar songs automatically on the web, or matching friends, which are all good for movie and music recording industries (e.g. choosing or finding specific ring tones for tel. sets).
Eigenvectors for Recognition:
In one embodiment, to learn the samples more efficiently for a learning machine, we want to use low dimensionality (reduce degrees of freedom for original data), using a transformation technique, e.g. using histograms, Ritz approximation or example-based presentation. Independent-Component Analysis, (labor type filters, Karhunen-Loeve or Principal Component Analysis (PCA). Wavelets, or the like, to get a subspace of the original space.
For an object, e.g. a face or head, we have N number of models in library, with grid presentation, connecting multiple points with lines in-between, and the positions of the points are variable, or have fuzzy coordinate values, or are elastic, as shown in <figref idref="DRAWINGS">FIG. 168</figref> and <figref idref="DRAWINGS">FIG. 177</figref>. In <figref idref="DRAWINGS">FIG. 177</figref>, we have shown 2 models: grid model (using feature points, such as eyes, as anchor points or corners or edges, for tessellation or tiling or covering the whole face) and region block model (or region model), which has K <sub>RM </sub>regions (e.g. 12) and MRM relationships (e.g. 26) between regions, shown by arrows or vectors, for relative positions or orientations between regions, e.g. their coordinates, their corners, their boundaries, their edges, their centers of mass, their nearest points or edges, or their geometrical centers. (Please note that for <figref idref="DRAWINGS">FIG. 177</figref>, we drew the 2 models partially on the faces, to make the point.) In one embodiment, the tiling can be done by user, expert human, computer trained machine, or a model based computer. In one embodiment, using those N models and the fuzzy parameters for coordinates of reference points, we can fit any given face or head. Now, we store the data in the database. Then, for future, we can compare and find the best match, based on those N classes, to narrow down the search, at the beginning.
In one embodiment, we use the autocorrelation matrix. In one embodiment, normalized aligned meshes or grids with the fuzzy parameters for coordinates of reference points. In one embodiment, we use the neural networks for learning machine. In one embodiment, we use the age progression on faces to modify the face or morph the face based on age transformation model. In one embodiment, we use the lighting adjustment, to normalize or transform the pixels accordingly, for better comparisons between images. In one embodiment, we use the face recognition against the mood or emotion of face model templates in the library, to find the mood or emotion, to conclude the psychology or intention of the subject, e.g. for marketing purposes.
In one embodiment, we use the model shown e.g. in <figref idref="DRAWINGS">FIG. 168</figref> to morph the components of the object or face, based on the parameters and small changes on those parameters, e.g. in a chain sequence, e.g. for ΔX, ΔY, and Δθ perturbations, e.g. for small distances and angles, e.g. for components, e.g. for eyes and nose. In one embodiment, the perturbations can be on pixel level, or on component level, such as eye, or on curves defining the edges and boundaries of components, e.g. eye. In one embodiment, the perturbations are on tiling, or on edge of tiling, or on corners of tiling, or on such coordinates, or on region model or rectangles or triangles, as shown e.g. in any of 2 models shown in <figref idref="DRAWINGS">FIG. 177</figref>.
In one embodiment, we use the eigenvectors for the face or head for recognition, with the object (e.g. face or head) as the linear combination of the eigenvectors or basis functions (e.g. 100-200 of them in the library), e.g. as shown in <figref idref="DRAWINGS">FIG. 169</figref> or <figref idref="DRAWINGS">FIG. 170</figref> or <figref idref="DRAWINGS">FIG. 178</figref>. In one embodiment, these are simplified face types or component of face types, e.g. nose or eye (e.g. see <figref idref="DRAWINGS">FIG. 170</figref>), or are similar to basis functions for Fiadamard Transform or Discrete Cosine Transform (DCT), for images (e.g. see <figref idref="DRAWINGS">FIG. 169</figref> or <figref idref="DRAWINGS">FIG. 178</figref>).
In one embodiment, we use the distance between them, as the measure of similarity, or to find the person. In one embodiment, we can generate the eigenvectors or basis functions using thousands of images of faces (as training samples), or get the common denominators for those images by comparing them (or get the difference or delta and subtract the difference from the original image), or filter those images to intentionally blur them with different filtering schemes or steps (to generate those different eigenvectors, e.g. using averaging filter on neighboring pixels, e.g. for 8 neighboring pixels). Mathematically, we can write e.g. for a given face, F<sub>face</sub>, in terms of. N<sub>eigenvector </sub>eigenvectors or basis functions, V<sub>i-eigen</sub>, as their linear combination, with the coefficients A<sub>i-eigen</sub>:
<br /><i>F</i><sub>face</sub>Σ<sub>i</sub><i>A</i><sub>i−eigen</sub><i>V</i><sub>i−eigen </sub>
Wherein i=1, 2. . . N<sub>eigenvector</sub>, and the summation runs on variable i.
In one embodiment, we use the local feature analysis, for features on the face, e.g. mouth, nose, eyebrow, eye, ear, and the like, as can be represented as a superimposed image of separate images for different parts of the face, e.g. mouth, eye, and nose.
In one embodiment, if we have different basis functions or basis objects for recognition of different parts of the main object, e.g. for face, recognizing e.g. eye and mouth, as components of the face, then we look for similar basis functions or basis objects, e.g. for eve and mouth, to factor them together, in case they are the same or very similar, based on some fuzzy or crisp threshold or percentage or relative size or absolute size. Then, we save on the storage and calculation period, as the total number of basis functions or basis objects for all objects in our universe or set is reduced, making the process much faster. In addition, in one embodiment, we can do the parallel processing, because for most parts of the e.g. face, this can be processed at the same time for the same or common basis function. This is a huge advantage, in terms of processing time, e.g. in real-time or on-spot recognition, e.g. face recognition, e.g. at the airport.
In one embodiment, wavelets or Haar orthonormal or Fourier basis functions are used as simple black/white region rectangles or squares, or as resembling components of an object, or as resembling simple patterns, for face or object or pattern recognition, as we scan the image. In one embodiment, the wavelets or basis functions are used at different resolutions to scan the image to find all instances of such object in the image. In one embodiment, the wavelets or basis functions used at different resolutions are scanned simultaneously in parallel for faster search. In one embodiment, the wavelets or basis functions that look the same or similar for different objects at different resolutions are scanned or processed simultaneously in parallel for faster search.
In one embodiment, when we dot product the image with any given eigenvector or basis function (assuming orthogonal or orthonormal basis), then we get the coefficient corresponding for that eigenvector, for the linear combination formula mentioned above.
Feature Detection, Using Basis Objects or Basis Windows:
To find a face or other objects, one can use windows or filters that resemble their basis objects, as much as it is practical. The basis objects are the components of the object. For example, for the object of “face”, we have basis objects as eye, mouth, nose, and the like. So, we design a window or filter that looks like a mouth or eye, or resemble them roughly, as shown in <figref idref="DRAWINGS">FIG. 170</figref>. Then, we use them as our basis windows. In one embodiment, the basis windows are rectangular or square, which are simpler to handle. In one embodiment, the basis windows are in free form shape. The examples are rectangles or squares of size 2×2 pixels, 2×4 pixels, 4×2 pixels, 3×6 pixels, 4×8 pixels, 32×32 pixels, and so on. The basis windows are divided into two sections, e.g.: black section and white section. For example, the black section resembles the eye or nose. In one embodiment, having black section and white section in fuzzy domain, we assign values between 0 and 1 to the black section and white section, as membership values. In one embodiment, having black section and white section in crisp domain, we assign values between 1 and 0 to the black section and white section, respectively, as an example.
In one embodiment, for the basis windows, the black section does not resemble any basis object at all, but it looks like an ordered geometrical basis function, in black/white or in grayscale or in color components, similar to Walsh basis functions (for example, see page 136 of book Gonzalez et al., “Digital image processing”, published 1993, by Addison-Wesley), or similar to ordered Hadamard basis functions or Discrete Cosine Transform basis functions (for example, see pages 143 and 145 of book Gonzalez et al., “Digital image processing”, published 1993, by Addison-Wesley), as shown in our <figref idref="DRAWINGS">FIG. 169</figref> or <figref idref="DRAWINGS">FIG. 178</figref>, above.
In one embodiment, now, we express the image base on these basis windows, same as basis function representation. Or, in one embodiment, we can use the dot product of each of the basis windows with the image, to get the projection of the image on that basis window, which is similar to the component of the image on that basis window coordinate space. In one embodiment, the dot product is defined as the sum of multiplication of values of each pixel from image to that of the basis windows, as they overlap, within the basis window, and as the basis window moves across (or scans or traverses) the image.
In one embodiment, once we get the component of the image in those basis windows, we can store that in our database or compare that to those of the prior data or objects for comparison, match, and recognition, which can be a fuzzy recognition, based on fuzzy boundaries and membership functions and values, or can be crisp recognition based on e.g. a conventional threshold. The comparison can be based on degree of similarities or closeness between the coefficients of basis windows.
In one embodiment, we use the difference between the pixel values (e.g. color components values in RGB system or YMCK system, or intensity of pixels, or grayscale values of pixels) under black section and those under white section (which is an indication of contrast between the 2 sections) (e.g. see <figref idref="DRAWINGS">FIG. 169</figref> or <figref idref="DRAWINGS">FIG. 178</figref>), for our metrics, for comparison purposes, for detection or recognition, when scanning the basis window across the image. In one embodiment, for multiple basis windows, we use the aggregate of all contributions or average values or summation or max or MAX or sup (as commonly known in Fuzzy Logic) or union or the like, from all the contributions from all basis windows. In one embodiment, we use the sum all pixel values under black section and/or those under white section.
In one embodiment, we use Kalman filters or motion vectors (e.g. for motion detection and prediction of moving object) for video frames, for objects in the frames, such as a human. In one embodiment, we use multiple frames in a video to find the frontal view of the person, as optimum position for face recognition, with higher accuracy rate. In one embodiment, we first find the face, roughly, and then find components of the object or face, e.g. eyes, and then get the relationship between components found, e.g. eyes and mouth, and then verify it is a real face, based on the found relationships, and then if it is a real face, then find who it is, based on the face library for all population or our universe or set (and other data or clues or hunches or tags or comments for the picture or person), e.g. using Z-web, to correlate them.
In one embodiment, we use Haar filters for recognition of the face. In one embodiment, we use Viola-Jones method for recognition of the face or object or components of the face, e.g. eyes. In one embodiment, we define an “integral image” as follows. For a given pixel position in the original image (i, j), we set the value for that position (or image coordinate (i, j)) as the sum of the all pixels (or pixel values) which are located to the left and top of the given pixel. See e.g. <figref idref="DRAWINGS">FIG. 179</figref>, the top figure. For pixel at point 4, that would define a region defined by the highlighted rectangle, between points 4 and 5, at the diagonal positions, in <figref idref="DRAWINGS">FIG. 179</figref>. Now, for our notation, for the sum of pixels for the 4 rectangles defined by points 1, 2, 3, and 4 (as diagonal points, with respect to point 5, at the top left corner), we will have: S<sub>15</sub>, S<sub>25</sub>, S<sub>35</sub>, and S<sub>45</sub>, respectively. Also, for the area of the rectangle defined between points 1, 2, 3, and 4, in <figref idref="DRAWINGS">FIG. 179</figref> at top figure, for the sum of all pixels covered there, we will have the notation: S<sub>goal</sub>. Then, we can write S<sub>goal</sub>, in terms of other sums:
<br /><i>S</i><sub>goal</sub><i>=S</i><sub>45</sub><i>−S</i><sub>35</sub><i>−S</i><sub>25</sub><i>+S</i><sub>15 </sub>
In one embodiment, we use S<sub>goal </sub>for feature detection, e.g. for face, along with the sets shown in e.g. <figref idref="DRAWINGS">FIG. 178</figref>, top set or bottom set, to use the inherent contrast between eyes and nose and lips and other components or regions of the face. In one embodiment, we can define the integral image in a region of pixels with tilted boundaries, as shown at the bottom of <figref idref="DRAWINGS">FIG. 179</figref>, with lines at 45 degrees, with the corner point, point 4, in this case. In one embodiment, this can be used for frontal face detection. In one embodiment, we use AdaBoost or other similar methods to select a small number of critical features (out of a large set), for higher efficiency. In one embodiment, we add more complex classifiers, as cascade, for focusing more on important regions of the image (and ignoring the background), as focusing attention on features, and doing the process in multiple steps, for efficiency. In one embodiment, a series of classifiers are applied to every sub-window, for detection cascade, with first classifiers eliminating a large percentage of negative examples with relatively low processing power, in each step. In one embodiment, a multilayer cascaded classifier is trained with a set of face and non-face samples, using e.g. human tagged images or machine-tagged images. In one embodiment, the images are normalized for different light conditions. In one embodiment, multiple detectors are integrated or aggregated. In one embodiment, a majority voting scheme is applied for detectors.
In one embodiment, we use different sets for black-white regions as shown on top or bottom of <figref idref="DRAWINGS">FIG. 178</figref>, with rotated units in the bottom figure, or as shown in <figref idref="DRAWINGS">FIG. 169</figref>, on top or bottom figures, In one embodiment, the total pixel values for Black and White regions are calculated, separately. In one embodiment, we get the difference or delta between the total or summation of pixel values for Black and White regions (e.g. see <figref idref="DRAWINGS">FIG. 178</figref> for the 2 sets, and their units), as the assigned value for that unit, for that image processing step. In one embodiment, we use the same basis functions for different parts of the face, but at different weights. So, we can factor them out for calculations or scans or storage, for efficiency.
Information Retrieval:
In one embodiment, for information retrieval or search engines, we use term frequency (TF) and inverse document frequency (IDF), as a term weighting method (or TF-IDF), including e.g. Zipf's law or its variations, and normalized for document length. In one embodiment, we use a vector matching representation (for possible partial matching), using non-binary weights to index terms in documents or queries (for degree of similarity). Thus, the cosine of angle between 2 given vectors is an indication of similarity of the 2 vectors, which can be obtained by a probability ranking principle, or ranking based on relevant and non-relevant information. In one embodiment, the feedback information comes from local analysis (which includes clustering of results and modified user query) and global analysis (which includes external thesaurus, interdocument similarities, and modified user query). In one embodiment, the TF, the IDF, ranking, and the weights are all fuzzy values and parameters, with fuzzy boundaries and thresholding for the indexes for searches or databases. This makes the search more flexible and powerful.
In one embodiment, for information retrieval, we look at eye tracking data and relevance of information at hand. There are 4 types of eye behavior: gazing on an object or part of the scene for more than a fraction of second for information acquisition and processing, scan path for eye, pupil dilation indicating interest on the object by human, and fast movement of the eye to locate interesting parts of the scene. These give indication of the interest and relevance on a given object or subject by a user. In one embodiment, clicks (including clicks in a query chain) are used as the user's behavior analysis and metrics of user preference.
In one embodiment, a user access through user interface or GUI to query engine, which gets index from indexer, which is connected to the crawler, which is connected to the web. In one embodiment, we have a cluster-based architecture for the search module, with each cluster containing an index of the whole collection, with the index partitioned among M servers, with N clusters making N replicas of the whole index. The user interacts with the frontend servers (i.e. queries and answers), which is connected to document servers and answer cache servers, as well as broker network, which is connected to its own load-balancing server, which is connected to its own cluster, Each of the N clusters contains M combinations of “index cache plus search cluster”. In one embodiment, we have a distributed and parallel search engine, with a data parallel strategy and task parallel strategy.
In one embodiment, we have multiple indexes as hierarchical indexes, as improvement for performance, with the first one as small and fast index for most frequent queries, and the last one is the larger and slower index for not-most frequent queries. In one embodiment, we have distributed architecture, such as multisite architecture, due to limitation of the size of a single data center, e.g. due to cooling challenge and power requirements.
In one embodiment, we have a harvest architecture, with a user connected to the broker and also to object cache (which is connected to web site). The broker is connected to replication manager and other brokers, as well as gatherers (which gather information from anywhere, including the web site). In one embodiment, we have harvest architecture more efficient than conventional architecture.
In one embodiment, for ranking, we use domain names as an indication of confidence on quality of content, e.g. .G-OV or .EDU. In one embodiment, for ranking, we use content parameter, structural parameter (e.g. for textual data, using a text anchor, for search or query, as a proxy text of the web page), link-based parameter (e.g. number of in-links and out-links to or from a page), web usage parameter (as a feedback from the user(s), e.g. extracted from clicks, number, frequency, how long, purchases, dollar amount, traffic, comments, tags, “favorite”, LIKE flag, email to others, recommend to others, forward to others, text to others, or how often), or user parameter (e.g. user's IP address, language, geography, operating system, browser, or history (cookies)). In one embodiment, for ranking, we use Hypertext Induced Topic Search or PageRank (designed by GOOGLE®), which simulates a user navigating randomly on the web, which has problems for self-links and dead-end links, and which can be computed with an iterative algorithm. In one embodiment, we use machine learning to learn to rank, by training samples. In one embodiment, search engine ranking with our model of Z-web, including reliability factor and other Z-factors, becomes much improved.
Crawlers:
In one embodiment, for crawlers, we focus on one of the following goals: quality, volume, or being up-to-date. We can focus on one or two goals, or compromise on all three, as our final goal. In one embodiment, for crawlers, we have static and dynamic data, some private and some public, some indexable and some hidden, some reachable by links and some reachable by forms, only. In one embodiment, for crawlers, we have downloader connected to the web, and downloads pages and puts it in storage, from which a metadata is extracted and is given to the scheduler, which sends the URL to the downloader, for the scheduled download from the web, at a later time.
In one embodiment, for crawlers, we have downloader connected to the web, and the downloader contains short term scheduler and multi-threaded fetchers. The “multi-threaded fetchers” downloads pages and puts it in storage, which contains rnetadata, links, and rich text. From storage, the data goes to the long-term scheduler, which supplies the downloader, through short term scheduler. The short term scheduler feeds multi-threaded fetchers, which is connected to the web, to complete our loop, to get the data from the web, based on the schedule designed earlier. In one embodiment, for crawlers, we have parallel crawlers, for improving efficiency. In one embodiment, for crawlers, we have revisit policy, for creations, updates, and deletions. In one embodiment, for crawlers, we have multiple policies, to combine together.
Analysis on Various Types of Data:
In one embodiment, we get multimedia data, as input, which is then segmented, compressed, and stored. In addition, after segmentation step or after storage step, we summarize the data. Furthermore, after segmentation step, we extract the features and then index it, based on retrieval models in our library. In addition, after storage step and after indexing step, we display the result(s) to the user, e.g. on monitor of computer or smart phone or tablet, e.g. using user interface or GUI or browser or query engine or module or software. In one embodiment, usually, as we go from simple to more complex form of data (e.g. from text to image to video to music), we have more semantic gap between our knowledge and the meaning of the multimedia data. In one embodiment, we analyze the machine generated data, e.g. tables or lists or computer logs, for behavioral analysis for consumers for marketing purposes. In one embodiment, the retrieval is based on color, texture, or distinct points in the image (regardless of the image scale, e.g. corner of objects in the image).
In one embodiment, the speech recognition is based on Hidden-Markov Model (HMM), based on a word model with phonemes for the word, based on an acoustic phoneme model, based on e.g. state sequence diagram with self-loop feature (to construct or model the pronunciation of the word), e.g. with the probability of a specific Mel-Frequency Cesptral Coefficients (MFCC) vector (as an example), which transforms the broad shape for our spectrogram into a vector with low dimensionality, which can be accomplished with a DCT (Discrete Cosine Transform) with 10 to 20 coefficients.
In one embodiment, in video application, we get an abstract or summarization based on identification of the key-frames, based on the frames in video with the largest changes or deltas or differences between consecutive frames, e.g. based on motion vectors. Summaries and abstracts can be searched more efficiently than the original data. In one embodiment, in video application, the sequence of the key frames gives a general summary of the whole video (or storyline). In one embodiment, in face recognition, we use eigenfaces (i.e. eigenvectors and its summations or linear combinations), to store, reconstruct, summarize, compare, or recognize images or faces, very efficiently. The eigenfaces are stored in our library in advance, based on thousands of training sample images on a neural network, or based on filtering thousands of training sample images (based on different filters to get those eigenfaces).
In one embodiment, we combine or merge the models or results e.g. for audio-visual speech recognition, e.g. to combine acoustic data from speech with e.g. the facial expression of the speaker, to recognize the multimedia data. For example, if the shape of mouth (or face) looks like “smiling” face (based on templates, or based on real faces, or based on face formulations, or based on face grids, in our library, for comparison and determination), indicating happiness or mood of the speaker, then if the speech or sound is not clear and noisy, and the speech recognition is vague with respect to identification of e.g. one word, but with 2 choices, e.g. “sad” and “pad”, then the system probably chooses “pad”, as the better choice for recognition, because the word “sad” is the opposite of the mood of the speaker (i.e. happiness, in this example), making it the worst choice for recognition (for such a speech).
In one embodiment, first, we combine or merge audio and visual data together, and then we apply HMM on it, for analysis and recognition. In one embodiment, first, we apply HMM on each individual data component (e.g. audio and visual data), and then we combine them together at the end. In one embodiment, we segment the video, e.g. into mixed sound tracks (which is divided into speech, music, and sound effects) and video frames (which is divided into scenes or frames, and then divided into shots). In one embodiment, speech is recognized based on phoneme list in its corresponding library, sound effects are recognized based on known sound effects stored in its library or database, and music is recognized based on MIDI, tempo, score, notes, or any codes or instructions or symbols for expressing the music, stored in its library.
In one embodiment, for video segmentation, we use color information for transition frames or fading frames, using its peaks and valleys on the color component curves, plus pixel intensity curves, using its peaks and valleys, to find or mark the transition or important points in time or corresponding frames, and mark them accordingly, for segmentation and further analysis. In one embodiment, we segment the data of any type, including video, sound, and multimedia, based on sudden change in the sequence (or big delta or difference), e.g. based on an assumption or model, starting from time zero, and go on in time, until the assumption is broken drastically, which means that this is a good place to segment the sequence, and mark it accordingly (assuming that the noise level is low, for this case, and the sudden change is not due to the random noise, itself). In one embodiment, we use Bayesian model, for both sides of the potential boundary between segments, with 2 different model parameters, to fit the 2 sides better, to examine the potential boundary for segmentation, e.g. for speech.
Speech & Language Recognition:
For speech or language recognition, in one embodiment, we use anchors (as special characters that anchor regular expressions to particular places in a string), disjunction operator (or “pipe”) (to search e.g. for “A OR B”), grouping, and parenthesis operator (e.g. to enclose a pattern), based on the operator precedence hierarchy (in the absence of parenthesis), e.g. in this order, from highest to lowest precedence, for one embodiment: parenthesis, counters, sequences & anchors, and disjunction.
In one embodiment, we use finite-state automation (FSA), with states, including start state and final state, with transitions, represented by arcs in the graph. The arcs are generally from one state to the next state or to same original state. The FSA can be deterministic or non-deterministic. In one embodiment, for a language, for strings, we have the following operations: intersection, difference, complementation, and reversal. In one embodiment, for morphological parser, we use lexicon, morphotactics, and orthographic rules (such as spelling rules). In one embodiment, we use finite-state lexicon or finite-state transducers or transducers and orthographic rules. In one embodiment, we use lexicon-free FST (or finite-state transducer) (the Porter stemming algorithm). In one embodiment, we use word and sentence tokenization, related to word segmentation and sentence segmentation.
In one embodiment, we use string distance or minimum edit distance, e.g. for spelling correction. In one embodiment, we use N-gram models, language models, word prediction, chain rule of probability, and Markov models, e.g. for speech recognition, handwriting recognition, and machine translation. In one embodiment, we use word counting in corpora (a computer readable collection of text or speech), with probabilities based on counting items.
In one embodiment, we use maximum likelihood estimation (MLE), normalization, N-gram probability, and relative frequency. In one embodiment, we use training and test sets or training corpus. In one embodiment, we use part-of-speech tagging (word classes, morphological classes, or lexical tags). In one embodiment, we use rule based tagging (e.g. hand written rules), HMM (Hidden Markov Model) and maximum entropy tagging (statistical techniques), memory based tagging, or transformation based tagging. In one embodiment, we use contextual spelling error correction. In one embodiment, e.g. to find the probability of the next letter in a sequence, we use HMM, maximum entropy Markov model (a sequence classifier or sequence labeler), weighted finite state automaton, or Markov chain. In one embodiment, we use the forward-backward algorithm for HMM training.
In one embodiment, we use phonetics for speech recognition, speech synthesis, and text-to-speech conversion. In one embodiment, we use phonological categories and variations of pronunciation. In one embodiment, we use waveform, Fourier analysis, sound spectrum, phonetically annotated corpus, or pronunciation dictionaries. In one embodiment, we use text normalization or sentence tokenization. In one embodiment, we use context-free grammar. In one embodiment, we use a treehank search, e.g. for a specific grammar. In one embodiment, we use dynamic programming parsing technique, Cocke-Kasami-Younger (CKY) algorithm (based on Chomsky normal form (CNF)), Earley method, or chart parsing.
In one embodiment, for a conversational agent, we have a speech recognition module, which feeds the natural language analysis or understanding module, which feeds a dialogue manager module, which is connected a task manager module. The dialogue manager module is also connected to natural language generation module, which is connected to a text-to-speech synthesis module.
In one embodiment, we have recursive phrase structure expansion, as in tree structure format, to segment the sentence and tag the components, e.g. for the sentence “The people sat.”, we have, e.g.:
<tables id="TABLE-US-00005" num="00005"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="5"><colspec colname="offset" colwidth="28pt" align="left" /><colspec colname="1" colwidth="42pt" align="left" /><colspec colname="2" colwidth="42pt" align="left" /><colspec colname="3" colwidth="49pt" align="left" /><colspec colname="4" colwidth="56pt" align="left" /><thead><row><entry /><entry namest="offset" nameend="4" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry /><entry>S</entry><entry>NP</entry><entry>AT</entry><entry>“The”</entry></row><row><entry /><entry>S</entry><entry>NP</entry><entry>NNS</entry><entry>“people”</entry></row><row><entry /><entry>S</entry><entry>VP</entry><entry>VBD</entry><entry>“sat”</entry></row><row><entry /><entry namest="offset" nameend="4" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>
So, in the example above, we start from S on the top. Then, S splits into two branches NP and VP. Then, NP splits into 2 branches AT (“The”) and NNS (“people”). However, VP has only one branch going out, as VBD (“sat”). Thus, this scans the whole sentence, based on its components and grammar, based on templates and tags, in our library, pre-defined, for matching. We can show this in tree structure, with arrows, as well. In this example, we have S for the original sentence, NP for noun phrase, VP for verb phrase, AT for articles, NNS for plural nouns, and VBD for the verb for the past tense. Of course, this is just an example, and any other set of notations would work, as well. Since some of the tags can be nested themselves, within itself, the tagging process above is recursive. In one embodiment, we use Penn Treebank, for our system.
In one embodiment, for machine translation, we use alignment lines between corresponding words and phrases, sometimes in different order in the sentence. In one embodiment, for machine translation, we use a pyramid (called Vauquois Triangle), starting from base as source language text, as input, and ending at other end at the base of pyramid, as output, as target language text. For the first level, we have words to words, direct translation. Then, on the 2<sup>nd </sup>level, for synthetic structure, we have synthetic transfer. Then, on the 3<sup>rd </sup>level, for semantic structure, we have semantic transfer. Then, on the top, at peak, we have interlingua. So, starting from input base on the bottom of the pyramid or triangle, going up between each level to the peak, we have morphological analysis input to the first level (words), which feeds parsing to the second level (synthetic structure), which feeds shallow synthetic analysis to the 3<sup>rd </sup>level (semantic structure), which feeds conceptual analysis to the peak (interlingua), which feeds back down from the top, conceptual generation to lower level (semantic structure), which feeds semantic generation to the lower level (synthetic structure), which feeds synthetic generation to the lower level (words), which outputs morphological generation for target language text, at the bottom of the pyramid, at the other side. Therefore, now, we have a complete machine translation method and system here.
In one embodiment, for machine translation, we use statistical alignment lines, or we use offset alignment lines, using signal processing methods, e.g. on bit text maps, to correspond the matching text together in different languages. In one embodiment, for text categorization, we use decision trees, using conditional probability and training sets. In one embodiment, for ranking or recognition, we use the frequency and distribution of some keywords. In one embodiment, the keywords can be obtained from the related nodes in Z-web.
Learning Machines:
In one embodiment, for fitting the data points, the “overfitting” problem may cause that we use lower order curve fitting, even if they actually have higher order curve in reality in behavior. In one embodiment, for training, for more reliable data points, we set more weights, or increase the copies of that data point with the same ratio, as new training samples. In one embodiment, for the gradient descent method, if going stochastically, one data point at a time, we go toward the optimum point with the step size proportional to the reliability of that data, e.g. the higher the reliability factor (which is a part of the Z-factor), the higher the step size. In one embodiment, for learning machines, instead of using a single weight for a data point, we have a function of the weight, or a function of combination of the weight and the data point itself, as the new applied weight. In one embodiment, for learning machines, the expert knowledge or world knowledge determines the form of the formula or function or other requirements, down the road, for the learning process.
In one embodiment, e.g. for credit score for loan or risk analysis, if it turns out that e.g. the age is not a big factor, then the impact factor for age parameter is determined to be low (for loan determination goal or task). Then, for information regarding the age of the loan applicant, the age information does not have to be very reliable. For example, the age information with reliability factor of 75 percent is enough for our loan application, which is part of our Z-web for the loan applicant (person), as one of the , Z-factors. That is, for low relevance factor or low impact factor (also part of Z-factors), we can relax the reliability factor of the data (reduce the min. threshold needed for the reliability factor of the data). In one embodiment, for low relevance factor or low impact factor, e.g. for age information, instead of using age as a value in linear models, we use square root of age (or log(x), or the like), in linear models, to de-emphasize or reduce the significance of the value of age in the analysis.
In one embodiment, e.g. for loan analysis, if there is a rule forbidding anybody less than 18 to get a loan, then instead of linear regression, we can use a non-linear function in there, or use a second order term for the cut-off age, or use the moment terms of the 2<sup>nd </sup>order, to mimic the effect of the cut-off age. In one embodiment, e.g. for loan analysis, if it turns out that the age bracket is important, e.g. bracket or range of age between e.g. “low 40 to mid 50”, then we have fuzzy range and parameters, rather than crisp number(s). In one embodiment, for stochastic gradient descent, we use more than one data points, e.g. get an average (or aggregate or median or weighted average) for 5 or 10 points for each step, to get a better result.
In one embodiment, for constructing kernels (K) for SVM, we can use basis functions (B) based on polynomials, Gaussians, or logistic sigmoids family of functions:
<br /><i>K </i>(<i>x, {dot over (x)}</i>)=<i>B </i>(<i>x</i>)<sup>T</sup><i>B</i>(<i>{dot over (x)}</i>)=Σ<sub>i </sub><i>B</i><sub>i</sub>(<i>x</i>) <i>B</i><sub>i</sub>(<i>{dot over (x)}</i>)
Wherein i runs from 1 to p, and T denotes the transpose of the matrix.
In one embodiment, for classification, e.g. for one million data points, we choose one thousand points only, randomly or uniformly, if possible (i.e. a subset), and find the support vector machines for the subset (derived SVM), which is much faster than that of the original data set, and then try the remaining data points (999,000 points, in this example) against the resulting the support vector machines and the support vectors, to adjust, if needed. Since, in average, for most cases, most of the original 1 million data points are far from the support vectors, and thus, not contributing to the support vectors, the adjustment is usually limited to (or required for) a small fraction of those remaining 999,000 points. This increases the efficiency of the calculation of the SVM.
In one embodiment, for adjusting the derived SVM result for 1000 points, we can find all the data points close to (or within) the region defined by (or surrounded by) the support vectors (points) of our derived SVM (or within union of those regions), out of those remaining 999,000 points. Let's assume there are M points like that, in that region, out of those remaining 999.000 points. Then, we can combine the M points with our original (1000) points, and calculate the SVM for the resulting (M+1000) points, again, which would be our final SVM result.
In one embodiment, for adjusting the derived SVM result for 1000 points, we can find all the data points close to (or within) the region defined by (or surrounded by) the support vectors of our derived SVM (or within union of those regions), out of those remaining 999,000 points. Let's assume there are M points like that, in that region, out of those remaining 999,000 points. Let's assume that those M points constitute an imaginary band (or imaginary rectangle covering those M points or band). Then, the band, when it is skeletonized (with image processing skeleton or thinning operator), becomes a single line, in the middle of the band, with a specific equation. Then, to adjust our derived SVM , to get the final SVM, we have multiple techniques, from any one of the following: <ul id="ul0084" list-style="none"><li id="ul0084-0001" num="0000"><ul id="ul0085" list-style="none"><li id="ul0085-0001" num="2457">Based on width and/or length of the band</li><li id="ul0085-0002" num="2458">Based on width and/or length of the rectangle covering the band</li><li id="ul0085-0003" num="2459">Based on equation of the skeleton line representing the band</li><li id="ul0085-0004" num="2460">From the point where the derived SVM intersects the skeleton line, rotate the derived SVM toward the skeleton line, half way (or rotate with an angle somewhere in between)</li><li id="ul0085-0005" num="2461">Match the skeleton line, or introduce the skeleton line, as our final SWM</li><li id="ul0085-0006" num="2462">Shift, rotate, twist, and/or translate the derived SVM, toward the skeleton line</li><li id="ul0085-0007" num="2463">Shift, rotate, twist, and/or translate the derived SVM, toward the band</li></ul></li></ul>
Shift, rotate, twist, and/or translate the derived SVM, toward the rectangle around the band <ul id="ul0086" list-style="none"><li id="ul0086-0001" num="0000"><ul id="ul0087" list-style="none"><li id="ul0087-0001" num="2465">For small changes, do not change the derived SVM at all, based on some thresholds</li><li id="ul0087-0002" num="2466">Or any combination of the above</li></ul></li></ul>
In another version, we do the same method as above for 2 or more different subsets of original 1 million data points, e.g. N subsets. Then, we generate multiple (N) SVMs, one for each subset. Then, we get the average of those N SVMs, or a line in between of all of those N SVMs, or a line in between of all of those N SVMs with minimum total distance (or square of distance) to all of those N SVMs, or with minimum total angle with all of those N SVMs (when crossing them at one point), or choose a line or hyperplane for separation of clusters with coefficients in the equation of the line or hyperplane derived as the average (or median or the like) of those corresponding coefficients in those multiple N SVMs, or choose a combination of the above methods. So, from the above, we get a semi-final SVM result. Then, from the remaining data points, we adjust the semi-final SVM result, to get to the final SVM result, for all 1 million data points, with one of the methods mentioned above. This increases the efficiency of the calculation of the SVM result.
In one embodiment, we have lots of data coming in real time, as input. First, we calculate our first SVM for the first e.g. 1000 data points, and store the result in the library. Then, we adjust the first SVM result, based on the coming data (millions of points) in real time, as they come in, based on the methods shown above, as an approximation (similar to running average of data points coming in, in real time). Thus, we can handle large amount of data, in real time, to get the SVM, for classification, recognition, and verification purposes (or the like).
In one embodiment, to find a cluster, we start from a small region in N-dimensional feature space, with points in close proximity, as our original cluster. Then, we expand with circles (or hyperspheres) of small radius (or squares (hypercubes) of small dimensions), going beyond the boundary of the original region or cluster. If the small circles include enough points or have enough point density (above a threshold), then the circle is a part of the original region, and they get UNION-ed together, as sets or regions or points, as our new cluster region, and this continues, until the next expansion circles are empty or almost empty, which means that we get to a region between the clusters, and we stop in that direction. Once all directions and all around the boundary of the original region are exhausted, and after the growth of the region is stopped (in all directions), then that would be the final shape of our cluster. So, we found one complete cluster. Continuing on this, we find other clusters, and eventually, find all clusters available. Then, we can use them for the classification.
In the conventional SVM, we get a penalty, if we cross or get into the margin of the line separating the clusters, e.g. with a new data point. However, in one embodiment, we do not get penalized for crossing a new data point in that marginal band or region around the separation line (or hypersurface or plane), as long as that new point belongs to a cluster.
For learning machines, the minimum description length (MDL) principle (similar to Occam's Razor) states that the best hypothesis (for a given set of data) is the one that leads to the best compression of the data, or fewer bits to describe the data. Similarly, given two hypotheses that can explain the behavior of a given data, we prefer to choose the simpler (or less complex) hypothesis or model or assumption. Note that this is related to the Kolmogorov complexity (or algorithmic entropy, descriptive complexity, Kolmogorov-Chaitin complexity, or program-size complexity) for an object (e.g. a piece of text), which measures the computational resources needed to specify the object, e.g. the length of the shortest possible description of the object (in some description language or grammar). (Note that the :Kolmogorov complexity is also related to polynomial-time computable problem.)
Please note that for learning machines, the VC dimension (Vapnik-Chervonenkis dimension) is a measure of the capacity of a statistical classification algorithm (e.g. the cardinality of the largest set of points that the algorithm can shatter (e.g. with the model making no errors, when evaluating that set of data points)).
For learning machines, the Falsifiability factor relates to the data that shows an assumption (or statement, hypothesis, or theory) is wrong. This is also part of the Z-factors in our Z-web. The Falsifiability factor depends on the size of data. For example, to show some function is (or is not) linear, we need more than 2 points to prove (or disprove) such a statement, because one can pass a straight line through any 2 points.
In one embodiment, for fuzzy SVM, we have sets with fuzzy boundaries, and the members with membership values between 0 and 1. Thus, the margin of the line separating the clusters (or hyperplane, in general), with respect to the support vectors (designated points), are all fuzzy, and all correspond to their respective membership values (including the support vectors, themselves). So, fur fuzzy SVM technique, the margin or band around our separating line is wider and “fuzzier” or “cloudier”.
A Note on Zadeh's Z-Numbers and Z
+
Extension Principle:
In one embodiment, we use restricted-centered theory of reasoning and computation in an environment of uncertainty and imprecision (also called RRC), to enhance capability of reasoning and computation in an environment of uncertainty, imprecision and partiality of truth. The point of departure in RRC is a basic premise. In the real world, such environment is the norm, rather than exception. For example, for the question of “How long does it take to go from home to office?”, we may have the answer, e.g. “Normally, about 45 minutes”. These types of answers are RRC type (with restriction). The restriction by itself is a carrier of information. The restriction can be possibilistic (e.g. “X is large.”). The restriction can be probabilistic (e.g. “X has a uniform probability distribution.”). Or, the restriction can be both possibilistic and probabilistic (e.g. “Usually, X is large.” or “it is very likely that there is a large decrease in the price of gold in the short term,”), which can be expressed by Z-numbers.
In one embodiment, Z-numbers can be used e.g. for scheduling for adding the time periods together e.g. to find out the final arrival time to destination, which involves the addition of restrictions, e.g. going from A to B takes “about 5 hours, normally”, and from B to C, it takes “roughly 3 hours, usually”. So, we have 2 Z-numbers here. To get the final time, for going from A to C, we add them up, in Z-number domain, in the form of (A, B):
<br /><i>Z</i><sub>final</sub><i>=Z</i><sub>1</sub><i>+Z</i><sub>2</sub>=(About 5, Normally)+(Roughly 3, Usually)
We have shown the Z-number arithmetic elsewhere in this disclosure. So, using Z-number domain, we can find answers to everyday problems and process natural language information by humans, which would not be possible before (without Z-number domain).
For a given conventional theorem, we can add fuzzy logic generalization, to generalize the theory in the fuzzy domain, using fuzzy sets and fuzzy parameters. The structure of modes of reasoning and computation can be mathematical (which can be Type 1 or Type 2) and non-mathematical (which is Type 3, unprecisiated perceptions, related to f-valaidity). Type 1 is for measurements, related to p-validity, and Type 2 is for measurements plus percisiated perceptions. The restriction can be expressed as:
<br />R(X): X ∈ A
The restrictions can be hard or soft. The restrictions can be direct or indirect. In one embodiment, the restriction can be a possibilistic restriction, e.g.:
<br /><i>R</i>(<i>X</i>): <i>X </i>is <i>A </i>(with (r=blank))
In one embodiment, the restriction is Z-restriction, wherein X is a real-valued random variable. Then, we have Z-restriction (r=z, s is suppressed) being expressed as:
<br />R(X): X iz Z
where Z is a combination of possibilistic and probabilistic restrictions defined as:
<br />Z: Prob (X is A) is B
Where A and B are fuzzy sets, e.g. from natural language processing. The ordered pair of (A, B) is Z-number, which we explained elsewhere in this disclosure. For example, the fuzzy number, B, is a possibilistic restriction on the certainty (probability) that X is A. Now, we have Z<sup>+</sup>-restriction (r=z<sup>+</sup>, s is suppressed) being expressed as:
<br />R(X): X iz<sup>+</sup> Z<sup>+</sup>
<br /><i>Z</i><sup>+</sup>=(Poss(<i>X</i>), Prob(<i>X</i>))
Wherein Z+ is an ordered pair, (Poss(X), Prob(X)), in which Poss(X) and Prob(X) are, respectively, the possibility and probability distributions of X. Note that Z<sup>+</sup> is more informative than Z. So, if (Z=(A, B)) and p is the underlying probability density function of X, then
<br /><i>Z</i><sup>+</sup>=(<i>A, p</i>)
If Z is (A, B) and Z<sup>+</sup> is (A, p), then B is an indirect possibilistic restriction on (μ<sub>A·p</sub>). p is explicit in Z<sup>+</sup> and implicit in Z. The ordered pair (A, p) is referred to as a Z<sup>+</sup> -number. Now, we have Z-valuation as an ordered triple of the form (X,A, B), where X is a real-valued variable and (A, B) is a Z-number. Equivalently, a Z-valuation, (X,A,B), is a Z-restriction on X:
<br />(X,A, B)→X iz (A,B)
For example, we have: <ul id="ul0088" list-style="none"><li id="ul0088-0001" num="0000"><ul id="ul0089" list-style="none"><li id="ul0089-0001" num="2486">(length of car, short, very likely)</li><li id="ul0089-0002" num="2487">(stock value next July, sharp increase, extremely unlikely)</li></ul></li></ul>
So, we can process and evaluate a lot of situations in our life, which is naturally expressed in our language in the Z-number domain (in contrast to crisp values, e.g. 3.1557 dollars). Then, we have Z-rule as a conditional restriction in which the antecedent and consequent are Z-valuations:
If (X,A<sub>1</sub>,B1) then (Y,A<sub>2</sub>,B<sub>2</sub>)
For example:
If (consumer confidence, low, usually) then (unemployment, high, usually)
So, we can input these conditions or rules into our rule engine, or use it for prediction, control system, forecasting (economy, elections, and other events), social behavioral analysis, consumer behavioral analysis, predicting revolutions or unrest, detecting frauds, detecting unusual behaviors, detecting unusual patterns, finding liars or contradictions, resolving contradictions, and the like. In our daily life setting, much of the information in an environment of uncertainty and imprecision is represented as a collection of Z-valuations and Z-rules, which we call Z-information, as a whole. Any interpolation based on Z-numbers is called Z-interpolation, which is very important for our fuzzy control systems. In one embodiment, we model a piece of information as a restriction. In one embodiment, we model the meaning as a restriction. All of the above is foundations for computing with words (CWW), which is natural to the natural language processing or human understanding of a language.
In one embodiment, we use extension principles to compute the result, e.g. for probabilistic extension principle with a possibilistic restriction, we have:
<maths id="MATH-US-00112" num="00112"><math overflow="scroll"><mfrac><mtable><mtr><mtd><mrow><mi>Y</mi><mo>=</mo><mrow><mi>f</mi><mo></mo><mrow><mo>(</mo><mi>p</mi><mo>)</mo></mrow></mrow></mrow></mtd></mtr><mtr><mtd><mrow><mi>R</mi><mo>(</mo><mrow><mi>p</mi><mo></mo><mstyle><mtext>):</mtext></mstyle><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mrow><mi>g</mi><mo></mo><mrow><mo>(</mo><mi>p</mi><mo>)</mo></mrow></mrow><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>is</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>A</mi></mrow></mrow></mtd></mtr></mtable><mtable><mtr><mtd><mrow><mi>R</mi><mo></mo><mrow><mo>(</mo><mi>Y</mi><mo>)</mo></mrow><mo></mo><mrow><mo>(</mo><mrow><mrow><mrow><mi>f</mi><mo></mo><mrow><mo>(</mo><mi>A</mi><mo>)</mo></mrow></mrow><mo></mo><mstyle><mtext>):</mtext></mstyle><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mrow><msub><mi>μ</mi><mi>Y</mi></msub><mo></mo><mrow><mo>(</mo><mi>q</mi><mo>)</mo></mrow></mrow></mrow><mo>=</mo><mrow><msub><mi>sup</mi><mi>p</mi></msub><mo></mo><mrow><msub><mi>μ</mi><mi>A</mi></msub><mo></mo><mrow><mo>(</mo><mrow><mi>g</mi><mo></mo><mrow><mo>(</mo><mi>p</mi><mo>)</mo></mrow></mrow><mo>)</mo></mrow></mrow></mrow></mrow></mrow></mrow></mtd></mtr><mtr><mtd><mrow><mrow><mi>subject</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>t</mi><mo></mo><mstyle><mtext>o:</mtext></mstyle><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>q</mi></mrow><mo>=</mo><mrow><mi>f</mi><mo></mo><mrow><mo>(</mo><mi>p</mi><mo>)</mo></mrow></mrow></mrow></mtd></mtr></mtable></mfrac></math></maths><img file="US2022121884A1_D23081.tif" /><img file="US2022121884A1_D23082.tif" /><img file="US2022121884A1_D23083.tif" /><img file="US2022121884A1_D23084.tif" /><img file="US2022121884A1_D23085.tif" /><img file="US2022121884A1_D23086.tif" /><img file="US2022121884A1_D23087.tif" /><img file="US2022121884A1_D23088.tif" /><img file="US2022121884A1_D23089.tif" /><img file="US2022121884A1_D23090.tif" /><img file="US2022121884A1_D23091.tif" /><img file="US2022121884A1_D23092.tif" /><img file="US2022121884A1_D23093.tif" /><img file="US2022121884A1_D23094.tif" /><img file="US2022121884A1_D23095.tif" /><img file="US2022121884A1_D23096.tif" /><img file="US2022121884A1_D23097.tif" /><img file="US2022121884A1_D23098.tif" /><img file="US2022121884A1_D23099.tif" /><img file="US2022121884A1_D23100.tif" /><img file="US2022121884A1_D23101.tif" /><img file="US2022121884A1_D23102.tif" /><img file="US2022121884A1_D23103.tif" /><img file="US2022121884A1_D23104.tif" /><img file="US2022121884A1_D23105.tif" /><img file="US2022121884A1_D23106.tif" /><img file="US2022121884A1_D23107.tif" /><img file="US2022121884A1_D23108.tif" /><img file="US2022121884A1_D23109.tif" /><img file="US2022121884A1_D23110.tif" /><img file="US2022121884A1_D23111.tif" /><img file="US2022121884A1_D23112.tif" /><img file="US2022121884A1_D23113.tif" /><img file="US2022121884A1_D23114.tif" /><img file="US2022121884A1_D23115.tif" /><img file="US2022121884A1_D23116.tif" /><img file="US2022121884A1_D23117.tif" /><img file="US2022121884A1_D23118.tif" /><img file="US2022121884A1_D23119.tif" /><img file="US2022121884A1_D23120.tif" /><img file="US2022121884A1_D23121.tif" /><img file="US2022121884A1_D23122.tif" /><img file="US2022121884A1_D23123.tif" /><img file="US2022121884A1_D23124.tif" /><img file="US2022121884A1_D23125.tif" /><img file="US2022121884A1_D23126.tif" /><img file="US2022121884A1_D23127.tif" /><img file="US2022121884A1_D23128.tif" /><img file="US2022121884A1_D23129.tif" /><img file="US2022121884A1_D23130.tif" /><img file="US2022121884A1_D23131.tif" /><img file="US2022121884A1_D23132.tif" /><img file="US2022121884A1_D23133.tif" /><img file="US2022121884A1_D23134.tif" /><img file="US2022121884A1_D23135.tif" /><img file="US2022121884A1_D23136.tif" /><img file="US2022121884A1_D23137.tif" /><img file="US2022121884A1_D23138.tif" /><img file="US2022121884A1_D23139.tif" /><img file="US2022121884A1_D23140.tif" /><img file="US2022121884A1_D23141.tif" /><img file="US2022121884A1_D23142.tif" /><img file="US2022121884A1_D23143.tif" /><img file="US2022121884A1_D23144.tif" /><img file="US2022121884A1_D23145.tif" /><img file="US2022121884A1_D23146.tif" /><img file="US2022121884A1_D23147.tif" /><img file="US2022121884A1_D23148.tif" /><img file="US2022121884A1_D23149.tif" /><img file="US2022121884A1_D23150.tif" /><img file="US2022121884A1_D23151.tif" /><img file="US2022121884A1_D23152.tif" /><img file="US2022121884A1_D23153.tif" /><img file="US2022121884A1_D23154.tif" /><img file="US2022121884A1_D23155.tif" /><img file="US2022121884A1_D23156.tif" /><img file="US2022121884A1_D23157.tif" /><img file="US2022121884A1_D23158.tif" /><img file="US2022121884A1_D23159.tif" /><img file="US2022121884A1_D23160.tif" /><img file="US2022121884A1_D23161.tif" /><img file="US2022121884A1_D23162.tif" /><img file="US2022121884A1_D23163.tif" /><img file="US2022121884A1_D23164.tif" /><img file="US2022121884A1_D23165.tif" /><img file="US2022121884A1_D23166.tif" /><img file="US2022121884A1_D23167.tif" /><img file="US2022121884A1_D23168.tif" /><img file="US2022121884A1_D23169.tif" /><img file="US2022121884A1_D23170.tif" /><img file="US2022121884A1_D23171.tif" /><img file="US2022121884A1_D23172.tif" /><img file="US2022121884A1_D23173.tif" /><img file="US2022121884A1_D23174.tif" /><img file="US2022121884A1_D23175.tif" /><img file="US2022121884A1_D23176.tif" /><img file="US2022121884A1_D23177.tif" /><img file="US2022121884A1_D23178.tif" /><img file="US2022121884A1_D23179.tif" /><img file="US2022121884A1_D23180.tif" /><img file="US2022121884A1_D23181.tif" /><img file="US2022121884A1_D23182.tif" /><img file="US2022121884A1_D23183.tif" /><img file="US2022121884A1_D23184.tif" /><img file="US2022121884A1_D23185.tif" /><img file="US2022121884A1_D23186.tif" /><img file="US2022121884A1_D23187.tif" /><img file="US2022121884A1_D23188.tif" /><img file="US2022121884A1_D23189.tif" /><img file="US2022121884A1_D23190.tif" /><img file="US2022121884A1_D23191.tif" /><img file="US2022121884A1_D23192.tif" />
wherein p is a probability density function in R, and A is a fuzzy set in the space of probability density functions. For Z<sup>+</sup>-extension principle, we have the restriction on X as a Z<sup>+</sup>-restriction.
<maths id="MATH-US-00113" num="00113"><math overflow="scroll"><mfrac><mtable><mtr><mtd><mrow><mi>Y</mi><mo>=</mo><mrow><mi>f</mi><mo></mo><mrow><mo>(</mo><mi>X</mi><mo>)</mo></mrow></mrow></mrow></mtd></mtr><mtr><mtd><mrow><mi>R</mi><mo>(</mo><mrow><mi>X</mi><mo></mo><mstyle><mtext>):</mtext></mstyle><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>X</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><msup><mi>iz</mi><mo>+</mo></msup><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mrow><mo>(</mo><mrow><mi>A</mi><mo>,</mo><mi>p</mi></mrow><mo>)</mo></mrow></mrow></mrow></mtd></mtr></mtable><mrow><mi>R</mi><mo></mo><mrow><mo>(</mo><mi>Y</mi><mo>)</mo></mrow><mo></mo><mrow><mo>(</mo><mrow><mrow><mi>f</mi><mo></mo><mrow><mo>(</mo><mrow><mi>A</mi><mo>,</mo><mi>p</mi></mrow><mo>)</mo></mrow></mrow><mo></mo><mstyle><mtext>):</mtext></mstyle><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mrow><mi>R</mi><mo></mo><mrow><mo>(</mo><mi>Y</mi><mo>)</mo></mrow></mrow><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><msup><mi>iz</mi><mo>+</mo></msup><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mrow><mo>(</mo><mrow><mrow><mi>f</mi><mo></mo><mrow><mo>(</mo><mi>A</mi><mo>)</mo></mrow></mrow><mo>,</mo><mrow><mi>f</mi><mo></mo><mrow><mo>(</mo><mi>p</mi><mo>)</mo></mrow></mrow></mrow><mo>)</mo></mrow></mrow></mrow></mrow></mfrac></math></maths><img file="US2022121884A1_D23193.tif" /><img file="US2022121884A1_D23194.tif" /><img file="US2022121884A1_D23195.tif" /><img file="US2022121884A1_D23196.tif" /><img file="US2022121884A1_D23197.tif" /><img file="US2022121884A1_D23198.tif" /><img file="US2022121884A1_D23199.tif" /><img file="US2022121884A1_D23200.tif" /><img file="US2022121884A1_D23201.tif" /><img file="US2022121884A1_D23202.tif" /><img file="US2022121884A1_D23203.tif" /><img file="US2022121884A1_D23204.tif" /><img file="US2022121884A1_D23205.tif" /><img file="US2022121884A1_D23206.tif" /><img file="US2022121884A1_D23207.tif" /><img file="US2022121884A1_D23208.tif" /><img file="US2022121884A1_D23209.tif" /><img file="US2022121884A1_D23210.tif" /><img file="US2022121884A1_D23211.tif" /><img file="US2022121884A1_D23212.tif" /><img file="US2022121884A1_D23213.tif" /><img file="US2022121884A1_D23214.tif" /><img file="US2022121884A1_D23215.tif" /><img file="US2022121884A1_D23216.tif" /><img file="US2022121884A1_D23217.tif" /><img file="US2022121884A1_D23218.tif" /><img file="US2022121884A1_D23219.tif" /><img file="US2022121884A1_D23220.tif" /><img file="US2022121884A1_D23221.tif" /><img file="US2022121884A1_D23222.tif" /><img file="US2022121884A1_D23223.tif" /><img file="US2022121884A1_D23224.tif" /><img file="US2022121884A1_D23225.tif" /><img file="US2022121884A1_D23226.tif" /><img file="US2022121884A1_D23227.tif" /><img file="US2022121884A1_D23228.tif" /><img file="US2022121884A1_D23229.tif" /><img file="US2022121884A1_D23230.tif" /><img file="US2022121884A1_D23231.tif" /><img file="US2022121884A1_D23232.tif" /><img file="US2022121884A1_D23233.tif" /><img file="US2022121884A1_D23234.tif" /><img file="US2022121884A1_D23235.tif" /><img file="US2022121884A1_D23236.tif" /><img file="US2022121884A1_D23237.tif" /><img file="US2022121884A1_D23238.tif" /><img file="US2022121884A1_D23239.tif" /><img file="US2022121884A1_D23240.tif" /><img file="US2022121884A1_D23241.tif" /><img file="US2022121884A1_D23242.tif" /><img file="US2022121884A1_D23243.tif" /><img file="US2022121884A1_D23244.tif" /><img file="US2022121884A1_D23245.tif" /><img file="US2022121884A1_D23246.tif" /><img file="US2022121884A1_D23247.tif" /><img file="US2022121884A1_D23248.tif" /><img file="US2022121884A1_D23249.tif" /><img file="US2022121884A1_D23250.tif" /><img file="US2022121884A1_D23251.tif" /><img file="US2022121884A1_D23252.tif" /><img file="US2022121884A1_D23253.tif" /><img file="US2022121884A1_D23254.tif" /><img file="US2022121884A1_D23255.tif" /><img file="US2022121884A1_D23256.tif" /><img file="US2022121884A1_D23257.tif" /><img file="US2022121884A1_D23258.tif" /><img file="US2022121884A1_D23259.tif" /><img file="US2022121884A1_D23260.tif" /><img file="US2022121884A1_D23261.tif" /><img file="US2022121884A1_D23262.tif" /><img file="US2022121884A1_D23263.tif" /><img file="US2022121884A1_D23264.tif" /><img file="US2022121884A1_D23265.tif" /><img file="US2022121884A1_D23266.tif" /><img file="US2022121884A1_D23267.tif" /><img file="US2022121884A1_D23268.tif" /><img file="US2022121884A1_D23269.tif" /><img file="US2022121884A1_D23270.tif" /><img file="US2022121884A1_D23271.tif" /><img file="US2022121884A1_D23272.tif" /><img file="US2022121884A1_D23273.tif" /><img file="US2022121884A1_D23274.tif" /><img file="US2022121884A1_D23275.tif" /><img file="US2022121884A1_D23276.tif" /><img file="US2022121884A1_D23277.tif" /><img file="US2022121884A1_D23278.tif" /><img file="US2022121884A1_D23279.tif" /><img file="US2022121884A1_D23280.tif" /><img file="US2022121884A1_D23281.tif" /><img file="US2022121884A1_D23282.tif" /><img file="US2022121884A1_D23283.tif" /><img file="US2022121884A1_D23284.tif" /><img file="US2022121884A1_D23285.tif" /><img file="US2022121884A1_D23286.tif" /><img file="US2022121884A1_D23287.tif" /><img file="US2022121884A1_D23288.tif" /><img file="US2022121884A1_D23289.tif" /><img file="US2022121884A1_D23290.tif" /><img file="US2022121884A1_D23291.tif" /><img file="US2022121884A1_D23292.tif" /><img file="US2022121884A1_D23293.tif" /><img file="US2022121884A1_D23294.tif" /><img file="US2022121884A1_D23295.tif" /><img file="US2022121884A1_D23296.tif" /><img file="US2022121884A1_D23297.tif" /><img file="US2022121884A1_D23298.tif" /><img file="US2022121884A1_D23299.tif" /><img file="US2022121884A1_D23300.tif" /><img file="US2022121884A1_D23301.tif" /><img file="US2022121884A1_D23302.tif" /><img file="US2022121884A1_D23303.tif" /><img file="US2022121884A1_D23304.tif" />
where A is a fuzzy set which defines the possibility distribution of X, and p is the underlying probability density function of X. For Z-extension principle, we have the restriction on X as a Z-number:
<maths id="MATH-US-00114" num="00114"><math overflow="scroll"><mfrac><mtable><mtr><mtd><mrow><mi>Y</mi><mo>=</mo><mrow><mi>f</mi><mo></mo><mrow><mo>(</mo><mi>X</mi><mo>)</mo></mrow></mrow></mrow></mtd></mtr><mtr><mtd><mrow><mi>R</mi><mo>(</mo><mrow><mi>X</mi><mo></mo><mstyle><mtext>):</mtext></mstyle><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>X</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>iz</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mrow><mo>(</mo><mrow><mi>A</mi><mo>,</mo><mi>B</mi></mrow><mo>)</mo></mrow></mrow></mrow></mtd></mtr></mtable><mrow><mi>R</mi><mo></mo><mrow><mo>(</mo><mi>Y</mi><mo>)</mo></mrow><mo></mo><mrow><mo>(</mo><mrow><mrow><mi>f</mi><mo></mo><mrow><mo>(</mo><mrow><mi>A</mi><mo>,</mo><mi>B</mi></mrow><mo>)</mo></mrow></mrow><mo></mo><mstyle><mtext>):</mtext></mstyle><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>Y</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>iz</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mrow><mo>(</mo><mrow><mrow><mi>f</mi><mo></mo><mrow><mo>(</mo><mi>A</mi><mo>)</mo></mrow></mrow><mo>,</mo><mi>C</mi></mrow><mo>)</mo></mrow></mrow></mrow></mrow></mfrac></math></maths><img file="US2022121884A1_D23305.tif" /><img file="US2022121884A1_D23306.tif" /><img file="US2022121884A1_D23307.tif" /><img file="US2022121884A1_D23308.tif" /><img file="US2022121884A1_D23309.tif" /><img file="US2022121884A1_D23310.tif" /><img file="US2022121884A1_D23311.tif" /><img file="US2022121884A1_D23312.tif" /><img file="US2022121884A1_D23313.tif" /><img file="US2022121884A1_D23314.tif" /><img file="US2022121884A1_D23315.tif" /><img file="US2022121884A1_D23316.tif" /><img file="US2022121884A1_D23317.tif" /><img file="US2022121884A1_D23318.tif" /><img file="US2022121884A1_D23319.tif" /><img file="US2022121884A1_D23320.tif" /><img file="US2022121884A1_D23321.tif" /><img file="US2022121884A1_D23322.tif" /><img file="US2022121884A1_D23323.tif" /><img file="US2022121884A1_D23324.tif" /><img file="US2022121884A1_D23325.tif" /><img file="US2022121884A1_D23326.tif" /><img file="US2022121884A1_D23327.tif" /><img file="US2022121884A1_D23328.tif" /><img file="US2022121884A1_D23329.tif" /><img file="US2022121884A1_D23330.tif" /><img file="US2022121884A1_D23331.tif" /><img file="US2022121884A1_D23332.tif" /><img file="US2022121884A1_D23333.tif" /><img file="US2022121884A1_D23334.tif" /><img file="US2022121884A1_D23335.tif" /><img file="US2022121884A1_D23336.tif" /><img file="US2022121884A1_D23337.tif" /><img file="US2022121884A1_D23338.tif" /><img file="US2022121884A1_D23339.tif" /><img file="US2022121884A1_D23340.tif" /><img file="US2022121884A1_D23341.tif" /><img file="US2022121884A1_D23342.tif" /><img file="US2022121884A1_D23343.tif" /><img file="US2022121884A1_D23344.tif" /><img file="US2022121884A1_D23345.tif" /><img file="US2022121884A1_D23346.tif" /><img file="US2022121884A1_D23347.tif" /><img file="US2022121884A1_D23348.tif" /><img file="US2022121884A1_D23349.tif" /><img file="US2022121884A1_D23350.tif" /><img file="US2022121884A1_D23351.tif" /><img file="US2022121884A1_D23352.tif" /><img file="US2022121884A1_D23353.tif" /><img file="US2022121884A1_D23354.tif" /><img file="US2022121884A1_D23355.tif" /><img file="US2022121884A1_D23356.tif" /><img file="US2022121884A1_D23357.tif" /><img file="US2022121884A1_D23358.tif" /><img file="US2022121884A1_D23359.tif" /><img file="US2022121884A1_D23360.tif" /><img file="US2022121884A1_D23361.tif" /><img file="US2022121884A1_D23362.tif" /><img file="US2022121884A1_D23363.tif" /><img file="US2022121884A1_D23364.tif" /><img file="US2022121884A1_D23365.tif" /><img file="US2022121884A1_D23366.tif" /><img file="US2022121884A1_D23367.tif" /><img file="US2022121884A1_D23368.tif" /><img file="US2022121884A1_D23369.tif" /><img file="US2022121884A1_D23370.tif" /><img file="US2022121884A1_D23371.tif" /><img file="US2022121884A1_D23372.tif" /><img file="US2022121884A1_D23373.tif" /><img file="US2022121884A1_D23374.tif" /><img file="US2022121884A1_D23375.tif" /><img file="US2022121884A1_D23376.tif" /><img file="US2022121884A1_D23377.tif" /><img file="US2022121884A1_D23378.tif" /><img file="US2022121884A1_D23379.tif" /><img file="US2022121884A1_D23380.tif" /><img file="US2022121884A1_D23381.tif" /><img file="US2022121884A1_D23382.tif" /><img file="US2022121884A1_D23383.tif" /><img file="US2022121884A1_D23384.tif" /><img file="US2022121884A1_D23385.tif" /><img file="US2022121884A1_D23386.tif" /><img file="US2022121884A1_D23387.tif" /><img file="US2022121884A1_D23388.tif" /><img file="US2022121884A1_D23389.tif" /><img file="US2022121884A1_D23390.tif" /><img file="US2022121884A1_D23391.tif" /><img file="US2022121884A1_D23392.tif" /><img file="US2022121884A1_D23393.tif" /><img file="US2022121884A1_D23394.tif" /><img file="US2022121884A1_D23395.tif" /><img file="US2022121884A1_D23396.tif" /><img file="US2022121884A1_D23397.tif" /><img file="US2022121884A1_D23398.tif" /><img file="US2022121884A1_D23399.tif" /><img file="US2022121884A1_D23400.tif" /><img file="US2022121884A1_D23401.tif" /><img file="US2022121884A1_D23402.tif" /><img file="US2022121884A1_D23403.tif" /><img file="US2022121884A1_D23404.tif" /><img file="US2022121884A1_D23405.tif" /><img file="US2022121884A1_D23406.tif" /><img file="US2022121884A1_D23407.tif" /><img file="US2022121884A1_D23408.tif" /><img file="US2022121884A1_D23409.tif" /><img file="US2022121884A1_D23410.tif" /><img file="US2022121884A1_D23411.tif" /><img file="US2022121884A1_D23412.tif" /><img file="US2022121884A1_D23413.tif" /><img file="US2022121884A1_D23414.tif" /><img file="US2022121884A1_D23415.tif" /><img file="US2022121884A1_D23416.tif" />
where C is the certainty of f(A). Computation of C involves an application of the Z<sup>+</sup>-extension principle, followed by an application of the probabilistic extension principle with a probabilistic restriction, (p·A is B). For example, sum of two Z-numbers is done by this method. For example, let's look at the steps for method to find the sum of two Z-numbers:
Let X=(A<sub>X</sub>, B<sub>X</sub>) and Y=(A<sub>Y</sub>, B<sub>Y</sub>). The sum of X and Y is a Z-number, Z=(A<sub>Z</sub>, B<sub>Z</sub>). The sum of (A<sub>X</sub>, B<sub>X</sub>) and (A<sub>Y</sub>,B<sub>Y</sub>) is defined as:
<br />(<i>A</i><sub>X</sub><i>, B</i><sub>X</sub>)+(<i>A</i><sub>Y</sub><i>, B</i><sub>Y</sub>)=(<i>A</i><sub>X</sub><i>+A</i><sub>Y</sub><i>, B</i><sub>Z</sub>)
where (A<sub>X</sub>+A<sub>Y</sub>) is the sum of fuzzy numbers A<sub>X </sub>and A<sub>Y </sub>computed through the use of fuzzy arithmetic. Then, we compute B<sub>Z</sub>. Let p<sub>X </sub>and p<sub>Y </sub>be the underlying probability density functions in the Z-valuations (X,Ax,I3x) and (Y,A<sub>Y</sub>, By), respectively. If p<sub>X </sub>and p<sub>Y </sub>were known, the underlying probability density function in Z is the convolution of p<sub>X </sub>and p<sub>Y</sub>, (p<sub>Z</sub>=p<sub>X </sub>O p<sub>Y</sub>), which is expressed as (where R is real):
<br /><i>p</i><sub>X+Y </sub>(<i>v</i>)=∫<sub>R </sub><i>p</i><sub>X</sub>(<i>u</i>) <i>p</i><sub>Y</sub>(<i>v−u</i>) <i>du </i>
We do not know p<sub>X </sub>and p<sub>Y</sub>, but we know the restrictions on p<sub>X </sub>and p<sub>Y</sub>, which are:
<br />(∫<sub>R </sub>μ<sub>AX</sub>(<i>u</i>) <i>p</i><sub>X</sub>(<i>u</i>) <i>du</i>) is <i>B</i><sub>X </sub>
<br />(∫<sub>R </sub>μ<sub>AY</sub>(<i>u</i>) <i>p</i><sub>Y</sub>(<i>u</i>) <i>du</i>) is <i>B</i><sub>Y </sub>
Using extension principle, for restriction on p<sub>Z</sub>, we have:
<br />μ<sub>pZ</sub>(<i>p</i><sub>Z</sub>)=sup<sub>pX,pY </sub>(μ<sub>BX</sub>(∫<sub>R </sub>μ<sub>AX</sub>(<i>u</i>) <i>p</i><sub>X</sub>(<i>u</i>) <i>du</i>) {circumflex over ( )} μ<sub>BY</sub>(∫<sub>R </sub>μ<sub>AY</sub>(<i>u</i>) <sub>Y</sub>(<i>u</i>) <i>du</i>))
<br />subject to: (<i>p</i><sub>Z</sub><i>=p</i><sub>X </sub><i>O p</i><sub>Y</sub>)
<br />(∫<sub>R </sub><i>p</i><sub>X</sub>(<i>u</i>) <i>du</i>)=1
<br />(∫<sub>R </sub><i>p</i><sub>Y</sub>(<i>u</i>) <i>du</i>)=1
If we know p<sub>Z</sub>, then we have:
<br /><i>B</i><sub>Z</sub>=(∫<sub>R </sub>μ<sub>AZ</sub>(<i>u</i>) <i>p</i><sub>Z</sub>(<i>u</i>) <i>du</i>)
Where:
<br />μ<sub>AZ</sub>(<i>u</i>)=sup<sub>v </sub>(μ<sub>AX</sub>(v){circumflex over ( )} μ<sub>AY</sub>(<i>u−v</i>))
Now, we apply extension principle, to get restriction on B<sub>Z</sub>:
<br />μ<sub>BZ</sub>(<i>w</i>)=sup<sub>pZ </sub>(μ<sub>pZ</sub>(<i>p</i><sub>Z</sub>))
subject to:
<br /><i>w</i>=(∫<sub>R </sub>μ<sub>AZ</sub>(<i>u</i>) <i>p</i><sub>Z</sub>(<i>u</i>) <i>du</i>)
We already got (μ<sub>pZ</sub>(p<sub>Z</sub>)). Thus, the sum of Z-numbers is completed now.
Another important transformation is f-transformation, in the context of f-geometry, which we draw the geometrical shapes with fuzzy boundaries, or with thick non-sharp cloudy boundaries, as if it is drawn by hand with a spray pen. Then, we will have the following f-concepts in f-geometry: f-point, f-triangle, f-line, f-circle, f-bisector, f-tangent, f-proof, f-perpendicular, f-median, f-altitude, f-definition, f-theorem, and the like.
In summary, Z-number domain is a powerful domain and tool for processing natural language data or our daily way of life, to better understand and process the information (efficiently and correctly).
Some Technical Notes & Applications:
In one embodiment, we use two learning machines which get trained by two images from binocular vision, or stereoscopic vision, or binocular disparity, or parallax, or as if they are a set of two eyes on somebody's head, e.g. for depth perception or binocular fusion, for a machine which can find the depth or perspective, based on its training, which is very valuable e.g. for a replacement for a human in a robotic vision or target detection or space missions (for automatic landing).
<figref idref="DRAWINGS">FIG. 128</figref> shows some of the applications or modules, using the analyzer or processor taught in this invention, applying the methods taught in this invention, for various uses, with analyzer feeding data to or receiving data from the components, for various tasks. In one embodiment, the Big Data analytics is used for marketing, geolocation information, mobile users, fraud prevention, investing, and mortgage analysis.
In one embodiment, to do the data mining from Z-web, we can use “extract, transformation, and load” procedure, to our data warehouse, and then report it in various formats to the user, from the data warehouse, e.g. for batch reports and decision support systems reports, which can be multi-dimensional, rational, or hybrid, with queries based on natural language in free human language format, or based on templates. In one embodiment, the calculations are all done in the warehouse. In one embodiment, the calculations are done outside the warehouse in a multi-dimensional database. The reporting can be done on CRM, e-business intelligence, web traffic analysis, and click stream analysis, for customer taste, complementary merchandise, gift suggestions, customer profile, marketing and sales, and the like. In one embodiment, for frequently asked questions or those with high probability, for retrieval or calculations, to avoid double work for retrieval or calculations very often, the system stores the results in the intermediate storages for quick access by other users, without double calculations, e.g. calculating the average salary of all teachers in all school districts in US once, and only once.
In one embodiment, we add hashing, compression of data, partitioning the data, clustering, and parallel processing to the data mining module. In one embodiment, we use Z-webs for prediction engines, using the data mining from Z-web, to e.g. predict what the user will buy for next year, e.g. in terms of fashion, color, and the like. From the prediction engines for human behaviors and emotion variables, one can predict social unrests and revolutions, or on an individual basis, the problems with a specific person, which helps predicting policing for crime prevention.
In one embodiment, we have learning machines with multiple search options: logic-based, cultural-related, or evolutionary or genetics search. For genetic algorithm or programming, we have to determine the set of terminals and functions, as well as the fitness measure and parameters for the run, e.g. number of generations and population size, plus the method for getting the result and how to terminate the run, based on some criteria. The genetic algorithm can be combined with our method of our invention for learning machines. In addition, for the way that nodes of Z-web evolve, we can use a genetic algorithm, to progressively improve the Z-web node values and Z-factors.
In one embodiment, we have a large set of facts, e.g. encyclopedia, and a set of formulas or relationships, e.g. for conversion of currency or length or weight or the like, e.g. between US Dollar and Euro, and a set of presentation took, such as graphs or 2-D Cartesian drawings (for Y versus X axis) or tables, to present the raw facts in a presentable format or modified format, as required per query or search by user. For example, if the user wants to know “the population of US in 2000 according to US Census Bureau”, in addition to the simple answer as an integer, the system presents all the available data for population, e.g. from 1900 to now, by a plot or graph in 2D on display for the user, as an extra information.
In one embodiment, a search engine can be customized for a user, based on her specific developed Z-web, with her preferences embedded in there. That also helps to find the right context e.g. for a word search with multiple meanings, to find the intention of the user automatically, from the Z-web. In one embodiment, the browsing habits or history or purchases or web sites or clicks are part of the customized feedback for the user, to modify her Z-web for future.
General Notes:
For all the systems taught here, one can use a microprocessor, processor, computer, computing device, controller, CPU, central processing module, processing unit, or controlling unit, to calculate, analyze, convert, and process the data, and it can store the information on a disk, hard drive, memory unit, storage unit, ROM, RAM, optical disc, magnetic unit, memory module, database, flash drive, removable drive, server, PC, RAID, tape, or the like. The information can be processed serially or in parallel. The communication between different units, devices, or modules are done by wire, cable, fiber optics, wirelessly, WiFi, Bluetooth, through network. Internet, copper interconnect, antenna, satellite dish, or the like.
In general, for all teachings of this disclosure, the changes or rules or commands or corrections can be in crisp values, e.g. 10 percent change or threshold or difference, or in one other embodiment, in Fuzzy domain, e.g. Fuzzy rules, commands, and corrections, e.g. large difference or large change, or can be expressed in combination of both Fuzzy and crisp rules and parameters. The Fuzzy rules and sets and their treatments are explained elsewhere in this disclosure.
Note that throughout this disclosure, “we” or If means “our system” or “our controller” or “processor” or “CPU” or “our computer” or “our system of invention or embodiment” or “one of our embodiments” or “our method of invention” or “system of invention” or “microprocessor” or “processing unit of our system” or “our device” or “server” or “our teaching based on our method or system or device”, which is (or related to) a machine or device or hardware, and not referring to a human at all. We also (sometimes) use the words “we” or “our” as our teaching entity or “teacher” for our disclosure, which again means that we are talking about “our system” or “details of our system” or “our method” or “details of our method” or “how it works, based on components of our system or steps of our method” (and not referring to a human at all).
Any other teachings similar to here or variations of here are also meant to be included for protection under the current invention disclosure. All embodiments and examples are independent for teaching purposes, and they are not limiting the scope of the invention at all. However, they can be combined for or in our system, in any combination possible, with no limitation intended.
Introduction (Video and Image Search Engines):
With powerful search in images and videos, more photos or videos become available as source of information which results in more growth in sharing the images as way of sharing information. The information becomes more available and hence more useful and valuable.
3D Model of Head and Body from Video:
In one embodiment, using various frames of a video for a person, the analysis engine determines the motion and poses of the person (e.g., orientation) from a frame(s), extracts features (e.g., facial or body), and map those features to a 3D model for that person. Certain poses provide more reliability for certain features (or they may hide other features), e.g., front and side way poses expose different parts of a face with different reliability (based on projection angle to the camera or viewer).
The learning of the features take into account the reliability of a given feature based on the pose and the quality of the image (e.g., fuzziness, sharpness, contrast, scale).
Background Check Application:
In one embodiment, applicants fill applications for example for getting hired by a company, receive medical benefit or insurance, e.g., Medicare or Medicaid, license to drive, license to practice law, license to become accountant, or gun license. The sources of the names/entities may be from the application or from a list (e.g., based on zip code, associated with a locality or an entity, including name/address pairs).
Application may be in form of name/value pair of information, in flat form or structured in a hierarchical form, e.g., XML, or in a database relational tables. See <figref idref="DRAWINGS">FIG. 206</figref> for example. The analysis engine obtains or queries other search engines, databases, social media, and repositories to gather information and data related to the applicant or the items in the application related to the applicant.
Analysis engine incorporates the information in Z-web along with the reliability factors, e.g., based on the queries from various repositories and engines, and based on the relative weight/reliability of the source of information for a given query.
Z-web may be queries to obtain detailed or aggregate information and analysis regarding the application or the applicant (or the person or entity being investigated or being queried). Such results may be provided based on subscription (e.g., paid) to investigation agencies as the Z-web databases grow. Reliability of overall, subset or individual piece of the application may be determined.
The result may be organized by individual people even if they have similar or the same name, based on correlation with their images and associated documents, activities, and background. This approach disambiguates the labels/names and associated information for individual people or entities, based on reliability of information and match.
In one embodiment, to identify a person, e.g. the system is based on the hierarchy of the classifiers. First, it is established that the object is human for the first classifier, then it goes on to the ethnicity or facial features, as the second classifier, to separate people into groups of similar features, to limit the scope of the search, and have better weights for the learning machine. Then, it goes on to the third classifier, that identifies a person based on its database, on that region or ethnicity, specialized for that region or ethnicity, e.g. Northern Europe Scandinavian type people. This way, we can continue in more nested classifiers, or hierarchy, so that we get more accurate results at the end. So, potentially, for some large populations, with diverse shapes and features, we may go e.g. 3-10 steps, before we get to the final results.
Z-Web, with Reliability Factor or Z-Factors:
In one embodiment, Z-web, the analyzer, and our search engine (Z-engine or Z-search engine) get the information from the user or social media, and analyze them. Alternatively, it crawls in the Internet, to get the data. Then, any search result from other conventional search engines, e.g. GOOGLE, can be refined, corrected, ordered, and edited, to be presented to a querying user, through a GUI or user interface, with high reliability or improved Z-factors, which is much more useful result for the user. The types that are handled are images, text, video, documents, metadata, voice, and the like. The processor for Z-web also indexes the web or Internet, and has features repository, for efficient navigation of web or Internet. For example, see <figref idref="DRAWINGS">FIG. 207</figref>.
Security Application:
For example, see <figref idref="DRAWINGS">FIG. 208</figref>. In one embodiment, for example, at the airport, we have multiple cameras, as a person walks around, to monitor people, along with voice or sound capture, e.g. the sound of walking or foot on the ground or voice of people, to get walking patterns as a signature for a person, or voice recognition. It is non-intrusive. It can get the walking pattern, e.g. drunk person, or when person tilting toward left due to heavy bag or unusually heavy bag, to warn the authorities. It also detects the sweat on persons face, or facial expressions e.g. nervousness or agitation or anger, to get mood, behavior, state, status, or intention of the person. In one embodiment, it is for access control for a building. In one embodiment, it has a database of targeted individuals. In one embodiment, we have the pattern of walking combined with signature of walking combined with facial expressions. In one embodiment, it determines the invariant features e.g. size of nose, with variant features, e.g. size of mouth during big laugh, to find the right person, by databases (DB). In one embodiment, we convert the variant features to invariant counterparts, or normalize them, or convert to neutral ones, from databases, or using rules or models, to be able to compare or recognize them, against the known people.
In one embodiment, we have the pose e.g. bent back, or motion pattern e.g. the sequence or patterns of body pieces during walking or sitting, in motion or at stationary positions, for signatures for a person or person's behavior or intention or action, e.g. fast running or nervous running or running while looking backward (as guilty feeling). In one embodiment, we alert the authorities, and also track the specific person using multiple cameras, using the motor(s) or hinges or arms under each camera, to focus or zoom or follow a person in 3D coordinates, in 3 axes, for finding the person. In one embodiment, the system records the interesting events in storage, for later view and review and analysis, or marks the interesting parts, for partial storage, only.
Image of an Object (Versus Image Related to an Object (or Face or Person)):
For example, see <figref idref="DRAWINGS">FIG. 209</figref>. In one embodiment, we get features from images and video, along with user identity, relationships, and annotations, to match features with labels, users, entities, to auto-annotate and apply matched relationships. Then, in one embodiment, for a new image and/or metadata of that image or video, the system extracts features, and then, the system matches with existing features or annotations, as mentioned above, e.g. based on rules and policy engine. Then, in one embodiment, for matched images, the system locates or identifies same or similar person, object, or entity, based on matched features, in various images, photos, audios, or videos (e.g. the location in video frames, e.g. at 30-50 second points or frames or ranges), e.g. based on annotations, including auto-annotations. In one embodiment, the system locates (for pictures) at what part of picture or body, and for videos, it locates at what track and timing or segment of track, using scene name or number or ID, or for frames, locating with location or position or coordinate (at which part(s) of the frame or image).
In one embodiment, we get confidence factor and reliability factor, as Z-factors. In one embodiment, we use it for dating sites or type of look search or FBI face search. In one embodiment, we get images of object A, rather than images related to object A. In one embodiment, we use video frame images or sequences or major changes. In one embodiment, we search by image or video piece (e.g. based on percentage of matches between single frames or series of frames, with a threshold(s), for action sequences or emotion or pose or behavior, e.g. walking or drunk walking or explosion scene or sitting or rocket take-off, for human or animal or object, e.g. for similar to dictionary or reverse dictionary search. In one embodiment, we have self-annotate function, by user or friends. In one embodiment, we have auto-annotate function. In one embodiment, we have the data indexed or linked from the database. In one embodiment, we locate or identify the person or object in various videos or still images. In one embodiment, we use audio track or OCR for recognition analysis. In one embodiment, we name the person with real name that we had found. In one embodiment, we tag the person as person X, as a substitute, until we name the person later on, with his/her real name, when it is known to us. In one embodiment, we have video frames or pieces identified with its track or piece number or ID.
Image or Information Network (for People, Places, Concepts, or Objects):
For example, see <figref idref="DRAWINGS">FIG. 210</figref>. In one embodiment, we have a network of photos or images, with relationships between photos or people in the photos. In one embodiment, we have links, LIKE button results, and relationships, e.g. follower, groupie, fan, supporter, mentor, idle, friend, close friend, acquaintance, boss, dad, son, or co-worker. In one embodiment, we have navigation by UI, or by search engine (e.g. using criteria or analytics). In one embodiment, we have analytics, e.g. with web elements and links, e.g. to enhance metadata for links, e.g. using degrees, time periods, and the like. In one embodiment, we find or verify one object through one or more images or relationships.
In one embodiment, once uploaded the albums in our web site, by friends, a friend can link and go to others, by relationship web, and navigate through pictures or albums, using e.g. context, e.g. for friends or co-workers, for their corresponding links, optionally showing all links and relationships as an overlay to the albums and pictures, and optionally showing the images and links as miniature versions or thumbnails, for faster review and scanning by user.
In one embodiment, once uploaded the albums in our web site, by friends, one person can ask if there is a picture of these two people A and B in this or other albums, and if so, where? Then, the search engine finds it, if any, and gives the location to the user. In one embodiment, once uploaded the albums in our web site, by friends, one person can ask what relationship exists between person A and B, e.g. father, or friend-of-friend-of-friend, or son-in-law, or identify them by name (and any other related data about that person).
Image Recognition for People (or Objects):
For example, see <figref idref="DRAWINGS">FIG. 211</figref> (as an example of Z-web). In one embodiment, we have two people called Jim and John, as 2 entities, with a third entity with the same name as Jim, but a different person. They have their own IDs and properties or attributes, and relationships, e.g. between 2 entities, e.g. friends, or father-son, with Z-factors between them, e.g. as reliability factor, e.g. with cross tables or pointers or arrows, showing them or re erring to each other. In one embodiment, we distinguish between 2 people with same name (Jim), using images and other attributes, with Z-factors (e.g. reliability factor or confidence factor), or if they are the same person, merging the two entities as one “Jim”, together.
In one embodiment, the system shows the nodes connected to the original node, in the Z-web, on screen or monitor for the user to see, for more research, search, hint, clue, or the like, pictorially or in text format or in voice format or bar-code or coded format or multimedia or mixed format or any other format. For example, if the user is searching for “outdoors”, the system shows the picture of “outdoors”, as well as e.g. a picture of “SUV” or “JEEP” automobile or “beach umbrella” or “flying kite”, on the side of the screen, so that the user or her friends can select the side pictures and continue going deep with it, in one or more directions in the Z-web, for related concepts or objects or people, e.g. by clicking on them, to discover more in the Z-web and the knowledge base.
Auto-Annotation & Feature-Enabling Web Albums:
For example, see <figref idref="DRAWINGS">FIG. 212</figref>. In one embodiment, we search e.g. by gender, or looking for a “red dress”, color of dress, or “wedding dress”, or looking for “cold weather”, using indicators, e.g. hat, coat, GPS data (for location on hemisphere or planet Earth), ice, snow, time or season, or the like. In one embodiment, we look for bride in an album (image album or video library) for wedding, or wedding indicators, e.g. wedding dress, tags, comments, formal dress, cake, tie, or jacket. In one embodiment, we do the same in frames of video.
In one embodiment, we have a person with multiple images and video albums or archives, each from an occasion, e.g. trip to zoo, with metadata, e.g. GPS data for location on planet Earth, date, time, or camera or lens information or specifications. In one embodiment, we have ADD and DELETE and UPDATE functions to add or subtract or update or synchronize between 2 devices for some data, e.g. attributes, tags, metadata, and the like. In one embodiment, we have private and public areas for albums or display or distribution or sharing or access or input or comment or tagging or output or email capability. In one embodiment, we self or automatically organize or use or tag or annotate photos or videos or pieces of videos. In one embodiment, we find or detect expressions on face, e.g. smiling or anger, closed eyes, red eyes, not-front-face posture, foggy photo, half-head in photo, open-mouth in photo, not-focused lens photo, or other problems or features in the image. In one embodiment, we have those features optional with the user (interactive with user, with GUI).
In one embodiment, we have cross reference between final albums, or soft boundaries between album classifications, either automatically or manually. In one embodiment, one image can be in multiple albums, as referenced or as copies. In one embodiment, the processor fixes or highlights or separates or brings apart or collects the red eye images or other features or problems. In one embodiment, the processor fixes the red eye or other problems, using other images of the person, e.g. using his eyes in the good or approved pictures to replace the bad ones, automatically. In one embodiment, we have clusters based on camera ID or recording time periods, in albums.
In one embodiment, we can search by e.g. people's name, occasion, or time, or by the characteristics of a dress, e.g. type of dress, e.g. “wedding dress”, or attributes, e.g. color, or objects, e.g. hat or type of “hat”, or e.g. abstract level of relationship for web or semantic web, e.g. “bride”, to search for “wedding dress”, or “cold weather”, to search for hat, snow, or ice, or search for concepts or environments, e.g. night or day (in the image, based on color, histogram, “Moon”, “Sun”, intensity, time, or the like). Then, in one embodiment, after search, we can organize and rank the results. The result is based on images, or parts of images with objects in them, or highlighted parts. In one embodiment, with a click of the mouse or selector on screen or monitor or display, the system goes or jumps or refers to other data about the image, or original image itself, or relationships for the image. In one embodiment, we can get the information about the body of the person, or infer the age of person, in the image, using the metadata (or the like). In one embodiment, we search e.g. for CASUAL EVENT, e.g. looking for casual dress, tie, or jacket, coming from a database or rule storage, to expand the search terms.
In one embodiment, first, for a user, it searches his own database, and then friends' databases, as default, or alternatively, set the order of search as the user wishes, to search in that order for those databases. In one embodiment, for search, one can use image, part of image, or annotation of image, as search term or part of search terms. In one embodiment, other terms can be combined logically, using AND or OR or NOT operators, or using fuzzy logic operators or modifiers, e.g. showing degree of match or membership values. In one embodiment, the features are extracted, and then are used as the search terms, without any text or typing by the user. In one embodiment, the user can share the annotations with friends or public. In one embodiment, for generalization or specification situation, e.g. one is looking for “animal” or “panda”, which are related to the “animal zoo”, to be used for search term. In one embodiment, for search, we use the attributes of e.g. “animal” for “panda”, for search terms (where “panda” is a subset of “animal”).
Dictionary of Images:
For example, see <figref idref="DRAWINGS">FIG. 213</figref>. In one embodiment, we have dictionary of images, or reverse dictionary of images, for searches both ways. In one embodiment, we have a document and document reviewer, for rendering, e.g. with image and text on the same file or page or layout. In one embodiment, processor uses the figure caption or figure number in the text to get information about the image, e.g. as a match of figure numbers, e.g. for sources of metadata. In one embodiment, main processor uses tags, OCR, or natural language module, to understand the related text.
In one embodiment, the user can do the selection on the objects, or alternatively, it does that automatically. In one embodiment, the user can hover over the image to get data about the image or object in the image, e.g. using a mouse, or click on it (or the like). In one embodiment, the analysis is based on reference URL, or metadata associated or embedded, or sources of information, or figure caption. In one embodiment, for the URL for image, the URL is associated with annotations. In one embodiment, we have functions WHOIS? and LEARN, e.g. with the right click on the image, to identify (image, person, or object), or learn it (as a learning or training sample).
In one embodiment, we use URL, metadata, or whole image, to get annotations, reliability, link, and other metadata. In one embodiment, we use a processor or plug-in to do the function or method mentioned here in this disclosure. In one embodiment, the plug-in is interactive, to be able to enter data. In one embodiment, we have PDF reader, browser, or MICROSOFT WORD, for the reader or viewer. In one embodiment, for large documents, for the extracted data, it can be used for other images, e.g. using cached information for other instances. In one embodiment, we use web crawlers or bots for pre-capture, analysis, and indexing. In one embodiment, we have embedded data, with no reference. In one embodiment, we have referenced image or data.
In one embodiment, the plug-in has a corresponding user interface, communicating with Z-web and its databases. In one embodiment, there is a context, obtained from metadata, or from enclosing documents, or from user ID, or from reader's ID. In one embodiment, in one or more databases, we have well-known people or objects, or classes of them. In one embodiment, we have various thresholds for different matchings. In one embodiment, we have batch process before the user's view, based on web page or image, or document capture, or indexing process, or background process in network (e.g. not user-driven e.g. using annotations. (Note that these can be before that process, or at the same time.) In one embodiment, some of the process can be done without user's involvement or reader's involvement. In one embodiment, the UI or drop-down menu is used for entry into database, for editing and entry, or for learning an image or object.
In one embodiment, we have reverse dictionary of photos, e.g. with a GUI, e.g. with a plug-in, e.g. with a right-click-mouse function, e.g. for WHOIS? function (to identify the person or object in the image), or UPLOAD function to upload, or ANNOTATE function to annotate, or LINK function to link, or the like. In one embodiment, for the match, we compare with user's album, friend's album, friend-of-friend's album, group's album, super-group's album, social network's album, or the like, in an expanding manner, for scope or reach or size or width. In one embodiment, for the match, we have a repository of famous people, places, objects, or the like, with corresponding thresholds or criteria, with corresponding Z-factors, e.g. reliability factor. In one embodiment, for a given image or picture, the system gets or extracts a concept or object, and from that, the system can get antonyms or synonyms for that concept or object, if any, pictorially or textually or both, displayed to the user, on GUI or monitor or display. In one embodiment, the system displays ads based on antonyms or synonyms or related concepts. In one embodiment, the system displays concepts related to the object, based on a thesaurus, slangs, proverbs, or idioms dictionary, fully pictorially, or half pictorially (mixed with text).
Context:
For example, see <figref idref="DRAWINGS">FIG. 14</figref>. In one embodiment, the system gets an image in a context, and then it finds the interest points in there. In one embodiment, it uses multiple classifiers, using multiple databases, e.g. for people, objects (e.g. for home, office, or road), buildings, animals, or satellite images, e.g. with hierarchy of more specialized classifiers. In one embodiment, it uses semantic web, e.g. using the Z-web (with reliability factor or other Z-factors), to uniquely identify, and if needed, go deeper in the classifiers chain. When, e.g., we find a collection of objects as “computer, fax machine, and white board”, we may infer from them e.g. the OFFICE, as the context or environment for the collection of those objects, based on a database for context (or rules or rules engine).
In one embodiment, it also uses dictionary, and common misspellings listing or rules for correction module, to try different versions or variations for possible match. In one embodiment, it looks for generic object, e.g. “human”, rather than “Jim”. In one embodiment, it has reliability factor for each level of recognition, e.g. 90 percent for the recognized object being “human” (at the top level), and 10 percent for that to be “Jim” (at a lower level, as a subset of the top level). In one embodiment, it uses semantic web, to e.g. get “pet”, as the extra object to search for, when e.g. searching for the object “dog”, to expand the scope of the search, for better and more comprehensive search (for “dog”).
In one embodiment, e.g., we find 4 objects in the example of <figref idref="DRAWINGS">FIG. 214</figref> (as localization of interest points), two of which are the human and the pet (as class identification), and the other 2 maybe not recognized, yet. Then, for the entity identification, we have identified them as e.g. Joe and his dog, e.g. called Dragon, which have some Z-factor (or reliability factor) associated with their respective identifications.
Application for Social Network or Using Social Network:
For example, see <figref idref="DRAWINGS">FIG. 215</figref>. In one embodiment, e.g. in <figref idref="DRAWINGS">FIG. 215</figref>, we have user A's photo album is input and analyzed for match and recognition, e.g. recognizing A, based on extracted features and matching them. But e.g. person labeled X is not resolved or needs further verifications. So, we analyze user B's album, and the result goes to a resolver module, to resolve person C, as being the same X, using another module, in which we use e.g. a user's data, e.g. user A and social network as input, and found links based on that, e.g. for list of friends or co-workers, which helps the resolver module resolving the identity of X, as being equal to C. In one embodiment, person C and person B are the same. In one embodiment, e.g. the user is asked to help to resolve or verify identities, by the system, if possible, by a window or text dialog appearing on the screen. In one embodiment, the user is asked to resolve people based on the order of e.g. their frequency of appearances, e.g. as showing more importance for larger frequencies.
For example, see <figref idref="DRAWINGS">FIG. 216</figref>. In one embodiment, 2 people use each other's albums or photos, or cross-reference other one. In one embodiment, e.g. we get pictures for a group of people, as mutual friends, but not all know each other. Then, once all people are identified, and a new picture is input, then, we label the new one with known people, and send one or some or all people in the picture an email or notification or SMS or the like, about the picture or each other or the picture itself, e.g. in a social network setting. In one embodiment, we use contact list from email or the like, e.g. OUTLOOK, or the registration log or account for each user, or for friends. In one embodiment, we send the email to the user or friend or both. In one embodiment, we use the contact list as a guide for annotation or more links. In one embodiment, we let the users verify images of themselves or friends, e.g. in a game or by simple window inquiry by system. In one embodiment, the user wants to know the identity of the 2nd person, and initiates the query, or links it to his contact list. In one embodiment, the match is done, but with low reliability. So, it asks the user or friend to verify that match. In one embodiment, the system uses this introduction mechanism between people, to make people connected or friend in the big network, to expand it very fast.
In one embodiment, the user can invite one or multiple people in the photo, to join or become friend or linked or come in to his circle or social network, or send an email, texting, SMS, TWITTER, broadcast, warning, invitation, or notice, automatically, e.g. textually or verbally or symbolically or pictorially, e.g. by clicking on people or objects, or going or hovering over them, or with stylus, finger or pen, or by hand movement or pose nearby, or face gesture with camera(s), or eye tracking or pose with camera(s), or by RFIDs or tags or beacons or sensors or magnets or devices or transmitters or inductor devices or capacitor devices or reflectors or lenses or mirrors on fingers or hands or body or clothing or gloves or hat or helmet or eyeglasses or the like, or other similar ways.
Using Faces for Verification of Email Recipients:
In one embodiment, for the email system, for the email listing, people's faces are shown for verification of recipients, so that the mail does not go to the wrong people, as with visual confirmation by the sender, for fewer mistakes. In one embodiment, for the email system, for the email listing, the list is done textually, or by voice recognition naming the people, initially, and then verified visually by user, using the pictures or images or faces of recipients, or other attributes or caricatures or other signatures or trademarks of people or well-known facts about people (visually). In one embodiment, for the email system, for the email listing, the list is done or selected visually by the user, from the beginning, in one step. In one embodiment, we perform auto-completion for email from figures, for multiple choices for figures (for candidates for a person).
Picture Selection Criteria:
In one embodiment, we have a metrics for pose or quality of print or other quality of the picture, so that based on that, we can rank, sort, or search images, and present the listing or ranking or best one(s) to the user (or optionally to the user, for further narrowing down the choices), e.g. good pictures for the resume or for newspaper article, or a picture with a tie and jacket selected, or a best picture in a context, e.g. for beach ad, with a bathing suit, among one or more people, based on templates or rules, e.g. defining the good height to width ratio of a person, or defining muscular bodies for sports figure selection, e.g. based on some training samples or features detections on the body.
Searching (or Getting or Finding) Image of a Person (or Object):
In one embodiment, e.g. we have person A inputting the pictures or albums, which gets analyzed, and then, annotated or tagged, as in <figref idref="DRAWINGS">FIG. 217</figref>, e.g. to get “image of” a person, rather than image “related to” a person, which is much bigger scope and yields more as output, but sometimes not what exactly we are looking for. For example, for search of a person, as we can distinguish from the name, when searching for her name, in the images, we do not want to show a picture of the house of that person, but rather, we usually (in one embodiment) want to get the picture of the person herself. In one embodiment, as in <figref idref="DRAWINGS">FIG. 217</figref>, instead of “query for user A label”, for “search engine, e.g. GOOGLE”, we have “query for Entity 1 or 2 label”.
In one embodiment, as in <figref idref="DRAWINGS">FIG. 218</figref>, e.g. we are querying for label A (e.g. somebody's name, e.g. person A). We get images from other search engines, and then we clean up the results, to get only the images of label A. In one embodiment, the system searches through other search engines, first, and then the system compares it with the annotated images we had had before. We also distinguish two entities with the same name, e.g. Entity n, with the same label A, e.g. “Jim”, as the name for 2 different people. In one embodiment, the system lists e.g. the people with the same name, in a ranking order based on e.g. the proximity link they have with the user (e.g. how close they are). In one embodiment, we display the results with links and metadata, using GUI. In one embodiment, we have link proximity based on e.g. user, friends, or famous people. In one embodiment, we put the search results from other search engines, e.g. GOOGLE, at the end of our own search results, as secondary results (i.e. with lower quality), for user's view and reference or comparison. In one embodiment, for a user, we can e.g. bypass the step of “Search related images, e.g. from other search engines”, as in <figref idref="DRAWINGS">FIG. 218</figref>, if we know the user (with his picture albums and friend links), to go directly to the step of “Search and match URL and label A”, as in <figref idref="DRAWINGS">FIG. 218</figref>, which is fed from user's photo album and friends' links database.
In one embodiment, if the system finds a picture for person A. as verified, and knows where it came from, then that web site (as a source) has more weight, and can be explored further in depth to get more reliable information about person A.
In one embodiment, for the results from other search engines, for expansion, the system uses the URL for extracting more information, e.g. via web crawler and hot, e.g. in a batch process or background process.
Privacy:
In one embodiment, we have private or public or semi-public or semi-private (or the like) settings for our sharing or displaying or reviewing or tagging or annotating or accessing or searching or browsing of images or objects or videos, for user, friends, family, co-worker, boss, employee, contractor, senior management, public, social network, college, school, classmate, roommate, household, shared device, shared account, friend-of-friend, friend-of-friend-of-friend, and so on, or the like. In one embodiment, we have government excluding list database, for specified individuals, to exclude for the rules, for the above functions, for privacy settings. In one embodiment, we have the intersection of the privacy settings of multiple users or contributors, in set of rules, parameters, settings, coverages, scopes, extensions, reach, neighboring groups, overlaps, members, access points, or the like. In one embodiment, we have the union (or AND or OR or logical operators or XOR or fuzzy operators or MAX or MIN or “max” or “min” or Max-Min or Min-Max or Sup or the like) of the privacy settings of multiple users or contributors, in set of rules, parameters, settings, coverages, scopes, extensions, reach, neighboring groups, overlaps, members, access points, or the like.
In one embodiment, the user determines or sets who can annotate, to whom, where, when, for whom, who can look at them, who can copy them, wh© can download them, who can print them, who can see the relationships, who can see the names, if his relationships can be combined with his friends', if his relationships can be combined with those of his friends-of-friends (and so on), if his relationships can be combined with those of general public, the scope of the combination of his relationships, names, dates, locations, pictures, or data with others', if his data can be used for statistical usage with no identification, if his data can be used for statistical usage with identification of his name, if his data can be used for non-profit purposes, if he gets any royalty or fee or licensing for usage of his data (and how much or based on what metrics), if he can swap his data with his friends or others, what part of his data can be public, if the system has to ask permission for usage of which part of his data on a case-by-case basis, or similar rules or constraints or permissions or situations, set by user or friends or both, or collectively, or conditionally, using menus, dialog windows, options, buttons, screen items or boxes, or the like.
Visual Indicator:
In one embodiment, we have visual feedback or visual indicator for the images, e.g. having an extra border or overlay on top of or around the image frame, so that it has different colors or grey scale values or intensities or frequencies, indicating e.g. the reliability factor, e.g. going from light to dark green or blue, e.g. representing 0 to 100 percent reliability factor, or in fuzzy terms, e.g. going from very low to very high reliability factor or other Z-factors.
Games:
In one embodiment, we have a game for friends, tagging names on pictures for people or objects, e.g. to get points, to accumulate, e.g. to get a prize or coupon or win a trip or exchange points with selection of awards or to get listed in the Hall of Fame of a specific game. In one embodiment, we have this method as a way of training for our learning machine. In one embodiment, we have this method as a fan club or game club or social network connector, linking people more and more. In one embodiment, we have this method to reduce uncertainty or conflict on naming or tagging objects or people. In one embodiment, we have weighted average or average or voting or weighted voting or consensus of users or friends, to get the final result from multiple people or users. In one embodiment, we have e.g. higher weights for people who have more experience, or experts, or people with higher score for credibility so far, or people who played more, or people who were ranked higher by others in the community or social network.
In one embodiment, the system has a game, in which the heads of people (or an object e.g. a car, or part of an object, e.g. tire on a car) in the image are exchanged or edited or replaced or hidden or switched or obscured, in which case the friends or other users have to guess, identify, name, tag, or replace the objects or heads for the match or partial match, to get points or rewards, or e.g. as a funny or entertaining game, for bringing the traffic to our web site, or for training our learning machine (as training samples or users' feedback or input for identification, as supervised learning). In one embodiment, the system has this done for components of the object, e.g. eyes only, to hide eye, or replace eye, or cover eye, or only show eye, or put eyeglasses on the eye, or put eye patch on the eye, or put a famous or funny eye on the face, or the like, which can be a very fun or funny game, for guess and identification between friends, as a game.
Social Network Application:
In one embodiment, we have e.g. a social network application, such as FACEBOOK, running for a user, with pictures showing in the user's timeline or album, which may be addressable. In one embodiment, we have our overlay on top of the social network application, e.g. the timeline display, or modify the display. In one embodiment, we have the interactivity with the user. In one embodiment, we have code or data running or presented in or through the social network application or platform, or by the browser, or using or through or by their API (application programming interface) or SDK (software development kit or “devkit”). In one embodiment, the user goes through our analytics engine or processor, to log in with the social network application, through the intermediary, with e.g. URLs stored in a database. In one embodiment, there is a plug-in for this process. In one embodiment, there is no plug-in for this process. In one embodiment, the relationship between 2 people is identified from the social network application or web site.
In one embodiment, the system encourages more participation in social network and more traffic, e.g. for more ad revenue. In one embodiment, the system enables finding new friends with similar interests. In one embodiment, the system enables finding new friends with particular facial or body features, or dress taste, or food taste, or wine taste, or the like.
Advertisement:
In one embodiment, we have images and videos annotated and analyzed, which make them searchable by others, e.g. for safety (by police or law enforcement) or for security (for access control or target-list). In one embodiment, the system searches for small scope, such as within user and her friends scope or radius, or alternatively, it can increase the scope e.g. for other databases, e.g. region-wide, famous people, city-wide, co-workers, and the like. In one embodiment, the system uses the information for ad or income or referral or recommendation or suggestion or customization, e.g. for travel or vacation for next Summer, for interest or experience of user or her friends, for her taste or history or circle of friends or type of people, for person's personality or profile or background, e.g for airline tickets, flights, clothing, food, restaurant, car, sport, concert, accessory, wine, soft drink, luggage, eyeglasses, or the like, from pictures or images or videos. In one embodiment, the system applies in the context of family, business, friends, university, or the like, to customize the suggestions or advertisements.
At Store:
In one embodiment, the system lets a user use a store e.g. on-line), in which the store has a subscription to the Z-web (based on video or image analyzers), which it can query, to get e.g. the kind or brand for clothing, based on the context and preference, e.g. based on percentage, ranking, fuzzy membership, or fuzzy descriptor, e.g. “85 percent” “casual”, or “mostly” “casual”. In one embodiment, the system has one or more cameras at the physical store, tracking and analyzing the customer, e.g. for identification and analysis, e.g. based on face, way of walking, emotion, GPS data, smart phone ID, RFID tag, credit card ID, driving license ID, store card ID, coupon ID, or any other ID mechanisms, with store's database, getting the preferences or taste for the user, e.g. in coordination with rules database, styles database, and habits database. In one embodiment, the system uses a cookie for tracking purposes for the user, e.g. clicking patterns or behaviors.
Image Analysis:
In one embodiment, the system uses statistics and patterns extracted from images, over time, e.g. to find anomalies, even if we do not know what we exactly are looking for at the beginning, to alert or warn user or others, e.g. finding a person with bathing suit in a black-tie event or formal dinner, or finding a person with formal dress at the beach, where all others having bathing suit, in the photo or image or video. In one embodiment, the system is used for medical images, e.g. to find cancer tumor, or satellite image to find a tank or car, or for spectrum analyzer to find peaks or valleys for the curve, e.g. to find elements or features or accessing quality in the matter or compound or specimen or sample, e.g. for semiconductor material, bridge analysis, blood analysis, chemical analysis, or the like, for training or recognition or classification later on.
Video (or Multimedia or Movie (Including Homemade Movie)):
In one embodiment, the system uses video track and frames, to analyze motion, for people or objects or animals, e.g. getting the features, e.g. for sitting posture, running, falling down, eating, walking as drunk or sleepy, explosion, rocket take-off, and the like, which are searchable, e.g. to analyze scenes, e.g. to later gather individual scenes to find the stotyline or summary for the whole video, or to find the context, or to classify the context (e.g. with a classifier, e.g. using 200-2000 features, for 1-10 million training samples).
In one embodiment, the system gets a video, and it identifies e.g. Abraham Lincoln, “war” scene, and “old style clothing”, along with audio track which is transcribed to text for search, or searched by voice analyzer directly, which can identify the person in movie as e.g. Abraham Lincoln, as well, indicating a movie about Abraham Lincoln. In one embodiment, the system classifies the video as historical, or comedy, or the like, based on some rules and tags or labels or identifiers or indicators, or set of them, or rules engine, or fuzzy rules engine.
In one embodiment, the system has an input from a URL of a movie e.g. from YOUTUBE, or other content owners or repositories, with tags, description, title, top comments, or the like, from which we get keywords and concepts, to analyze, and then send to different classifiers or databases, e.g. specialized classifiers for a specific classification, e.g. face recognition module, or special ethnicity face recognition module for more accurate recognition at a later stage, e.g. to find or locate features in the movie, to index or store them for future use or current search. In one embodiment, the system has a UI or GUI for description of objects or scenes or images, textually, by menu, verbally, or pictorially, to search for them, to find them in the video or track or frame or range of frames, and to mark or flag the location or record the place and time in the video, or record the proximity to other objects or scenes in the video in a storage, for future search. This can be combined with a Z-web, or linked to a Z-web, as a “Z-link”, for expressing or including relationships and Z-factors, including reliability factor.
In one embodiment, the system uses a web browser and plug-in for a movie e.g. from YOUTUBE, or other content owners or repositories, for a click, to jump to a location in the movie or track or frame series. In one embodiment, the system has a UI for getting or capturing LIKE locations, auto-capture, comment on scenes, user annotation on scenes, user notes on scenes, ask-friends for comments on scenes, or the like, or for communicating these to others, e.g. friends in social network, e.g. to encourage participation in this social interaction, which brings more traffic to our web site, or can be used for training purposes (by users' input or feedback or comments on scenes), or can be used for marketing or advertising purposes for movie or objects in the movie or characters in the movie, or can be used to collect public opinion about an event or subject, e.g. drunk driving and corresponding laws, or can be used as survey or voting or public behavior analysis, or can be used for platform for searching interesting things in this movie or all movies, which brings huge traffic to our web site.
In one embodiment, the system uses the email or other forms of communications, e.g. texting or SMS, to communicate or notify friends or others, about the actions or interactions mentioned above, using the mailing list or contact lists or other listing for such purpose. In one embodiment, the system analyzes the emails between friends, or comments posted or TWITTER sent or tags posted, to get some information about a particular video or image. In one embodiment, the system sends a small section of video or first frame or interesting frame or scene or tagged ones or flagged ones to the friend automatically, or with user's option or input, along with the location and position of the interesting scenes, e.g. with a link or code or actual piece or comments or tags or blogs or pointer to the piece, for the friend to review or view.
In one embodiment, the system uses the method above to rank movies and scenes automatically. In one embodiment, the system analyzes the most popular movies in display at the theaters currently or recently, to tag and annotate them for interesting scenes, for users come and add more to it, for a large attraction for such activities, e.g. movie fans around the world, e.g. for most liked scene, most watched scene, most ridiculous scene, funniest scene, most romantic scene, most emailed scene, most commented scene, most hated scene, or the like. In one embodiment, we have the user getting a video (plus audio) from YOUTUBE or similar site, with her browser and her PC. Then, the user accesses our server (which acts as a portal for movies for social network site, for and from members), which has analyzed the video accessed by the user already, or will do that very soon, by accessing the content owner web site, such as YOUTUBE, to give information to the user about the movie, as detailed above.
In one embodiment, for a site e.g. FACEBOOK, or other social networking sites, for a user, the system accesses the movies (URL), e.g. for title or description, recognizes people in e.g. home videos, and annotates them or tags them or flags them or puts notes on them or marks them, and then stores them, or sends email or text or notification or the like, regarding the content or with the content or with a piece of content, to one or more people involved in the video, or friends or family or group or network. In one embodiment, the collection of movies or videos are analyzed, e.g. for the background of the image. In one embodiment, people access the collections for view, comments, referrals, purchase (the video), rent, lease, ad view, review of other's comments, and the like, e.g. with the log-in, with the application at the social site.
In one embodiment, the system has IM (instant message) feature and biog between friends for comments. In one embodiment, the system has a mask feature for hiding images or objects or people, depending on the viewer or user, e.g. for privacy purpose or for game or for guessing challenge for friends. In one embodiment, the system classifies based on topics, e.g. funny video. In one embodiment, the selection is done by right click on image or object, or by hovering over the object by mouse or finger or stylus or other input or selection devices or methods.
Catalogs:
In one embodiment, the system goes through web sites or databases, which are well-organized for different categories, e.g. on-line catalog, or e-commerce, or pet store, or book store, or AMAZON.COM, or EBAY, or libraries, or repositories, or the like, to define or learn species and subset of classes or subclasses or classification (usually designed by a human expert, previously, for the other web site), to learn from that in our system, automatically, e.g. traversing through the classification or catalog tree structure, node by node through branches, to learn the classification and relationships, e.g. “men's shirt” being under the category of (or as a subset of “men's clothing”.
Fashion:
In one embodiment, the system looks for and analyzes models (people's identity), celebrities, friends, famous people, fashion dresses (clothing), eyeglasses, sportswear, shoes, watches, jewelry, accessories, or the like, e.g. with emphasis on patterns, trends, styles, colors, or the like, e.g. at occasions or events, such as OSCAR ceremony, using tags, footage, or metadata, e.g. for search to find an exact match or similar object(s), e.g. finding a similar or exact clothing at half price somewhere else, e.g. with the same brand or another brand, for shoppers on-tine, or bargain hunters . Sometimes, people are interested in similar products (not exact or not the same), but at bargain price, with or by a non-brand name manufacturer. In one embodiment, the system looks for components of e.g. a dress or shirt, e.g. short sleeve or long sleeve, or components of clothing, e.g. pants, and compares it to a catalog or database or user's preference or user's history of purchase or public's preference or public's history of purchase, for matching. In one embodiment, the system is connected to a social network site, for interactions, comments, and referrals between members or friends.
In one embodiment, the same search engine can also be used to find the potential trademark or copyright infringers e.g. for the clothing or design industry, on Internet, automatically, which is compared with the list of authorized dealers or licensees, to see if that is included in there, or if that needs further review, by human or computer, to determine the exact nature of use or sale, e.g. for a specific web site on Internet.
Hand-Drawn Images:
In one embodiment, the system lets the user input hand-drawn images, by tablet or mouse or stylus or finger or on-screen or the like, or input by scanner, or alternatively, using fuzzy descriptors using templates or pre-designed figures, as a combination of pieces, for input. Then, the engine searches for similar figures, e.g. as a reverse dictionary. This can be used for police to find the missing person or described person, matched with other images in the database or in video library.
In one embodiment, the system uses this engine for a game, for multi-user game or teams, to draw by hand by the first user, and other people guess the person intended, from library of famous people, or friends' images. In one embodiment, the game has a template library, to help finish the drawing for the user, to make it easier for matching, e.g. as auto-finish function, as the drawing is done with some simple or coarse strokes by the user, which resembles part or all of a specific design or figure in a template, for the system to present that template to the user, to be chosen as an option to substitute the strokes by the user, to reconstruct part or all of the face for the famous person or friend, in one or more steps. The system searches for such match, as well, to be compared with people's guesses. This can be used as a fun game, or as a training tool for our learning machine, for faces, with users' input or feedback.
In one embodiment, the system lets the user morph the hand-drawn image, e.g. by mouse dragging on the object borders or objects, or by transformations or templates or filters available to the user on computer menu or screen, to be used on selected objects, e.g. elongating the size of the chin or nose, based on computer model and template library, to get later matched by our system with another person or famous personality or friend, e.g. to be compared with people's guesses, e.g. as a fun game. The face game can be done on any other object, e.g. cars or houses, as well.
Semantic Web:
In one embodiment, the system uses semantic web, through the Z-web, to get the relationships, e.g. to relate the “outdoors” to “river” and “hills”, pictorially, as still single images or videos or video frames. In one embodiment, the system connects components to subcomponents or the object, or classes to subclasses, or to synonym, or to related objects, e.g. “car” related to “tire”. In one embodiment, that could expand the search scope. In one embodiment, if one types or searches for “outdoors” (e.g. pictorially, e.g. starting from an image of “outdoors”), then some images of “river” and “hills” appear on the screen automatically, which can be further chained in a sequence for related concepts, for more display of more images, by computer automatically, or optionally, in a direction guided by the user, in a branch of a semantic web chosen by the user.
Video Analysis:
In one embodiment, the system uses a video sequence, e.g. for a car, to get different views of a car, for the same car, from different perspectives and angles, from different frames. In one embodiment, the system uses a 3D (3-dimensional) model, and a learning machine, for those input samples from different views of the car, to learn the car in 3D. according to the 3D model of the car. In one embodiment, the system uses relative position, perspective, correlation, normal vector, facing vector (which is parallel to the vector which is normal to the face of the object), movement vector, motion vector for the video frames, and transparency of the surfaces, e.g. glass of the window for the car, to keep an account for the car and its components, e.g. tire, e.g. to track or follow the car, and also to help recognize the other objects in the video.
In one embodiment, the system uses a frame of the video that inherently is not fully complete, as a single still image. However, that frame gets completed using the neighboring frames in that sequence, to fill up the pixel or raster or scanning gaps (or interpolate or extrapolate), for a resulting complete single still image, representing that frame, which can be used for our image analysis or image or object recognition. Thus, in these situations, in one embodiment, such preprocessing is used for our video frames, to make them ready for our further analysis or search or recognition.
Human (or Object) Model in 3D:
In one embodiment, the system uses a real human, with sensors or beacons on body parts or clothing to track his movements in 3D in a room, with detectors or cameras all over the room, at different angles, to capture him in 3D, based on e.g. about 20-40 anchor points on his body, usually at joints or major moving parts or natural hinges on human body parts, e.g. at knees. Alternatively, one can capture the real human movements through multiple cameras, with reflective surfaces on clothing or body parts, or using light sources, to get a 3D coordinates of the body parts, to track them in movements, e.g. walking, running, angry walking, or drunk walking, to model all those modes and postures and activities and emotions for human or animal, and capture and store them in our databases, for future reference or comparisons. These can be used for our supervised learning for our learning machine, for sequences defining a situation, e.g. being drunk, angry, or nervous, for video analysis, based on our built-up library of sequences and gestures. This can also be used for video analysis, to examine sequences for objects or animals, e.g. defining rocket take-off, or bird flying. This can also be used for analysis, as a dictionary or reverse-dictionary of gestures, modes, actions, postures, or emotions.
Using Camera for Social (or Business) Networking:
In one embodiment, the user uses a camera to capture the images or videos, e.g. the one on his eye glasses or necklace or watch or phone or digital camera or tie or hat or helmet or hidden in his jacket or hidden in his pen or hidden in the pin on his jacket or the like, which transmits the data to outside, e.g. using wireless, wire, fiber optics, WIFI, 4G, BLUETOOTH, or the like. In one embodiment, the user triggers the image capture, using a button or menu or key or the like, e.g. visible to all. Or, in one embodiment, this is hidden from all, using e.g. a key with transmitter in his pocket, with a button to push, using his fingers, without others noticing, with a camera hidden in his clothing or accessories, e.g. eye glasses, so that the picture capture is not noticed at all, by others in the room. The key transmitter in his pocket transmits the command to take a picture or video to the hidden camera, to trigger the picture or video capture. In one embodiment, the user triggers such an event from a remote place, or based on a pre-determined time, or based on another event, or based on periodic time, or based on a third party, or based on a rule engine, or based on a condition being satisfied.
In one embodiment, the user also uses a microphone for speaker recognition or voice recognition or natural language processing. In one embodiment, the user sends the photo to analyzer for analysis and recognition, so that the name and other information for the person in photo are obtained and returned back to the user, e.g. on his phone or other mobile devices or his PC or IPAD or computing tablet. This is useful for parties, business meetings, social gatherings, networking events, social networking, or the like. This is useful for in-person meeting or by computer introduction. In one embodiment, the introduction is done by email or texting or phone or the like, to the 2nd person. In one embodiment, a connection request or friend request message is sent to the 2nd person, automatically. In one embodiment, this increases the social network or business network connections. In one embodiment, the system displays all related data for the person in the photo, to the 1st user, using tables or list or menu. In one embodiment, the Z-factor for the recognition is shown to the 1st user (e.g. the reliability factor).
In one embodiment, the 1st user connects or syncs to 2nd user wirelessly, when both of their phones or devices are in close vicinity, and after the invitation for friendship was sent by device of the 1st user to that of the 2nd user. The next step is by the 2nd user, to accept the invitation, if desired, to get connected by phone, email, other devices or means, or in social network, e.g. FACEBOOK account. This is a fast method of adding friends, using pictorial method, as described above.
In one embodiment, the 1st user wants to get connected or introduced to all the people in the photo, who are not already his friends, after recognizing all people in the photo, as much as possible, and figuring out who is not in his circle of friends, already, from the list of friends. So, the 1st user can use his common friends, if any, to make the connections, or send the invitation directly to the 2nd user, if the 2nd user's address or email is available. Thus, the introduction can go through a common friend's account, if applicable, e.g. by an email.
In one embodiment, the friends, common friends, friends-of-friends, friends-of-friends-of-friends (and so on), unknown people, recognized people, famous people, family members, co-workers, boss, teacher, or the like, are all identified by color frames or various shapes or markers or flags or the like, superimposed on the photo, visually, for the ease of use, for the user, for identification of people based on their class or type. In one embodiment, the other data, such as name or address or position in the company, are also tagged, written, linked, or coded by symbols or colors or the like, e.g. using a pop-up balloon or menu or window or box. In one embodiment, for any new photo, it is also analyzed, and the people who are not friends are identified (in those images or photos or videos), and then, they get contacted for friend-request (or the like), as explained above.
At Store:
In one embodiment, there is a kiosk in a store with camera and other biometrics detectors and analyzers, e.g. fingerprint recognition, to verify the identification of the person, by image or face recognition or other recognition methods, such as signature recognition, or measuring the pen pressure during signing by the user on the sensitive pad at the kiosk (e.g. working with piezoelectric (sensor) or capacitance or electrical resistance variations or changes effect, based on amount of pressure, measuring with sensors on the pad's surface), as compared with the database of known people (and their known characteristics). In one embodiment, the kiosk acts as a recognition unit, verification unit, analyzing unit, coupon dispensing unit, and messaging unit (getting messages from store or advertisements or special price announcements, or from user's friend or spouse, as a reminder to buy something from the store).
In one embodiment, the display is on a big monitor in the store, in every corner, following the user on sequential monitors in the store, based on the user's location, e.g. in one embodiment, based on the GPS data, or triangulation, or using the smart phone location, so that the user can see the ads or messages clearly. In one embodiment, the direction of the movement of the user in store is tracked, e.g. by cameras, sensors, detectors, RFIDs, tags, GPS, smart phone location, or face recognizers, for various sections, e.g. shoe section, to target ads or messages for him, accordingly, for a specific brand, type, product, or merchandise, e.g. specific shoe, especially, if he had a history for purchase of that product in the store database. In one embodiment, for mobile devices, the lower resolution versions of images (or partial images or icons or thumbnails) are used for faster loading or retrieval or efficiency.
In one embodiment, emotion or mood or posture of the people in picture, or the person taking the picture (based on the opposite camera, on the camera phones with double cameras, taking the picture of the camera holder, automatically), is recorded and analyzed, for better ad targeting and marketing, in real time, or at a later time, e.g. to target the people in store or on Internet, e.g. based on personality, mood, and prior history of purchases and tastes (e.g. the bottle of wine at a person's hand in the picture, with a brand, which is identified on the bottle, using an OCR module, indicating his type of preference for “wine” and the identified brand, with a high certainty factor, or Z-factor).
Grammar or Standard Description Language for Image or Video:
For describing the objects, images, videos, frames of videos, coordinates, positions, locations, objects hiding or covering other objects. types of objects, flags, comments, place holders in videos or albums, and the like, we use a grammar or standard description language or a set of tags and parameters for image or video. For example, for tagging or flagging a scene in a video, one can specify the time, for the location of the scene or frame, e.g.:
<br /><t=14567 sec>
or use the frame number in the sequence:
<br /><N=234,459>
Or, for an object A in front of object B, we have the FRONT function:
A=Front (B)
Or, for the position of an object or pixel, we have the coordinates (x,y) on screen as, e.g.:
(34, 56)
expressed as e.g. in cm or meter, or number of pixels from the origin of the coordinate system.
In one embodiment, the related information is extracted from MPEG, JPEG, and other formats, e.g. from their headers or tracks or attachments or content or encoding scheme.
Video or Image Applications:
In one embodiment, the system for video or image recognizer is used for access control, e.g. for building, elevator, airport, security, or government, or for anti-terrorism, or for police work, or for background check, or for employment verification. In one embodiment, the system is used for face or object detection and recognition in pictures or images, e.g. in albums or videos.
In one embodiment, the system is used for recognition of face with hats or eyeglasses, or eye tracking or movement (or pupil or iris) for mood or emotion analysis or sleepiness analysis or drunk-person analysis (e.g. based on some pre-determined data on patterns previously reported and captured or tagged, for machine learning samples or in a database), or sweat on skin or face or clothing for mood or emotion analysis (or temperature of the environment analysis), or wrinkles on face or skin for age analysis (or mood or emotion analysis), or color of face or blood vessels on face or neck for age analysis (or mood or emotion analysis, or health analysis, e.g. for medical doctors), or recognizing taste or fashion (e.g. for clothing and food, e.g. for marketing purposes, e.g. for magazines or on-line catalogs or web sites), or recognizing posture, action, or pose (e.g. for mood, situation, or status analysis, e.g. resulting in the analysis that “Jim is running & he looks scared”, or “RUNNING+SCARED” as attributes to JIM), or determining the context or environment for the scene or image or sound or music (as “scary” or “creepy” or “war zone” or “fighting” or “angry”, which are also fuzzy parameters, in natural language processing, with assigned membership values or functions).
In one embodiment, the system is used for lip reading from a video, with templates of various sounds and pieces (e.g. collectively corresponding to words or phrases) corresponding to lip and mouth and face movements or poses or sequences stored in the database, for matching and recognition, beyond some probability or threshold or reliability factor or Z-factor, e.g. using Z-web analysis or using Hidden Markov Model (HMM), as explained in details elsewhere in this disclosure and the parent of this patent application.
In one embodiment, the system is used for hand gesture analysis from a video, with templates of sign language in different styles or languages, for translation to regular English or other languages or text or voice, or for analysis of hand gesture in other applications, e.g. for baseball game, or for construction workers in a noisy environment with critical results, or for codes between friends, or for special symbols between cultures or people, e.g. “V” sign, by 2 fingers, indicating VICTORY.
In one embodiment, the system is used for tracking and understanding video or camera images, e.g. for a computer or smart phone or tablet input (or computer game systems), e.g. for capturing and interpreting the finger(s), hand, body, face, eye, eyebrow, nose, mouth, hat on the head, eyeglasses on the head, and the like, for poses, gestures, sequences, movements, and the like, based on coded definitions or prior interpretations or stored sequences or videos or images or frames, for comparison and analysis, to match and interpret the meaning, e.g. to convert to text or computer commands or codes, e.g. to initiate an action on the device, or other functionalities or options on the device, e.g. entailing a file or picture to a friend.
Or, for example, the system interprets a “closed fist” for left hand and “circular motion” with right index finger as e.g. a command for “drawing a complete circle on the screen”, on the drawing software, using pre-programmed sequences or commands or codes or executables on the drawing software, based on the library of hand motions, e.g. in the server farm, to initiate such an action, to draw a circle on the screen or display. In one embodiment, the system combines e.g. text commands and voice commands, as well, to e.g. move the circle (in the example above) around on the screen, e.g. for “move up” command, or using an “arrow-up” on the keyboard, to e.g. move the “circle” up on the display.
In one embodiment, e.g. for <figref idref="DRAWINGS">FIG. 220</figref>, when hovering on a person in the image, some menu or buttons or thumbnails appearing on the side of the screen, so that the user can select more details, or some links are associated with the image of the person, so that the user can jump to another location for more data or information.
In one embodiment, in addition to image or video recognizer, to supplement the Z-web analytics, the system uses voice and speaker recognizers, with text transcribe module, to recognize people or objects.
In one embodiment, for image or video, we train the simple objects (which e.g. have more distinct features, for ease of recognition), first, for our learning machine.
In one embodiment, the system tracks a person (or an object) in video frames, and once the system knows the identity of that person from another method, then the system replaces the ID tag for that person with his real name.
In one embodiment, the system shows the user a teaser or short version of a movie, and if the user likes it, the user can buy or rent or watch or download or use the rest or the whole movie or video, through the transaction module, or through the DRM (digital rights management) module.
In one embodiment, the system keeps or marks or demarcates the location where the user has gone so far, on the movie or on the tracks e.g. for video, as a placeholder, or flag, so that for next session, the user can continue from the previous placeholder or marker, or the user can repeat or review a section of the movie again, or send it to her friends, or archive it, or the like. In one embodiment, the system keeps a section of the video, selected based on major changes in the frames, e.g. in the scenes, as pieces, for representation of the video, e.g. as a summary, for ease of review or initial survey, e.g. for the user, or other search engines searching in our databases or archives or libraries.
In one embodiment, the system asks the user or friends or public to approve, confirm, verify, identify, disapprove, challenge, deny, feedback, opinion, vote for or against, or help request, for the purpose of identification, locating, narrowing down, comments, LIKE function (e.g. “I like it.”), description, summarization, or verification, for a person or object or concept, e.g. in a video or image or sound piece (such as tagging as “embarrassing moment” by the user, e.g. for a “naked man” in the “formal party setting” in a picture or video), through a GUI or user interface, e.g. in game or dialog window, or collaboratively by multiple users, questioning or challenging the user(s), for input or answer or feedback or opinion or vote.
In one embodiment, the system classifies and cross-classifies the object or video or image in one or more classes, as in relational databases, with cross-links between them, so that one can search for the same video from multiple approaches or concepts or leads, and still ends up with the same result. In one embodiment, for the example above, the video or image is listed under the following categories: “embarrassing moment”, “naked man”, and “formal party setting”, and it can be searched and reached to, from any of those categories or leads, which a user may remember later, e.g. remembering or searching as a “video containing an embarrassing moment”. This search or query can be accessed or initiated by another picture under “embarrassing moment”, pictorially, or by verbal command by a user (using voice recognizer module) for a given search, e.g. mentioning the phrase “video containing an embarrassing moment”, to initiate a search by the search engine, or textually (e.g. user typing the search terms, or their logical combinations, or phrases, with the natural language processor module), or the like. In one embodiment, for an object, the degree of membership for each of those classes in classification is expressed as a soft boundary, e.g. as a fuzzy number or value, e.g. with corresponding membership functions or values.
3D Models and Templates:
In one embodiment, the system uses the 3D model for faces (or objects) to get the non-frontal face poses, e.g. face at 30 degree to the right-hand side, or at 45 degree to the left side, or side-view, or half-back side view at 45 degree angle, for generating templates, for recognition purpose for any face or a new given face, as input. Since the video already has a person's face (or car or an object) at different angles in different frames (tracked), a movie (or video, MPEG, QUICKTIME, multimedia, or the like) is a good source of the training for our learning machine, for training samples, or to capture the patterns emerging, or to model the 3D templates, or to adjust such templates or models (or parameters for them), empirically.
In one embodiment, the system uses the 3D model for faces or heads, with family members have similar features in common, using both parents, as a starting point, or one parent, or sibling, or children, or grandparents, or grandkids, or cousins, or the like, for modeling and recognition purpose. In one embodiment, the system uses figure captions or comments or tags on the figures. In one embodiment, the system uses the 3D model to generate faces in other orientations, to reconstruct, or to interpolate between them, for recognition purpose. In one embodiment, the system uses the 3D sub-models, for poses and emotions and variations, e.g. sneezing face, e.g. starting from neutral front-looking face with no emotions, as the basis, and generating other situations, to store in the pose and emotion databases, for later comparisons, for recognition purpose. In one embodiment, the system uses e.g. thousands or millions of real images beforehand, to get the parameters for the 3D models and the 3D sub-models fixed, or trained by learning machine, for different templates for different classes of heads or faces, e.g. 30-300 classes and 10-30 sub-classes of templates, e.g. using tagged supervised learning, or human expert interactive learning, or voting scheme with multiple human users, or the like. In one embodiment, the system uses the same training samples multiple times, for training.
Information Layers:
In one embodiment, the system tags people (or objects) in images or videos, by one or more extra layers, for their names and other information, e.g. address and tel. numbers, for each layer, superimposed on the coordinate of the photo or image or video frame, with the layers stored with image, or separately, or remotely, or in our server farm, or in cloud, or in the social network site, or as attachments, or as a header, or as part of the content of the file, or as a parallel track, or as a separate track, or as a synchronized track, as one option being visible, or invisible, or sometimes visible, or partially visible, to the user's view or friends' view, based on settings by the user or the friends, e.g. chosen by the menus or buttons on screen or voice commands, for the display to the user or friends or public or group or social network or followers or fans or groupie or supporters or party or classmates or students or the like, on their mobile device, smart phone, PDA, pad, tablet, camera, watch, TV, monitor, display, or the like.
Relationship Distance:
In one embodiment, the system shows or indicates, by text or pictorially or indicators or graphically or sound or color or size or objects or symbols or letters or order or ranking or shapes or music notes or patterns or the like, the relationships between people, e.g. the relationship distance, as how far they are from each other, or haw many steps or people-in-between apart, as a metrics, e.g. sister-in-law, or 2nd cousin, or friend-of-friend, or friend-of-cousin-of-sister-in-law, or boss's-son, or best-friend's-son, which is optionally represented by a fuzzy parameter or a crisp number or value or tag or adjective, e.g. “far” or “close” or “2 people apart” or “D=3.6 ‘people-distance’ between them” or “2 people in between them”, e.g. with a real number representing the strength of relationships between people, in a scale or axis, or normalized to one or 100 percent, or expressed as an inverse of a parameter or value.
Music Recognizer:
In one embodiment, the system recognizes the song or lyrics (or music or ring tone or “beeping” sound or rhythm or “beating” sound or notes or music pieces or humming sound or whistling sound or sound of tapping on the table or sound made by mouth or sound made by or on any object or music instrument or body parts, e.g. clapping hands), to find the musician or song or music album, to direct the user to the e-store or regular store or web site, e.g. for participating stores or merchants, e.g. for service or sale or rent, e.g. to facilitate the commerce or sale or transaction, e.g. with a percentage of the deal, or for click fee referral, or for coupon for the store or product, e.g. for download, or CD, or listening, e.g. for ringtone, or any tone for functions on keyboard or computer or telephone or mobile device. In one embodiment, the system lets the user send recommendation to friends (in social network or group or club or email list or class), for the music, or forward the music directly.
Image Matching:
In one embodiment, the system recognizes or matches faces or photos (or objects or pets or places or events or emotions or actions in a movie) very fast, using e.g. basis functions, or Haar wavelets or functions. In one embodiment, the system breaks down each image into multiple blocks, e.g. 5×5 pieces, or 5 sections on each dimension, or 25 blocks total. In one embodiment, the system finds the correlations for match with the database of known images, which are already analyzed and indexed. In one embodiment, the system uses N parameters, e.g. 4-20 parameters, calculated or extracted for each block, or middle blocks, or outer edge blocks, or corner blocks, or all blocks together, for matching or comparisons, for object or picture or face or people matching or recognition, e.g. against one or more thresholds.
In one embodiment, if one (or M) of the thresholds is passed with a large margin of approval (high certainty factor), then other thresholds or comparisons for other parameters are relaxed, in terms of acceptance criteria. That is, the system forgives them, as being a bit lower than the corresponding threshold. That is, the system counts the image as accepted or approved, as matched with the other picture in the database or library.
In one embodiment, if one (or P) of the blocks is passed with a large margin of approval (high certainty factor), then other blocks or comparisons for other blocks are relaxed, in terms of acceptance criteria, for the whole photo.
In one embodiment, if one (or P) of the blocks, with M thresholds combination, is passed with a large margin of approval (high certainty factor), then other blocks or parameters or comparisons for other blocks or parameters are relaxed, in terms of acceptance criteria, for the whole photo. (Please note that M, N, and P are positive integers for this example, here.)
In one embodiment, the system determines object shapes, histograms (e.g. for color, intensity, grey scale, or the like), range of parameters (e.g. for color, intensity, grey scale, or the like), or ratios of parameters, average of pixel values, total of pixel values, median of pixel values, rate of change of pixel values (e.g. intensity change of 20 points per pixel length in x-direction or horizontal direction), rate of change of rate-of-change of pixel values (2nd order difference or delta, or “acceleration” value), maximum value, minimum value for pixels, contrasts, patterns, standard deviation, variance, shape of distribution of the pixel values, location of distribution of the pixel values in the block, shape of the distribution for pixel values in the block with respect to the Normal or Gaussian distribution, for each block, for the image or photo or video frame or painting or cartoon or movie or the like, to get the values as parameters, for the comparison and matching, e.g. photo matching.
In one embodiment, the system evaluates the totality of all N parameters for matching photos or images or faces, or compares them using weights for more emphasis on some parameters, or adds all the scores for comparisons together for all parameters, or do a weighted average or score or vote for N parameters (e.g. N comparisons), e.g. against or versus one or more thresholds, e.g. N threshold values, or do a fuzzy comparison with no hard boundary or thresholding for any parameter, using fuzzy sets, fuzzy rules engine, or membership functions, for each or all parameter(s) or comparison(s).
In one embodiment, the system normalizes the values for parameters for comparisons. In one embodiment, the system compares in parallel. In one embodiment, the system compares in series for parameters. In one embodiment, the system processes in batch file, for speed or efficiency. In one embodiment, the system asks the user for help or comment or feedback or input or approval for recognition. In one embodiment, the user loads the images by uploading the file on web site, or email as attachment or content, or clicking on the file, or right-clicking on the image, or drag-and-dropping the file, or choosing the file by any other method. In one embodiment, the user opens an account for her pet on the pet social network for her pet's photos, for exchange with her friends and comments, or for pet store, or for pet adoption, or for finding a similar looking pet in the database, or for finding a lost pet (among pictures of the found pets).
SVM (Support Vector Machines):
In one embodiment, the system uses a continuum of points, represented by the density of points, or color coded based on the density of points, for classification purposes. In one embodiment, the system uses a continuum model, instead of discrete points, for classification. In one embodiment, the system converts back to the discrete points, after the boundary lines are drawn or found, and the classification is finalized, to find where the clusters are with respect to the individual points. In one embodiment, the system uses this method for fast classification of a large number of points. In one embodiment, the system uses an iterative process for classification. In one embodiment, the system uses this method e.g. for Big Data analysis or a large amount of images.
Landmark (or Feature) Recognizer:
In one embodiment, for famous landmark recognizer, the system uses GPS data and travel guides, plus encyclopedia for geographical facts, to correlate data, and filter the images taken by individuals and posted on the web site, as photo album or video library, for clustering purpose and recognition tasks, e.g. geo-clustering, to validate landmarks' identifications. In one embodiment, for landmark recognizer, the system uses the unsupervised learning. In one embodiment, the system uses matching based on local features. In one embodiment, the system finds interesting points or features, e.g. using Laplacian-of-Gaussian filters. In one embodiment, the system then finds local descriptors, e.g. using multi-dimensional Gabor Wavelets, for texture features on local regions, e.g. using 50-200 dimensions. In one embodiment, the system then reduces the dimensionality of the features, e.g. by 50 percent, e.g. using Principle Component Analysis (PCA) technique, to simplify the problem by reducing dimensionality and calculations. In one embodiment, the system then compares the shapes geometrically, from the extracted interesting points or features above, to find the match against the library. In one embodiment, in this stage, the system uses e.g. affine transformations for geometrical matching for shapes. From here, in one embodiment, the system gets matching scores, which indicate the result of comparisons with the library of images or landmarks.
In one embodiment, furthermore, binomial distribution for the probability model or Bayes technique can be used for the object matching. In one embodiment, the system uses matching edges and overlap edges for various regions, as the metrics for comparisons. In one embodiment, the system uses graph clustering, for grouping together similar images. In one embodiment, the system uses tree method for matching. In one embodiment, the system uses parallel processing for computation efficiency.
Search Scope Based on linked Groups/Entities/Individuals:
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 219</figref>, the focus of search starts with the data related to User A, such as features, metadata and annotation extracted from the user's data, e.g., albums and metadata. In one embodiment, the search is expanded to the databases associated with links to user A, e.g., based on social network settings, such as user A's friends, family, or colleagues' DBs. In one embodiment, the search is extended to the database of famous people or things (e.g., buildings, paintings, sites, logos) and general (e.g., generic) concepts (e.g., car, boat, road, river, water, liquid, glass). The search in general concepts may be extended further by semantic web. In one embodiment, the search is expanded to a business/company database. In one embodiment the search is expanded to a global or a regional search, based on features being searched. In one embodiment, the search services are based on subscription and fee.
GUI for Detected Features and Annotations:
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 220</figref>, a graphical user interface uses a surrounding border or fill (e.g., rectangular or rounded) to indicate that features on the image (e.g., faces) are detected. In one embodiment, one or more classes of annotation (e.g., names) are displayed next to the feature, based on the user preferences (e.g., on mouse over, display charactetistics for font. size, format and location). In one embodiment, various color codes or continuum are used to indicate the reliability of the annotation, e.g., based on Z-web data. in one embodiment, fuzzy or coarse terms are used to indicate the values, e.g., the reliability. In one embodiment, the border or fill visual feedback is used to indicate the type of relationship between the objects in the image (e.g., to a particular object for example in the same or other images, or to a particular entity such as the user), such as friend, family, or colleague. In one embodiment, indicators are placed on the image to indicate more metadata or features may be displayed or links to other data (e.g., related to the object or entity indicated). In one embodiment, selecting the object prompts a user interface for entering/updating/correcting data or annotation regarding the object. In one embodiment, a preconfigured list of items is presented to the user based on the class of object detected, to enter or confirm or reject annotations related to the items (e.g., name and relation). In one embodiment, the annotation uses the contact list to pull information (e.g., name) from contact database.
Feature Detection Based on Context, e.g., Clothing and Fashion:
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 221</figref>, the feature detector is trained to detect clothing items worn on body parts. Such clothes are associated with the people wearing them, based on annotation or recognition (e.g., facial features). In one embodiment, the clothing and attributes (e.g., type and color) are extracted from the images or videos and are associated with the people (e.g., users) or models/brand/publishers (e.g., determined from metadata). A clothing item may be located by other recognition engines, and passed on to a dress/clothing detection engine, for further detail classification (such as hat or eyeglass),
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 222</figref>, various features are detected, e.g., for clothing and dress, and various attributes are determined such as style and color. During a search, search terms are analyzed by a semantic/relation/reasoning engine to expand search terms based on concept-semantic, lexical relationship, cognitive synonyms databases/search engine and other knowledgebase to expand the search terms to determine the category of the search. In one embodiment, the categories of the objects detected (e.g., clothing/dress) or sub-categories (e.g., shirt, gown), are stored and used to limit the search expansion to such categories. In one embodiment, the user or a process may search for “bride” or “red dress” to find a white gown and red tie in images, respectively. In one embodiment, a search may be done by style, color, or a person (e.g., fashion model, brand, or a person, or a combination of matching criteria).
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 223</figref>, a Conceptual-Semantic, Lexical Relationships, Cognitive Synonyms, or Knowledgebase is used to expand the search terms or find applicable categories to search for (e.g., matching) features in images and movies or other metadata, such as occasion/event or related to the footage. In one embodiment, the search results are used to facilitate labeling/autoannotation, as well as indexing. In one embodiment, one or more terms used in finding the results are displayed to the user.
In one embodiment, an image or movie (or a portion thereof) is used as a search term. In one embodiment, the features of the image/movie are determined and used to search for similar data/image containing same/similar attributes. In one embodiment, the features are presented to the user to indicate which feature is must be the focus of the search and be prioritized. In one embodiment, the search terms based on an image/movie is augmented/edited by the user to specify other filters (e.g., by specifying other attributes, logical constructs AND, OR, NOT, and other features from other images)
Correlation to Descriptive Features/Labels:
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 224</figref>, 3D objects in images or movies are detected based on models of parts and sub-parts. The features from the feature detector are correlated (e.g., by using a restricted Boltzmann machine, RBM) with descriptive labels and attributes, via a correlation layers (e.g., made up of stochastic sigmoid units with unidirectional weighted links. In one embodiment, the descriptive labels and features are organized in to body parts and components/subparts, and attributes include the surface properties such as transparency, color and texture. The geometrical model properties are used for surfaces and direction. Some attributes describe the state of relative position of the parts, e.g., a car door being closed or open (or the degree, e.g., based on cosine of the opening angle). Some attributes describe the constraint in arrangement (position, orientation) between the parts. In one embodiment, the attributes are learned via correlation layer through a supervised training. In one embodiment, the 3D model rendering parameters, e.g., perspective, scale, relative eye/camera orientation, applied from an object in the image, are applied to other objects in the image to facilitate their identification, for example, by holding the label units corresponding to perspective and orientation to those attributes when analyzing other objects in the image. In one embodiment, the training of the feature detector is done via rendering from a 3D model as a training set generator, including the rendering for occlusion and hidden surfaces based on the surface normal vector.
In one embodiment, video or sequence of highly correlated images/frames from different perspective are used in learning the 3D model or motion. In one embodiment, an empirical model is built via training with data obtained from sensors/detectors used for tracking the key portions of a physical object (e.g., in 3D tracking). In one embodiment, the 3D coordinates of each point is captured via triangulation with multiple sensors, and organized into a captured sequence of correlated movements. One embodiment uses a sequence of data to train the motion features, e.g., by using a RBM with multiple linked visible and hidden layers associated with various timeframes. In one embodiment, a supervised learning is used to label the learned (unsupervised) motions.
In one embodiment, relative distances of the objects detected in an image or frame are determined based on scale, orientation and perspective. In one embodiment, the changes in relative position of objects detected in sequence of images or frames are determined, by comparing those between images or frames.
In one embodiment, images/frames are built from various frames from the video, e.g., by decoding the video data. In one embodiment, raster lines are combined from sequential frames to make a full image/frame. In one embodiment, the changes in the video frames e.g., motion vectors) are used to determine the potential motion of objects captured in the video. In one embodiment, the scale and motion of objects are used to determine whether the camera was in motion compared to background (e.g., looking outside from a moving train or car).
Individualized Correlators:
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 225(<i>a</i>)</figref>, learning individual correlators are used for individual labels or identities. For example, to recognize whether an image is of a particular person, among several other persons, each person is represented by a label, e.g., with value in [0, 1] to indicate its degree of membership of the image for that label. In one embodiment, each correlator is trained by a supervised learning approach. In one embodiment, additional people may be added to a group of people, and for each added person, an individualized correlator is trained to identify that person among the group, without retraining the other individualized correlators, as the diversity of the features (e.g., facial features) in a small groups (e.g., in a social network links) are generally met. In one embodiment, other correlators in for the group members are spot checked against the images of the added person, and if one or more prior individual correlators return positive indication (e.g., high label value over a threshold), then (e.g., based on rules and a rules engine) the correlators are trained using the larger set including the images of the added person, to adjust for differences in attributes.
In one embodiment, the individualized correlators tend to reduce the dimensionality of the feature space (to few labels), and therefore, they tend to occupy small foot print for efficient storage and transmission of the correlators. In one embodiment, the individualized correlators are used for rapid identification or matching of people or objects in multiple images or video (e.g., related or in the same album or related to the same user). In one embodiment, a reliability factor is used to determine the reliability of the identification. For example, in one embodiment, the weighted input from correlation layer units to a label unit is used as the basis for the reliability of the label (e.g., between [0, 1]). In one embodiment, multiple positive label indication is used to reduce the reliability of identification or any of those labels. In one embodiment, the individualized correlators are used based on the proximity to the albums' owner/user, e.g., based on the social network list of links, e.g., friends, family, colleagues. In one embodiment, the preliminary features or metadata, if available, are used to order the candidate correlators for a given image. In one embodiment, the individualized correlators are defined by their structure (e.g., number of units) the bias on the units and the weights associated between the correlation units and label and feature units, respectively.
In one embodiment, as depicted for example in <figref idref="DRAWINGS">FIG. 225(<i>b</i>)</figref>, the individualized correlators are used to determine group through a consolidation layer. The Group label Gk represents a set (crisp or fuzzy) set of individuals associated with the individualized correlators. In one embodiment, the consolidation layer provides for identification of several groups and sub-groups, given a set of people. In one embodiment, the consolidation layer is trained via a supervised learning approach.
Descriptive Correlators and Reconstruction:
In one embodiment, as depicted for example in <figref idref="DRAWINGS">FIG. 226</figref>. the correlation layer is used to train the descriptive parameters of a model, give a trained feature detector (e.g., trained unsupervised). This allows for more general identification of people or object in a larger population as the feature space of the descriptive parameters is similar to the feature space of the features determined by the feature detector. In one embodiment, the feature detector is fine tuned, e.g., via a deep autoencoder and back propagation, to be able to reconstruct images accurately. In one embodiment, the eyes/camera relationship to the object is modeled by perspective (e.g., infinity points), scale, and orientation (e.g., polar coordinate angles (θ,ϕ)) parameters. In one embodiment, invariant or semi-invariant parameters are more structural and core to the identification of a person or object, while the variant parameters (e.g., mouth open/closed, expressions such as smiling) may radically be different from image to image. In one embodiment, the invariant parameters are determined as those invariant with respect to different poses and expression of the same person or object, while variant parameters (values) tend to be in common for various people and object with the same or similar expressions. The parameters for part and sub-parts are nested in one embodiment, and the relationship between parts and parts and subparts are represented by constraint parameters (e.g., an angle between eyes and the tip of the nose). In one embodiment, the descriptive parameters are used in supervised learning (e.g., using a model renderer) to learn the correlation layer.
In one embodiment, a high level labels/parameters may have fuzzy values or discrete values. In one embodiment, the expressive parameters (e.g., smiling) are represented as modification to state and relationships for parts, with for example, parameters values controlling the degree of the modifications. In one embodiment, various 3D models of face/head/body are used to represent the skeleton or hard foundation features, soil (e.g., muscular) features used for expressive parameters, and skin parameters used for color and texture, as well as, various models for hair, teeth, eye glasses, and hats.
In one embodiment, a data is input to the feature detector and its descriptive parameters are derived from the correlation layer to the label layers. In one embodiment, the descriptive parameters are modified (e.g., by changing the expression from neutral to smiling), and the image is reconstructed (e.g., via a one pass top down reconstruction derived from the con elation layer through the feature detector (e.g., based on RBM)). In one embodiment, various poses and expression of a person detected in an image (based on the features) are generated by varying the descriptive labels and reconstruction (as for example described also our prior patent application).
In one embodiment, the features obtained from images (or frames of a video) at different pose (e.g., orientation) provide different reliability of features. For example, the features of an ear in an image may not be as reliable in frontal view compared to side view (e.g., for certain classes of ears). One embodiment used a combination of features and their reliability factors obtained from different poses provide for more reliable model of a face/head (or other object classes/types). One embodiment updates the feature parameter values as more data arrives. One embodiment uses fuzzy values to describe feature parameters. One embodiment uses a model to apply probability distribution and variance for different parameters projected from different poses. In one embodiment, a 3D rendering is used to estimate the reliability of obtaining feature in a pose by varying the feature parameters and estimating the corresponding partial derivatives (e.g., gradients) of the features obtained from the rendered projection, and estimating the sensitivity of the rendered image in such a pose with respect to the modeled feature parameter.
Video/Mate Analysis, Annotation, and Classification:
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 227</figref>, frames of a video or movie are analyzed by building a frame, e.g., by decoding from I-frame (Intra-coded picture), P-frame (Predicted picture), or B-frame (Bi-predictive picture), or slices. An image analyzer is used to detect features (e.g., people and objects) on the frame, while a motion analyzer uses multiple frames to detect motion of objects in between the frames. For example, in one embodiment, macroblock segments are used to determine the potential movement between the frames. In one embodiment, features from the picture/image/frame/macroblock/slice are used and correlated to determine the correlation and identification of objects across the timeline. In one embodiment, the features from motion are determined. One embodiment, for example, uses encoded motion vectors (e.g., determined based on motion estimation or from other blocks e.g., in direct/skip mode of H.264) are used to determine regions of the frame that potentially corresponds to a moving object. In one embodiment, common features from scene are determined. In one embodiment, the determined features are associated with frames, group of frames, and scene. In one embodiment, the scene detection uses a collection of I-frames to determine major changes in the background or consistency of the image across frames. In one embodiment, a voice/sound. analyzer feeds to a speaker recognition module that associates a tonal signature to a speaker. In one embodiment, a transcription module is used to create metadata (text) from spoken voices and associate the data to the timeline (ranges) or scene labels. In one embodiment, the voice of the speaker/object is matched (e.g., via temporal correlation/occurrence) and/or via motion of the mouth to a particular person or object detected in image. The correlation is used for resolution of the recognition of person/object in images/frames where the faces/bodies are not detected reliably, e.g., by combining the reliability information (e.g., via Bayesian inference and/or Z-web).
In one embodiment, the motion of the mouth movements in frames is used to detect the speaking intervals from the video, and their correlation (e.g., via regression) with the speaking intervals from the audio, e.g., via a comparison module, provides for an out of synch timing between the video and audio portion of a movie. In one embodiment, the multimedia/movie is edited/updated/recoded to fix the out of synch timing by shifting the track timing (for example for audio track) to match that of video track by the amount compensating for the out of synch interval. In one embodiment, the visual key points in video motion corresponding to sound/voice generation are used to correlate the sound/voice with the video. In one embodiment, statistical threshold is used to determine whether the mismatch is attributed to jitter or a consistent bias (e.g., out of synch issue).
In one embodiment, the scene or motion is characterized/classified/categorized based on matching template from knowledgebase or based on supervised training. One embodiment auto-annotates the recognized features/attributes based on frame, location within frame, scene, or whole presentation.
In one embodiment, the users' DBs are used to match features with users, e.g., to specifically identify individuals in the video. In one embodiment, features are extracted from video/audio and associated with the objects/video/frame (e.g., in a database based of features). In one embodiment, the features are used to match objects within various frames/scenes in the video and other videos (e.g., related videos, for example, based on the metadata, category, and user/owner/channel).
In one embodiment, the user is prompted to annotate (e.g., via a GUI or voice annotation) the detected objects/people in video and/or audio. In one embodiment, for example, few frequently occurring detected objects and/or people are used to prompt the user for annotation and propagate the annotation automatically based on a reliability threshold to other objects/features detected, e.g., in the same video/.audio, and other data in or related to the users (e.g., albums).
In one embodiment, a user selects a potion of the frame via a GUI (e.g., click and drag a rectangle/oval around or about a location), and use that as the search query to find similar object/person in the video or other videos. In one embodiment, the selected portion is analyzed by one or more image analyzers to detect features (e.g., classes of objects and/or detailed features for identification). In one embodiment, the corresponding audio track is used to correlate with a speaker, and extend the search on the audio track or transcript or captions (if any). In one embodiment, the search is made based on a voice segment. In one embodiment, the voice segment is used to extract tonal features and speech particularities for speaker recognition or for matching with voice signatures in a database. In one embodiment, the association of the speaker to the visual images/frames are used to find the same or similar speakers in the same video or others, and identify/annotate/localize.
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 228</figref>, based on an identifier or a URL, a movie and its associated data (e.g., metadata, title, description, owner/uploader, channel, comments, likes, and statistics) are extracted from a repository. In one embodiment, the movie and its associated data are analyzed, e.g., by a video/audio analyzer and keyword/concept extraction/analyzer, to provide/generate features/annotation and metadata. In one embodiment, the features/annotations/metadata are used to classify/categorize/index the movie (including association with the URL or movie identifier). In one embodiment, the determined features (e.g., based on images/frames/locations within frames/scenes) are used for classification and indexing. In one embodiment, a semantic web or a concept relationship database are used to expand the annotation and enhance the indexing/search. In one embodiment, a user interface or a service is provided to receive the search/query, based on for example the URL or ID, image, voice, and other filtering metadata, and return candidate movies, location of features (temporal and spatial), annotations, and generated links, e.g., for annotations or recognized entities.
In one embodiment, for example, a product placement or class/type of objects are determined (e.g., a car or beverage) and used for targeted advertisement overlaid on the movie or on the side of movie playback frame, e.g., with links to other movies or ad webpage. In one embodiment, the duration of the advertisement is based on the duration of the presentation of the object on the video, e.g., for a minimum amount of time and/or for the duration/interval of the object display in the movie. In one embodiment, multiple objects are detected in the image or frame/scene, and the targeted ad is presented to the user, based on the user's preferences, characteristics, or previous buying habits or interests.
In one embodiment, the comments/annotation indicator or overlaid ad indicator moves with the object as the object's location is changed within the frame. In one embodiment, the corresponding indicators are placed at the side of the frame as to not interfere with the playback. In one embodiment, upon user's action (e.g., clicking on the indicators), the GUI shows identifies the corresponding object on the image/frame, e.g., with border/fill, tooltip or an annotation marker.
In one embodiment, a comment/annotation indicator moves/tracks with the object. In one embodiment, the comment/annotation indicator enters the scene or displayed if the object appears again or mentioned on the voice track, e.g., by overlaying and inclusion of the GUI for the indicator and detecting the location of the object (e.g., surrounding region/rectangle or center or a key location such as on a recognized part/subpart of the object).
In one embodiment, Kalman filtering is used to predict the location of object in subsequent frames for more efficient detection.
In one embodiment, the voice is input (e.g., via a UI such as a microphone) and used to annotate an image/video/frame(s)/scene or objects/motions/concepts recognized (e.g., selected) within the image/video/frame/scene. In one embodiment, the audio comment/annotation is transcribed by a transcript generator and the transcription is used for annotation.
In one embodiment, a user is provided with a GUI to reply on an annotation/comments for an object (e.g., detected or associated with a frame/scene/image), for example via a bubble/tooltip/comment box.
In one embodiment, the location((e.g., temporal and/or spatial) of an object is used as a reference (e.g., together with the identification or URL of the image/video/audio) for later usage, such as favorites, or for sharing (e.g., via email or posting to a social network). In one embodiment, the tags are made as part of the URL to indicate such reference, e.g., by generating identification codes/hash values for various objects/scenes/frames.
In one embodiment, the snapshot (e.g., a thumbnail) or a short duration of the movie is taken (e.g., upon user's action) and presented to the user to input annotation or comments at a later point.
In one embodiment, the links and GUI are provided (e.g., overlaid on images/frames) to provide one or more actions available to the user related to the object, e.g., based on the context of the scene, class/type/identity of the object. For example, clicking on a person in an image frame brings up a popup menu showing the actions available for the object in the image, such as fixing red eye In one embodiment, the action taken for one frame is also performed on other frames where the object appears and the action is applicable (for example, based on proximity of the other frames to selected frame). In one embodiment, a particular attribute (e.g., red eye or an expression) is searched in video/image by searching the applicable objects and their attributes/features. In one embodiment, the user is presented with search results and the action is taken on the selection of instances made by user. In one embodiment, the features of the object on the database are used to take the action (e.g., by determining the color of the person's eye from other images to fix the red eye issue in a particular image or set of frames).
In one embodiment, for example or an image, the action reconstructs the image or a portion of image face) to change one or more attributes e.g., descriptive labels). For example, in one embodiment, the user queries for a person in an album (e.g., his or her images) where the expression is not neutral or smiling, the mouth is open, or the eyes are shut. In one embodiment, the portions of the face (e.g., eyes, eyebrows, mouth, and chin) are reconstructed according to the descriptive labels. In one embodiment, a morph module is used to control the changes to the face based on model (e.g., 3D model) of the face/head and the features determined from the person (e.g., from other images/videos). In one embodiment, the reconstruction is made via a deep autoencoder or RBM invoked through a correlation layer connected to the label units, for a portion of the image (e.g., face).
In one embodiment, the reconstruction is used to modify clothes or their attributes such as color. In one embodiment, the reconstruction is used to remove items, e.g., eye glasses from the image, by specifying the state and expression for the eye and using the facial features from the database.
In one embodiment, a morph module/application is used to make adjustment to descriptive features/labels after recognizing the model features.
In one embodiment. GUI is provided for user to specify action annotations on the video, e.g., by placing annotation associated with the video track to change playback speed (e.g., slowdown) for a segment of video, zoom in to an object, and track an object. In one embodiment, the action annotations are shared by providing an identifier to the annotation(s) associated a given movie.
Video/Image Analysis and Annotation in Context of Social Network:
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 229</figref>, a user (A) logs in to an online application (e.g., social network), for example, via an annotator application (e.g., a cloud/web or a mobile/desktop application). The user then uses the annotator application to annotate an object in a movie or image (from a repository, e.g., referenced via a link/ID). In one embodiment, the user's annotations and/or auto-annotations are associated to the user/group and stored in a database (as well as other features/objects detected/analyzed). In one embodiment, the annotation from user A is shared with others, e.g., based on groups, friends, or classmates/professor or are made public for to access/view. In one embodiment, the annotations are associated with the user's ID (e.g., from social network site). In one embodiment, the content provider or other commentators pre-allocate notes and comments, e.g., as annotations/comments, associated with the video. In one embodiment, the annotation is filtered based on the annotator's ID or group belonging (e.g., user A's friends). In one embodiment, the annotations are used in educational/instructional settings; for example, a student/audience member comments on the portions or on objects (captured in the movie) of a lecture by a professor/teacher/presenter. In one embodiment, user B accesses the annotations to view along with the viewing the movie or image. In one embodiment, the annotations are provided to user B if user B is part of the group authorized to see/add/edit annotations, e.g., based on the social network settings obtained (e.g., friend's list) or other lists such as class roster (e.g., obtained via a structured listing or group association in an LDAP database). In one embodiment, the history of the annotations is kept in transactional DB, e.g., based on the time/date the annotations were made.
In one embodiment, comments/annotations are viewed or accessible per user or a group of users (e.g., who made the annotations). In one embodiment, one or more users are selected to filter the annotations/comments. In one embodiment, the annotations (including auto-annotations) are organized by users, scenes, objects/people (detected) in the movie/image. In one embodiment, the user indication of “like” is associated with a location (e.g., if clicked) and frame time, range of frames (e.g., if user held the mouse down), scene, or object/people.
In one embodiment, when a user indicates “like” or other annotations on an image/movie, the person recognized on the image/movie automatically gets an indication of the annotation (e.g., with a link to annotation and location in the image/movie/frame/scene) via social network or other available form such as email from contact list (e.g., with the snap shot of movie or photo).
In one embodiment, the UI input such as mouse or touch input changes to a tool (e.g., “like” or question mark or emotion icons) to express action or emotion of the user for quick annotation upon users action (e.g., click or touch), for example, during the movie playback, to associate/perform the expression/action/annotation with association with the object/frame/scene. In one embodiment, a touch/click by the user provides a UI such as the popup menu for user to quickly select the action/emotion to use with respect the object selected (e.g., detected).
In one embodiment, the annotations and/or features are maintained in one or more databases which may be separate from the domain of the social network or the movie repository.
In one embodiment, the annotations may be specified as private (e.g., for the user's own usage) and not accessible to others (e.g., in social network or public), for example, for user's own favorite spots on the movie/scene/image.
In one embodiment, an annotation is used to indicate where the user left off viewing the movie for later playback from on or earlier spot on the movie. In one embodiment, the user is asked to annotate certain objects on the movie, e.g., in order to gather statistics of annotation to indicate whether the user actually viewed the movie/image, e.g., for online course or certification.
In one embodiment, the annotations are used to indicate a portion of movie or snap shot to share with others.
In one embodiment, a summary of a movie is specified by annotations marking the scenes/range of frames to include in the summary. The play back uses the annotation timestamps to jump to the selected segments (e.g., sequentially). In one embodiment, a summary may be annotated by searching based on objects/people/scenes detected based on image/movie analysis.
In one embodiment, the timings of the annotations are automatically adjusted based on the objects/scenes/features to account for a delay in a user's reaction in seeing an object and actually clicking/inputting/touching/acting.
In one embodiment, the annotation/comment on the scene is automatically associated or time stamped, based on the interval of the scene. In one embodiment, the categorical annotations (e.g., interesting) is used for quick annotation with automatic time stamp based on the current location of the playback, so others may jump (e.g., from a list of interesting locations) to the location on the movie.
In one embodiment, more useful comments or more specific to parts of the movie/object/people are made based on object/attribute detection in the image/video/audio and based on more recognizable user identification (e.g., based on the user name or ID from a social network). Higher value comments and annotations provide for higher value metadata for the advertisers for targeted advertising, or statistical analysis with more reliability or traceability. For example, in an embodiment, advertisement specific to portions of the movie or tailored to the user and various objects in the movie are provided to the viewing users. For example, one user may be presented with an advertisement and another user may be presented with another advertisement for the same segment of the movie, depending on various contexts of the segment and the user.
In one embodiment, the annotations are used for training. For example, in one embodiment, the user is prompted to annotate certain objects or segments. In one embodiment, the scenes are classified based on the annotations, metadata, and features detected, and the categorizations and features are used to index the scene for future search/query.
In one embodiment, the user annotations are played back in an audio output, e.g., in a translation scenario or in a short explanatory/commentary related to an object/scene, e.g., based on user preference.
In one embodiment, the annotation tools with GUI such as balloon with tips are used to place annotations over the frame. In one embodiment, the annotation tip/location automatically conforms/tracks to the object(s) on the frame/scene/image. In one embodiment, the voice annotations (e.g., emotional) from multiple users are combined and played back for a user, e.g., to give an impression of viewing the presentation live in a crowd.
In one embodiment, the annotations are used as a voting tool, e.g., to vote on objects/people detected in the image or video. For example, this can be used to vote on people or object appearing in the movie by directly interacting with UI overlaid on the movie frame.
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 230</figref>, images and movies placed in albums or other areas (e.g., timeline feature in Facebook®) are analyzed and annotated (e.g., automatically). In one embodiment, an online application (<b>2510</b>) (e.g., a social network) communicates (<b>2516</b>) with the user's browser or application (e.g., running on a user's device) (<b>2512</b>) and provide information about the user's own (or others) information, e.g., timeline (<b>2514</b>), including associated data such as multimedia or images placed, e.g., on the timeline or albums, by the user or others, including sponsored ads/info for advertisements. In one embodiment, a first process or an application (<b>2518</b>) (e.g., a cloud or web application), e.g., adapted for the social network platform, receives information from on line application (<b>2510</b>) or the user's application (<b>2512</b>), e.g., when the user's application invokes a resource or process or function of the first application, based on a data received from the online application (<b>2510</b>), e.g., a URI, of a resource associated with the first application. In one embodiment, the online application invokes the first application and provides information. In one embodiment, the information is obtained by the first application using the authorization of the user (e.g., a token obtained via a login process) from the online application <b>2510</b>. In one embodiment, such information includes, for example, the user data/ID, movies, and images (e.g., associated with the timeline or albums) and/or respective identifiers or URLs. In one embodiment, the user ID and references (e.g., URL, or ID) associated with the movie or image are sent to a search/indexing engine/application/process (<b>2520</b>), to find features/annotations previously analyzed or obtained from such movie or image. If such information found, they are extracted (<b>2522</b>) from a database or Z-web (<b>2524</b>), e.g., including features, temporal/spatial locations, labels, autoannotations and users' annotations, for example, associated with user/group (e.g., for friends, colleagues, for example, based on social network setting), and processed/organized by a search engine (<b>2520</b>) and passed on (<b>2526</b>) to the user's browser or application (<b>2512</b>), via for example, the first process or application (<b>2518</b>), e.g., after reformatting and coding by the first process or application (<b>2528</b>), so that the information will be rendered and can be acted upon by the user via the user's application (<b>2512</b>). In one embodiment, when such annotation or features are not available in the database (<b>2524</b>), the movie or the image (or a portion thereof) is obtained by the Analytics engine (<b>2520</b>), e.g., via the on-line application (<b>2510</b>), a user's repository, a third party repository (e.g., a movie or image repository), or a search engine, e.g., based on an identifier such as URL or label/title/ID. In one embodiment, the movie or image is analyzed to find feature/locations and perform autoannotations, e.g., based on the user's data or data associated with the user (e.g., albums), or based on classification of other matched people and objects, e.g., based on similar context.
In one embodiment, the user's application includes a plug-in module (<b>2530</b>) which communicates the user ID and references (e.g., URL, or ID) associated with the movie or image are sends such information to a search/indexing engine/application/process (<b>2520</b>), e.g., via a second process or application (<b>2532</b>), such as a web application. Similarly, features, temporal/spatial locations, labels, autoannotations and users' annotations are extracted (<b>2522</b>) from a DB or Z-web (<b>2524</b>) and passed on to the plug-in, e.g., via the second application or process, and rendered in the user's application or browser (<b>2512</b>), e.g., via the plug-in (<b>2530</b>).
In one embodiment, the first and second application and process refer to the same application or process. In one embodiment, the first application/process or the second application/process are incorporated or part of the analytics/search engine. In one embodiment, the user's application or the user's repository may be on a mobile device. In one embodiment, the title/description or other metadata of the movie is used to search for the movie. In one embodiment, a pending analysis message is returned to the plug-in or the user's application, to indicate to the user that an analysis is scheduled and pending for a given image or movie of a part thereof. In one embodiment, the background task is associated with such image or movie to obtain and control the status of the task.
Search in Feature Space via Hierarchical Clustering:
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 231</figref>, the clusters of data in the multi-dimensional (d) (e.g., a highly dimensional) feature space are formed to facilitate fast indexing and search. In such a situation, it may be more efficient to index (e.g., a nested index) based on clusters as opposed to indexing based on highly dimensional features. For example, for a given feature set associated with an image or object in an image, there may not be an exact match found in the database, and similar objects (in feature space) with close feature distance may be searched for. In one embodiment, non-variant (or semi-non-variant) features are used to form feature space and/or clusters in the feature space. In one embodiment, clusters are formed around a feature vector of a data point, e.g., during population of the feature space with the feature vectors. In one embodiment, the clusters are adjusted (added/subtracted), e.g. by using a clustering technique, based on monitoring the population and the density of the data points in clusters for efficient cluster-based. search. Each cluster (including sub-cluster) is associated by its boundary (crisp or fuzzy) within the feature space, e.g., determined by a model (e.g., center and radius, PCA) or combination of the feature space subsets. In one embodiment, feature vector for a given data point X1 is determined, and its membership in various clusters (and levels) are determined. For example, based on the features, X1 is in cluster ID1I, ID4, ID5, ID8, and ID9. In one embodiment, cross tables are used to track the association between clusters and sub-clusters. In one embodiment, clusters overlap to allow more flexibility for classification and search. In one embodiment, e.g., in a sparse feature space and/or when populating the feature space, when a point does not fit into any cluster at a given hierarchy level (e.g., Li, Li+1, and Li+2), a cluster is formed about that point (e.g., with a default extent/radius about the point for a given level and/or based on heuristics from other regions of the feature space), and the level records and cross tables are updated to account for the new cluster(s) and their relationships, in one embodiment, similar data points (e.g., to X1 or any arbitrary point in the feature space) are searched, by first analyzing the clusters the point belongs (which may include multiple path to the point due to the overlapping nature of the clusters). Then, similar data points are determined based on the located clusters. For example, in one embodiment, the data points in the same deep level cluster(s) that the searched point belongs are returned. For example, in one embodiment, based on the feature vector (e.g., for X1), deep clusters ID8 and ID9 are determined by traversing from the higher level clusters (e.g., ID12, ID4, and ID5) and matching/finding the lower level cluster candidates based on cross tables (between the levels). In one embodiment, based on the found clusters, the data points (e.g., X<sub>3</sub>) belonging to those clusters are returned (along with their maximum membership function in the union, if fuzzy clusters). In one embodiment, if the scope of returned data point is expanded by using the overlap between the clusters (e.g., of the same hierarchical level). The overlap between two clusters is determined, e.g., based on their extent in the feature space, or by determining if they share data points. For example, by joining a cross table by itself (e.g., Li+2 to X cross table) and grouping for unique cluster relationships, a cluster overlap result is obtained (e.g., for clusters in Li+2) and stored/updated (e.g., with records indicating the following overlap relationships: I D8-ID9, ID8-ID 10, and ID9-ID10 at and D3-ID4 and ID4-ID5 at Li+1). In one embodiment, based on overlap between the clusters, the (e.g., deep level) searched clusters (e.g., ID8 and ID9) are used to determine other overlapping clusters at the same level. For example, based on ID8 and ID9, cluster ID10 is determined as an overlapping cluster, and the data points associated with ID10 (e.g., X2) are also returned.
In one embodiment, e.g., through supervised learning, the clusters are labeled by higher order labels/features describing the clusters.
In one embodiment, the feature space is dependent on the feature extraction engine (e.g., RBM or deep autoencoder). In one embodiment, a mapping is made to facilitate a search across or between two feature space (e.g., corresponding to two feature extraction engine). For example, one extraction engine may be specialized to recognize detailed features of a face or particular ethnicities, or a particular types of vehicles or trees), while another feature extraction engine may recognize higher level features or different set of features at even a different dimensionality of feature space. In one embodiment, the same data point (e.g., from the same image) is used to determine the mapping. In one embodiment, a second feature space has levels, e.g., Kj, Kj+1, Kj+2. In one embodiment, similar hierarchies, cross tables, and overlap tables are determined between K levels and their corresponding data. points. In one embodiment, the deep levels of both feature spaces (e.g., Li+2 and Kj+2) are used to determine the mapping at deep level, using the data point memberships in the clusters at those levels in the corresponding feature spaces. For example, if X3 belongs to ID<sub>9</sub><sup>F1 </sup>and ID<sub>20</sub><sup>F2</sup>, (where the superscript refers to a particular feature space, and subscript refers to an index/ID of the level in the corresponding feature space), then an overlap between feature spaces clusters are established, e.g., by joining feature spaces' deep level cluster and data point cross tables (es., based on common data points) and grouping based on unique cluster relationships across the feature space. The count of the grouping indicates how correlated the feature spaces may be. The correlation is taken to higher levels by grouping based on the cross tables of higher to lower level clusters (in each feature space). In one embodiment, a data point or an arbitrary point in one feature space is matched with the deep clusters (and/or overlapping clusters) or a higher level cluster(s) of that feature space. Then, the result (i.e., cluster IDs) are used to find corresponding clusters in another feature space and finding similar data points corresponding to those clusters or to determine labels/high level features on the second feature space. This provides for an efficient handoff from one feature detector to another.
The higher count associated with unique grouping (e.g., between deep level clusters of two feature spaces) indicates a higher measure of correlation between the clusters across the feature spaces, while a higher number of groupings indicates lack of specificity between the features of two feature space. These measures are dependent on specific portions of the feature space (e.g., dependent on specific clusters). In one embodiment, these statistical measures are used to decide which second detection engine to use based on the features detected by the first detection engine, e.g., in expert selection.
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 232</figref>. the features of two feature spaces are correlated (based on the common data points), e.g., by learning using an RBM as correlation layer. Then, the feature vector form e.g., from one feature detector) can be used through the feature space correlator to determine a candidate feature vectors(s) in the second feature space.
In one embodiment, the number of clusters (e.g., at deep level) is kept one or two orders of magnitude less than the number of data points. In one embodiment, clustering hierarchy in the feature space allows for efficient global search when the user database (including user's linked databases, such as friends albums) are not available or do not yield result with reliability or otherwise a global search is required.
SVM for Big Data Processing Based on Density Graph:
In one embodiment, the classification learning of data requires a large dataset (e.g., few billions) which may not be handled by conventional SVM (Support Vector Machine) learning approach (e.g., limited to few thousand data points). In one embodiment, the density mapping of data is tracked in a resolution (e.g., non-uniform) corresponding to the number of grids/regions that can be handled by SVM training. The number of data points falling in each region or grid is tracked based on the incoming (e.g., labeled) data points, and a strength measure is associated with each grid or region in the feature space, for a given class, e.g., based on the (e.g., relative) number of the data points contained in the grid or region for a given class. The strength measure for each grid/region and class forms a density graph representing the data point densities for a given class. As the number of data points are increased the density map becomes more and more stable, while the conventional SVM approach for learning quickly hits its limit. The density graphs may be generated based on time slices associated with the data points (if time based). The density graphs may be combined in one embodiment, allowing the aggregation of such data from multiple processing units (e.g., in Cloud computing). In one embodiment, the density aggregation is achieved on a corresponding grid/region from multiple density graphs, by weighted summation of the densities based on the number of points supported by each density graph. In one embodiment, the density graph is updated in batch as the data arrives, e.g., by incrementing the strength associated for grid/region for a class. In one embodiment, if the number of data points associated with a grid or region is below a threshold, then in learning approach the data points are used directly instead of regions/grids. In such as case, for example, each such point is given a strength measure equivalent to a region/grid containing that single data point. In one embodiment, the SVM learning is done based on grids/regions (instead of data points) and the error function per grid/region is weighted based on the associated strength measure. In one embodiment, a representative point associated with grid/region (e.g., center of grid) is used to represent grid/region by a point with corresponding strength measure. SVM learning is then employed based on such points and their strength measures. In one embodiment, a region is split to two or more sub-region each represented by a point, e.g., with strength of the region distributed among those representative points. In one embodiment, the trigger to recalculate the SVM weights, occur after the change in the density strengths exceed a threshold. In one embodiment, large number of data samples may be used in learning via SVM by using SVM against the class density map instead of the individual points themselves. In one embodiment, the density/color graph forms a semi-continuum representation of the data points, as the basis for fast iterative learning from big data via SVM. In addition to classification by SVM, the resulting density graphs for various classes, also help predict the probability of the classification of a data point based on the location of the data point in the graph (i.e., region/grid) and the corresponding strength for a given class.
In one embodiment, for example as shown in <figref idref="DRAWINGS">FIG. 233</figref>, data is processed by multiple processors in parallel (labeled 1 through 5), e.g., in a computing cloud (e.g., with a distributed file system), and the results of processing are aggregated in a aggregation node (A).
In one embodiment, the density graphs are aggregated from distributed processing nodes in the aggregation node. In one embodiment, SVM weights are determined in multiple processing nodes and the aggregated weights are determined in the aggregation node.
Improving General GUI for Email Systems (or File Systems):
In one embodiment, we improve general GUI (graphical user interface or UI) for email systems or file systems or file hierarchy systems, on any computing or communication devices, with a user interface. In one embodiment, we are providing improvements for the performance of email systems in different aspects, e.g. in terms of reliability, efficiency, redundancies, safety, security, and convenience for the users. The system can be on a computer, PDA, tablet computer, phone, smart phone, electronic device, game device, e-book reader, game console, communication device, computing device, PC, server, terminal, kiosk, video game, entertainment device, music box, music player, multimedia device, movie player, calendar device, watch, clock, or the like.
The embodiment mentioned here can be applied to (and includes) SMS (Short Message Service), MMS (Multimedia Messaging Service), XMS (Extended Messaging Service), texting, voice message, multimedia message, video message, combination message, live messaging, instant message, chat session, blog, social media forum, voting forum, discussion forum, consumer forum, or the like, in which a message or information or data is transmitted or sent or pushed or pulled or downloaded or uploaded from or between point A and point B or 2 or more people or computer units or terminals, automatically (e.g. by a computer, microprocessor, or processor), based on a trigger or event, semi-automatically, or manually, e.g. by a user or a third party, acting on it, e.g. by pushing a button or choosing a menu item on the screen or display or monitor. Thus, this embodiment is for any form of communications, which is a superset of email systems.
In one embodiment, the system relates to dragging and dropping emails into different folders. In one embodiment, when a user wants to store an email into a specific folder (e.g. after reading an email), for storage for future reference, the user may make a mistake and put (or drag-and-drop) that email in to a wrong place or folder. To avoid such a mistake (or reduce the possibility of such problems, or increase the speed and efficiency of the user), the email system let the user choose or highlight a specific target folder beforehand (e.g. by clicking on the folder using the right button of the mouse, to choose or highlight the folder). Then, as long as the user has not reversed his highlight feature for a specific folder, the folder is activated (as described below).
In one embodiment, for a highlighted folder, the vicinity and neighboring area around the folder is designated as the folder itself in terms of screen or display coordinates or position. That is, the area corresponding to the folder increases drastically, to cover the neighboring folders, by one or more folder spaces (folder or icon size, on screen or display or monitor), e.g. 2 folder-size on each side of the folder (e.g. in up and down directions), such that the neighboring folders cannot be selected anymore, and anything (any file) going near the highlighted folder will be attracted and dropped into the highlighted folder (or “Magnetic” folder) automatically (like a magnet pulling in the object, within its vicinity). This way, the user cannot make a mistake and put the file or email into a wrong folder or neighboring folder by mistake (i.e. effectively disabling the other neighboring folders, temporarily, for the sake of speed and accuracy). The speed of the process of drag-and-drop increases, as well, increasing the efficiency of the user.
In one embodiment, as an example, the user selects a folder by right clicking on it, and choose the option “Magnetic folder”, to highlight the selected folder, which increases the size of the icon representing the selected folder from a rectangle with (G×H) pixels, dimensions in 2 orthogonal axes, e.g. to ((3G)×(3H)) pixel dimensions, or to ((5.6G+20)×(3.9H+50)) pixel dimensions, to scale the icon larger, for ease of use, for the user to see. However, the actual “magnetic” region (for the actual effective area, to attract the emails or files in that region) does not have to be the same as the visual icon's size (for the enlarged icon). In one embodiment, it is larger. In one embodiment, it is smaller. In one embodiment, it is the same size and region.
However, in one embodiment, to make it easier for the user, for one of the examples above, of the enlarged icon by a factor of 3, i.e., ((3G)×(3H)) pixel dimensions, e.g. centered at the original icon's position or coordinate, the system disables e.g. the neighboring 5 folders on either side (e.g. up and down, on screen), and also assigns a region of ((5G)×(5H)) pixel dimensions as the “magnetic” region (as defined above), around the point centered at the original icon's position or coordinate. Thus, for any file or email coming into that “magnetic” region, e.g. as dragged or selected by the user, the file or email automatically goes into the highlighted (selected) enlarged folder, making the mistakes by the user minimal (or none at all), for the email or file placements or arrangements.
In one embodiment, the user is now finished with the process, and thus, the user right-clicks on the “magnetic” or selected folder, to undo the property, or to unselect the folder, to get that back to a normal folder. In that case, both the icon apparent size for display and the real region of clickability go back to their respective original sizes, i.e. the sizes before any of the operations mentioned above.
In one embodiment, the user uses any method of selection, e.g. mouse, hovering, clicking, pen, stylus, pad, roller, tablet, finger on touch-sensitive screen, finger near display, finger pose (as detected by a camera on device and analyzed, as the meaning of the pose by the user's finger(s) or hand), or the like.
In one embodiment, this process can be done for multiple folders in the email hierarchy (or folder tree, pyramid, or hierarchy), which correspond to the folders that the specific user uses most often in a given session. In one embodiment, this can be suggested by the email system itself. That is, based on the prior usage of user A, or history or histogram, on the frequency of usage of different folders, the email system automatically identifies (and waits for the approval of the user), or optionally, even highlights or chooses the corresponding folders for the user (e.g. highlights the top 5 folders, or top 10 percent folders, in terms of frequency of usage or drag-and-drop function on the folder).
In one embodiment, the Magnetic folder is activated or deactivated using a key combination or sequence on keyboard (predetermined, default, pre-set, or customized by the user). In one embodiment, the Magnetic folder is deactivated, if the mouse stays on the folder's icon with no activity, for example, for more than 3 seconds. In one embodiment, the Magnetic folder's icon size gets enlarged by a factor of, for example, 3, to highlight the selection, and making it easier for the user. In one embodiment, the Magnetic folder gets activated automatically for a folder, when that folder is used, for example, 3 times in a row, or 10 times in the last 10 minutes. In one embodiment, the Magnetic folder is acting as an attraction pole or focal point, pulling the folders in, from the vicinity, to snap in the tight folder, hence, the name, the “Magnetic” folder.
In one embodiment, the training on the system to learn the patterns is done using e.g. a neural network system, e.g. to analyze the emails or contents, e.g. to classify, to properly place the file or email or image in a correct folder or super-folder, even if the user makes a mistake for placement, with an optional feature, e.g. for warning or emailing or messaging to the user, if that happens.
Please note that all or some of the features and embodiments above can also be combined in the same email (or texting or telephone or communication or computer or tablet or smart phone or file) system. Please note that all the teachings in this embodiment are also applied to SMS, texting, emails, or telephone messages, and the system can notify the user through all or any communication methods, e.g. calling, emailing, texting, vibration on device, flashing light on device, special note or music or tone or ringtone on device, heating a resistive coil in device (for heat sensitivity, detected by the user), paging the person, or beeping the person, e.g. using a phone set, PDA, computer, laptop, IPAD, tablet computer, smart phone, GPS, wireless device, pager, walkie-talkie, two-way radios, one-way radios, intercom, broadcasting device. Internet, voice-over-IP, computer network, fiber optic, optical communication device, or other similar devices, or using the combinations of the above.
General Notes:
For all the systems taught here, one can use a microprocessor, processor, computer, computing device, controller, CPU, central processing module, processing unit, or controlling unit, to calculate, analyze, convert, and process the data, and it can store the information on a disk, hard drive, memory unit, storage unit, ROM, RAM, optical disc, magnetic unit, memory module, database, flash drive, removable drive, server, PC, RAID, tape, or the like. The information can be processed serially or in parallel. The communication between different units, devices, or modules are done by wire, cable, fiber optics, wirelessly, WIFI, BLUETOOTH, through network. Internet, copper interconnect, antenna, satellite dish, or the like.
In general, for all teachings of this disclosure, including the above sections, the changes or rules or commands or corrections can be in crisp values, e.g. 10 percent change or threshold or difference, or in one other embodiment, in Fuzzy domain, e.g. Fuzzy rules, commands, and corrections, e.g. large difference or large change, or can be expressed in combination of both Fuzzy and crisp rules and parameters. The Fuzzy rules and sets and their treatments are explained elsewhere in this disclosure or incorporated by reference in our prior application(s).
In general, whatever we teach here for face can be applied to other objects and components or parts, as well, and vice versa. In general, whatever we teach here for image can also be applied to video, frames, movie, and the like, and vice versa.
Note that throughout this disclosure, “we” or “it” means “our system” or “our controller” or “processor” or “CPU” or “our computer” or “our system of invention or embodiment” or “one of our embodiments” or “our method of invention” or “system of invention” or “microprocessor” or “processing unit of our system” or “our device” or “server” or “our teaching based on our method or system or device”, which is (or related to) a machine or device or hardware, and not referring to a human at all. We also (sometimes) use the words “we” or “our” as our teaching entity or “teacher” for our disclosure, which again means that we are talking about “our system” or “details of our system” or “our method” or “details of our method” or “how it works, based on components of our system or steps of our method” (and not referring to a human at all).
In this disclosure, video also refers to Video/Audio including other tracks such as captions and transcripts.
Some Examples/Embodiments:
First example: A system for tagging images or videos, said system comprising:
an image analyzer for finding features in an image or video;
a feature extractor for extracting features in said image or video;
a correlation module for relating different parameters from various databases or albums or repositories with respect to said extracted features;
a processor module for identifying said image or video or one or more objects in said image or video;
a tagging module for tagging on said image or video or said one or more objects in said image or video;
a commenting module for commenting on said image or video or said one or more objects in said image or video;
a demarcating module for marking on said image or video or said one or more objects in said image or video;
a notification module for notifying one or more people identified in said image or video;
an email module for sending said image or video, or its tags, comments, flags, or markers, or the links to such information, to said one or more people identified in said image or video;
a bldg forum for people to interact on images or videos;
a web site for people to load image or video albums;
said web site displays information about said image or video, along with its tags, comments, flags, or markers, or the links to such information;
said system lets the people look at each other's image or video, along with its tags, comments, flags, or markers, or the links to such information, to interact with each other;
using said markers, a third party can review and comment on other people's interesting videos or images, as a social network place.
Other examples: <ul id="ul0090" list-style="none"><li id="ul0090-0001" num="0000"><ul id="ul0091" list-style="none"><li id="ul0091-0001" num="2733">A system for searching images or videos, starting from an image, sound, text, video, or description.</li><li id="ul0091-0002" num="2734">A system for searching images or videos, as a reverse-dictionary for images or videos.</li><li id="ul0091-0003" num="2735">A system for searching images or videos, as a dictionary for images or videos.</li><li id="ul0091-0004" num="2736">Search engine for images or videos.</li><li id="ul0091-0005" num="2737">Search, based on hierarchical overlapping clusters in feature space, for global search.</li><li id="ul0091-0006" num="2738">A system for annotating video, which can be shared with his social network.</li><li id="ul0091-0007" num="2739">Using similar annotations, to annotate a target image or video, e.g. from other people's library or album.</li><li id="ul0091-0008" num="2740">A method of finding relationships between people or objects or concepts or animals in an image or video.</li><li id="ul0091-0009" num="2741">A system for matching target image or video with other videos or images.</li><li id="ul0091-0010" num="2742">A user interface or GUI, e.g. for automatic link, accessing a photo web, jumping to photo web, automatic search, and filtering; topics, with crisp or fuzzy relationships.</li><li id="ul0091-0011" num="2743">A method of analysis and annotation beforehand, e.g. using ID or URL, so that later on, a plug-in recognizes and queries, to get information based on URL or ID, to render the information into the application, on image or video.</li><li id="ul0091-0012" num="2744">A method of connecting people together in a social network, using images and video.</li><li id="ul0091-0013" num="2745">A method of obtaining image of an object, from many more images initially extracted, which are just related to the object.</li><li id="ul0091-0014" num="2746">A system for semantic web analysis, to expand search terms, for more comprehensive search.</li></ul></li></ul>
Video and Image Annotations:
In one embodiment, we have logical operations for images, objects in images, or annotations in the images. For example, we have “object A IN FRONT OF object B”, “object A AND object B”, “person A in image”, “person A NEAR person B in photo”, “A, but not B”, or the like. In one embodiment, we have the relationships based on the users' annotations. In one embodiment, we have the relationships based on the system analyzing the objects and images and annotations. In one embodiment, the system lets the user search the relationships, images, objects, video and photo albums, or annotations, which includes tags, flags, LIKE, DISLIKE, comments, voice, text, music, notes, symbols, signs, patterns, codes, executables, pictures, videos, photos, albums, images, links, hierarchical structure (comments on comments), listing, numbers, files, folders, directory, or the like. In one embodiment, the system lets the user search, order, rank, list, and display the items.
In one embodiment, the system lets the user specify the location or frame number or frame time or range of time or starting time, for the annotations or attachments or insertions, e.g. in the video or movies or multimedia or voice or music track(s), to get incorporated or displayed or inserted or reviewed or searched or indexed or stored.
In one embodiment, the system searches in video or images for objects, people, sequences, actions (such as running or laughing), frames, pieces, patterns, features, or emotions (e.g. angry, or nervousness, as an indication for not being truthful, e.g. as a lie detector). The system can then auto-annotate, based on its findings and determinations, in addition to the user's annotations, for a complete set of annotations, or comparison of the annotations by user versus those of the system.
In one embodiment, the system sends an instant message (IM) or text or email, with all annotations attached, e.g. as a self-contained file structure. In one embodiment, the system uses XML (Extensible Markup Language, or the like) for tagging the images or videos. In one embodiment, the system uses plug-ins for mobile applications or devices, in addition to browser software.
In one embodiment, the user e.g. clicks on a button, e.g. on the menu or on the video, to specify the starting and stopping time ranges or frames or spots, e.g. for the piece of video or voice or music or multimedia, to specify where to annotate or insert the annotations or plug-in or attach a file or link to a site or link to a hyperlink (or the like). In one embodiment, the user e.g. clicks on a button or on screen, e.g. to halt or pause the movie and put comment in the meantime, and then restart the movie again. In one embodiment, when the user restarts the movie, the movie starts from e.g. 2 seconds before (as a rewind), so that the user does not miss any part of the movie. In one embodiment, when the user puts the annotations, using e.g. a single button or click or gesture or command, it is done in real-time, without pausing the video or movie.
In one embodiment, to show the number or concentration of comments or annotations to the user, the system shows or uses curves, counters (e.g. on screen or video or on the side bar), numbers on screen, color coded on axis, with separate colors for LIKE, DISLIKE, DISAPPROVE, APPROVE, NEUTRAL, NOCOMMENT, or the like, with color intensity e.g. reflecting the density of number of comments or importance of comments or most popular comments, e.g. for dark green, light green, dark blue, or light blue, with the time line for annotations parallel to the video track time line (marked), e.g. with the user be able to zoom-in on time line or axis, and e.g. showing a typical thumbnail picture from a video frame or a feature of the frame, as a typical frame or video, or e.g. showing a comment or start of a comment or summary of comment or name of the commentators or picture of the commentators, e.g. as a teaser, e.g. to attract more interactions and to solicit more comments e.g. from other users or friend of the original user or friend of who loaded the video or picture or image on our site or third party's site or album) or general public or guests or close friends only.
In one embodiment, to show the number or concentration of comments or annotations to the user, the system shows or uses density of color or grayscale value for indication of concentration of comments for an axis of time for video, e.g. using dark blue or darker blue. In one embodiment, the system shows the concentration or density by dots on screen, near axis, at the time corresponding to the video frame. In one embodiment, the user can click and jump to the next comment on time axis, or next comment at the same time moment, using various menu options. The comment time axis is parallel or the same as the video frame time axis. In one embodiment, the comment time axis unit is a “second” or a fraction of second. In one embodiment, the comments are stacked on top of each other, or listed on a scroll bar fashion, in the order of time or reverse order of time. In one embodiment, the comment has an upper limit for durations, for time, or for storage limit. In one embodiment, the comment or frame icon, on screen, near the time axis, is enlarged as we move the mouse or selector across the time axis or comment scroll bar, vertically or horizontally, to show more details for the user, for fast review.
In one embodiment, to show the number or concentration of comments or annotations to the user, the system shows counter on the bottom, or superimposed on the video for small screen, e.g. for mobile devices, such as phones. In one embodiment, to make comments, no sign up is needed. In one embodiment, to make comments, sign up is mandatory, e.g. through FACEBOOK or other social media sites.
In one embodiment, the users regulate the quality of comments, as the comments that are offensive are reported, or the bad ones get bad score or rating, and push down in the list, for low chance of further review by others or users. In one embodiment, the voting or score is used for self-regulation by users, e.g. for reliable commentators, e.g. based on history. In one embodiment, as an example, the system sorts inversely, based on duration of comments, which indicates that the shorter comments are generally more specific, on topics, and so, should have higher ranking and should come up on the list, to the top (if everything else being equal). In one embodiment, as an example, the reverse is applied, as the longer comments are more descriptive and informative, based on the environment and context (depending on the situation).
In one embodiment, as an example, the system sorts inversely, based on spatial size of the boxed region in the image, as the smaller size of the boxed region generally indicates more specific object(s), or topic, and so, it should be more relevant and focused, and it should come up to the top of the list, with a higher score or ranking. In one embodiment, as an example, the reverse is applied, as the larger regions are more inclusive with more related objects, based on the environment and context (depending on the situation), and thus, it should be higher ranking in the list.
In one embodiment, the system applies cross album reference, or within one album, for pictures or videos or both, for one or more people, e.g. using annotations, e.g. using voice comments or annotations, e.g. between friends or community or group only, or between one's album only, or among all users or public.
In one embodiment, the user tells story or dialog between images, e.g. with marker or highlighter or clicks or mouse movements, e.g. to select a region or image or frame, e.g. as a storyteller, who can select, can combine, can link, can reference, can annotate, can relate, can sequence, or can summarize a series of e.g. images or objects, for a particular story or dialog, to be stored as a sequence or series of actions or objects or links or annotations or images or videos or voices or music or text or the like, for sharing, review, distribution, broadcast, sending, transmission, or the like, for the user, friends, family, group, party, class, public, guests, trusted entities, officials, government, or limited list, depending on the privacy or distribution or sharing settings, by the user.
In one embodiment, the user uses automatic sharing, which jumps to the link or place in the video or image or album, which is of interest, e.g. marked by others or user herself, beforehand. This can be used e.g. for class discussion, college project, or group project or homework, e.g. between co-workers or classmates or professor or instructor or boss. In one embodiment, the system has templates for various types of videos. For example, for the instructional videos for courses, the comments are called Questions, Answers, and Comments. For scary movies, the comments are called. Scary, Very Scary, and Comments. For funny movies, the comments are called Funny, Very Funny, and Comments. These can be flags or buttons, to be selected by the user, without any typing, to speed up the tagging process, during the playback of the video or movie.
In one embodiment, the user has the options in the menu or display or interface, for entry of comments and playback the comments, along with the video playing, or without the video. In one embodiment, the comments are searchable, along with the tags or flags, in voice, sound, text, images, or objects in the images, and can be indexed and stored beforehand. In one embodiment, the user has the option to share or send or link the comments or tags with public, friends, friends of friends, or customized individually. In one embodiment, the user has links to comments, to different time flags, on time axis, e.g. to link user's comments with her friends, or to accumulate them, or to jump between them, or to summarize the text or voice, or to use them as an anchor point(s) to start with, or to use flags as starting and ending points or frames, or to point to other similar or related video or content or comment or frames or points on axis, or to gather all similar or related videos or content or comment or frames or objects in videos.
In one embodiment, the user uses hierarchical comments, e.g. comments on comments, or chain, or sequence, or based on, or nested, or pyramid-type, or tree-type. In one embodiment, the user uses speaking balloon shapes on screen for comments (or other icons for voice, music, figure, text, video, or link, for display on screen of monitor or device). In one embodiment, the system tracks the speaker or person in video in different frames, with speaking balloon shapes on screen for comments, tagging along on the screen with the person or speaker. In one embodiment, the user has the option to stop the video, superimpose the comment on video, show the comment on the bottom, or track the object in video.
In one embodiment, the system is used for comments as e.g. to take a vote or use question or multiple answers or survey or plot, and e.g. notify or email the interested parties and subscribers or followers the statistics or results, e.g. with triggering the notifications happening above a threshold or number, e.g. how many people commented on a specific part of the video, or on the part of the video that the original user annotated, first, e.g. to see the reaction or comments of the user's friends or public, in general.
In one embodiment, the system is used for display, e.g. for multiple tracks for play back annotations as overlaid on video, or as preview snapshot with annotation over it, or as a window on the side, or annotation on still image or frame of video.
In one embodiment, the system is used for voice recognition and voice relationship in our video album or voice annotation, e.g. from video data used for our Z-web, for relationships between different people and objects, e.g. using recognition and transcription to text, e.g. to find the people's taste or preferences, e.g. for marketing. In one embodiment, the system is used to search transcription from voice. In one embodiment, the system is used to have voice recorded from text templates that people read and record beforehand (or for any message or interactive session). In one embodiment, the system is used e.g. to get the user's voice or voice signature or voice commands or typical messages for his friends.
In one embodiment, the system is used for the mobile device or phone to take a picture or video, by the user, and then the picture is analyzed fast by our software in the phone or laptop, to find all the faces, and mark them by box or rectangle (around the face) (box them). Then, the user can click on faces and can comment or tag them by voice and other data. Then, the comment and. content goes to our repository for further analysis, and a copy goes to the user's social site or album site. In one embodiment, the user can also add a voice message and email that to a friend, using e.g. the screen menu choices. In one embodiment, when the phone is charging at night, the system does the calculations on the user's phone e.g. for the recognition and analysis, during idle times. In one embodiment, the user backs up the annotations in our repository, for sate keeping or storage, from his phone or mobile device or tablet.
In one embodiment, the system is used for mobile phone to take picture and video, and then tagged or commented or annotated by the user, e.g. using voice annotations, e.g. “The picture of me and dad, in Paris, 2006 Summer vacation, having fun”. The annotation can be transcribed to text, and stored as text, as well. The figures can be searched (by voice recognition or text-basis), later on, from albums, e.g. using questions or hints, e.g. the following (to find the picture(s)): <ul id="ul0092" list-style="none"><li id="ul0092-0001" num="0000"><ul id="ul0093" list-style="none"><li id="ul0093-0001" num="2767">“picture of me and my dad”</li><li id="ul0093-0002" num="2768">“Paris vacation”</li><li id="ul0093-0003" num="2769">“2006 vacation”</li><li id="ul0093-0004" num="2770">“fun vacations”</li><li id="ul0093-0005" num="2771">“Paris photos”</li><li id="ul0093-0006" num="2772">“travels”</li><li id="ul0093-0007" num="2773">“overseas photos?”</li></ul></li></ul>
In one embodiment, the system provides templates for comments or provides links, for ease of user, or provides symbols or icons or tags, such as happy face or smiling face, for the user to click or drag-and-drop, to choose, e.g. from a menu, to include in the text or comments. In one embodiment, the system provides links or suggests links, e.g. as auto-link. In one embodiment, the user or her friends provide links or tags. In one embodiment, the system works using voice commands, in addition to text commands. In one embodiment, this is used for scientific collaborations, course review, classroom, co-workers, security, entertainment, fun activity, movie industry, and the like.
Privacy:
In one embodiment, the user uses different classes or categories for privacy or sharing or display or emailing or producing or the like (e.g. for permission domain, for access, or for filtering view), e.g. for “myself”, close friends, friends, casual friends, friend of friends, family, far relatives, public, one-time-visitors, guests, limited list, exceptions, or the like. In one embodiment, the user uses different classes or categories for comments coming e.g. from (or going to): anonymous, mine, friends, named people, verified people, famous people, public figures, politicians, popular people, popular comments, popular commentators, or the like (e.g. based on vote and ranking or feedback of others), e.g. to filter or select or narrow down the sources or recipients or direction of comments (or distribution or censoring, e.g. for kids).
In one embodiment, the system is used for permission for annotation or sharing annotation, e.g. propagates the permission, e.g. who can do it or see it. In one embodiment, a famous character opens up to everybody, as one extreme example, with minimum privacy setting. In one embodiment, the system is used with a model to start from zero permission and add to it gradually, or in an alternate model, start from foil permission and chip away from that, to reduce the permission scope and level. In one embodiment, the public knowledge is open to all, e.g. available data on Internet. In one embodiment, once a picture is shown to public, the features can be extracted by the public, which cannot be undone (after the public disclosure). In one embodiment, if the image is not shared to public, and later, the image is deleted, then the extracted feature set from the image is also erased from the system, or can be used only for the user or his circle of friends, based on permission level or privacy level.
In one embodiment, the system is used for permission level based on the triangle of “feature-identity-picture” relationships, as the 3 corners of a triangle being FEATURE, IDENTITY, and PICTURE (or image). This means that, e.g. once one person, e.g. user 1, is identified by the user 2, e.g. from exposure of a picture of user 1 to user 2, then even if the picture is deleted by user 1, from the album, later on, user 2 can still remember the identity of user 1 in his head (keep the identity), which is the association of features with the identity of a person, as denoted by one side of the triangle mentioned above, which will be remaining (even after the picture or image is gone or erased). In one embodiment, the system or user can assign a permission setting for this association, too.
Video Conferencing:
In one embodiment, the system is used for lie detector or body language or emotion analysis on video or in court or video conferencing, for conclusion about a person or his intention or his behavior.
In one embodiment, as described before in our prior disclosures, for the face recognition in an image, using basis function, first, the system finds the tilt or orientation, so that to rotate in the right direction, as normalized, and then the system finds the scale of at least a head or body, for the correct size of basis function, using one face or object as a normalization or scaling factor.
In one embodiment, the system is used for video conferencing, with information about attendees, and also image of the attendees, so that less information is transmitted, and still getting better image construction on the other side. For video conferencing, e.g. the system finds the 4 people in the room, and boxes their faces, and then transmits the faces once with high resolution, and then superimpose the emotions on faces (with minimum transmission cost) later. In one embodiment, the system transmits the rest of the objects at low resolution, or based on difference of frames. In one embodiment, the system reconstructs the faces at the other end, based on models or templates or simulations on expression of faces, without actual face transmission, just by tags indicating emotions, which is extremely low bandwidth transmission. The people on the other side can examine the facial expressions and body languages of the user, during video conference. This reduces the need for traveling for business meetings, which saves a lot of money for the businesses.
Event-Centric Social Network:
In one embodiment, we have a social network that is event-centric, rather than individual-centric. In one embodiment, people are going to a real meeting or official event or party or social event (or a virtual one), and take pictures or videos (or audio), e.g. by their cell or mobile or smart phones or cameras or tablets, and put it (upload) on the event-based social website. Then, later on, they can go and comment on and annotate with voice, text, image, video, music, or symbols (or the like), on their own or others' albums at the party, so that they can continue their conversations, even after the party or event, for more interactions and communications between the members or participants of the party or event, to essentially re-do or re-live the party, and extend it forever, as much as desired.
In one embodiment, they have a private “room” or “lounge” for the private communications. In one embodiment, they have a professional or political gathering for a specific cause or topic. In one embodiment, they have a dating site for a subset of people, for finding a match, or connect people with similar interests, e.g. book club or yoga or rock climbing or wine tasting. In one embodiment, they can share or store the pictures or videos or corresponding comments, or hide them from some or all people or public or members (of the event or party). In one embodiment, they can have overlap between events. Iii one embodiment, they can merge 2 or more events, e.g. if they are started by 2 different members, for the same exact event. In one embodiment, the system lets the members know that they might have repetitious or same/similar events, e.g. based on time and GPS recorded, e.g. by cameras, as a suggestion for merger or combined events, if they desire, e.g. where at least one or two or majority or supermajority of members of each event desires so (or approves or consents to).
In one embodiment, they have one or more managing member(s). In one embodiment, they have a starting member or initiation member. In one embodiment, they have an approval member for new members to verify them as a member of the event or as a guest for the event. In one embodiment, they have an ejection rule, for an arbitration person, for disagreements or bad or rude behavior on site or toward each other. In one embodiment, they have a guest member (e.g. with limited rights or access or privacy on the site or party or event), or e.g. for people who missed the party (hut invited already), or for people who may become interested in the subject of the event or party, to visit or browse or comment on others or interact with others, to encourage more interactions and networking. In one embodiment, the sign-up is mandatoty. In one embodiment, the sign-up is through other web sites, e.g. FACEBOOK or TWITTER or GOOGLE sites, for using the same identification for the user, or for ease of use for the user, or if the user desires.
In one embodiment, the interactions are before, during, and after the real or virtual party, with or without host(s), or one or more hosts or mangers, with different degrees or levels of invitees or guests with different levels of access or privacy, for e.g. pictures, conversations, and inviting privileges or rights.
In one embodiment, the system automatically suggests friends or other events to others, based on date, location, GPS, names, title, tags, and friend circles. In one embodiment, the various events can be merged based on managers' approvals or consent, as one event or combination event, which carries all the conditions and rights or constraints of individuals or people on individual events.
In one embodiment, the system loaded on a phone and camera, e.g. as plug-in, to let the user take a picture or video, and upload them in our web site by users or automatically, with copies or invitations emailed to friends by users or automatically, and with annotations done by users or automatically, and the recognitions of people or objects done by users or automatically.
In one embodiment, an event is automatically suggested based on a photo or a video of a user. In one embodiment, a face recognition module is used to match the faces found in the photo and video with those in a database, e.g., based on a user's album, or in an album of another user directly or indirectly connected to the user. In one embodiment, similar photos across albums are determined (e.g., based on common persons, background, metadata, GPS/location, and time) to fit a criteria of belonging to the same or similar event. In one embodiment, an event is (e.g., automatically) suggested to a user (or users), and e.g., upon initiation, an event object is setup and the photo or video is associated with the event object (e.g., in a database). In one embodiment, one or more users or recognized people in the photos or videos are (e.g., automatically) sent an invitation to join or visit or attend the event using an email, SMS, message, or notification, e.g., automatically, by using a face recognition module or annotation on the video or photo and by matching the identity of recognized faces or annotated persons/entities to the contact mode of notification (e.g., via contact list, email database, or a social network).
As for example depicted in <figref idref="DRAWINGS">FIG. 234</figref>, in one embodiment, the album of user <b>101</b> includes one or more (<b>104</b>) images or videos (or audio) related to an event. In one embodiment, an album of user <b>102</b> includes one or more (<b>105</b>) images or videos (or audio) related to the same event. In one embodiment, one or more video/audio/images are annotated (manually or automatically), e.g., with identity (or classification) of the people/objects/entities and/or information about the event (e.g., birthday, conference, or party). In one embodiment, the automatic annotation uses facial locator/recognizer module(s) to find the facial features (e.g., description or abstract features) of a face in an image or video, and determine a match in the user's (and/or the user's contacts/connections') annotated facial database (e.g., with a reliability or certainty factor), and automatically annotate the recognized face/object in a particular image or video. The auto-annotation for an audio uses a speaker recognition module that recognizes the audio signatures of a speaker and finds a match with an identified or annotated feature signature in a database. In one embodiment, an event object is automatically suggested by a event generator module based on annotations, GPS data, time, album organization, image/video/audio metadata (e.g., filenames sequences) and/or matching attributes or rules, or created/initiated by a user. An event object (<b>108</b> or <b>109</b>) is associated with a collection of such images/videos/audio and annotations, e.g., in a database. In one embodiment, an annotation or recognition of person/object in an image/video/audio (e.g., <b>104</b> and/or <b>105</b>) in an album or an event (e.g., <b>108</b> and/or <b>109</b>, respectively), refers or points to or identifies (e.g., <b>121</b> and/or <b>122</b>, respectively) other users (e.g., <b>102</b> and/or <b>101</b>, respectively). In one embodiment, based on cross identification, relationships, location (GPS), time/date, and other metadata or annotations, an event matching module determines that various events (e.g., <b>108</b> and <b>109</b>) or various collections (e.g., albums) refer to the same event. In one embodiment, a notification is automatically sent to the event managers to merge the events in one (e.g., <b>110</b>). In one embodiment, the merge is done automatically, based on satisfaction of predetermined criteria and/or user settings (e.g., including based on automatic acceptance of event mergers with certain users for certain dates/tines). In one embodiment, the merge is achieved by associating an identifier (representing the merged event, <b>110</b>) with the other event objects (<b>108</b> and <b>109</b>) identifiers, e.g., in a database. In one embodiment, annotations (e.g., inform of text, voice, or video), comments, blogs, or chats are added or associated with an event or objects (e.g., images, video, audio, other annotations or comments) associated with the event. In one embodiment, via annotation or face recognition module or speaker recognition module, a person (<b>103</b>) or object is recognized (e.g., in a database or social network). For example, in case of person or entity, a notification is (e.g., automatically) sent to the person (<b>103</b>) by a notifier module via for example, social network messaging, email, or SMS to participate in the event and/or contribute or upload material (e.g., image, video, audio) (<b>106</b>). In one embodiment, a person's albums are automatically searched for matching annotations or indicators (e.g., time/date or location/GPS) or similar group or sub-group of people or objects or similar background or scene in the image/video/audio to suggest incorporation of such material into the event by the person or entity (<b>103</b>). In one embodiment, the image/video/audio (or their references or addresses) are added to the event automatically, based for example on user settings, criteria, or rules. In one embodiment, events (e.g., <b>110</b> and <b>112</b>) are overlapped based on one or more criteria or relationships (e.g., based on people, time, subject, or location proximity). In one embodiment, authorized users may browse or navigate between events. In one embodiment, a person (e.g., <b>111</b>) may be invited to participate in an event (e.g., <b>110</b>) by one or more users or participants (e.g., <b>103</b>) of the event. In one embodiment, event messages are sent as notifications to event participants, e.g., when a user adds a comment or annotation. In one embodiment, a notification is sent to the participants identified by a particular image/video/audio, person contributing the object, or to invitees, based upon a user making an annotation or comment on the image/video/audio. In one embodiment, more events (e.g., <b>113</b>) may be merged together (e.g., <b>114</b>), for example, by associating an identifier of merged event (<b>114</b>) with those of merging events (e.g., <b>113</b> and <b>110</b>).
In one embodiment, as depicted for example in <figref idref="DRAWINGS">FIG. 235</figref>, an event or party object may be extended to a social application, such as a dating application. For example, users (e.g., <b>201</b> and <b>202</b>) participating in an event (e.g., a party) (<b>200</b>) may indicate comments or indicators (e.g., private comment/indicator only visible to each user) such as “Wink” or “Like” (e.g., <b>203</b> and <b>204</b>) on other people (e.g., <b>205</b> and <b>206</b>) that appear in images/video-'audio in the event. In one embodiment, a matching module determines a cross/mutual interest between people (e.g., <b>201</b> and <b>202</b>, based on <b>206</b> and <b>205</b>, respectively identified as the same people) and automatically sends those people notifications regarding the cross/mutual interest. In one embodiment, the capability to indicate such comments or indicator by a person may be limited by a total number or other rules, e.g., associated with the event or per user. In one embodiment the notification of mutual/cross interest is sent based on satisfying one or more rules and conditions based associated with the event or the users. For example, in one embodiment, the “Wink” indicator may not be sent to more than (for example) two people. For example, in one embodiment, a user may set a rule or setting not to accept a notification of cross interest, if the other user has given similar indication to more than a set number of people (e.g. three) in the event. In one embodiment, the notifications to a person for a mutual/cross interest are prioritized or filtered based on various factors, such as, the number similar indications sent by another person to other people. In one embodiment, people may tag their comments, conversations, chats, or annotations as private as to one or more other users. In one embodiment, a user may invite another user to an event. In one embodiment, a semi-private “Wink” or “Like” indicator from a user (e.g., <b>202</b>) on an object (e.g., <b>206</b>) representing or referring to a user or a person (e.g., <b>201</b>), is visible or notified to the referred person (<b>201</b>) automatically, based on the event setting or the users' settings. In one embodiment, the private or semi-private indicators are matched or compared across various events, e.g., a mutual/cross interest between two users/entities can be matched when each interest indicator occurred in different event, e.g., by propagating the mutual/cross interest to the user level from the event domain.
<figref idref="DRAWINGS">FIG. 236</figref> depicts an embodiment for event centric social network.
Different Applications (and Their Sections/Parts/Components):
In one embodiment, as an example, the system comprises the following components (with the following functions, as described elsewhere in this or our prior disclosures, in more details): <ul id="ul0094" list-style="none"><li id="ul0094-0001" num="0000"><ul id="ul0095" list-style="none"><li id="ul0095-0001" num="2792">Our Next Generation Search Engine, using image, video, voice, annotations, text, and the like <ul id="ul0096" list-style="none"><li id="ul0096-0001" num="2793">a Find objects, people, emotions, subjects, actions, context, environment, relationships, patterns, fashion, or the like, through images, videos, voice, text, and the like</li><li id="ul0096-0002" num="2794">Relevant and reliable search es. for images and videos (e.g. using Z-factors)</li><li id="ul0096-0003" num="2795">Relationships between text, image, sound, voice, and other forms of data (e.g. using Z-web)</li></ul></li><li id="ul0095-0002" num="2796">Automated Image Organizer and Relationship Manager <ul id="ul0097" list-style="none"><li id="ul0097-0001" num="2797">Search for people</li><li id="ul0097-0002" num="2798">Logical operations (e.g. AND, OR, NOT, or a combination)</li><li id="ul0097-0003" num="2799">Multiple User Albums Cross Identifier</li><li id="ul0097-0004" num="2800">For video and still image</li></ul></li><li id="ul0095-0003" num="2801">Z-web platform and relations knowledgebase <ul id="ul0098" list-style="none"><li id="ul0098-0001" num="2802">Expanding Z-web database, with corresponding Z-factors</li><li id="ul0098-0002" num="2803">To interface or make inquiry or query about an object or relationship in Z-web, with corresponding Z-factors (called “Z-inquiry”)</li></ul></li><li id="ul0095-0004" num="2804">Pose and expression auto-editor (e.g. for human faces, e.g. for smiling face, for editing automatically)</li><li id="ul0095-0005" num="2805">On-line Image or Video Finder/Search (e.g. based on text or image query) <ul id="ul0099" list-style="none"><li id="ul0099-0001" num="2806">People Finder/Search</li><li id="ul0099-0002" num="2807">Video Finder/Search</li><li id="ul0099-0003" num="2808">Image Finder/Search</li><li id="ul0099-0004" num="2809">Segment Finder/Search</li><li id="ul0099-0005" num="2810">Object Finder/Search</li><li id="ul0099-0006" num="2811">Action Finder/Search</li><li id="ul0099-0007" num="2812">Logical operations (e.g. AND, OR, NOT, or a combination)</li></ul></li><li id="ul0095-0006" num="2813">On-line Image and Video Annotator <ul id="ul0100" list-style="none"><li id="ul0100-0001" num="2814">Annotate on the timeline of video (e.g., “like”, “don't like”, comments, flags, placeholders, pointers, insertions, notes, markers, share comments, email comments, notify about other's comments, or the like)</li><li id="ul0100-0002" num="2815">Annotate parts of the image (e.g. identify, “like”, recommend, note, link). The part is marked by the user or automatically suggested by the system, e.g., by the face-object locator module.</li><li id="ul0100-0003" num="2816">Annotate using text, voice, image, video, doodle, symbol, drawing, music, link, or the like</li><li id="ul0100-0004" num="2817">Annotations tagged with topics (es. pre-configured, dynamic)</li><li id="ul0100-0005" num="2818">Annotate on other annotations, e.g. blog or hierarchy</li><li id="ul0100-0006" num="2819">Annotations for: location, event, date/time, type (political, comedy, drama, news, sports, etc., which is useful for marketing and ads), starting points or markers in the movie or scenes (shared, or e.g. can be emailed)</li><li id="ul0100-0007" num="2820">Shared (social network)</li><li id="ul0100-0008" num="2821">Play-back annotations, e.g. voice annotations</li><li id="ul0100-0009" num="2822">Searchable annotations</li><li id="ul0100-0010" num="2823">Categorized annotations</li><li id="ul0100-0011" num="2824">Organized based on commented portion</li><li id="ul0100-0012" num="2825">Filter based on friends</li><li id="ul0100-0013" num="2826">Privacy level of comments</li><li id="ul0100-0014" num="2827">Organized based on commenter (or commentator or annotator) (e.g., famous people) (order or filter based on commenter (e.g., ID or ranking))</li><li id="ul0100-0015" num="2828">Show current comments (close to current time)</li><li id="ul0100-0016" num="2829">Preview of the comment, e.g. using a mouse hovering over a thumbnail image or an icon, representing the comment</li><li id="ul0100-0017" num="2830">Organized based on named comments, versus anonymous comments</li><li id="ul0100-0018" num="2831">Show summary count or density of comments (or e.g. types, e.g. with color codes, e.g. for LIKE, DISLIKE, etc.)</li><li id="ul0100-0019" num="2832">Comments or annotations, as thumbnails or icons or buttons or symbols on screen of device</li><li id="ul0100-0020" num="2833">Interactive with user (e.g. put forth photos or parts or segments, and ask NL (natural language) questions) (e.g. use prior questions and annotations, to guide for words, using templates or rules or decision trees)</li><li id="ul0100-0021" num="2834">Cross-Album user annotation or comment, e.g., voice annotation, covering multiple images and parts</li><li id="ul0100-0022" num="2835">Storyline by user (e.g. with marker, highlighter, or object selector)</li><li id="ul0100-0023" num="2836">Order or filter based on commented part of image (content)</li><li id="ul0100-0024" num="2837">Order based on types of annotation and rankings of annotations</li><li id="ul0100-0025" num="2838">Search or organize by annotation, topic, annotators, type, location, or coordinates in time or space</li><li id="ul0100-0026" num="2839">Follow a topic or person, with auto-notification</li><li id="ul0100-0027" num="2840">Transcription of voice to searchable text</li><li id="ul0100-0028" num="2841">Annotate video and images from other sources or stored at our site</li><li id="ul0100-0029" num="2842">Using mobile devices, for capture, annotations, and transmission or storage of videos and images</li></ul></li><li id="ul0095-0007" num="2843">Services (based on Ad, subscription, software licensing) <ul id="ul0101" list-style="none"><li id="ul0101-0001" num="2844">Video annotation (public or private)</li><li id="ul0101-0002" num="2845">Image Search</li><li id="ul0101-0003" num="2846">Video Search</li></ul></li><li id="ul0095-0008" num="2847">Library of voice annotations <ul id="ul0102" list-style="none"><li id="ul0102-0001" num="2848">Voice recognition</li><li id="ul0102-0002" num="2849">Speaker recognition</li><li id="ul0102-0003" num="2850">Transcribe to text</li></ul></li><li id="ul0095-0009" num="2851">Behavior and trend analysis <ul id="ul0103" list-style="none"><li id="ul0103-0001" num="2852">Marketing value</li><li id="ul0103-0002" num="2853">Targeted ads and income</li></ul></li><li id="ul0095-0010" num="2854">For social gatherings (or formal meetings or events) <ul id="ul0104" list-style="none"><li id="ul0104-0001" num="2855">Photo and video album after the party</li><li id="ul0104-0002" num="2856">Annotations and comments for photo and video album after the party (including voice annotation)</li><li id="ul0104-0003" num="2857">More interactions and relationships after the party</li><li id="ul0104-0004" num="2858">Parties</li><li id="ul0104-0005" num="2859">Virtual parties</li><li id="ul0104-0006" num="2860">Invitations to join, before or after the party</li><li id="ul0104-0007" num="2861">Community of people (matching people, e.g. book club)</li><li id="ul0104-0008" num="2862">Dating site (with common interest or friend, or using friend's recommendation) (knowledgeable matching, based on the other person's interests or comments or annotations) (facial or features matching, using our image search engine, within the album): generating subscription and income</li><li id="ul0104-0009" num="2863">Professional services (for formal meetings or events) (e.g. video conferencing)</li></ul></li><li id="ul0095-0011" num="2864">Image Editing, e.g., automatic finding and changing expressions, e.g., smiling, closing mouth, opening eyes, red eyes (automatic correcting or editing, using correct color and texture, from surrounding color of skin or face)</li></ul></li></ul>
In one embodiment, the system unlocks information and maximizes value of images and videos, by extracting reliable and relevant information from image and video, e.g. for expressions and actions, within images and videos, which is also searchable, by the user, e.g. in the albums (for the user or his friends), with self or auto or cross annotations. In one embodiment, the system is used for Big Data analysis, as well. In one embodiment, the system is used for instructional video (e.g. targeted communication, via objects within a video), fashion (e.g. search to find same or similar dress, or compare prices in catalogs, for bargain prices), security (e.g. for airports or entry to a building or elevator or room or computer), travel industry, entertainment industry, movie or music industry, or the like.
Video and Image Recognition:
In one embodiment, the system changes resolution during the recognition process, for an image or video, e.g., once the face is detected in the frame or image, then to recognize the face, the resolution used goes higher, dynamically, e.g., based on a rules engine.
In one embodiment, the system recognizes the arrangement of the objects in an image, e.g., object A located in front of object B, or covers object B, or on the left side of object B. In one embodiment, the system uses different focuses for distances or depths for various objects in the image (located at different distances or depths), for recognition purposes. In one embodiment, the system uses an incomplete line or abrupt discontinuity in borders or boundaries as an indication of another object covering the first object (as hidden, or located on the back).
In one embodiment, the system recognizes the objects in a video, using only pieces of the video, for selected frames or selected regions in a frame. In one embodiment, the system uses the recognized objects for the ad revenue, e.g. from the manufacturer or store, skipping he middleman, e.g. for connecting the chain of object-content owner-distributor-shows-middleman-ads, e.g. which can be shown on ad-track, e.g. for a video, parallel to the video normal track, on timeline or time axis.
Eye-Glasses as Computer Monitor or Display or Computer Interface:
In one embodiment, the eyeglasses are used for monitor or computer interface. The image is projected at a focal length f<sub>l</sub>, on eyeglasses, from the perspective of the user, at a distance f<sub>1</sub>. However, for people who wear prescription eyeglasses, they cannot wear both at the same time. So, for them, the focal length is f<sub>2</sub>, i.e., at a distance of f<sub>2</sub>. So, the difference is Δf=abs(f<sub>2</sub>-f<sub>1</sub>), as the absolute value of the difference. Thus, we have a correction on the focal length equal to Δf. So, the user can put her prescription parameters for her eyeglasses in the system to adjust for focal length for monitor or display of the computer, or the system determines her eye problem, or reads her medical chart or history, to adjust based on Δf. The eye astigmatism can also be corrected with correction on display, such that the user does not need the conventional eyeglasses for that, to view the monitor on computer eyeglasses directly. In this case, the correction is on tilt (Δα), curvature (e.g. Gaussian curvature form), angle (Δθ), envelop, or shape. So, basically, the image is formed, by considering the user's eye problem already included in the position, angle, curvature, and tilt of the image rays and image formation, on an image plane, which is distanced (at f<sub>2</sub>) and centered (in both directions of coordinates, with deviation at Δx and Δy), accordingly.
Using Templates to Store Information:
In one embodiment, for remembering or recalling or storing the numbers or poems, the system uses rhymes or templates to fit in the text or voice information, as an envelope or carrier data or shell or modulated data. The templates are stored in a database. The templates generally reduce the size of the data stored. The templates represent patterns in nature or information for compression of data received or observed, in most cases. For example, to store a telephone number, e.g. (734) 435-1214, the system breaks it down as: 734, 435, 12, and 14, to be stored as 4 integer numbers. Or, the voice can be stored as a rhyme or poem type information for the telephone number. For example, we can have the rhyme for telephone number above as: “DaDaDa-DaDaDe-DaDe-DaDa”, as an envelope or shell or template for the 4 integer numbers above.
Using Templates for Voice Generation:
In one embodiment, for text to voice conversion, the system has templates based on voice-actors or the user herself, with voice pre-recorded, for various emotions, e.g. angry, happy, laughing, scared, nervous, and the like, which can be detected from natural language processing or learning from the context or words used in proximity, or which can be detected from image recognition on the video or image from the face (emotion or expression detection) or body language or action or pose of the subject under study, as described elsewhere in our disclosures. Then, the text will be converted to the voice using that template, e.g., saying “Watch out!” using a Nervous or Shouting (or combined both) template voice option(s), as this phrase usually refers to an urgency of information, or for the sender or originator of information. In one embodiment, the user or a third party tags the emotions or context In one embodiment, the system does the tagging automatically, e.g. based on the teachings on emotion recognition (taught elsewhere in our disclosures), and then selects the proper template(s) from the template database, to be used for text-to-voice conversion, as output as voice.
Sound Recognition:
In one embodiment, for voice recognition or natural language processing, the system uses fuzzy or soft boundary clusters, to e.g. find or separate or distinguish words or partial words or phrases in voice or text form. In general, the system uses fuzzy or soft boundary clusters or recognitions for any data recognition, e.g. in image or video or text or OCR, to combine all, and get better recognition on correlations of the individual recognitions.
In one embodiment, for sound recognition, one can have signatures or clusters or features recognized and stored in a database, or through a learning machine module or neural network weights, such as sounds for bomb or thunderstorm or gunshot or footstep or barking of a dog or coughing a person or sneezing of a person or pattern of footsteps, to be able to e.g. recognize gunshot, type of gun, identity of a person, size of the lung of a person, height of a person, weight of a person, knee or foot problem for a person, identity of a dog, or type of dog or other animals, by matching and recognizing against the database or taught learning machine, to e.g. add this recognition with other signatures or recognitions on text or OCR or picture or video or tags or comments or user's own identifications, to be able to get a better combined recognition result.
In one embodiment, for sound recognition, one can have multiple sound recorders or sensors installed on e.g. a post or fixed location, or moved as mobile recorder, e.g. with GPS or location recorder, around town or building or airport or street, for security purposes, to recognize the sound, and then by triangulation, GPS, or optical, sonar, laser, or other methods, find the location and distance of the source, to automatically notify authorities e.g. for coming storm or gunshot or bomb or car accident, by sound signatures in the database, for any event desired, for public safety, or other purposes, which can be also combined with the video or image feed, for better recognition or redundancies or accuracy.
Recognition Based on Style of Writing or Text or Speech:
In one embodiment, the system recognizes the author or user based on style of writing of that person, as stored or scanned before in a database, as signature or features for that person, e.g. how often he makes a new paragraph, phrases used, use of commas, correct or incorrect patterns of usage of grammar or abbreviations or phrases, slangs used, topics used, words used, common words, type of words used, length of text or paragraphs, numbering formats, indexing formats, conclusion formats, logic used, formality of text, or the like, to correlate to a person, in addition to signature or handwriting recognitions or others, if available, to combine for better recognitions. The Z-factor or reliability factor comes in here as a factor for correct recognition, from competing parameters, e.g. those mentioned above.
The same analysis applies to speech and voice or lecture or song or lyrics, converted to text or analyzed as sound only, or both text and sound analysis, for pauses, words, slangs, tone of voice, common words, mistakes, or topics used, frequency of words used, frequency spectrum of sound and peaks and relative sizes and locations, Fourier coefficients, loudness, emphasis, accent, localized words, e.g. in Australian English usage, or per city usage or slang, formats, grammar, or the like, for recognition of person, verification, identification of level of education, background, family history, place of birth, expertise, sanity of a person, type of person, anger level, danger level, reliability, or reasonableness of a person, or social unrest collectively on a website or log or network, as a metrics or predictor parameter for possible revolution in a country or unrest, or political or social opinions, or voting on a movie or topics, collectively.
Using Hardware:
In one embodiment, the system is based on hardware, with analog devices, for learning and recognition purposes, for faster and parallel processing, e.g. to be able to handle Big Data and face recognition in a very short amount of time, or in real time. So, e.g. the devices are stacked physically in 3-D (dimensional), on top of each other, e.g. using Si-via-hole technology, to be able to process the data faster, with a processor at each node in circuit, for parallel processing. In one embodiment, the matrix or vector manipulation can be approximated by the function of the device, as the speed is the main concern, and the results are still very good for recognition accuracy and reliability.
In one embodiment, the system is based on multiple-step step-wise interposer(s), as layers in between, in semiconductor processing for connectivity, for hardware, to connect many terminals or metal contacts to many other terminals or metal contacts or devices, in a large scale, for full connectivity between them, with many electrical connections in 3D, e.g. stacked vertically and crossing each other in a horizontal projection plane, without actually touching each other or shortening the circuit or shortening the terminals. So, the interposer is done e.g. at 20 steps, so that it can shift the location of a first terminal in horizontal plane X-Y coordinates, gradually, to be able to connect to a second terminal or metal contact or device, at a location that crosses it at a 2D projection horizontal plane X-Y coordinates, but in reality, that is clear from it electrically, i.e., not crossing each other in 3D, i.e., not shortening it electrically, for a full connection of many terminals or devices to many other terminals or devices (electrically).
In one embodiment, the system above is used for neural network simulations or actual hardware implementation of that, with nodes and layers, using devices on substrate in different layers of semiconductor structure, to connect to other devices or terminals or metal contacts, using e.g. a 20-step interposer metal connector or conductor (as a middle or inserted or intermediary or “translator” or adaptor or sandwiched layer), for full connection between layers (electrically), to represent and mimic neural networks (with nodes and layers, plus bias feed). In one embodiment, the system also has a 2D, horizontal plane X-Y coordinates, electrical distribution lines (or bus, e.g. in multiple of rows and columns) on substrate, for massive interconnects between devices or terminals, in the combination that is desired, or for bias voltage on each node, or for control of each node, or for weights.
In one embodiment, the system uses the hierarchical algorithm, or tree decision making, for which each node is a recognizer of a feature which may be real, e.g. eye or iris, or a combination of features of the face, e.g. (2W<sub>eye</sub>/L<sub>nose</sub>) for eye width and nose length, or abstract value, which is not readily derivable from features of the face. So, by using the depth and width of the hierarchy, the system controls the accuracy, speed, and level of recognition, in view of constraints of the computing power or time delays. In some cases, some general high level recognition can be accomplished on the surface, without full analysis, and some parts of the hierarchy can be idle and not used at all, for faster calculations and result (e.g. for ethnicity recognition or gender recognition, without recognizing the identity of the person). Note that each node depends on decisions of its sub-nodes (all or a majority or some of those sub-nodes), under its domain, under its branch.
In one embodiment, the system uses quantum computing using e.g. qubits (quantum bits), which is different from binary digital format, to represent the states and situations which are not in binary logic, e.g. in fuzzy domain, which relates to our current and prior inventions and disclosures, e.g. Z-numbers, Z-factors, and Z-web (or which are expressed in fuzzy clustering or soft boundary clustering, e.g. for recognition and classification purposes).
Face and Object Recognition or Tracking:
In one embodiment, the system uses eigenvector for faces (eigenfaces), as described in our prior disclosures, to average human face in 2D or 3D models, as a model or template. One way to do this is to average hundreds of faces in real life photos or images, by normalizing on the size first, and then superimposing or combining them (e.g. averaging, weighted averaging, combining, adding, aggregating, union or intersection logical operations on pixel level, or superimposing two images, pixel by pixel, or region by region). Another way is to use an averaging filter on an image of face or head, to fuzzify or unsharpen the image or lines, or as defocused image through an optical lens, or through a dirty or scratched lens, to produce such murky or foggy or muddy or cloudy effect (on clarity of picture or face), to produce such eigenfaces, as our basis functions.
In one embodiment, then, any new face is a linear combination of those eigenfaces (F<sub>i</sub>, e.g. about 100 or 200 of them), (Σ<sub>Ei </sub>α<sub>i </sub>F<sub>1</sub>), in our database, or alternatively, as a morphable variation of an eigenface, using a number of parameters to adjust features, e.g. nose, mouth, and eyes, to fit the model, e.g. L<sub>mouth </sub>or W<sub>nose</sub>, to change the size or boundaries of the objects or features, e.g. mouth or nose, by some delta or small differences or perturbations or variations, e.g. ΔL<sub>mouth </sub>or ΔW<sub>nose</sub>, for length of mouth or width of nose, to roughly fit the original eigenface. So, to store the information about the new face, we only need to store the coefficient of the linear combination in the example above (α<sub>i</sub>), or the small differences or perturbations or variations (ΔL<sub>mouth </sub>or ΔW<sub>nose</sub>) plus the identity of the original eigenface (F<sub>o</sub>), which is small data for storage or comparison or retrieval from a database, for more efficiency and higher speed.
In one embodiment, we have various amount or angle of lighting or camera or lens or focus or available colors or grey scale or texture, as variations of the faces. In one embodiment, we have various poses and angles and emotions (e.g. laughing or serious look) and views and perspectives, as variations of the faces. In one embodiment, we have various locations, e.g. frontal pose in the center of the image, or 45 degree side pose in the corner of top left of the image or photo, as variations of the faces. In one embodiment, we have various accessories, e.g. hair, eyeglasses, hat, or beard, as variations of the faces. These variations can be used for training purposes, or recognizing a person, or defining a person, or learning faces, or finding the orientation or environment of the face or camera or lens. So, once one parameter is taken as given, the others can be obtained from that, as the consequence or correspondence, after the training or learning mechanism above.
Once we find a good match, e.g. 92 percent match on then we can detect a person or identity, from a database of known people, or for the ones who were previously detected in another camera or video. In one embodiment, to find the overall match for all α<sub>i</sub>, we get the minimum value for all α<sub>i </sub>match scores, or get the multiplication of all α<sub>i </sub>match scores, or the average of all α<sub>i </sub>match scores. In one embodiment, this can be used for fitting score for matching a model or variations of a model or template. In one embodiment, we have hierarchical matching, with hierarchical classes or subclasses, for templates or models or eigenfaces or types of faces stored, for faster matching or comparisons. In one embodiment, we have separate databases or classes for different ages, genders, ethnicities, races, head types, or the like, to make the analysis and learning more accurate.
In one embodiment, we get lip reading with the emotion detection, on the face or lip or mouth, for sequence of configurations, as an action in video, for sequence of frames, to detect the words or emotion on the word, e.g. angry and shouting, for conversion to text or voice later on, for dictation or transcribing or storage. The templates on the training for the library of words and emotions or combinations of them are stored, based on supervised learning on known samples and videos, for future recognition of unknown input. The lip reading plus voice recognition are used for video caption generation.
In one embodiment, the model of the face or head is based on 3D scanning or laser scanning or digitizer, from real faces and heads, to be stored in a computer or database. In one embodiment, the beacons or tags or reflectors or RFIDs or transmitters are attached to the face or head, for digitization or recording or scanning of the face or head.
In one embodiment, the system transfers one face to another, using the model, to simulate the talking of one person, based on talking from another person, using the same words for imitation, based on word and mouth or face configuration and sequence correspondence, already learned or stored in a database. The various sequences are simulated based on parameters for that pose or emotion or sequence (which requires prior learning on many samples, or pattern recognition for supervised learning, or based on model for face or talking or mouth or shapes for various words captured and learned from many sequences beforehand), or actually taken as pictures and stored for that person, which requires prior tagging and classification for variations for that person.
In one embodiment, the system estimates the date or age of the picture from a rules engine, with correspondence on hair styles, clothing styles, wrinkles on picture, car models, and other objects in the picture, to be used for the current age of the person (as picture age can be added to the estimated age of the person in the picture at that time, which is based on the features of the face for different age ranges for male and female, already learned or classified based on many samples, e.g. through supervised learning).
In one embodiment, the system adjusts the color or background or contrast, to improve the contrast between face and background or other objects, so that recognition is done more accurately. In one embodiment, the system defines anchor points for the features on the face or objects for tracking them in the video, for better recognition, or for compression of data defining the video.
In one embodiment, first, the face is located in an image, e.g. using Viola-Jones algorithm. Then, two or more images of a person are captured at 2 or more different bands of spectrum of light, using different detectors or sensors or cameras, at different ranges of frequencies. Then, the captured images are aligned and normalized, for the referencing or comparison to each other. Then, the accessories, e.g. hair or eyeglasses, are removed from the image. Then, the system normalizes or equalizes the histogram from the images, to reduce any environmental effects or camera effects. Then, any of the methods below can be applied, for face recognition (or other methods we described in our prior disclosures). In one embodiment, the system uses grayscale image or infrared image of the face or object, as the basis, for recognition.
In one embodiment, the system uses the Principal Component Analysis (PCA) for face recognition, as a feature extractor, which relates to an orthogonal transformation to convert a set of possibly correlated variables observations into a set of uncorrelated variable values principal components), with usually fewer variables. The first principal component has the largest possible variance, and each other component has the highest possible variance, with the condition that it is uncorrelated with or orthogonal to previous components. A feature subset selection method is used to reduce dimensionality and enhance the speed for classification. In one embodiment, the system also uses moment invariants to enhance the performance of face recognition.
In one embodiment, the system uses Kalman filter for tracking face in video. It can also be used to track an object in video, to compensate for the shaky camera or moving base line or coordinate system, to reduce the effect, for better result and more stable image, for better recognition of the other objects in the frame.
In one embodiment, the system uses multiple versions of image in different resolutions or spatial frequencies to store for comparison for face recognition, for faster or more efficient comparisons, at different stages and levels of accuracy, e.g. for hierarchical comparisons.
In one embodiment, the system uses eye movement or tracking, with one or more cameras on screen, for detecting the focus of the eye for the user, e.g. as a mouse or selector on screen, so that the user interface becomes faster and easier, for selection of menus or buttons or actions on screen, which can be combined with blinking fast, or twisting mouth, or hand gesture, or other facial or body movements or gestures, with tracking or recognition of such gestures, to mean a function or action, e.g. mouse click or selection of the point on screen, by the user, for easier user interface. In one embodiment, the system detects the eye gazing or focusing point on the screen using a light (possibly invisible), to shine on the eye and detect the reflection using sensors in front of the eyes, to extrapolate the gazing position, based on head and eye for the sitting position for the user, for the positions and coordinates as detected by the sensors in front of the user.
In one embodiment, the system uses hierarchical algorithm for recognition. In one embodiment, the system selects to ignore some features or regions of image. In one embodiment, the system uses Gaussian filters or convolution or matrix equivalent or kernel to focus on a region or center of Gaussian curve and defocus on the surroundings of that region. That is equivalent to the vision of a person who needs an eyeglass to see properly, and uses the eyeglass for a view of a center of a region, and for the surrounding or rest of the regions, she does not use any eyeglasses for any correction and sees the world murky or cloudy or unfocussed. So, we apply that principal to our system (our recognition machine) for viewing different regions, for field of view or window, that can be moved around, as time passes, to focus on the neighboring region(s), as sliding focused window, if needed.
In one embodiment, the system learns how to learn. In one embodiment, the system learns how to emphasize or focus or de-emphasize or de-focus on some features or regions of image, using a learning machine module.
In one embodiment, the system uses fixed camera for security e.g. at buildings, streets, or airports. Thus, the background is fixed or limited in variations, which can easily and rapidly be learned or distinguished or subtracted or marked or separated. Thus, the objects or foregrounds can be extracted or understood or distinguished much faster.
In one embodiment, the system uses real parallel lines on sides of e.g. rectangle or square shapes, e.g. a box or building or street, to get their infinite horizon points or point or line for perspective, by finding the intersection of such lines in the image at infinite point, far away, or use the natural boundaries, such as ocean and sky boundary in the image, to find the “infinite” or horizon line and horizontal axis or plane or direction of gravity, to normalize or understood or rotate or recognize or make correction in tilt for the image or components or objects in the image.
In one embodiment, the system uses the biggest deltas or changes or differences, to find the frame major changes in video, e.g. relative deltas, to know the background is changed at that point, to go deep and find the background again, for the new series of the frames, again, and store the new background somewhere in memory for further analysis of the new frame series in that sequence.
In one embodiment, the system uses a standard language or grammar or alphabet sets for input or description of an image or object (or voice or text or other data, as well), for Internet or search engine, using combination of e.g. tags, text, labels, geometrical shapes, pieces, unit objects, unit pieces, image alphabets, or sound alphabets, a subset of which is with interface with humans and is human-readable, to be used for processing, storing, inputting, interfacing, or the like, with humans and other machines, for data or input or recognition or compression or summarization or indexing or storage or description purposes. For example, an image of an object or insect is described based on a collection and relative position of a series of geometrical units, such as rectangles or triangles, as they are located in front of another geometrical unit, to form the final image, as we see it in the picture or image. For example, we have: <ul id="ul0105" list-style="none"><li id="ul0105-0001" num="0000"><ul id="ul0106" list-style="none"><li id="ul0106-0001" num="2902">2 SQUARES directly on TOP LEFT and TOP RIGHT of 1 TRIANGLE</li><li id="ul0106-0002" num="2903">TRIANGLE color: RED (color code: 237)</li></ul></li></ul>
In one embodiment, the system asks the user to help to tag, for objects or people, to identify or verify, for fee or free, to correlate or vote between users, or based on the prior history and credibility of the user, or e.g. as a weighted average, or e.g. as measured as a Z-factor for the user for the reliability of information measure, or combine Z-factors of many users for combination of many information, some of which may seem contradictory or partially contradictory in conventional logic system, or e.g. using template or guided path for the user to answer or multiple choice or hierarchical choices for faster result, which is much more accurate and more efficient than that of other (conventional) methods, e.g. AMAZON Mechanical Turk for labeling, from multi-user response or crowd-sourcing, using public input.
In one embodiment, the system classifies e.g. a bird, e.g. a Cardinal, as a male and female, due to various or different appearances, or various colors due to different seasons or climates for animals, as a separate clusters or classifications, that are later related or connected by tags and extra information, to be in the same or under the same family or name or umbrella. In one embodiment, the system classifies the Cardinal, as a bird, and carries both information with the object, for the fact that all description of BIRD carries here, as inheritance, for simplicity for recognition for faster result, to describe the parameters or units defining a bird in an image (or sound or the like), from a template for BIRD in a database, already populated or learned. For example, see the example above, for the description of an insect with geometrical units or alphabets.
In one embodiment, the system gets a video, and to summarize the video, it overlaps the deltas or differences on top of each other, on a fixed background, e.g. for a fixed camera in an airport, or normalize on a fixed background from multiple cameras or moving camera, for security, for all activities observed e.g. in that part of the airport for the past week, which then can be detected for specific person, activity, object, action, or sequence, e.g. for suspicious activities, e.g. to alarm the police or authorities. So, in this case, the images of people potentially overlap on a specific space or coordinate in an image on background, but the system keeps track of them as separate objects, for analysis, or focusing more later, if needed.
Search Based on Image:
In one embodiment, a search query is made based on images or parts of a video, e.g., by user selecting one or more objects/persons from the image or part of video. In one embodiment, prior to the selection, an object/face/person/speaker locator/recognition module analyzes the image/video/audio. In one embodiment, the analyzer module determines the bounding boxes or borders of the objects/faces/bodies in images and/or video frames. In one embodiment, the selection module uses the bounding boxes or borders to determine objects/persons/faces being selected. In one embodiment, user selection (e.g., indicated by a point or a region on image, video frame or a point or an interval in video frame or audio track) is processed by a locator/recognition module to determine objects/faces/bodies within or at the vicinity of the selection spatial and/or temporal indicators. In one embodiment, the query module provides logical combination between the audio/visual search elements (e.g., AND, OR, NOT). In one embodiment, the signatures/features of the selected entities are determined for search in a database or index based on similar features. In one embodiment, the search features are used to locate the objects in live feeds prior to indexing the features of the live feed. In one embodiment, the search query includes descriptive test of the objects/persons. For example, in one embodiment, a search query is constructed by selecting a person and a bag or brief case from one or more video frames. In one embodiment, multiple objects are selected from image/video frames to indicate that they represent the same object/person/face (e.g., taken at different poses or at different occlusions). In one embodiment, the features representing the object/person/face are combined or enhanced based on the reliability of the features from different sources.
Extending the Feature Space Clusters to Encyclopedia Samples:
In one embodiment, a learning machine/module is trained to determine features of a class or species of objects, e.g., in via a non-supervised training. In one embodiment, the features are correlated with a set of descriptive features or principle components through a supervised training or using a correlation module. In one embodiment, clusters of sub-species are identified in the feature space, e.g., via SVM. In one embodiment, the range or extent of clusters are estimated in the feature space for the identified clusters. In one embodiment, encyclopedia samples (e.g., few images for a given sub-species) are used to determine the representative features (points or region) in the feature space. In one embodiment, the extent or ranges of other sub-species are used as the basis to estimate or make initial assumption as to the extent of the cluster for represented by few samples in the feature space for an encyclopedia sub-species. In one embodiment, a search based on an image of an object in the class uses the trained learning machine to determine the features of the object from the searched image. In one embodiment, the featured so determined are associated with one or more clusters, including those based on encyclopedia samples, to determine candidate subspecies close to the searched image. In one embodiment, candidate subspecies are determined based on the extent of the corresponding clusters and the point/region in feature space represented by searched object.
Applications:
The teachings here have applications e.g. for fashion e.g. clothing search (and supplier web address or store search, with price comparison), security, language translation e.g. for travel industry, application of “Who is at my door?”, using camera, to search for dangerous people in a database, and application of “What is this object?”, using camera, to search for an object captured by camera, in a database or on Internet or in a network, for search based on image, text, OCR, and sound, or other input, as explained here.
Embodiments & Applications:
There is a great wealth of information in image and video content, which cannot be obtained from text data. People and machines generate ever increasing volume of images and videos, e.g., using mobile devices with cameras. Search for an object by text alone is inadequate. Current image search engines deliver incomplete knowledge, with unreliable or irrelevant results. By analyzing/recognizing images, highly targeted and more relevant ads may be supplied to the users. In one embodiment, a search engine platform for image and/or video is used, e.g. for recognition of objects and/or humans, with high reliability, relevance, and speed. One embodiment results in high rate of click through and/or conversion for display ads relevant to the displayed items on webpages. Appendix 4 (slides including photographic images) depicts various embodiments of the invention.
A problem scenario (as for example depicted in <figref idref="DRAWINGS">FIG. B1</figref> of Appendix 4): A user sees an item, e.g., in a store or at a party or on a website, and wants to have it. The item may be hard to describe by words beyond few generic terms. In typical search engines (by words) the desired item may be lost within the vast amount of returned search results (due to generic terms which are typically used out of context from just about anywhere within a reference document) or totally absent from the search result despite the user's additional search terms (because the original item may not have been described (by words) with all those search terms in the first place). The problem for the user includes getting mixed images and items from various merchants with no time to sort through the results (even if the desired item is there), and not being taken to the targeted (desired) product item (webpage). In addition, the result set typically includes items that may or may not have all the characteristics described by those search words (but only some of them). Merchants also have a problem in determining the desired item based on image taken by the user or identified by the user, especially when words/label description are often not detailed or sufficient or do not match the search words. In case of advertising in a publisher's webpage, the merchant or advertiser is limited to an inefficient method of advertising, because they do not have an automated mechanism to match the images on the webpage to similar products in their catalogs, and as the result the user is not led to the desired product even if the user click or selects the ad. This leads to an inefficient advertising which fails to lead the user to the desired product and potentially miss a sale opportunity.
One embodiment converts such a disconnect to a sales opportunity, via a deep image analysis, search, and recommendation (as for example depicted in <figref idref="DRAWINGS">FIG. B2</figref> of Appendix 4). For example, in e-commerce, using an image search engine for clothing and accessories (e.g., for coat, dress, jacket, pants, short, skirt, suit, sweater, shirt, blouse, wedding dress, swimsuit, socks, tie, shoe, handbag, hat, glasses, watch, brooch, necklace, bracelet, ring, scarf, pin, and earring), the user's desired object is located. One embodiment enables highly targeted ads based on the merchants catalog items and the images from publishers' webpage that are shown to users. One embodiment enables a one-stop shop, as a front for retailers and as a major entry point to e-commerce. One embodiment searches and matches merchant catalog items (or other indexed images/objects) based on the images from the user, e.g., from photo album, camera, email, or the Internet. In one embodiment, the items searched for are hard to describe by words. In one embodiment, the user (e.g., browser) is taken to the catalog item webpage, saving the user time and trouble of sorting through thousands of irrelevant items. In one embodiment, the exact, similar and matching items are shown/provided to the user, based on color, pattern, or style identified/recognized in the image. In one embodiment, complementary items (e.g., in an outfit), e.g., by pattern, style, size, material, model, brand, price, and merchant, are shown/provided to the user, in a computing device such as a mobile device, laptop, or desktop.
<figref idref="DRAWINGS">FIGS. B3</figref> and B∝of Appendix 4 depict examples of ways to connect the user to the item/product through “See & Shop” (or S&S) platform (referring to a platform for matching the images selected/provided by user or appearing on a publisher's webpage with images in other repositories such as merchants' catalogs, through methods including image recognition). In one embodiment, the images in publishers' webpages (e.g., in fashion websites) are automatically matched to the items in merchants' catalogs. Such a match is of great value to both merchants/advertisers and publishers, as the ads based on such a match are highly relevant to the consumer's interest and immediately present while the user is viewing the webpage.
Image Analyzer and Search Platform:
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 237</figref>, the images or catalog items from a repository (e.g., a third party catalog) or a service (e.g., accessed via API through for example Web Service, SOAP, lightweight REST, HTTP) are obtained, for example by an automated crawler or an iterative procedure, and the items are cached. In one embodiment, the catalog items are obtained through extraction from the corresponding web pages. In one embodiment, titles/templates associated with a catalog or a portion of catalog are used to control or guide the extraction or used for validation of the data extracted. In one embodiment, the rules are implemented in an interface module used for extraction of the data from webpages or catalog. In one embodiment, the rules include the hierarchy of the catalog items and the hierarchy of the presentation of the catalog items provided. In one embodiment, in addition to image(s) of the catalog item, its corresponding webpage URL (e.g., used as the user landing page for referral or ad) and/or other descriptions are extracted and cached.
In one embodiment, a catalog analyzer module manages the analysis of catalog items by taking a catalog item from the cache (or from the original service or repository) and uses the image(s) to determine the features of the objects) contained therein, via an image analyzer engine. In one embodiment, the image analyzer engine uses other descriptive information to apply rules and parameters (for example in fashion). For example, in one embodiment, if the description indicates that the item is a dress, the rules will indicate to use the dress recognition engine (as opposed to shoe recognition engine), or the rules will indicate to use dress locator engine, or apply higher weight to dress recognition, or resolve ambiguity to its favor.
In one embodiment, the image analyzer engine identifies a set of features for the image analyzed, e.g., via a variety of methods such as SIFT, CPA, neural networks, and/or hierarchical approach to object recognition. In one embodiment, the features are stored in a repository and indexed for fast lookup based on the features and associated description (e.g., a distilled description), URL of the image, and merchant related information.
In one embodiment, the catalog items are queried or crawled to update changes to the catalog. In one embodiment, the catalog items and/or their changes are received via a feed via push or pull or against the repository or service.
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 238</figref>, a user's computing device sends or uploads an image to a server (e.g., a merchant server or website). In one embodiment, the user captures the image via built-in camera on the computing device (e.g., a mobile device) or from an album repository on the device. In one embodiment, the user via the computing device provides a URI for the image (e.g., residing in a cloud or network) to the server and the image is uploaded to the server based on the URI. In one embodiment, the image includes meta tags (e.g., GPS information, time/date, camera information, and/or annotations) or such information is uploaded/pulled'pushed separately to the server. In one embodiment, the server transmits the image (and/or meta data) to an analyzer and search platform (server) to determine the features of the image and find a match to the image based on those features (and/or the meta data and/or other criteria) with catalog items in the same or other merchants' catalogs. In one embodiment, the platform indicates the image query to a tracker module which stores the information about the query in a query database, based on rules associated with the query (e.g., accounting for querying the same image). In one embodiment, the query tracking is used as a basis to account for or monitor the service provided to the merchant, e.g., for billing purposes or satisfying a subscription agreement. In one embodiment, the provided images and/or metadata are stored/cached in an image/metadata database/file system (e.g., a distributed file system based on Hadoop and maplreduce). In one embodiment, the image is analyzed by an image analyzer engine to determine the features of the object(s) contained in the image. In one embodiment, the identified features are stored and indexed in a repository based on the features and/or other associated metadata. In one embodiment, a search module uses the features determined from the image to search for similar or exact features of other images/items in a feature/description repository to find one or more matches for the image. In one embodiment, the search is accelerated via indexing the features of previously analyzed images. In one embodiment, the indexing uses fuzzy values and intervals. In one embodiment, the search provides one or more potential matching results to a match maker module. In one embodiment, the feature values (fuzzy, crisp, labels) are also provided for coded features (i.e., the features that are descriptive). In one embodiment, the similarity factor for overall and for individual features are determined and provided. In one embodiment, the matches are determined from the items in the merchant's catalog, e.g., by filtering the search using the items associated with the merchant. In one embodiment, a merchant selector module uses the identity of the merchant and/or other factors to filter the results or search. An example of such factor may be the context or type of objects being analyzed.
In an embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. B19</figref> of Appendix 4, the user uses the camera on a mobile device to take a photo of an item via the merchant's mobile application (or other applications). The mobile application sends the image to the image analyzer and search platform (for example directly through API, or via the merchant's server) for determining the features on the object on the image. The platform analyzes the image, determines the features, and searches the features against the features/description of the catalog items of the merchant (e.g., previously analyzed and stored in a repository/database). In one embodiment, the match maker module uses the potential matches and/or coded features and provides matched items based on the similarity factors and context (e.g., from merchant) to the platform server to provide to the merchant server or the mobile device. In one embodiment, the matched catalog item(s) is shown to the user with the corresponding catalog item information such as model, price/discount, options (colors), and sizes. In one embodiment, the user has the option to select the item (for example by placing the item in electronic basket) for purchase. In one embodiment, the other matches are also shown to the user as similar results to give the user an option to select from those matches. In one embodiment, the user is shown the items in the catalog that are similar to the search result. In one embodiment, the user information is also received from the merchant and stored in a repository. In one embodiment, the automatic an reliable search from the image lets the user get to the relevant item in the merchant's catalog. This may increase the competitive sales conversion for the merchant as the merchant would be able to convert a potential sale from a competitor (e.g., displaying the item on a shelf). In one embodiment, the image recognition and search serve is provided to the merchant based on per query or subscription or platform license or as a percentage of the sale or based on the search result and volume/accuracy levels (e.g., above a certain similarity level or reliability threshold).
In one embodiment, a search/analysis platform provides a service to a merchant without interfering with the look & feel of the merchant's application to the user. In one embodiment, the platform closes the critical disconnect between the user's intention to buy an item depicted in an image or seen in a store and the merchant's ability to reliably provide to the user the highly relevant item from its catalog. In one embodiment, the reliable and accurate image recognition and search provides specific and relevant search results to what the user is searching for. This in turn yields high click rate and conversion rate for the merchant. It also creates an opportunity for competitive conversion, i.e., for the merchant to convert a sale that would have otherwise gone to a competitor having the item on display.
See & Shop Mobile App:
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. B18</figref> of Appendix 4, the user uses a (e.g., mobile) computing device to take a picture (or video) of an item (or select a video or picture from album). The mobile application sends the image or video to the search and analysis platform to determine the features of the object in the image and search for one or more catalog items (e.g., from analyzed merchant catalogs), in order to display matched catalog items from one or more merchant to the user. In one embodiment, when the user clicks on the item, the user is taken to the corresponding merchant's webpage for the item. In one embodiment, where the user uses the search/shopping application with the intent and attention on buying, there is a high click rate (on displayed merchants' items) and purchase of the item (conversion rate) from the merchants. In one embodiment, the number of clicks is monitored/tracked by invoking a tracking module/service, to be used as a basis for payment per click by merchants. In one embodiment, a reliable and accurate image recognition and search provides highly relevant search results which the user is after. This, in turn, yields high click rate and conversion rate for the merchant. Therefore, in one embodiment, the application offers a highly fruitful source of revenue for on-line merchants by presenting to the user highly relevant items from merchants' catalog, in response to the user's query intended to purchase such specific items.
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 239</figref>, a mobile application on a mobile device sends an image (or video) to an application server. In one embodiment, the image includes other metadata such as GPS and/or date/time. In one embodiment, the user logs in and is provided an interface to manage the user's profile and preferences. In one embodiment, the user may choose to save or delete the image on a repository. In one embodiment, the image is analyzed to extract features of the object(s) contained by an image analyzer module. In one embodiment, a search module uses the features identified (and/or other associated meta data with the image and/or the features) to search and determine similar matches to the (catalog) items based on the features and/or metadata associated with those items. In one embodiment, potential matches and/or coded features are determined (e.g., based on similarity threshold on the object and/or one or more features of the object). In one embodiment, a prioritizer module provides one or more factors or rules to select or rank merchants and catalog items. In one embodiment, a match maker module selects the matches based on priority, relevance (e.g., similarity of the features and reliability of the match), meta data from the image and items, context from the user (e.g., a set of priority features extracted from a user interface where the user specifies the features the user places higher emphasis for match). In one embodiment, the feature search module uses the user's priority features to select the potential matches, e.g., by assigning different ranges of tolerances for various features to be matches.
In one embodiment, the matched items are transmitted to the user's device (e.g., mobile application or browser), and the user selects one or more items. In one embodiment, through a user interface, the user selects item(s) to be added to a user's wish list, and the items are stored in a repository managed by the user via a user interface through an application server. In one embodiment, the user selects (e.g., by clicking) the item and the mobile application displays the landing webpage of the associated merchant's website for the user on the user's computing device. The user's selection of the item is indicated to a tracker module which records the click/selections in a repository for accounting and reporting, based on a set of rules for determining whether to count a click.
See &. Shop Anywhere (Plug-in):
<figref idref="DRAWINGS">FIG. B5</figref> of Appendix 4 depicts an embodiment where the browser includes or has a plug-in (or bookmarklet or a code/script) at executes on the browser and/or the user's computing device. Such plug-in identifies images on the webpage (of the publisher). For example, a script is executed that iterate through the document object model or the window object to identify elements associated with images, e.g., based on tags, IDs, and/or source's URL (e.g., ending with .jpg or .bmp). In one embodiment, the images are filtered based on criteria such as size of the image (e.g., minimum size). In one embodiment, the script determines whether to identify the images based on the domain name (e.g., as positive filter to include or negative filter to exclude).
In one embodiment, with a See & Shop browser plug-in (extension), the user has See & Shop capability at his/her fingertip just about anywhere the user browses the Internet, with no need for any special code on the website being viewed.
In one embodiment, the textual descriptions provided with the image on a typical webpage may be inadequate or irrelevant to describe the image on the webpage (e.g., in fashion). One embodiment bridges the disconnect between the user's intention to buy/get an item depicted in an image and the merchant's ability to reliably provide to the user relevant item from its catalog.
In one embodiment, the user invokes the See & Shop plug-in (e.g., by clicking on a button or toolbar) while viewing the webpage with the image (as for example depicted in <figref idref="DRAWINGS">FIG. B5</figref> of Appendix 4). In one embodiment, a script analyzes the document object model to determine images contained (e.g., by iterative or recursive walk thru or query against the object model). In one embodiment, the script communicates the image or an image identifier's) (e.g., URL) to a See & Shop server (e.g., by POST or GET method, or by calling an API). In one embodiment, XML and/or JavaScript Object Notation (JSON) is used to communicate data. In one embodiment, JSON with padding (JSONP) is used to communicate data (e.g., via a function container), e.g., via script element injection into DOM.
In one embodiment, an automatic analysis, search and recommendation platform provides specific and relevant search results from merchants' catalogs. This yields high click rate and conversion rate for the merchant. In one embodiment, a competitive advantage to the merchants results by providing relevant items to the user when the user decides to shop for an item in an ad hoc manner, while conventional ads on the same webpage conversion would miss the opportunity. Therefore, such an application offers a highly fruitful source of revenue for on-line merchants by presenting to the user highly relevant items from merchants' catalog, in response to the user's ad hoc query intended to shop for such specific items.
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 244</figref>, a crawler module receives images and/or content from a publisher's website (e.g., via automated exploring the links or via a template/rule set) or the publisher's content management system (e.g., via API or feed). In one embodiment, the crawled webpages and/or images are cached (including the corresponding websites, webpages, and URIs or other unique identifiers) in a database or storage. In one embodiment, the scheduler module sets up the cached images for analysis, for example by placing a status tag in a database indicating when or the order to run the analysis for an image or indicating whether an image should be analyzed during the next batch process or indicating the image should have a priority process. In one embodiment, the rules for scheduling the analysis are stored in a rules database and/or implemented in a rules engine or code/script. In one embodiment, the scheduling module or one or more of its elements run as background process or as service. In one embodiment, the scheduler initiates an image analysis run by instantiating or triggering an instance of the process. In one embodiment, a scheduler module initiates a crawl task for a website or one or more webpages. In one embodiment, the application server requests/triggers an image analysis directly or via a scheduler module. In one embodiment, the image and/or URL of image is received by the application server from the publisher's website and/or the browser (e.g., via the plug-in or scripts downloaded from the publisher's website and/or a web server). In one embodiment, the application server stores the image and URL (and other meta data) in a storage or database (e.g., indexed). In one embodiment, the application server determines if an image received already exists in its database, based on its URI. In one embodiment, an image is provided by the application server or from the database, and analyzed by the image analyzer engine to identify the features of the object(s) contained in the image. In one embodiment, if the image already exists in the database, the application server uses that image instead of downloading it from the publisher's website. In one embodiment, the image analyzer receives the image from a database or from an application server. In one embodiment, an application server modifies the priority or order of the image analysis for an image scheduled to be analyzed, e.g., when a plug-in or the browser forward the image or its URI to an application server. In one embodiment, the identified features by the image analyzer engine is indexed based on the features and/or other meta data (or description including the image URI) and stored in a repository or database.
In one embodiment, as depicted for example in <figref idref="DRAWINGS">FIG. 240</figref>, the plug-in sends the URL(s) of image(s) from a publisher's webpage loaded in a user's browser. In one embodiment, the user selects which image(s) should be used, via a user interface through the plug-in or scripts. In one embodiment, an application server receives the image from the publisher's website based on the image URL. In one embodiment, the application server determines if the image is already in the database/repository based on its URI. In one embodiment, the image and/or its meta data (including description corresponding to the image) and/or URI are stored/cached in a database or repository (with index for fast lookup and query), for example via the application server or a crawler module. In one embodiment, a feature finder module determines the feature of the image. In one embodiment, the feature finder module queries a database and/or repository to determine if the image is in the database or repository. In one embodiment, a query is made to the repository or database for indexed features/description which contains previously analyzed features and/or description. In one embodiment, such query is made even if the actual image does not reside in a database or repository. In one embodiment, the query to retrieve feature/description uses the image meta data or URI or an identifier (e.g., a primary key) as selection filter for the query. In one embodiment, the identified features are used (e.g., by feature finder module) to search for other items (e.g., catalog items) matching the features (e.g., by a feature search module). In one embodiment, the image is analyzed by an image analyzer module to determine its features, and the features/meta data/descriptions/URI are indexed (by an indexer) and stored in a database or repository. In one embodiment, a feature search module provides potential matches and/or descriptive features and/or the degrees of similarity or reliability of the match to a match maker module. In one embodiment, the match maker module uses the catalog items to provide matched items, e.g., based on priority or ranking factors related to the merchants (such as the pay per click or pay per action amounts, inventory status, and/or inventory replenishing/restocking rate). In one embodiment, the application server provides the matched items to the browser for display to the user. In one embodiment, the user makes one or more selections on the items. In one embodiment, the user selection(s) is provided to the application server (e.g., by the browser and/or plug-in/scripts). In one embodiment, the application server uses a tracker module to track the click events (or selection) made by the user on the item (corresponding to a merchant) in a click database or repository for purpose of accounting or reporting, based on click rules from a rules database or rules engine. In one embodiment, the application server provides landing page URLs corresponding to the matched items along with the matched items and/or in response to the user's selection. In one embodiment, the browser goes to the merchant's catalog item webpage directly via the landing page URI or indirectly via a temporary landing page used for measuring traffic/actions and/or shortening URLs and/or obfuscation to circumvent the attempts to bypass the process.
See & Shop Enabled Webpage:
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIGS. B7</figref>, B<b>8</b>, and B<b>9</b> of Appendix 4, a publisher's webpage is includes (i.e., enabled by) scripts or code corresponding to See & Shop platform. For example, the code/script when executed or rendered in a user's browser provides the user with a visual feedback (e.g., a button or an icon on the display or over an image on the webpage to indicate to the user the presence of the service (even without having plug-in/extension installed on the browser). In one embodiment, when a user selects an image or hover the mouse or selector over the image, a visual feedback provides the user with the area on the image, based on the analysis of the features of an object (e.g., a top or blouse bounding or grounding rectangles). In one embodiment, the item(s) matched to the object in the image is displayed to the user in an overlay or in a hovering pane or window, e.g., with a rolling display of selectable options for the user. In one embodiment, the browser goes to the merchant's catalog item webpage (“landing page”) upon selection the corresponding option to choose. In one embodiment, the browser goes to a temporary forwarding landing page before getting forwarded/directed to the merchant's landing webpage, e.g., for the purpose of accounting/reporting traffic.
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 241</figref>, the content provider/publisher's website directs or provides the user's browsers with scripts corresponding to See & Shop platform. In one embodiment, the scripts/code analyze the webpage (or rendered document object model) to determine images on the webpage, e.g., belonging to the same nodal hierarchy as elements (e.g., HTML elements) having a particular ID or class. In this way, the webpage images may be marked. with elements that are used as nodes/anchors to determine images automatically without modification to the code for the image. In one embodiment, the image code is provided with an ID or class, marking the image for analysis and/or referral and/or ad display. In one embodiment, the script/code provide the application server with the URLs and/or IDs associated with the images on the webpage: or corresponding images to the reference nodes in the tree hierarchy. In one embodiment, the images are retrieved from the publisher's website by the application server based on the URI or other identifiers. In one embodiment, a crawler or a process retrieves images and/or meta data and/or other descriptions from the publisher's website and/or its content management service, e.g., to cache and analyze by image analyzer engine to extract features corresponding to those images. In one embodiment, the application server provides matched items to the browser for display and selection by the user, e.g., at a hovering pane or IFrame. In one embodiment, the retrieved data (e.g., the bounding or grounding boxes for objects in the image) is used by the scripts to provide an interactive user interface overlaid on the image on the webpage, by for example dynamically adding new visual elements of controlling visual elements on the webpage, e.g., via jQuery and AJAX. In on embodiment, data is transmitted between the browser and the application server using XML, JSON and/or JASONP.
See & Shop Anywhere Website:
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIGS. B5</figref> and B<b>6</b> of Appendix 4, a website/interface/portal is provided for users to provide user management interface, e.g., registration and sing-in. In one embodiment, the browser is forwarded to the website via the plug-in and/or the corresponding scripts/code from a publisher's website. In one embodiment, the user uploads images (and/or annotations) of his/her wardrobe via the website and the platform provides suggestions for matches with other items based on analyzed outfits from collection of outfit images (e.g., from popular fashion sites) as well as the complementary matching items from merchants' catalogs. In one embodiment, the analysis and search platform analyzes an outfit and determines the objects in the outfit and makes a relationship between the features of the objects (or the objects) corresponding to the outfit. In one embodiment, such stored/indexed relationship is used to make recommendation for complementary items for an object in an image (e.g., from wardrobe or taken by a camera or from a webpage). In one embodiment, for an object identified in an image, matched items from merchant catalogs are provided to the user (e.g., for blouse or skirt) along with meta data including price, label, reviews, and merchant and description.
In one embodiment, the user uploads an image via website from a local or mobile device or via a URL, for search within the merchants' catalog or other repositories/caches. In one embodiment, the user is provided a wish list to store items of interest in a database or repository, e.g., from the uploaded or referenced image or from a catalog item. In one embodiment, a background process searches and finds matches to the items in the user's wish list. In one embodiment, a process orders the matches based on the user preference, e.g., price, brand, and particular rules based on features of the object.
In one embodiment, the image search uses multiple query images. In one embodiment, the query images are analyzed to ascertain the features. In one embodiment, the common or clustered features of the queried images are used as the basis/filter for search. In one embodiment, the user indicated the particular feature the user is seeking from a particular query image. In one embodiment, the search is cone based on the collection of the particular features specified from various query images (e.g., a strap similar to shoe No. 1, a heel similar to shoe No. 2, a texture similar to shoe No. 3). In one embodiment, the user is provided an interface to select the parts/features from a query image. In one embodiment, the user is provided with an interface summarizing the coded/descriptive features of an object with value of each feature provided as discrete, (semi) continuous, or fuzzy (label or range), e.g., based on the image analysis of the object and/or meta data and/or description and/or annotations and/or (cluster class label). In one embodiment, the user is provided with an interface to modify the features or parameters, e.g., via a fuzzy slider or ruler Fuzzy ruler or via a graphical interface that uses mouse or touch to change the parameters graphically on a graphical model (with anchor points to drag on a path), e.g., to make the sleeve shorter or longer. In one embodiment, the graphical model is posed/chosen/rendered to mimic/approximate the pose of the object in the image. In one embodiment, the user's refined/redesigned parameters/features are used to search for matched images/items in merchant catalog or other repositories. In one embodiment, the search is performed iteratively as the user modifies the feature./parameter value. In one embodiment, the user is provided with search results/items as the user modifies the parameters/features. In one embodiment, the user is provided with an interface to eliminate a feature or add a feature from a list of features based on the context of the object.
In one embodiment, the user is provided with an option to shop with a friend. The user is provided with an interface to put comments or add images (e.g., matches) on a bldg or an item from a friend's wish list. In one embodiment, the user gets a point or incentive to find a match between an object in an image and a merchant's item, via an interface provided from the platform. In one embodiment, the user may share points with friends. In one embodiment, the user specifies his/her styles, by for example uploading outfit images or by categories. In one embodiment, the user is provided results of search based on his/her preferences or styles. In one embodiment, the user is provided an interface to make or give suggestions via a social network to friends/circles/members. In one embodiment, the suggestions are displayed to user(s) with an ad based on merchants' catalog items that match the features of the image referred to or referred in the suggestion.
Intelligent Matching:
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. B10</figref> of Appendix 4 or <figref idref="DRAWINGS">FIG. 248</figref>, an image from a webpage (or another source) is analyzed and features of the object(s) contained in the image are determined via an image analysis engine or manually (e.g., by crowd sourcing). In one embodiment, an image (or multiple images at different poses) from a merchant's catalog item is analyzed and the features of the object(s) contained in that image are determined via an image analysis engine or manually (e.g., by crowd sourcing). In one embodiment, an intelligent matching module (or via a crowd source), a match is determined between the images, e.g., from the publisher's webpage and the merchant's catalog item, e.g., based on the features determined, meta data, and/or description. In one embodiment, the level of match (e.g., reliability or accuracy) is determined based on the closeness of the features and the context of the match (e.g., matching the clothing, shoes, faces, background, characteristics of the people in the image if any). In one embodiment, the match associates the image (and its URI), its corresponding element/node/frame/hierarchy on the webpage, the webpage URI, the domain/website, and/or the publisher identification to the item catalog identifier, merchant's identifier, image (or images) matched with and the corresponding URI(s), the description of the item, and/or the webpage for the catalog item (landing page).
In one embodiment, See &. Shop platform automatically matches the images in publishers' webpages (e.g., in fashion websites) to the items in merchants' catalogs. This match is of great value to both merchants/advertisers and publishers: <ul id="ul0107" list-style="none"><li id="ul0107-0001" num="0000"><ul id="ul0108" list-style="none"><li id="ul0108-0001" num="2939">Merchants/advertisers would be willing to bid/pay higher CPM (cost per impression) when they know that the click though rate and conversion rate on their ads will be higher and overall will reduce their cost. In addition, merchants are also willing to pay higher CPC (cost per click) because the landing page will point to the very item that the consumer is looking for, based on the interested image on the publisher's website.</li><li id="ul0108-0002" num="2940">Publishers are willing to receive less CPC (cost per click) for ads that are highly relevant to the consumer's interest, because the higher click rate for the relevant ads overall increases the revenue for the publisher for those ads. In addition, the publishers are willing to demand less CPM (cost per impression) because the relevant ads to their content of their webpages will appear as less of the distraction to the users of the website and more of a convenient service for them to purchase.</li><li id="ul0108-0003" num="2941">See & Shop can capitalize on these market positions for ad and create or form a basis for a targeted ad exchange based on image matching.</li></ul></li></ul>
In one embodiment, See & Shop platform provides a subscription or transaction based service to merchants/advertisers, publishers, and/or ad exchanges to evaluate the number of or quality of matches (e.g., in form of a summary report) or the actual matches. In one embodiment, an interface is provided for merchants to compare two different items to the number of matches meeting a quality threshold to publishers' webpages. One embodiment integrates the user traffic data to those website to provide/estimate/predict/compare the advertisers/merchants' relative potential revenue from those items. In one embodiment, an interface is provided to predict/estimate relative potential ad revenue for publishers from different images placed in the content of their webpages, by determining the number and quality of the matches with merchant's items. In one embodiment, merchants/advertisers and/or publishers query the platform to obtain such estimates, based on subscription or transactional basis. In one embodiment, the predictive module uses the heuristics, historical data on revenue generation, click rates, relevance, sites traffic, context to determine the user's behavior, e.g., click rate and conversion rate on a particular ad, e.g., based on similar ads/categories appearing on similar websites from similar merchants at similar price ranges.
Matching information, in one embodiment, is the basis for a new marketplace for targeted and highly relevant ads based on the match between the webpage images and items in merchants' catalogs. In contrast to irrelevant and ignorable ads, the high relevancy of the matched ads turns the user's interest on the webpage/image; into intent to shop.
Crowd-Based Matching:
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIGS. B11</figref> and B<b>12</b> of Appendix 4 or <figref idref="DRAWINGS">FIGS. 249 and 250</figref>, a crowd source is used to find matches between images from publishers' websites and merchants' catalog items. In one embodiment, an application and/or a browser plug-in provided to a user to identify or select images from various (e.g., publishers') websites/webpages. In one embodiment, the user activates the plug-in, e.g., by clicking on a toolbar for the plug-in. The script/code associated with the plug-in processes the user's action (e.g., mouse click or touch) as an event within a document object model or window to determine an image selected by the user (based on the position of the event). In one embodiment, the script/code determines the source/URI of the image, associated meta data or description (based on for example predetermined or learned template associated with the webpage), the webpage URI, the domain, the publisher (e.g., based on matching the domain to a publisher in a database, or entry by the user), and/or the hierarchical node where the image appears on the webpage. In one embodiment, a plug-in or an application is used to similarly let a user pickup/identify images and webpages corresponding to an on-line catalog item from a merchant. In one embodiment, the user specifies a match between the images from the publisher's webpage and the merchant's catalog item via an interface for entering the match, e.g., by giving the user the ability to run through, search and filter the picked up records based on meta data., description and/or features obtained from automatic image recognition. In one embodiment, an automatic process chooses the images from catalogs and publishers and present to the user to determine the potential matches, the degree of match, the degree of match for various features, and/or annotations by the user. In one embodiment, the match determined by a user is automatically presented to another user via a user interface, along with other images/options to verify the match (e.g., via consensus). In one embodiment, a record of consensus and rejections are monitored per user to determine the effectiveness of the user's matching capabilities or monitor the user's improvement over time. In one embodiment, when a user makes a match between an image (e.g., in a publisher's website) and another (es., in a merchant's catalog), the user is automatically provided similar items from the same or different merchant(s) to the user to indicate the degree of similarity between the matches or relative degree of similarity between the matches for overall and per various features presented. In one embodiment, more matches are created and stored based on the user's input for such options. In one embodiment, the user matches of input are used to train one or more components of an image recognition engine, e.g., in an iterative (stochastic) mode or batch mode.
In one embodiment, the result of automatic match and crowd source are reconciled together along with their respective reliability factors. As the reliability of the automatic match increases, in one embodiment, the volume of matches are increased. In one embodiment, the matches are provided to an image-based ad/referral engine, e.g., for service to an ad or referral network.
Extended Matching:
In one embodiment, a match (e.g., provided by a user or automatically by a feature matching search engine) is extended to other matches, by comparing an image signature (e.g., block hash/signature:) and searching for other images with the same or very similar signature (i.e., finding the instances of the same image or a cropped portion or a scaled version or somewhat) for example in an index repository or database. In one embodiment, the catalog items and webpages (e.g., of publishers) are crawled or gathered and a hash signature from the images associated with them are stored in an index database or repository based on the hash signature, the URI of the page and/or image. In one embodiment, a match (whether generated automatically or via. crowd source) is extended to other matches by comparing the signature of the images associated with the match and searching for other such images in the repository/database have the same or similar signature indicating that the images are of the same content. In one embodiment, new matches are expanded based on other combinations between the images with the same or similar signature. For example, when the same image (with the same signature) appears on another publisher's website or webpage, the match is extended or a new match created for that image/webpage/website/publisher. Also, when a catalog item from a manufacturer or a brand in a merchant website uses the same image (e.g., provided from the brand/manufacturer) as another merchant for the same item, then a match involving such a catalog item is extended and or created for the other catalog item. In one embodiment, matches are extended based on images appearing in social/bookmarking networks. In one embodiment, a user or an automated process determines a match between an image appearing in a social/bookmarking network (e.g., Pinterest fashion). In one embodiment, the web link URI (from where the image was extracted/pinned) and/or meta data (e.g., associated description and/or number of associated pins) are queried or extracted via a process (e.g., by crawling, using template or a macro, script/plug-in, or an API) from the social network interface. In one embodiment, a process identifies the image on the referenced webpage (e.g., at a publisher's website) based on, for example, signature block. URI, or description/meta data. In one embodiment, the referenced image may also have links/bookmarks/pins in the same or other social/bookmarking network. In one embodiment, a process determines the additional links to social/bookmarking network to identify instances of the image in (referenced/pinned), e.g., recursively using a crawler and repeating the process. The found instances are used to extend the matches.
Match Extension Via Image Hash/Signature:
In one embodiment, the matches are extended by querying an image signature from a repository (e.g., indexed) of image signatures associated with images/URIs. In one embodiment, a search engine, e.g., a search-by-image module, is used to obtain one or more instances of the same (or portion of or scaled or with slightly intensity/color modified) image with, for example, their associated URIs/meta data/description/webpages/websites. In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 247</figref>, a process crawls/scans a webpage (and images). In one embodiment, a process creates a set of hash/signature keys for an image. In one embodiment, the image hash/signature(s), URI, hash/signature ID, meta data, and/or description are stored in a (e.g., indexed) database or repository. In one embodiment, a service provides a search by image (hash/signature), e.g., by determining the signature/hash for the queried image (e.g., uploaded or retrieved by a link) and searching the signature/hash in an indexed database, or looking up the image (or it hash/signature) in a database (indexed) based on a URI. In one embodiment, the service or an extracting process provides the signature ID or hash ID (unique or primary/composite key) based on the query. In one embodiment, the hash/signature ID (or a code/script related thereto) is associated (e.g., in a database) with one or more matches that are associated with the image corresponding to the hash/signature ID. In one embodiment, an ad finder module determines/constructs a (relevant matching) ad with a merchant's catalog item/image to appear in the ad when a user is viewing the webpage with the image, e.g., by resolving/selecting the matches (e.g., by IDs) based on association with hash/signature Ms associated with the (e.g., publisher's) image/webpage URI or identifier. In one embodiment, the ad network scripts for the webpage (e.g., executing on the client side or server side) invoke the lookup or the query to determine whether a image-based match (ad) is available for the image or webpage (e.g., based on the query whether a hash ID associated with the image also has any associated match ID in the database).
In one embodiment, the match reliability and/or context is stored in a database or repository. In one embodiment, an ad selection process uses the reliability of the match and/or the context in selecting among various ads.
Image-Based Ad for Tagged/Marked Images/Links in Social Network:
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 246</figref>, a user tags an image or webpage (e.g., via tagging buttons such as Facebook's “Like” or Pinterest's “Pin” or via script/plug-ins/bookmarklets) from a publisher's website. In one embodiment, the tagged image/video/link appears in the corresponding social network page. In one embodiment, the image/page in publisher's website is crawled/scanned and image(s) identified, e.g., by an automated process. Social buttons/bookmarking elements are identified for a given set of social network, e.g., by identifying the HTML tags within the webpage. In one embodiment, unique characteristics of the tags are determined, e.g., the publisher's ID and application ID, Type identification, URI of the image and/or the page. In one embodiment, the image is analyzed to determine the features of the object(s) within the image. In one embodiment, one or more features are used to search and match with merchants' catalog items (e.g., based on features, descriptions, and meta data). In on e embodiment, the social network/bookmarking identifier's) is associated with the match and/or indexed for quick look up in a database or repository. In one embodiment, the social network platform manages/stores the tags (e.g., liked links, image URI, referenced webpage/website info) in a repository/database. In one embodiment, a social match finder module/process uses identifying attributes of the image/video/link (e.g., the image/page URI, publisher's ID) that associate these to the publisher's webpage/image, to query for one or more matches associated with the publisher's webpage/image. In one embodiment, an ad is selected and setup via an ad maker module for display via an ad script on the social network webpage on or at the vicinity of the displayed tagged image/video/link. In one embodiment, the ad scripts are associated with an application running on the social network platform. In one embodiment, the impressions of the ad and user click/selection of the ad are tracked automatically by executing a script or calling an API.
Block Signature:
In one embodiment, a process makes a set of signature/hash from an image, for quick search and indexing. In one embodiment, various transformations and/or aggregate functions are used to generate signature from the pixel map of the image, e.g., DCT (discrete cosine transform) wavelet, averaging, contrast, variation measures, and/or intensity measures. In one embodiment, an image is reduced to a thumbnail to take a signature, e.g., by down sampling (fat pixels) or resolution reduction (e.g., spatial and/or color resolution). In one embodiment, an image is fuzzied or unsharpened, e.g., via convolution with for example a Gaussian. In one embodiment, a process uses edge detection (e.g., Canny, Canny-Deriche, Differential, Sobel, Prewitt, and Roberts cross), corner detection (e.g., Moravec corner detection, Harris operator, Shi and Tomasi. Forstner corner detector, Level curve curvature, Laplacian of Gaussian (LoG) feature detection, difference of Gaussians (DoG) feature detection, and determinant of the Hessian (DoH) feature detection, affine-adapted interest point operators, Wang and Brady corner detection, smallest univalue segment assimilating nucleus (SUSAN), Trajkovic and Hedley corner detector, accelerated segment test (AST) based feature detector, and features from accelerated segment test (FAST)), blob detection (e.g., LoG, DoG, DoH, maximally stable extremal regions (MSER), and principal curvature-based region detector (PCBR)), ridge detection, Hough transform, affine invariant feature detection, affine shape adaptation, Harris affine region detector, Hessian affine region detector, Scale-invariant feature transform (SIFT), speeded up robust features (SURF) detector, gradient location and orientation histogram (GLOH), histogram of oriented gradients (HOG), scale-space, and Pyramid. In one embodiment, an image is segmented to one or more (e.g., overlapping) regions, such as rectangle/blocks, and a signature/hash is obtained for each block. In one embodiment, the block follows a sliding window (up and/or down) with threshold. In one embodiment, hash/signatures are associated with context dependent weights. In one embodiment, the block size and number of blocks are dynamically chosen. In one embodiment, the block size is fixed or proportional to the image size. In one embodiment, the block size is determined based on the intensity and/or color/grayscale variation/histogram.
Incentive Based Crowd Matching and Point Trading Platform:
In one embodiment, the user receives an incentive for providing one or more matches between a given image (e.g., an image from a publisher's webpage) and merchants' catalog items via a user interface. In one embodiment, the user receives an incentive, for example, the product for free or at a discount, e.g., based on the performance of the provided match to generate clicks from users/consumers and/or to generate sales (or action) for the item or for the merchant. In one embodiment, a payment from merchant to an ad network is made based on cost per click or pay per click (CPC or PPC) (e.g., specified as a bid for advertising or referral) or cost per action (CPA) (e.g., commission specified in form of per action or per sales price). In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIGS. B13</figref> and B<b>14</b> of Appendix 4 or <figref idref="DRAWINGS">FIGS. 251 and 252</figref>, users provide matches to the platform via a user interface, and the scripts from the publisher web pages (and/or the scripts from See & Shop platform) and/or plug-in show the ads or referral marks (e.g., icons) to a consumer when viewing the publisher's webpage. In one embodiment, when the consumer selects the referral icon, ad, or otherwise selects an item displayed on the webpage (or overlaid on it), e.g., based on the ad or referral match based on image, the browser is forwarded or taken to a landing page on the merchant or advertiser's site, e.g., via the ad network (e.g., based on Shop & See platform). In one embodiment, a fraction of Pay-for-Click or commission amount from the advertiser for the services of the ad network/See & Shop platform is provided, for example, as point(s) to user, e.g., up to the value of the item. As more consumers click on the ads or make purchases at the merchant based on the referral or ads, the user earns more point corresponding to the match provided by the user. In one embodiment, users trade points using a point trading platform (or module). For example, the module is accessed via See & Shop website when the user logs-in. In one embodiment, other users can sign up and participate as well in trading points with currency. In one embodiment, a valuation module predicts the future value of a point for a match based on the heuristics from consumer's clicks and conversions. In one embodiment, users are provided an interface to estimate the time it takes for the points for a match to grow to full value. In one embodiment, a future (estimate) value of points is provided, e.g., via a user interface, based on heuristics, e.g., the click through rate and/or conversion rate, the type of publisher's website, the time webpage or content was created/updated and/or the number of days or clicks previously done on the ad since ad was in place on the webpage (and/or website and/or other websites).
In one embodiment, the point value corresponding to a match is modified based on trading between users, e.g., via a point trading platform where the users log-in to manage and trade the points. In one embodiment, other users may participate in the point trading who have not created a match, through a user interface viewing what points/matches are up for trading. In one embodiment, an interface is provided for users to hedge against or for future point value of a match. In one embodiment, a new point value is assigned to a match based on the point trading. In one embodiment, a user interface is provided for the users to assign the matches. In one embodiment, a user interface is provided for specifying a point threshold for a match, such that when the point value reaches (or exceeds) the threshold, a process allocates the excess point to another eligible match. In one embodiment, a minimum point threshold (e.g., a ratio) is used to specify the minimum points required before the points are eligible for trading on the match (e.g., points added via trading). In one embodiment, a maximum point (cumulative) value/ratio is used for a match to determine the eligible points allowed for trading from the match. For example, in one embodiment, for a maximum point on a match set at (1+x).(Full Point Value), the amount of point earned on the match allowed to be traded out is (x . Full Point Value). In one embodiment, there is no restriction on the trading out the points that were previously traded in for a match.
In one embodiment, a user uses the full point of a match to purchase (e.g., for free) the item (associated with the match or an equivalent item) from the merchant through an e-commerce interface or via a coupon generated based on the points associated with the match. In one embodiment, the user uses a partial point on a match to purchase an item from the merchant at a discount. In one embodiment, upon usage of the points to purchase an item, the points are released back to the platform (i.e., out of the trading). In one embodiment, the user can opt for various coupon options having different point values, e.g., at 25%, 50%, 75% and 100%. In one embodiment, the user can use the point for purchase based on the coupon ratios available for the match and for the current point value. In one embodiment, a user can gift his/her points on a match to another user (i.e., one sided trade).
In one embodiment, the user is given different levels of points (e.g., compared to full value of the item) depending on the level of the task, such as finding the match, finding a number of matches for the same image, judging the match found by someone else, and selecting a match among the choices (e.g., automatically) presented to the user by a selection interface. In one embodiment, performing different tasks (e.g., judging a match suggested by someone else) is a prerequisite for a match made by the user to be eligible for earning point or eligible to earn point for the user (e.g., while being eligible to be gifted or to earn points for other uses).
In one embodiment, catalog items and/or publishers' webpages/images are gathered/fed and/or crawled and stored in a repository. In one embodiment, an interface is provided to the user (e.g., for a crowd source) to specify a match, one embodiment, the user uses a plug-in/script or an application to pick/tag/mark an item (e.g., webpage, image, and/or description) on a publisher's website. In one embodiment, the user uses a plug-in/script to pick/tag/mark an item from a merchant's catalog. In one embodiment, a user is provided with an interface to associate merchant's catalog items with publisher's images/webpages, such as a graphical drag and drop interface for arranging the corresponding images side by side or in a hierarchy. In one embodiment, for example as the automated analysis engine is getting trained, the user is provided with suggestion from the automated search engine from the merchant catalog items (or other repositories) for the user to verify the match with a publisher's image or specify degree of match (e.g., based on various features of the object in the image). In one embodiment, a user interface is provided to a user to select matches or similar items from the merchant's catalog (or multiple merchants' catalogs), for example, by automatically selecting items and displaying them to the user for selection of similar objects or features and the degree of similarity or dissimilarity (e.g., graphically via a fuzzy slider/ruler or a selection of checkboxes/buttons associated with choices).
In one embodiment, the matches provided by the user are automatically compared for consensus of the result. In one embodiment, various combination of images are provided to the user to eliminate/reduce inconsistencies or verify the choices among the users, e.g., combining two or more images from one selection with other images and showing the new selection to the same or other users for further selection and input.
In one embodiment, an interface is provided to mark and select matches to be consolidated in earning points among the selected users (e.g., with verified consensus of the users), for example to allow the points to be automatically consolidated (for example for a charity or for benefit of a user or a third party).
Image-Based Ads for Video:
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 245</figref>, a video is analyzed (e.g., by scene/flame via a scene selector module) and the timing information (e.g., from video track) and object features and spatial information (e.g., via an image analyzer engine) are extracted. In one embodiment, the timing and spatial information are stored in a database or repository to be used for example in creating an object track (e.g., a fashion track) for the video. In one embodiment, the features/description extracted are stored in a feature database (e.g., indexed) to be used for example for matching with other item/images (e.g., merchants' catalogs). In one embodiment, a track generator module, assigns tags/IDs (e.g., reference or key identifiers (Ref. ID)) to a track (e.g., fashion track) by associating the timing information to the tags. In one embodiment, a spatial track (e.g., fashion track) is setup to carry the spatial information (e.g., the grounding box of the object or an outline of the object, for example per frame or per multiple frames, or an aggregate box covering the object in multiple frames) and the attributes such as the coordinates and types of the spatial indicator (outline, rectangle, ellipse/oval, region/blob/silhouette of the object). In one embodiment, the object (e.g., fashion) track (including its media information such as blob description) is added to the video, for example by creating a new video or by creating a link to the track stored separate from the video using a unique identifier/link for later retrieval.
In one embodiment, the video is distributed by various methods such as publishing on web, as part of TV/cable programming, or through a content distribution network. In one embodiment, a user views or playbacks the video (e.g., in TV, DVD, browser or a viewing application). In one embodiment, the user interactions are captured, e.g., via a TV/multi gadget remote control from the TV/cable box or from the service provider capturing the user's input, or via the playback application/browser. In one embodiment, the user selection/interaction is captured for example including the video identifier, selection in time and location, and/or the Ref. ID corresponding to the user's selection.
In one embodiment, analyze, search, and match maker modules provide and/or store the match between the features/descriptions of the objects in the video with images/items (e.g., from merchants' catalogs). In one embodiment, the matches (or the features) are associated with Ref. IDs to provide an association hook to the video (fashion/object) track for fast lookup when a user selects an item, e.g., during the video playback.
In one embodiment, upon the user's selection, one or more matched catalog items are shown to the user in an interactive display (e.g., on the same webpage, or at the corner overlaid section of the TV screen), for example based on selection of the items, for example, by an ad network or referral network, for example by using the bidding information from the merchant/advertisers/agencies and the Ref. ID extracted from the user's selection and querying the corresponding matches.
In one embodiment, the matched items are automatically displayed to the user (e.g., at the side/corner of the screen or overlaid on video playback) without the user first selecting an object on the fashion/object track. In one embodiment, the playback triggers the auto display of the ads/items/images based on the timing of Ref. IDs from the object track and the matches associated with those identifiers. In one embodiment, an indicator of available match is displayed to the user during the playback for the user to select (if interested), for example, based on the spatial coordinates and types associated with the object/fashion track. In one embodiment, the textual information extracted from the matches are encoded in a text track (similar to the closed caption) and displayed to the user during the playback, with its the timing based on the object's timing from the object/fashion track.
In one embodiment, where the video is interrupted for ad display by the content/service provider, a set of processes render and display interactive ads based on images (e.g., cropped) from the video and merchants' catalog items that are matched to those images from the video, based on Ref. ID.
Image Ad & Referral Networks:
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIGS. B11</figref> or B<b>15</b> of Appendix 4 or <figref idref="DRAWINGS">FIG. 249 or 253</figref>, an ad network/exchange based on matching images is used to display merchant's catalog items within content of ad next to an image on a webpage, twit, email, document, or other forms of content delivery. In one embodiment, the ad network chooses between the various merchants' catalog item for an ad, based on for example, merchant's bid on PPC related to a collection or a subset of its catalog items, merchant's bid in fix amount and/or based on item's sales price, relevance of context, reliability and degree of the similarity in match the match, user's preference or perceived preference to a feature or a type/class of object (for example, in a multi-object situation such as an outfit that may produce matches with various classes of items), relevance factors, merchant's score/traffic, merchant's in-stock status for a matched item, merchant's re-stocking rate for a merchandise, publisher's restriction/filters to exclude certain or certain types of merchants and merchant's restriction/filters to exclude certain or certain types of publishers. In one embodiment, for example, the ranking order is higher for more relevant match, more reliable match, more similar match, in-stock status, higher merchant's score, and/or higher merchant's bid or commission (based on impression, click through, or conversion—with heuristic rates used for normalizing the bid basis and weights associated with preference between such bases). In one embodiment, a ranking function is calculated based on for example, weighted dependency on such ranking factors with linear, quadratic, polynomial, or exponential, or reciprocal (e.g., inverse of powers of inverse) dependencies. In one embodiment, the weights and dependencies are modified by automated process (e.g., via optimization methods or genetic algorithms), for example, to optimize for maximum sustainable return.
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 242</figref>, an ad network or a referral/commission network based on image is used to associate the publisher's image (on a webpage) to a merchant's catalog item. In one embodiment, one or more scripts or codes are downloaded to the user's browser or application (or executed on server) that are associated with See & Shop platform for ad/referral network. An ad server provides configured ads based on standard configurations (sizes, location, and appearance (color/font/fields), personalization for user and personalization of message) or custom configuration provided for example by merchant/advertiser/agencies or publisher. An ad configuration repository is used for example with a user interface to specify or provide the configuration, e.g., in form of script/XML/HTML code/form.
In one embodiment, a tracker module tracks the number of impression of the ad and click through events based on click/impression rules in one or more databases, for example, for financial, reporting, or aggregation purposes. A financial module determines the amounts receivable from merchants and communicates the invoice for a period (e.g., daily, weekly, monthly) and/or based on a threshold amounts to the advertiser/merchant, e.g., via an invoicing/payment module or system. In one embodiment, a portal for merchants/advertisers or publishers are provided to sign up, sign in, and manage their profiles and view their accounts via an account management module, and upload or provide their bids or parameters (e.g., daily limits, exclusions/filters) via a user interface or an API.
In one embodiment, as for example indicated by <figref idref="DRAWINGS">FIGS. B11</figref> and B<b>12</b> of Appendix 4 or <figref idref="DRAWINGS">FIGS. 249 and 250</figref>, a process generates product demand forecast to matched merchant, based on the traffic, bid, and heuristics. For example, when an image/webpage from a high traffic website is matched with a merchant's catalog item (or a process indicates that matches with such an item or class of items exists with an aggregated high traffic websites), based on one or more reporting threshold amounts, the merchant is automatically receives such notice with for example the report indicting the demand forecast for the item based on the matches to help inventory management and ordering process. In one embodiment, this service is provided as subscription and/or per transaction and/or per commission. In one embodiment, such matches with other merchant's catalog items are used by a process to report to affiliated merchants/advertisers with demand forecast for inclusion of the product in the inventory. In one embodiment, the newly added item to the inventory is reported by the merchant via an API call or data communication to the See & Shop platform (e.g., along with the report ID) to extend the match to the newly added item. In one embodiment, the newly proposed match is automatically checked to verify the image/description match to reduce mistakes or abuse.
In one embodiment, merchants/advertisers/agencies bid for an ad corresponding for an image/webpage of a publisher based on the match information provided to them. In one embodiment, publishers bid for referral/commission/PPC from a merchant/merchant catalog item(s) based on the match information provided to them. In one embodiment, the bids are resolved based on the supply (of the merchant/advertiser's ad budget or of the publisher's limited real estate for ad di splay) and demand (of advertiser for the webpage ad or of publisher for a particular merchant/catalog, item(s)). In one embodiment, the supply and demand are resolved in an ad/referral exchange/network based on relevance, traffic volume, context, reliability and similarity factors, and optimization of the return.
In one embodiment, the publishers are paid for a portion of the referral/commission/PPC for hosting the ad on their webpages. In one embodiment, the publishers (e.g., weblogs) share their ad revenue with the contributors of the content (e.g., the blogger).
In one embodiment, the users act as direct or indirect publisher's of the content, e.g., when tagging and recommending to their friends or others certain images or webpages, e.g., via social networks, bookmarking, twit, email, and sharing personal images. In one embodiment, an ad or code/script accompanies the user's communication to display matched items based on the image/text in the content of the user communication. In one embodiment, the click rate is higher for the referral or ads related to messages or communications and from trusted sources and individuals. In one embodiment, the messages are send/posted on behalf of the user from the See & Shop platform, e.g., by using the user's login authorization to post messages to the social/bookmarking networks. In one embodiment, the posted message includes links/scripts (e.g., in addition to static content) associated to the platform, such that when viewed by recipient or others, the script/code execute and the ad content is provided to the viewer and the accounting for the views/impression is made by a tracker module.
See & Shop Ads:
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIGS. B16</figref> and B<b>17</b> of Appendix 4, Ads based on matching images (based on features of objects in the image) automatically provide relevant images of items from various merchants' catalogs that match the items in an image on a webpage to a user viewing the webpage. In one embodiment, the scripts supporting the ads are incorporated in the webpage or fed to the browser to place the ads next to or at the vicinity of the image(s) on the webpage, e.g., by the content provider of the website, e.g., in order to participate in a highly effective ad revenue sharing based on such Ads. In one embodiment, the ad essentially lets the content provider (e.g., fashion or news site) offer See & Shop capability to its users, based on the content it provides while it shares a portion of the ad/referral revenue. In conventional ad models, the content providers have little control over the ads appearing on their fashion webpages (such as a political ads, miracle diets, or walk-in tubs). These conventional ads are at best related to previous webpages visited by the user (or others sharing the Internet connection from the same private network), e.g., tracked via tracking mechanisms such as Google's DoubleClick cookies. Such ads have been proven to produce relatively low click rates.
In one embodiment, the users click rate on ads are increased based on user's interest in the images viewed on the publisher's webpage and by providing relevant ad based on the image the user is likely to be interested in, at the time the user is actually viewing the image on the webpage. For example, for fashion, this is because, the user is potentially interested in the content of fashion webpages (which are highly visual, yet difficult or inconvenient or impractical to describe by words in details) which most likely includes the images on the webpage; therefore, the user is potentially more interested in the ads that reflect the items in such images than the irrelevant ads or those remotely related to the subject of the webpage. Also, the user may not view such highly relevant ads as distracting, especially when they are inviting the user to shop what the user likely finds interesting on the webpage to begin with (e.g., fashion and celebrities wearing such or visually similar items). In one embodiment, the user is more likely to shop for the items the user immediately sees on the interested images, especially if such items are readily displayed on the ads on the same webpage, the click rate and conversion rate (to sale) with such Ads is considerably higher. This translates to more effective advertisement and a new basis for revenue for the image ad exchange/network.
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIGS. 242 and 243</figref>(<i>e</i>), a set of processes (e.g., automated) scan/crawl the publisher's webpages and/or merchants' catalog items, analyze the features/descriptions of the images, search the features/descriptions and determine potential matches, select one or more matches for display in an ad on a webpage in vicinity or on an image associated with the match selected. In one embodiment, the scripts/codes for the ad on the webpage (corresponding to the ad network) execute on the user's browser (client side). In one embodiment, additional script/code/data are loaded e.g., from ad serve or ad network platform, e.g., to manage the user interface for the ad for the user and provide the links, referral landing page, graphics, and messages (e.g., personal messages). In one embodiment, a temporary landing page of link is provided to the user interface, such that when the user clicks on the ad (or a portion thereof), the browser is forwarded to a resource on the ad network to, for example, track the click, and/or provide a landing page forwarding link to the merchant's catalog item. In such a way, in one embodiment, the potential for abuse is reduced.
In one embodiment, the scripts on a webpage (e.g., publishers) when executed invoke a process in the platform (e.g., by calling a resource or an API) to detect whether the webpage/images(s) were scanned/crawled recently (e.g., based on a configuration for duration). In one embodiment, a crawling session is scheduled or performed to scan/crawl the webpage (or website), as for example depicted in <figref idref="DRAWINGS">FIG. 244</figref>, for an embodiment.
In one embodiment, when there is no match immediately available for ad based on image(s) on the webpage (e.g., publisher's), the platform/ad exchange/ad network uses other methods to provide context based ads for display. For example, a process uses other matches for the webpages on the same or other websites, e.g., within the same category/context (e.g., based on the words/text on the webpage such as titles). In one embodiment, the platform defers or falls back on an ad network/exchange based on words, by providing the ad configuration/page URI/publisher's ID (for the ad network) to the fall back network, and provide the ad content to the webpage (via script) provided by the fall back ad network.
In-Image Ads or Referral:
In one embodiment, the referral or ad scripts on a webpage or a plug-in script (in a browser) displace overlaid icons/markers/buttons/ads on the corresponding image, as for example depicted in <figref idref="DRAWINGS">FIGS. B17</figref> or B<b>7</b>-B<b>8</b> of Appendix 4. In one embodiment, the script uses jQuery and/or AJAX and/or JSON and/or JSONP to achieve user interactive responsiveness and communication with the platform servers. In one embodiment, the in-image ads/referrals are invoked by user selecting an icon/button overlaid on the image (for example as depicted in <figref idref="DRAWINGS">FIG. B17</figref> of Appendix 4) or in vicinity of the image (as depicted on <figref idref="DRAWINGS">FIGS. B7</figref>, B<b>8</b> or B<b>9</b> of Appendix 4) or in a tool bar (for example as depicted in <figref idref="DRAWINGS">FIG. B5</figref> of Appendix 4). In one embodiment, the in-image ad invocation includes events such as mouse over, opening/refreshing the webpage, and/or based on time an number of times (randomly or configured). In one embodiment, an in-image ad/referral pane or overlaid element slides up or appears (e.g., limited to a region on the image) and/or dismissed/disappears (e.g., by user action on a close box/button and/or based on time). In one embodiment, other matches show up via sliding up/down within the overlaid region (e.g., at the bottom of the image) or displayed in an automatically rolling fashion (e.g., based on a configurable time duration) as for example depicted in <figref idref="DRAWINGS">FIG. B17</figref> of Appendix 4. In one embodiment, the user is provided with an interface to manually roll the matches, click to go to See &. Shop website (with the parameters indicated by the image and webpage URI or assigned identifiers), click on items to go to merchant catalog item webpage (i.e., merchant's landing page) (e.g., directly or indirectly).
In one embodiment, the publisher does not need to replace dedicated ad real estate on a webpage from one ad network to another. In one embodiment, the image ad/referral network use overlaid panes/lFrames/Windows/regions over or close to the image to display the items/ads.
Extension of Word-Based ad Network (Image Referral Network & Image Ad Network):
In one embodiment, a service/process provides (e.g., supplements) the advertisers' bids on word-based ad networks with the description of the catalog items, e.g., as an additional bid on behalf of the merchant/advertiser/agency. In one embodiment, a service/process provides (e.g., supplements) the publisher's webpage word representation/signature (e.g., extracted by a crawl/search engine) by the description of the objects contained in the image(s) on the webpage, e.g., on behalf of the publishers for example if participating in bidding process. In one embodiment, the ad network uses the supplementary information for matching based on words and/or bidding on words, e.g., in determining relevance and ranking for selecting an ad to display.
In one embodiment, once the word ad network selects, for example, a regular/generic ad from a merchant/advertiser for display on a publisher's webpage, a process is used to query whether there is any match based on image from the same merchant/advertiser and the publisher e.g., based on their IDs or domain name of merchant's generic landing page and the publisher's website). In such a case, the word ad network makes a request (e.g., via an API) to display (e.g., more relevant) an image-based ad from an image ad matching engine (as for example depicted in <figref idref="DRAWINGS">FIG. B10</figref> of Appendix 4 or <figref idref="DRAWINGS">FIG. 248</figref>). Then the ad network renders the ad based on the matching information provided by the matching engine (for example, landing page, images, labels, features, and/or relevance, as depicted in <figref idref="DRAWINGS">FIG. B12</figref> of Appendix 4 or <figref idref="DRAWINGS">FIG. 250</figref>) to display on the user's device (e.g., in a browser, an application, or the application launching pad interface). In one embodiment, the word ad network delegate the ad display to the image-based ad network, e.g., by receiving the script/code/parameters used to display the image-based ads on the user's device. In one embodiments, the image-based ad/referral scripts/codes are executed (for example on the user's device) to display the image/catalog item on the ad. In one embodiment, a match ID (e.g., temporary placeholder ID/link/URI) is provided to the word ad network to relay to the browser (e.g., along with corresponding scripts) so that when scripts execute on the browser, the temporary ID is provided to the platform for retrieving the match for display as an ad to the user. In one embodiment, the temporary ID is used so that the word ad network is prevented to perform data mining on the image-ad network/platform. In one embodiment, the request to process an ad (e.g., by a script) on the image-ad network is check to determine whether the request is from a user's browser/application or from a process in the network (e.g., based on the http headers/signatures and IP addresses), in order to eliminate or reduce data mining.
In one embodiment, the word ad network is extended through a hint attribute/parameter. In one embodiment, a publisher adds image-based scripts/elements to its webpage for downloading to the user's web browser (and/or executing on the serer side). The script locates the hint attribute associated to an element associated with the word ad network/exchange (e.g., on the document object model or the source code), for example by querying for the signature tags/classes. In one embodiment, a code/script supplements the hint attribute with description related to the image on the webpage (e.g., based on the image feature analysis and description). In one embodiment, a code/script supplements the hint attribute with description related to one or more items from merchants' catalogs (e.g., based on matching). In one embodiment, a script/code tags/provides/supplements the hint attribute with an identifier associated with hints based on image (e.g., stored on image-based ad/referral network/platform). In one embodiment, the word ad network processes the hints (supplemented) and uses the descriptions/words for better matching with the associated merchant (or their catalog items) for more relevant ad (e.g., as a heightened relevance factor) in auction for word process to select an ad to display. In one embodiment, the identifier is queried by a process to provide hint records obtained for example based on image analysis. In one embodiment, the platform is queried for a hint for a publisher's webpage/image even if an ID was supplemented by a script (e.g., on the user's browser).
In general, the image adds a third dimension to the search engine, in addition to text/tags and cookies for tracking, that people/industry uses right now. So, the search becomes more powerful, now. In addition, people are more visual, and image can carry a lot more information than text, or it is harder to describe it by text or by tags. So, we have shown/taught here in this disclosure the frame works/systems/methods for Image Ad Network and Image Referral Network, the first in the industry, using our General-AI based platform (ZAC Image Recognition and Search Platform), to increase e-commerce and Internet usage drastically.
The ranking of websites and images can also be done on the ad network, based on at least 3 parameters/scores, or combination of them: relevance degree/score, the amount that people bid on to display their images (the higher the dollar amount, the higher the chance or frequency for display of that image), and/or the popularity of the image (e.g., how many people liked it or forwarded that image, e.g., as a score). We can define a function or table or curve to model the above 3 dependencies, e.g., as F(x,y,z), based on the 3 scores, x, y, and z, discussed above, which one should generally hid from the users, as they can play games on the system to cheat the ad/referral networks, as it is well-known in the ad industry right now.
This also can have auction or reverse-auction or Dutch-Auction or blind-bid/sealed auction or first-price sealed-bid auction format.
The platform is the integral part of Image Search Engine for Image Referral Network and Image Ad Network, to automate generation and placement of highly-relevant targeted ads based on images in a large scale for the first time in the industry, to increase ad revenue and e-commerce and website traffic and consumer satisfaction and referral revenue. ZAC's AI Platform can also be used for other types of images, data, or objects, e.g., sound, text, tables, email s, music, numbers, curves, shapes, clothing, purse, accessories, medical images, satellite images, and biometrics.
Connecting User to Product:
In various embodiments, the user is referred to a product in variety of ways. <figref idref="DRAWINGS">FIGS. 243(<i>a</i>) through 243(<i>e</i>)</figref> demonstrate for example several such ways.
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 243(<i>a</i>)</figref>, user using a (e.g., mobile) computing device e.g., equipped with a camera) takes a video or image (or pick one from album) and recognition and search platform provides a matching item in a merchant's catalog and provides the match(es) to the user/mobile phone to navigate to the merchant's webpage. One embodiment, for example, is illustrated in <figref idref="DRAWINGS">FIG. B18</figref> of Appendix 4.
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 243(<i>b</i>)</figref>, the (e.g., mobile) application communicates with a service (e.g., merchant's application server or website) and provides the image/video. The merchant service uses recognition and search modules to provide a match from the catalog and provides that to the user's device, e.g., to navigate to the item's webpage. One embodiment, for example, is illustrated in <figref idref="DRAWINGS">FIG. B19</figref> of Appendix 4.
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 243(<i>c</i>)</figref>, a user's browser installed with a plug-in/extension-'code picks/identifies an image/video on a publisher's website and recognition and search modules provide a merchant's catalog item webpage matching an object user specified on the video/image. One embodiment, for example, is illustrated in <figref idref="DRAWINGS">FIG. B5</figref> of Appendix 4.
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 243(<i>d</i>)</figref>, the user, using a browser, navigates to a publisher's website having script/code associated with the page (client and/or server side), such as referral or ad scripts. Via scripts, the browser uses the recognition and search modules to get a link and navigate to the landing page of merchant's catalog item. Examples of some embodiment are illustrated in <figref idref="DRAWINGS">FIGS. B7</figref>, B<b>8</b>, B<b>9</b>, B<b>16</b>, and B<b>17</b> of Appendix 4.
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 243(<i>e</i>)</figref>, the content of the publisher's webpages/images are crawled/gathered and analyzed and matched with catalog items from merchants, and ads are dynamically created for display to the user when an ad exchange/network selects the ad (match) for display on the publisher's webpage/website via an ad server which is invoked or communicated with ad/referral scripts associated with the web page (e.g., client side or server side).
Miscellaneous Applications:
PPC (pay per click), PPA (pay per action), and PPM (pay per impression) may be used interchangeably in various embodiments.
In one embodiment, OCR is used to recognize text from various parts of image. In one embodiment SIFT is used to recognize logos on various parts of image. In one embodiment, bar code recognition is used to read a bar code data from the image.
Merchants' catalog and/or catalog items (or updates thereof) may be retrieved from agencies, e.g., working with merchants (and/or receiving feeds from merchants), in various embodiments.
Image and video are used interchangeably in various embodiments. The ad/referral display may be in-image, on video track, overlaid or between the playback segments, in various embodiments.
In one embodiment, a discount or coupon from the merchants is automatically issued to the platform for use in the incentive-based crown sourcing and point trading, based on the ad click through/impression/conversion volume/rate.
In one embodiment, various publishers' websites (e.g., focusing on models and celebrities) are crawled and images analyzed and correlated to the individual celebrities, by a set of automated and/or manual methods. In one embodiment, a service is provided to web publishers that display a celebrity wearing an outfit or a clothing/accessory that match the image displayed in the webpage, e.g., on or at the vicinity of the webpage image. In one embodiment, a service is provided to a merchant to display a celebrity wearing an outfit or a clothing/accessory that match the image displayed in the merchant's catalog item webpage or a summary/category page. In one embodiment, a service is provided to suggest other clothing items or object based on the outfit worn be a celebrity, from the same or various merchants' catalog items. In one embodiment, for example, a celebrity(ies) dedicated website uses the service (referral) to increase referral revenue based on the image content. In one embodiment, a plug-in/code is provided to display matching outfit worn by various celebrities on or next to an image in a webpage, e.g., having similar or matching objects with the outfit worn by the celebrity. In one embodiment, when a user clicks or selects the outfit image f the celebrity, the user's browser navigates to a website where the outfit image was posted, a website for analyzing or for showing the analyzed outfit and various matching catalog items, or a merchant's webpage for the matching catalog item. In one embodiment, a webpage/window/tab is displayed with a portion (e.g., on top) managed by See & Shop platform scripts/codes/webpage, e.g., having controls/buttons to navigate to merchants' webpages for various outfit items, e.g., at another portion of the page (e.g., at the bottom), e.g., via IFrame. In one embodiment See & Shop tool bars are overlaid and the various merchants' pages appear on a different pane/window/tab, so that the user can navigate back and forth without losing/leaving. See & Shop control/tool bar.
In various embodiments, process or service is implemented or executed on a computing device (e.g., mobile, server, desktop), platform, or computing cloud.
In one embodiment, the user enters his/her input at a user interface comprising of a Fuzzy ruler/slider to adjust the level of relevance desired for matching different features of an object.
In one embodiment, near real-time ad is generated (e.g., based on near real-time image analysis) when a user communicates (e.g., the user twits, emails, Wogs, likes, or posts), with the ad displaying an item from a merchant's catalog that matches with the image being communicated. In one embodiment, the user sending the communication is provided with points, incentive, or rewards, for inclusion of the ad with the communication.
In one embodiment, the merchants are provided an interface to bid on images or category of images, e.g., with one or more particular features (e.g., ascertained from a collection of photos, for example automatically and/or by words/description), acid/or bid differently for various features (e.g., in a weighted bidding). In one embodiment, feature bidding allows the highly relevant matches e.g., between publisher's webpage/image and a merchant's catalog item(s).
In one embodiment, the number of likes/tags/pins for a particular item/image/webpage is used to prioritize the analysis and match finding for such an item, as the number of likes/tags/pins is related to the interest level for that item. In one embodiment, it is used a s a factor in bidding among entities (e.g., publishers) for a match (e.g., is there is a limited supply of allocated ad budget). In one embodiment, the social/bookmarking network (e.g., Pinterest) is used to retag/repin items to collect in them in a collection (e.g., board) with links/pointers (e.g., on a button) pointing to a URI/resource/link on a website (e.g., See & Shop platform) with the request for placeholder links initiating a request for match query for the item and forwarding the browser to a merchant's catalog landing page associated to a matching item or to See & Shop website with the image (or URL or another identifier) as a parameter to display the image and the matching items from various merchants.
Recognition:
In one embodiment, an optimization (e.g., used in training image recognition engine/component) is based on fuzzy constraint, or the constraints are made fuzzy through aggregation and simplification to reduce the complexity of the constraint surface in feature space. In one embodiment, the aggregated fuzzy constraint is used in Lagrange optimization or one with KKT condition.
In one embodiment, especially when the data (e.g., training samples) features are not readily forming a simple ellipsoidal distribution in feature space, the data is used to determine the principal components of clusters of data, i.e., the feature space is decomposition to ellipsoid like distributions in a hierarchical PCA. In recognition process, the data features are evaluated against the first few principal components, and then against the first few principal component of sub cluster, and so on. These series of top principal components, in one embodiment, represent various features of the object at different levels of granularity. In one embodiment, this provides for fast search through hierarchy of feature clusters. In one embodiment, the training is also simplified and made in steps, by for example ignoring certain detailed features/labels for initial feature classifications. The series of feature values for top components provide a signature for the item.
In one embodiment, as a preprocessing step for recognition, a thumbnail silhouette of the image is used as an initial stage to determine the outline of the object (e.g., background separation), high level classification of the object(s) and pose estimation. In one embodiment, the expert recognition system is selected based on the classification and the portion of the image associated with the subpart of the object is used for further recognition and detailed classification of the subpart (e.g., in context of the object). Recognition of the various subparts is used in Bayesian probability method to estimate the likelihood of various sub-classification of other parts, e.g., based on the analysis of the training samples and/or user feedback and/or reliability and certainty factors from other recognition methods.
In one embodiment, for a given class of objects (e.g., shoes or footwear), a general basis for description is used to describe features (for example in an XML hierarchy or based on web/graph relationship) for quick comparison of the coded/described features between the objects from different images, e.g., used during training, indexing or search processes.
In one embodiment a fuzzy SVM is used to train a classifier. In one embodiment, the membership function of the training data is made to be fuzzy, i.e., the data point may partially belong to a particular class. In one embodiment, the slack error function may be constant, linear or quadratic with respect to the slack from margin. In one embodiment, the slack error function for each point is weighted by a complement membership function imposed by the classifier (e.g., based on the classifier line and its margin). In one embodiment, the complement membership function is 1 when the point is misclassified and it is outside of the margin around the center line, and less than 1 when it is within the margin around the center line (e.g., proportional to slack). In one embodiment, the classifier line may be considered as a fuzzy line classifier. The line refers to hyper plane. In one embodiment, the hyper plane is on a transform space e.g., based on a kernel).
Emotion Recognition:
In one embodiment, from the voice or text or typing or handwriting, one can get the emotion of the speaker or writer, as well as the intention, truthfulness, and type of personality. The parameters are pitch, volume, pause frequency, pause length, emphasis, loudness, speed, timing, energy, pressure on keyboard, computer input surface, or paper, vocabulary used, frequency of voice, relative or absolute values, relative to normal behavior, head, mouth, body, hand language and movements, speed/frequency of blinking, speed/frequency of breathing, skin color, skin wrinkles, facial form, lip form, neck position, range of voice, speed of typing, and the like. For the parameters given above, we have an N dimensional space, which we can train the system to recognize the person in different conditions, or use it on many users/people, to get the clusters separated out in the N dimensional space for different conditions, and marked accordingly during the training. Then, next time, when we get a point in that N dimensional feature space, we can find out the condition and its relative degree of that condition, e.g., “very-angry”, which is also a fuzzy parameter, based on the position of the point with respect to the cluster of “anger”, e.g., its position with respect to the cluster's center and boundary, to set the degree of the condition or the relative strength. For example, the center of cluster may be regarded as the highest strength for that condition, as one embodiment.
SVM:
We present a method and system for iterative preprocessing for training a support vector machine, e.g., for a large dataset, based on balancing the center of mass of input data, e.g., within a variable margin about the hyperplane. At each iteration, the input data is projected on the hyperplane (or on a vector parallel to the hyperplane), and the imbalance of the center of mass for different classes within a variable margin is used to update the direction of the hyperplane within the feature space, in addition to other factors including the estimate of slack error changes due data points entering and exiting the margin. In one embodiment, an estimate for the margin and the regularization constant is provided based on scanning/counting an ordered list of projected data points on a direction perpendicular to the hyperplane. In one embodiment, a fuzzy membership function for data points is used as an input (or estimated), for example, to determine center of mass and/or count data points which violate the margin. In one embodiment, non-linear SVM, e.g., based on kernels, such as (homogeneous or inhomogeneous) Polynomial, Gaussian radial basis function (RBF), or hyperbolic tangent, is used for training from input dataset, and the required dimension is estimated for the feature space (represented via a set of orthonormal feature vectors) based on a set of points in input space that provide coverage on all or substantially all data points via kernel (e.g., Gaussian) and provide sufficient information to uniquely identify a data point of a series of (e.g., neighboring) data points.
Appendix :5 includes slides of presentation “Preprocessing Method for Support Vector Machines Based on Center of Mass”, presented on Dec. 16, 2013, at The Third Annual World Conference on Soft Computing, WCSC 2013, in San Antonio, Tex.
SVM Quadratic Dual Form:
Support vector machines (SVMs) are powerful tools for classification of input data based on structural risk minimization. SVM uses a hyperplane (within the input space, in case of linear SVM, or in a feature space, in case of non-linear SVM) to separate the input data based on their classification while maximizing the margin from the input data. In case of inseparable dataset, a soft margin version of SVM is used to allow for misclassification error by imposing a penalty, e.g., proportional with the Euclidian distance from the class margin. In such a case, a regularization parameter is used as a tradeoff mechanism between the maximizing the margin and minimizing the error penalty. The appropriate level of tradeoff is determined by a validation step to estimate the out-of-sample error.
N number of samples (x<sub>i</sub>, y<sub>i</sub>) are used for training an SVM, where x<sub>i </sub>∈<img file="US2022121884A1_D23417.tif" /><sup>d </sup>and y<sub>i </sub>∈ {−1, 1} (denoting the classification of the i<sup>th </sup>data sample). A hyperplane classifier is sought to separate the input data according to their classification:
<maths id="MATH-US-00115" num="00115"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><mi>f</mi><mo></mo><mrow><mo>(</mo><mi>x</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mrow><mi>sign</mi><mo></mo><mrow><mo>(</mo><msub><mi>u</mi><mi>i</mi></msub><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mrow><mi>sign</mi><mo></mo><mrow><mo>(</mo><mrow><mrow><mi>w</mi><mo>·</mo><msub><mi>x</mi><mi>i</mi></msub></mrow><mo>+</mo><mi>b</mi></mrow><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mo>{</mo><mtable><mtr><mtd><mrow><mrow><mo>+</mo><mn>1</mn></mrow><mo>,</mo></mrow></mtd><mtd><mrow><mrow><mi>if</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><msub><mi>y</mi><mi>i</mi></msub></mrow><mo>=</mo><mrow><mo>+</mo><mn>1</mn></mrow></mrow></mtd></mtr><mtr><mtd><mrow><mrow><mo>-</mo><mn>1</mn></mrow><mo>,</mo></mrow></mtd><mtd><mrow><mrow><mi>if</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><msub><mi>y</mi><mi>i</mi></msub></mrow><mo>=</mo><mrow><mo>-</mo><mn>1</mn></mrow></mrow></mtd></mtr></mtable></mrow></mrow></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mn>19</mn><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2022121884A1_D23418.tif" /><img file="US2022121884A1_D23419.tif" /><img file="US2022121884A1_D23420.tif" /><img file="US2022121884A1_D23421.tif" /><img file="US2022121884A1_D23422.tif" /><img file="US2022121884A1_D23423.tif" /><img file="US2022121884A1_D23424.tif" /><img file="US2022121884A1_D23425.tif" /><img file="US2022121884A1_D23426.tif" /><img file="US2022121884A1_D23427.tif" /><img file="US2022121884A1_D23428.tif" /><img file="US2022121884A1_D23429.tif" /><img file="US2022121884A1_D23430.tif" /><img file="US2022121884A1_D23431.tif" /><img file="US2022121884A1_D23432.tif" /><img file="US2022121884A1_D23433.tif" /><img file="US2022121884A1_D23434.tif" /><img file="US2022121884A1_D23435.tif" /><img file="US2022121884A1_D23436.tif" /><img file="US2022121884A1_D23437.tif" /><img file="US2022121884A1_D23438.tif" /><img file="US2022121884A1_D23439.tif" /><img file="US2022121884A1_D23440.tif" /><img file="US2022121884A1_D23441.tif" /><img file="US2022121884A1_D23442.tif" /><img file="US2022121884A1_D23443.tif" /><img file="US2022121884A1_D23444.tif" /><img file="US2022121884A1_D23445.tif" /><img file="US2022121884A1_D23446.tif" /><img file="US2022121884A1_D23447.tif" /><img file="US2022121884A1_D23448.tif" /><img file="US2022121884A1_D23449.tif" /><img file="US2022121884A1_D23450.tif" /><img file="US2022121884A1_D23451.tif" /><img file="US2022121884A1_D23452.tif" /><img file="US2022121884A1_D23453.tif" /><img file="US2022121884A1_D23454.tif" /><img file="US2022121884A1_D23455.tif" /><img file="US2022121884A1_D23456.tif" /><img file="US2022121884A1_D23457.tif" /><img file="US2022121884A1_D23458.tif" /><img file="US2022121884A1_D23459.tif" /><img file="US2022121884A1_D23460.tif" /><img file="US2022121884A1_D23461.tif" /><img file="US2022121884A1_D23462.tif" /><img file="US2022121884A1_D23463.tif" /><img file="US2022121884A1_D23464.tif" /><img file="US2022121884A1_D23465.tif" /><img file="US2022121884A1_D23466.tif" /><img file="US2022121884A1_D23467.tif" /><img file="US2022121884A1_D23468.tif" /><img file="US2022121884A1_D23469.tif" /><img file="US2022121884A1_D23470.tif" /><img file="US2022121884A1_D23471.tif" /><img file="US2022121884A1_D23472.tif" /><img file="US2022121884A1_D23473.tif" /><img file="US2022121884A1_D23474.tif" /><img file="US2022121884A1_D23475.tif" /><img file="US2022121884A1_D23476.tif" /><img file="US2022121884A1_D23477.tif" /><img file="US2022121884A1_D23478.tif" /><img file="US2022121884A1_D23479.tif" /><img file="US2022121884A1_D23480.tif" /><img file="US2022121884A1_D23481.tif" /><img file="US2022121884A1_D23482.tif" /><img file="US2022121884A1_D23483.tif" /><img file="US2022121884A1_D23484.tif" /><img file="US2022121884A1_D23485.tif" /><img file="US2022121884A1_D23486.tif" /><img file="US2022121884A1_D23487.tif" /><img file="US2022121884A1_D23488.tif" /><img file="US2022121884A1_D23489.tif" /><img file="US2022121884A1_D23490.tif" /><img file="US2022121884A1_D23491.tif" /><img file="US2022121884A1_D23492.tif" /><img file="US2022121884A1_D23493.tif" /><img file="US2022121884A1_D23494.tif" /><img file="US2022121884A1_D23495.tif" /><img file="US2022121884A1_D23496.tif" /><img file="US2022121884A1_D23497.tif" /><img file="US2022121884A1_D23498.tif" /><img file="US2022121884A1_D23499.tif" /><img file="US2022121884A1_D23500.tif" /><img file="US2022121884A1_D23501.tif" /><img file="US2022121884A1_D23502.tif" /><img file="US2022121884A1_D23503.tif" /><img file="US2022121884A1_D23504.tif" /><img file="US2022121884A1_D23505.tif" /><img file="US2022121884A1_D23506.tif" /><img file="US2022121884A1_D23507.tif" /><img file="US2022121884A1_D23508.tif" /><img file="US2022121884A1_D23509.tif" /><img file="US2022121884A1_D23510.tif" /><img file="US2022121884A1_D23511.tif" /><img file="US2022121884A1_D23512.tif" /><img file="US2022121884A1_D23513.tif" /><img file="US2022121884A1_D23514.tif" /><img file="US2022121884A1_D23515.tif" /><img file="US2022121884A1_D23516.tif" /><img file="US2022121884A1_D23517.tif" /><img file="US2022121884A1_D23518.tif" /><img file="US2022121884A1_D23519.tif" /><img file="US2022121884A1_D23520.tif" /><img file="US2022121884A1_D23521.tif" /><img file="US2022121884A1_D23522.tif" /><img file="US2022121884A1_D23523.tif" /><img file="US2022121884A1_D23524.tif" /><img file="US2022121884A1_D23525.tif" /><img file="US2022121884A1_D23526.tif" /><img file="US2022121884A1_D23527.tif" /><img file="US2022121884A1_D23528.tif" /><img file="US2022121884A1_D23529.tif" />
Direction of w is perpendicular to the hyperplane, and its inverse of magnitude represents the margin between the hyperplane (having plane number 0) and the margin surface having the plane number u<sub>i </sub>set to +1 or −1 (e.g., at the nearest class data points in a linearly separable case):
<br /><i>y</i><sub>i</sub><i>u</i><sub>i</sub><i>=y</i><sub>i</sub>(<i>w·x</i><sub>i</sub><i>+b</i>) ≥1<i>, ∀i</i>=1 to <i>N </i> (20)
As an example of when the dataset is not linearly separable, a slack (or error) parameter is used to still classify the data point correctly within the slack from the class margin:
<br /><i>y</i><sub>i</sub><i>u</i><sub>i</sub><i>=y</i><sub>i</sub>(<i>w·x</i><sub>i</sub><i>+b</i>) ≥1−ξ<sub>i</sub>, ξ<sub>i</sub>≥0<i>, ∀i</i>=1 to <i>N </i> (21)
To maximize the margin ∥w∥<sup>−1</sup>, an objective function is formed to minimize (w·w) as well as the slack errors, based on the trade off parameter C, subject to (21):
<maths id="MATH-US-00116" num="00116"><math overflow="scroll"><mtable><mtr><mtd><mrow><mi>Minimize</mi><mo></mo><mrow><mo>(</mo><mrow><mrow><mfrac><mn>1</mn><mn>2</mn></mfrac><mo></mo><mrow><mi>w</mi><mo>·</mo><mi>w</mi></mrow></mrow><mo>+</mo><mrow><mi>C</mi><mo></mo><mrow><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>1</mn></mrow><mi>N</mi></munderover><mo></mo><msub><mi>ξ</mi><mi>i</mi></msub></mrow></mrow></mrow><mo>)</mo></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mn>22</mn><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2022121884A1_D23530.tif" /><img file="US2022121884A1_D23531.tif" /><img file="US2022121884A1_D23532.tif" /><img file="US2022121884A1_D23533.tif" /><img file="US2022121884A1_D23534.tif" /><img file="US2022121884A1_D23535.tif" /><img file="US2022121884A1_D23536.tif" /><img file="US2022121884A1_D23537.tif" /><img file="US2022121884A1_D23538.tif" /><img file="US2022121884A1_D23539.tif" /><img file="US2022121884A1_D23540.tif" /><img file="US2022121884A1_D23541.tif" /><img file="US2022121884A1_D23542.tif" /><img file="US2022121884A1_D23543.tif" /><img file="US2022121884A1_D23544.tif" /><img file="US2022121884A1_D23545.tif" /><img file="US2022121884A1_D23546.tif" /><img file="US2022121884A1_D23547.tif" /><img file="US2022121884A1_D23548.tif" /><img file="US2022121884A1_D23549.tif" /><img file="US2022121884A1_D23550.tif" /><img file="US2022121884A1_D23551.tif" /><img file="US2022121884A1_D23552.tif" /><img file="US2022121884A1_D23553.tif" /><img file="US2022121884A1_D23554.tif" /><img file="US2022121884A1_D23555.tif" /><img file="US2022121884A1_D23556.tif" /><img file="US2022121884A1_D23557.tif" /><img file="US2022121884A1_D23558.tif" /><img file="US2022121884A1_D23559.tif" /><img file="US2022121884A1_D23560.tif" /><img file="US2022121884A1_D23561.tif" /><img file="US2022121884A1_D23562.tif" /><img file="US2022121884A1_D23563.tif" /><img file="US2022121884A1_D23564.tif" /><img file="US2022121884A1_D23565.tif" /><img file="US2022121884A1_D23566.tif" /><img file="US2022121884A1_D23567.tif" /><img file="US2022121884A1_D23568.tif" /><img file="US2022121884A1_D23569.tif" /><img file="US2022121884A1_D23570.tif" /><img file="US2022121884A1_D23571.tif" /><img file="US2022121884A1_D23572.tif" /><img file="US2022121884A1_D23573.tif" /><img file="US2022121884A1_D23574.tif" /><img file="US2022121884A1_D23575.tif" /><img file="US2022121884A1_D23576.tif" /><img file="US2022121884A1_D23577.tif" /><img file="US2022121884A1_D23578.tif" /><img file="US2022121884A1_D23579.tif" /><img file="US2022121884A1_D23580.tif" /><img file="US2022121884A1_D23581.tif" /><img file="US2022121884A1_D23582.tif" /><img file="US2022121884A1_D23583.tif" /><img file="US2022121884A1_D23584.tif" /><img file="US2022121884A1_D23585.tif" /><img file="US2022121884A1_D23586.tif" /><img file="US2022121884A1_D23587.tif" /><img file="US2022121884A1_D23588.tif" /><img file="US2022121884A1_D23589.tif" /><img file="US2022121884A1_D23590.tif" /><img file="US2022121884A1_D23591.tif" /><img file="US2022121884A1_D23592.tif" /><img file="US2022121884A1_D23593.tif" /><img file="US2022121884A1_D23594.tif" /><img file="US2022121884A1_D23595.tif" /><img file="US2022121884A1_D23596.tif" /><img file="US2022121884A1_D23597.tif" /><img file="US2022121884A1_D23598.tif" /><img file="US2022121884A1_D23599.tif" /><img file="US2022121884A1_D23600.tif" /><img file="US2022121884A1_D23601.tif" /><img file="US2022121884A1_D23602.tif" /><img file="US2022121884A1_D23603.tif" /><img file="US2022121884A1_D23604.tif" /><img file="US2022121884A1_D23605.tif" /><img file="US2022121884A1_D23606.tif" /><img file="US2022121884A1_D23607.tif" /><img file="US2022121884A1_D23608.tif" /><img file="US2022121884A1_D23609.tif" /><img file="US2022121884A1_D23610.tif" /><img file="US2022121884A1_D23611.tif" /><img file="US2022121884A1_D23612.tif" /><img file="US2022121884A1_D23613.tif" /><img file="US2022121884A1_D23614.tif" /><img file="US2022121884A1_D23615.tif" /><img file="US2022121884A1_D23616.tif" /><img file="US2022121884A1_D23617.tif" /><img file="US2022121884A1_D23618.tif" /><img file="US2022121884A1_D23619.tif" /><img file="US2022121884A1_D23620.tif" /><img file="US2022121884A1_D23621.tif" /><img file="US2022121884A1_D23622.tif" /><img file="US2022121884A1_D23623.tif" /><img file="US2022121884A1_D23624.tif" /><img file="US2022121884A1_D23625.tif" /><img file="US2022121884A1_D23626.tif" /><img file="US2022121884A1_D23627.tif" /><img file="US2022121884A1_D23628.tif" /><img file="US2022121884A1_D23629.tif" /><img file="US2022121884A1_D23630.tif" /><img file="US2022121884A1_D23631.tif" /><img file="US2022121884A1_D23632.tif" /><img file="US2022121884A1_D23633.tif" /><img file="US2022121884A1_D23634.tif" /><img file="US2022121884A1_D23635.tif" /><img file="US2022121884A1_D23636.tif" /><img file="US2022121884A1_D23637.tif" /><img file="US2022121884A1_D23638.tif" /><img file="US2022121884A1_D23639.tif" /><img file="US2022121884A1_D23640.tif" /><img file="US2022121884A1_D23641.tif" />
The solution may be found at the saddle point of the Lagrangian:
<maths id="MATH-US-00117" num="00117"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><mi>L</mi><mo></mo><mrow><mo>(</mo><mrow><mi>w</mi><mo>,</mo><mi>b</mi><mo>,</mo><msub><mi>α</mi><mi>i</mi></msub><mo>,</mo><msub><mi>β</mi><mi>i</mi></msub></mrow><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mrow><mfrac><mn>1</mn><mn>2</mn></mfrac><mo></mo><mrow><mi>w</mi><mo>·</mo><mi>w</mi></mrow></mrow><mo>+</mo><mrow><mi>C</mi><mo></mo><mrow><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>1</mn></mrow><mi>N</mi></munderover><mo></mo><msub><mi>ξ</mi><mi>i</mi></msub></mrow></mrow><mo>-</mo><mrow><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>1</mn></mrow><mi>N</mi></munderover><mo></mo><mrow><msub><mi>α</mi><mi>i</mi></msub><mo></mo><mrow><mo>(</mo><mrow><mrow><msub><mi>y</mi><mi>i</mi></msub><mo></mo><mrow><mo>(</mo><mrow><mrow><mi>w</mi><mo>·</mo><msub><mi>x</mi><mi>i</mi></msub></mrow><mo>+</mo><mi>b</mi></mrow><mo>)</mo></mrow></mrow><mo>-</mo><mn>1</mn><mo>+</mo><msub><mi>ξ</mi><mi>i</mi></msub></mrow><mo>)</mo></mrow></mrow></mrow><mo>-</mo><mrow><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>1</mn></mrow><mi>N</mi></munderover><mo></mo><mrow><msub><mi>β</mi><mi>i</mi></msub><mo></mo><msub><mi>ξ</mi><mi>i</mi></msub></mrow></mrow></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mn>23</mn><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2022121884A1_D23642.tif" /><img file="US2022121884A1_D23643.tif" /><img file="US2022121884A1_D23644.tif" /><img file="US2022121884A1_D23645.tif" /><img file="US2022121884A1_D23646.tif" /><img file="US2022121884A1_D23647.tif" /><img file="US2022121884A1_D23648.tif" /><img file="US2022121884A1_D23649.tif" /><img file="US2022121884A1_D23650.tif" /><img file="US2022121884A1_D23651.tif" /><img file="US2022121884A1_D23652.tif" /><img file="US2022121884A1_D23653.tif" /><img file="US2022121884A1_D23654.tif" /><img file="US2022121884A1_D23655.tif" /><img file="US2022121884A1_D23656.tif" /><img file="US2022121884A1_D23657.tif" /><img file="US2022121884A1_D23658.tif" /><img file="US2022121884A1_D23659.tif" /><img file="US2022121884A1_D23660.tif" /><img file="US2022121884A1_D23661.tif" /><img file="US2022121884A1_D23662.tif" /><img file="US2022121884A1_D23663.tif" /><img file="US2022121884A1_D23664.tif" /><img file="US2022121884A1_D23665.tif" /><img file="US2022121884A1_D23666.tif" /><img file="US2022121884A1_D23667.tif" /><img file="US2022121884A1_D23668.tif" /><img file="US2022121884A1_D23669.tif" /><img file="US2022121884A1_D23670.tif" /><img file="US2022121884A1_D23671.tif" /><img file="US2022121884A1_D23672.tif" /><img file="US2022121884A1_D23673.tif" /><img file="US2022121884A1_D23674.tif" /><img file="US2022121884A1_D23675.tif" /><img file="US2022121884A1_D23676.tif" /><img file="US2022121884A1_D23677.tif" /><img file="US2022121884A1_D23678.tif" /><img file="US2022121884A1_D23679.tif" /><img file="US2022121884A1_D23680.tif" /><img file="US2022121884A1_D23681.tif" /><img file="US2022121884A1_D23682.tif" /><img file="US2022121884A1_D23683.tif" /><img file="US2022121884A1_D23684.tif" /><img file="US2022121884A1_D23685.tif" /><img file="US2022121884A1_D23686.tif" /><img file="US2022121884A1_D23687.tif" /><img file="US2022121884A1_D23688.tif" /><img file="US2022121884A1_D23689.tif" /><img file="US2022121884A1_D23690.tif" /><img file="US2022121884A1_D23691.tif" /><img file="US2022121884A1_D23692.tif" /><img file="US2022121884A1_D23693.tif" /><img file="US2022121884A1_D23694.tif" /><img file="US2022121884A1_D23695.tif" /><img file="US2022121884A1_D23696.tif" /><img file="US2022121884A1_D23697.tif" /><img file="US2022121884A1_D23698.tif" /><img file="US2022121884A1_D23699.tif" /><img file="US2022121884A1_D23700.tif" /><img file="US2022121884A1_D23701.tif" /><img file="US2022121884A1_D23702.tif" /><img file="US2022121884A1_D23703.tif" /><img file="US2022121884A1_D23704.tif" /><img file="US2022121884A1_D23705.tif" /><img file="US2022121884A1_D23706.tif" /><img file="US2022121884A1_D23707.tif" /><img file="US2022121884A1_D23708.tif" /><img file="US2022121884A1_D23709.tif" /><img file="US2022121884A1_D23710.tif" /><img file="US2022121884A1_D23711.tif" /><img file="US2022121884A1_D23712.tif" /><img file="US2022121884A1_D23713.tif" /><img file="US2022121884A1_D23714.tif" /><img file="US2022121884A1_D23715.tif" /><img file="US2022121884A1_D23716.tif" /><img file="US2022121884A1_D23717.tif" /><img file="US2022121884A1_D23718.tif" /><img file="US2022121884A1_D23719.tif" /><img file="US2022121884A1_D23720.tif" /><img file="US2022121884A1_D23721.tif" /><img file="US2022121884A1_D23722.tif" /><img file="US2022121884A1_D23723.tif" /><img file="US2022121884A1_D23724.tif" /><img file="US2022121884A1_D23725.tif" /><img file="US2022121884A1_D23726.tif" /><img file="US2022121884A1_D23727.tif" /><img file="US2022121884A1_D23728.tif" /><img file="US2022121884A1_D23729.tif" /><img file="US2022121884A1_D23730.tif" /><img file="US2022121884A1_D23731.tif" /><img file="US2022121884A1_D23732.tif" /><img file="US2022121884A1_D23733.tif" /><img file="US2022121884A1_D23734.tif" /><img file="US2022121884A1_D23735.tif" /><img file="US2022121884A1_D23736.tif" /><img file="US2022121884A1_D23737.tif" /><img file="US2022121884A1_D23738.tif" /><img file="US2022121884A1_D23739.tif" /><img file="US2022121884A1_D23740.tif" /><img file="US2022121884A1_D23741.tif" /><img file="US2022121884A1_D23742.tif" /><img file="US2022121884A1_D23743.tif" /><img file="US2022121884A1_D23744.tif" /><img file="US2022121884A1_D23745.tif" /><img file="US2022121884A1_D23746.tif" /><img file="US2022121884A1_D23747.tif" /><img file="US2022121884A1_D23748.tif" /><img file="US2022121884A1_D23749.tif" /><img file="US2022121884A1_D23750.tif" /><img file="US2022121884A1_D23751.tif" /><img file="US2022121884A1_D23752.tif" /><img file="US2022121884A1_D23753.tif" />
where α<sub>i</sub>, β<sub>i</sub>≥0, and the Lagrangian is minimized w.r.t. (w, b) and maximized w.r.t. (α<sub>i</sub>, β<sub>i</sub>), yielding:
<maths id="MATH-US-00118" num="00118"><math overflow="scroll"><mtable><mtr><mtd><mrow><mi>w</mi><mo>=</mo><mrow><mover><munder><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>1</mn></mrow></munder><mi>N</mi></mover><mo></mo><mrow><msub><mi>α</mi><mi>i</mi></msub><mo></mo><msub><mi>y</mi><mi>i</mi></msub><mo></mo><msub><mi>x</mi><mi>i</mi></msub></mrow></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mn>24</mn><mo>)</mo></mrow></mtd></mtr><mtr><mtd><mrow><mrow><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>1</mn></mrow><mi>N</mi></munderover><mo></mo><mrow><msub><mi>α</mi><mi>i</mi></msub><mo></mo><msub><mi>y</mi><mi>i</mi></msub></mrow></mrow><mo>=</mo><mn>0</mn></mrow></mtd><mtd><mrow><mo>(</mo><mn>25</mn><mo>)</mo></mrow></mtd></mtr><mtr><mtd><mrow><mrow><mrow><msub><mi>α</mi><mi>i</mi></msub><mo>+</mo><msub><mi>β</mi><mi>i</mi></msub></mrow><mo>=</mo><mi>C</mi></mrow><mo>,</mo><mrow><mn>0</mn><mo>≤</mo><msub><mi>α</mi><mi>i</mi></msub></mrow><mo>,</mo><mrow><msub><mi>β</mi><mi>i</mi></msub><mo>≤</mo><mi>C</mi></mrow><mo>,</mo></mrow></mtd><mtd><mrow><mo>(</mo><mn>26</mn><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2022121884A1_D23754.tif" /><img file="US2022121884A1_D23755.tif" /><img file="US2022121884A1_D23756.tif" /><img file="US2022121884A1_D23757.tif" /><img file="US2022121884A1_D23758.tif" /><img file="US2022121884A1_D23759.tif" /><img file="US2022121884A1_D23760.tif" /><img file="US2022121884A1_D23761.tif" /><img file="US2022121884A1_D23762.tif" /><img file="US2022121884A1_D23763.tif" /><img file="US2022121884A1_D23764.tif" /><img file="US2022121884A1_D23765.tif" /><img file="US2022121884A1_D23766.tif" /><img file="US2022121884A1_D23767.tif" /><img file="US2022121884A1_D23768.tif" /><img file="US2022121884A1_D23769.tif" /><img file="US2022121884A1_D23770.tif" /><img file="US2022121884A1_D23771.tif" /><img file="US2022121884A1_D23772.tif" /><img file="US2022121884A1_D23773.tif" /><img file="US2022121884A1_D23774.tif" /><img file="US2022121884A1_D23775.tif" /><img file="US2022121884A1_D23776.tif" /><img file="US2022121884A1_D23777.tif" /><img file="US2022121884A1_D23778.tif" /><img file="US2022121884A1_D23779.tif" /><img file="US2022121884A1_D23780.tif" /><img file="US2022121884A1_D23781.tif" /><img file="US2022121884A1_D23782.tif" /><img file="US2022121884A1_D23783.tif" /><img file="US2022121884A1_D23784.tif" /><img file="US2022121884A1_D23785.tif" /><img file="US2022121884A1_D23786.tif" /><img file="US2022121884A1_D23787.tif" /><img file="US2022121884A1_D23788.tif" /><img file="US2022121884A1_D23789.tif" /><img file="US2022121884A1_D23790.tif" /><img file="US2022121884A1_D23791.tif" /><img file="US2022121884A1_D23792.tif" /><img file="US2022121884A1_D23793.tif" /><img file="US2022121884A1_D23794.tif" /><img file="US2022121884A1_D23795.tif" /><img file="US2022121884A1_D23796.tif" /><img file="US2022121884A1_D23797.tif" /><img file="US2022121884A1_D23798.tif" /><img file="US2022121884A1_D23799.tif" /><img file="US2022121884A1_D23800.tif" /><img file="US2022121884A1_D23801.tif" /><img file="US2022121884A1_D23802.tif" /><img file="US2022121884A1_D23803.tif" /><img file="US2022121884A1_D23804.tif" /><img file="US2022121884A1_D23805.tif" /><img file="US2022121884A1_D23806.tif" /><img file="US2022121884A1_D23807.tif" /><img file="US2022121884A1_D23808.tif" /><img file="US2022121884A1_D23809.tif" /><img file="US2022121884A1_D23810.tif" /><img file="US2022121884A1_D23811.tif" /><img file="US2022121884A1_D23812.tif" /><img file="US2022121884A1_D23813.tif" /><img file="US2022121884A1_D23814.tif" /><img file="US2022121884A1_D23815.tif" /><img file="US2022121884A1_D23816.tif" /><img file="US2022121884A1_D23817.tif" /><img file="US2022121884A1_D23818.tif" /><img file="US2022121884A1_D23819.tif" /><img file="US2022121884A1_D23820.tif" /><img file="US2022121884A1_D23821.tif" /><img file="US2022121884A1_D23822.tif" /><img file="US2022121884A1_D23823.tif" /><img file="US2022121884A1_D23824.tif" /><img file="US2022121884A1_D23825.tif" /><img file="US2022121884A1_D23826.tif" /><img file="US2022121884A1_D23827.tif" /><img file="US2022121884A1_D23828.tif" /><img file="US2022121884A1_D23829.tif" /><img file="US2022121884A1_D23830.tif" /><img file="US2022121884A1_D23831.tif" /><img file="US2022121884A1_D23832.tif" /><img file="US2022121884A1_D23833.tif" /><img file="US2022121884A1_D23834.tif" /><img file="US2022121884A1_D23835.tif" /><img file="US2022121884A1_D23836.tif" /><img file="US2022121884A1_D23837.tif" /><img file="US2022121884A1_D23838.tif" /><img file="US2022121884A1_D23839.tif" /><img file="US2022121884A1_D23840.tif" /><img file="US2022121884A1_D23841.tif" /><img file="US2022121884A1_D23842.tif" /><img file="US2022121884A1_D23843.tif" /><img file="US2022121884A1_D23844.tif" /><img file="US2022121884A1_D23845.tif" /><img file="US2022121884A1_D23846.tif" /><img file="US2022121884A1_D23847.tif" /><img file="US2022121884A1_D23848.tif" /><img file="US2022121884A1_D23849.tif" /><img file="US2022121884A1_D23850.tif" /><img file="US2022121884A1_D23851.tif" /><img file="US2022121884A1_D23852.tif" /><img file="US2022121884A1_D23853.tif" /><img file="US2022121884A1_D23854.tif" /><img file="US2022121884A1_D23855.tif" /><img file="US2022121884A1_D23856.tif" /><img file="US2022121884A1_D23857.tif" /><img file="US2022121884A1_D23858.tif" /><img file="US2022121884A1_D23859.tif" /><img file="US2022121884A1_D23860.tif" /><img file="US2022121884A1_D23861.tif" /><img file="US2022121884A1_D23862.tif" /><img file="US2022121884A1_D23863.tif" /><img file="US2022121884A1_D23864.tif" /><img file="US2022121884A1_D23865.tif" />
The modified Lagrangian in dual form (i.e., by substituting (24) and using (2.5) and (26)) is quadratic in α<sub>i</sub>, and it is minimized w.r.t. α<sub>i</sub>, subject to constraint (26):
<maths id="MATH-US-00119" num="00119"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><msup><mi>ℒ</mi><mi>′</mi></msup><mo></mo><mrow><mo>(</mo><mi>α</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mrow><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>1</mn></mrow><mi>N</mi></munderover><mo></mo><msub><mi>α</mi><mi>i</mi></msub></mrow><mo>-</mo><mrow><mfrac><mn>1</mn><mn>2</mn></mfrac><mo></mo><mrow><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>1</mn></mrow><mi>N</mi></munderover><mo></mo><mrow><munderover><mo>∑</mo><mrow><mi>j</mi><mo>=</mo><mn>1</mn></mrow><mi>N</mi></munderover><mo></mo><mrow><msub><mi>α</mi><mi>i</mi></msub><mo></mo><msub><mi>α</mi><mi>j</mi></msub><mo></mo><msub><mi>y</mi><mi>i</mi></msub><mo></mo><mrow><msub><mi>y</mi><mi>j</mi></msub><mo></mo><mrow><mo>(</mo><mrow><msub><mi>x</mi><mi>i</mi></msub><mo>·</mo><msub><mi>x</mi><mi>j</mi></msub></mrow><mo>)</mo></mrow></mrow></mrow></mrow></mrow></mrow></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mn>27</mn><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2022121884A1_D23866.tif" /><img file="US2022121884A1_D23867.tif" /><img file="US2022121884A1_D23868.tif" /><img file="US2022121884A1_D23869.tif" /><img file="US2022121884A1_D23870.tif" /><img file="US2022121884A1_D23871.tif" /><img file="US2022121884A1_D23872.tif" /><img file="US2022121884A1_D23873.tif" /><img file="US2022121884A1_D23874.tif" /><img file="US2022121884A1_D23875.tif" /><img file="US2022121884A1_D23876.tif" /><img file="US2022121884A1_D23877.tif" /><img file="US2022121884A1_D23878.tif" /><img file="US2022121884A1_D23879.tif" /><img file="US2022121884A1_D23880.tif" /><img file="US2022121884A1_D23881.tif" /><img file="US2022121884A1_D23882.tif" /><img file="US2022121884A1_D23883.tif" /><img file="US2022121884A1_D23884.tif" /><img file="US2022121884A1_D23885.tif" /><img file="US2022121884A1_D23886.tif" /><img file="US2022121884A1_D23887.tif" /><img file="US2022121884A1_D23888.tif" /><img file="US2022121884A1_D23889.tif" /><img file="US2022121884A1_D23890.tif" /><img file="US2022121884A1_D23891.tif" /><img file="US2022121884A1_D23892.tif" /><img file="US2022121884A1_D23893.tif" /><img file="US2022121884A1_D23894.tif" /><img file="US2022121884A1_D23895.tif" /><img file="US2022121884A1_D23896.tif" /><img file="US2022121884A1_D23897.tif" /><img file="US2022121884A1_D23898.tif" /><img file="US2022121884A1_D23899.tif" /><img file="US2022121884A1_D23900.tif" /><img file="US2022121884A1_D23901.tif" /><img file="US2022121884A1_D23902.tif" /><img file="US2022121884A1_D23903.tif" /><img file="US2022121884A1_D23904.tif" /><img file="US2022121884A1_D23905.tif" /><img file="US2022121884A1_D23906.tif" /><img file="US2022121884A1_D23907.tif" /><img file="US2022121884A1_D23908.tif" /><img file="US2022121884A1_D23909.tif" /><img file="US2022121884A1_D23910.tif" /><img file="US2022121884A1_D23911.tif" /><img file="US2022121884A1_D23912.tif" /><img file="US2022121884A1_D23913.tif" /><img file="US2022121884A1_D23914.tif" /><img file="US2022121884A1_D23915.tif" /><img file="US2022121884A1_D23916.tif" /><img file="US2022121884A1_D23917.tif" /><img file="US2022121884A1_D23918.tif" /><img file="US2022121884A1_D23919.tif" /><img file="US2022121884A1_D23920.tif" /><img file="US2022121884A1_D23921.tif" /><img file="US2022121884A1_D23922.tif" /><img file="US2022121884A1_D23923.tif" /><img file="US2022121884A1_D23924.tif" /><img file="US2022121884A1_D23925.tif" /><img file="US2022121884A1_D23926.tif" /><img file="US2022121884A1_D23927.tif" /><img file="US2022121884A1_D23928.tif" /><img file="US2022121884A1_D23929.tif" /><img file="US2022121884A1_D23930.tif" /><img file="US2022121884A1_D23931.tif" /><img file="US2022121884A1_D23932.tif" /><img file="US2022121884A1_D23933.tif" /><img file="US2022121884A1_D23934.tif" /><img file="US2022121884A1_D23935.tif" /><img file="US2022121884A1_D23936.tif" /><img file="US2022121884A1_D23937.tif" /><img file="US2022121884A1_D23938.tif" /><img file="US2022121884A1_D23939.tif" /><img file="US2022121884A1_D23940.tif" /><img file="US2022121884A1_D23941.tif" /><img file="US2022121884A1_D23942.tif" /><img file="US2022121884A1_D23943.tif" /><img file="US2022121884A1_D23944.tif" /><img file="US2022121884A1_D23945.tif" /><img file="US2022121884A1_D23946.tif" /><img file="US2022121884A1_D23947.tif" /><img file="US2022121884A1_D23948.tif" /><img file="US2022121884A1_D23949.tif" /><img file="US2022121884A1_D23950.tif" /><img file="US2022121884A1_D23951.tif" /><img file="US2022121884A1_D23952.tif" /><img file="US2022121884A1_D23953.tif" /><img file="US2022121884A1_D23954.tif" /><img file="US2022121884A1_D23955.tif" /><img file="US2022121884A1_D23956.tif" /><img file="US2022121884A1_D23957.tif" /><img file="US2022121884A1_D23958.tif" /><img file="US2022121884A1_D23959.tif" /><img file="US2022121884A1_D23960.tif" /><img file="US2022121884A1_D23961.tif" /><img file="US2022121884A1_D23962.tif" /><img file="US2022121884A1_D23963.tif" /><img file="US2022121884A1_D23964.tif" /><img file="US2022121884A1_D23965.tif" /><img file="US2022121884A1_D23966.tif" /><img file="US2022121884A1_D23967.tif" /><img file="US2022121884A1_D23968.tif" /><img file="US2022121884A1_D23969.tif" /><img file="US2022121884A1_D23970.tif" /><img file="US2022121884A1_D23971.tif" /><img file="US2022121884A1_D23972.tif" /><img file="US2022121884A1_D23973.tif" /><img file="US2022121884A1_D23974.tif" /><img file="US2022121884A1_D23975.tif" /><img file="US2022121884A1_D23976.tif" /><img file="US2022121884A1_D23977.tif" />
In a non-linear case, where the optimization is performed in a feature space <img file="US2022121884A1_D23978.tif" />, the vector product in (25) would become (z<sub>i</sub>·z<sub>j</sub>), where z<sub>i</sub>=ϕ(x<sub>i</sub>) is the corresponding feature vector and the dot product in space <img file="US2022121884A1_D23979.tif" /> may be expressed as a corresponding kernel <img file="US2022121884A1_D23980.tif" />(x<sub>i</sub>·x<sub>j</sub>) in X domain satisfying Mercer condition. The solution for (27) provides a set of {α<sub>i</sub>} l where most are typically zeros, indicating the corresponding data points that are outside the margin (with zero slack). A non-zero α<sub>i </sub>represents an x<sub>i </sub>which is at the margin or violating the margin with a non-zero slack. The KKT (Karush-Kuhn-Tucker) conditions for the solution are:
<maths id="MATH-US-00120" num="00120"><math overflow="scroll"><mtable><mtr><mtd><mrow><mo>{</mo><mtable><mtr><mtd><mrow><mrow><mrow><mrow><msub><mi>y</mi><mi>i</mi></msub><mo></mo><msub><mi>u</mi><mi>i</mi></msub></mrow><mo>></mo><mn>1</mn></mrow><mo>⇔</mo><msub><mi>α</mi><mi>i</mi></msub></mrow><mo>=</mo><mn>0</mn></mrow></mtd></mtr><mtr><mtd><mrow><mrow><msub><mi>y</mi><mi>i</mi></msub><mo></mo><msub><mi>u</mi><mi>i</mi></msub></mrow><mo>=</mo><mrow><mn>1</mn><mo>⇔</mo><mrow><mn>0</mn><mo>≤</mo><msub><mi>α</mi><mi>i</mi></msub><mo>≤</mo><mi>C</mi></mrow></mrow></mrow></mtd></mtr><mtr><mtd><mrow><mrow><mrow><mrow><msub><mi>y</mi><mi>i</mi></msub><mo></mo><msub><mi>u</mi><mi>i</mi></msub></mrow><mo><</mo><mn>1</mn></mrow><mo>⇔</mo><msub><mi>α</mi><mi>i</mi></msub></mrow><mo>=</mo><mi>C</mi></mrow></mtd></mtr></mtable></mrow></mtd><mtd><mrow><mo>(</mo><mn>28</mn><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2022121884A1_D23981.tif" /><img file="US2022121884A1_D23982.tif" /><img file="US2022121884A1_D23983.tif" /><img file="US2022121884A1_D23984.tif" /><img file="US2022121884A1_D23985.tif" /><img file="US2022121884A1_D23986.tif" /><img file="US2022121884A1_D23987.tif" /><img file="US2022121884A1_D23988.tif" /><img file="US2022121884A1_D23989.tif" /><img file="US2022121884A1_D23990.tif" /><img file="US2022121884A1_D23991.tif" /><img file="US2022121884A1_D23992.tif" /><img file="US2022121884A1_D23993.tif" /><img file="US2022121884A1_D23994.tif" /><img file="US2022121884A1_D23995.tif" /><img file="US2022121884A1_D23996.tif" /><img file="US2022121884A1_D23997.tif" /><img file="US2022121884A1_D23998.tif" /><img file="US2022121884A1_D23999.tif" /><img file="US2022121884A1_D24000.tif" /><img file="US2022121884A1_D24001.tif" /><img file="US2022121884A1_D24002.tif" /><img file="US2022121884A1_D24003.tif" /><img file="US2022121884A1_D24004.tif" /><img file="US2022121884A1_D24005.tif" /><img file="US2022121884A1_D24006.tif" /><img file="US2022121884A1_D24007.tif" /><img file="US2022121884A1_D24008.tif" /><img file="US2022121884A1_D24009.tif" /><img file="US2022121884A1_D24010.tif" /><img file="US2022121884A1_D24011.tif" /><img file="US2022121884A1_D24012.tif" /><img file="US2022121884A1_D24013.tif" /><img file="US2022121884A1_D24014.tif" /><img file="US2022121884A1_D24015.tif" /><img file="US2022121884A1_D24016.tif" /><img file="US2022121884A1_D24017.tif" /><img file="US2022121884A1_D24018.tif" /><img file="US2022121884A1_D24019.tif" /><img file="US2022121884A1_D24020.tif" /><img file="US2022121884A1_D24021.tif" /><img file="US2022121884A1_D24022.tif" /><img file="US2022121884A1_D24023.tif" /><img file="US2022121884A1_D24024.tif" /><img file="US2022121884A1_D24025.tif" /><img file="US2022121884A1_D24026.tif" /><img file="US2022121884A1_D24027.tif" /><img file="US2022121884A1_D24028.tif" /><img file="US2022121884A1_D24029.tif" /><img file="US2022121884A1_D24030.tif" /><img file="US2022121884A1_D24031.tif" /><img file="US2022121884A1_D24032.tif" /><img file="US2022121884A1_D24033.tif" /><img file="US2022121884A1_D24034.tif" /><img file="US2022121884A1_D24035.tif" /><img file="US2022121884A1_D24036.tif" /><img file="US2022121884A1_D24037.tif" /><img file="US2022121884A1_D24038.tif" /><img file="US2022121884A1_D24039.tif" /><img file="US2022121884A1_D24040.tif" /><img file="US2022121884A1_D24041.tif" /><img file="US2022121884A1_D24042.tif" /><img file="US2022121884A1_D24043.tif" /><img file="US2022121884A1_D24044.tif" /><img file="US2022121884A1_D24045.tif" /><img file="US2022121884A1_D24046.tif" /><img file="US2022121884A1_D24047.tif" /><img file="US2022121884A1_D24048.tif" /><img file="US2022121884A1_D24049.tif" /><img file="US2022121884A1_D24050.tif" /><img file="US2022121884A1_D24051.tif" /><img file="US2022121884A1_D24052.tif" /><img file="US2022121884A1_D24053.tif" /><img file="US2022121884A1_D24054.tif" /><img file="US2022121884A1_D24055.tif" /><img file="US2022121884A1_D24056.tif" /><img file="US2022121884A1_D24057.tif" /><img file="US2022121884A1_D24058.tif" /><img file="US2022121884A1_D24059.tif" /><img file="US2022121884A1_D24060.tif" /><img file="US2022121884A1_D24061.tif" /><img file="US2022121884A1_D24062.tif" /><img file="US2022121884A1_D24063.tif" /><img file="US2022121884A1_D24064.tif" /><img file="US2022121884A1_D24065.tif" /><img file="US2022121884A1_D24066.tif" /><img file="US2022121884A1_D24067.tif" /><img file="US2022121884A1_D24068.tif" /><img file="US2022121884A1_D24069.tif" /><img file="US2022121884A1_D24070.tif" /><img file="US2022121884A1_D24071.tif" /><img file="US2022121884A1_D24072.tif" /><img file="US2022121884A1_D24073.tif" /><img file="US2022121884A1_D24074.tif" /><img file="US2022121884A1_D24075.tif" /><img file="US2022121884A1_D24076.tif" /><img file="US2022121884A1_D24077.tif" /><img file="US2022121884A1_D24078.tif" /><img file="US2022121884A1_D24079.tif" /><img file="US2022121884A1_D24080.tif" /><img file="US2022121884A1_D24081.tif" /><img file="US2022121884A1_D24082.tif" /><img file="US2022121884A1_D24083.tif" /><img file="US2022121884A1_D24084.tif" /><img file="US2022121884A1_D24085.tif" /><img file="US2022121884A1_D24086.tif" /><img file="US2022121884A1_D24087.tif" /><img file="US2022121884A1_D24088.tif" /><img file="US2022121884A1_D24089.tif" /><img file="US2022121884A1_D24090.tif" /><img file="US2022121884A1_D24091.tif" /><img file="US2022121884A1_D24092.tif" />
The classification hypothesis may be expressed by the few non-zero α<sub>i</sub>'s (by substituting (24) in (19)) with their corresponding x<sub>i</sub>'s denoted as support vectors (SVs):
<maths id="MATH-US-00121" num="00121"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><mi>f</mi><mo></mo><mrow><mo>(</mo><mi>x</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mi>sign</mi><mo>(</mo><mrow><mrow><munder><mo>∑</mo><mrow><msub><mi>α</mi><mi>i</mi></msub><mo>></mo><mn>0</mn></mrow></munder><mo></mo><mrow><msub><mi>α</mi><mi>i</mi></msub><mo></mo><msub><mi>y</mi><mi>i</mi></msub><mo></mo><mrow><mi>𝒦</mi><mo></mo><mrow><mo>(</mo><mrow><msub><mi>x</mi><mi>i</mi></msub><mo>,</mo><mi>x</mi></mrow><mo>)</mo></mrow></mrow></mrow></mrow><mo>+</mo><mi>b</mi></mrow><mo>)</mo></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mn>29</mn><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2022121884A1_D24093.tif" /><img file="US2022121884A1_D24094.tif" /><img file="US2022121884A1_D24095.tif" /><img file="US2022121884A1_D24096.tif" /><img file="US2022121884A1_D24097.tif" /><img file="US2022121884A1_D24098.tif" /><img file="US2022121884A1_D24099.tif" /><img file="US2022121884A1_D24100.tif" /><img file="US2022121884A1_D24101.tif" /><img file="US2022121884A1_D24102.tif" /><img file="US2022121884A1_D24103.tif" /><img file="US2022121884A1_D24104.tif" /><img file="US2022121884A1_D24105.tif" /><img file="US2022121884A1_D24106.tif" /><img file="US2022121884A1_D24107.tif" /><img file="US2022121884A1_D24108.tif" /><img file="US2022121884A1_D24109.tif" /><img file="US2022121884A1_D24110.tif" /><img file="US2022121884A1_D24111.tif" /><img file="US2022121884A1_D24112.tif" /><img file="US2022121884A1_D24113.tif" /><img file="US2022121884A1_D24114.tif" /><img file="US2022121884A1_D24115.tif" /><img file="US2022121884A1_D24116.tif" /><img file="US2022121884A1_D24117.tif" /><img file="US2022121884A1_D24118.tif" /><img file="US2022121884A1_D24119.tif" /><img file="US2022121884A1_D24120.tif" /><img file="US2022121884A1_D24121.tif" /><img file="US2022121884A1_D24122.tif" /><img file="US2022121884A1_D24123.tif" /><img file="US2022121884A1_D24124.tif" /><img file="US2022121884A1_D24125.tif" /><img file="US2022121884A1_D24126.tif" /><img file="US2022121884A1_D24127.tif" /><img file="US2022121884A1_D24128.tif" /><img file="US2022121884A1_D24129.tif" /><img file="US2022121884A1_D24130.tif" /><img file="US2022121884A1_D24131.tif" /><img file="US2022121884A1_D24132.tif" /><img file="US2022121884A1_D24133.tif" /><img file="US2022121884A1_D24134.tif" /><img file="US2022121884A1_D24135.tif" /><img file="US2022121884A1_D24136.tif" /><img file="US2022121884A1_D24137.tif" /><img file="US2022121884A1_D24138.tif" /><img file="US2022121884A1_D24139.tif" /><img file="US2022121884A1_D24140.tif" /><img file="US2022121884A1_D24141.tif" /><img file="US2022121884A1_D24142.tif" /><img file="US2022121884A1_D24143.tif" /><img file="US2022121884A1_D24144.tif" /><img file="US2022121884A1_D24145.tif" /><img file="US2022121884A1_D24146.tif" /><img file="US2022121884A1_D24147.tif" /><img file="US2022121884A1_D24148.tif" /><img file="US2022121884A1_D24149.tif" /><img file="US2022121884A1_D24150.tif" /><img file="US2022121884A1_D24151.tif" /><img file="US2022121884A1_D24152.tif" /><img file="US2022121884A1_D24153.tif" /><img file="US2022121884A1_D24154.tif" /><img file="US2022121884A1_D24155.tif" /><img file="US2022121884A1_D24156.tif" /><img file="US2022121884A1_D24157.tif" /><img file="US2022121884A1_D24158.tif" /><img file="US2022121884A1_D24159.tif" /><img file="US2022121884A1_D24160.tif" /><img file="US2022121884A1_D24161.tif" /><img file="US2022121884A1_D24162.tif" /><img file="US2022121884A1_D24163.tif" /><img file="US2022121884A1_D24164.tif" /><img file="US2022121884A1_D24165.tif" /><img file="US2022121884A1_D24166.tif" /><img file="US2022121884A1_D24167.tif" /><img file="US2022121884A1_D24168.tif" /><img file="US2022121884A1_D24169.tif" /><img file="US2022121884A1_D24170.tif" /><img file="US2022121884A1_D24171.tif" /><img file="US2022121884A1_D24172.tif" /><img file="US2022121884A1_D24173.tif" /><img file="US2022121884A1_D24174.tif" /><img file="US2022121884A1_D24175.tif" /><img file="US2022121884A1_D24176.tif" /><img file="US2022121884A1_D24177.tif" /><img file="US2022121884A1_D24178.tif" /><img file="US2022121884A1_D24179.tif" /><img file="US2022121884A1_D24180.tif" /><img file="US2022121884A1_D24181.tif" /><img file="US2022121884A1_D24182.tif" /><img file="US2022121884A1_D24183.tif" /><img file="US2022121884A1_D24184.tif" /><img file="US2022121884A1_D24185.tif" /><img file="US2022121884A1_D24186.tif" /><img file="US2022121884A1_D24187.tif" /><img file="US2022121884A1_D24188.tif" /><img file="US2022121884A1_D24189.tif" /><img file="US2022121884A1_D24190.tif" /><img file="US2022121884A1_D24191.tif" /><img file="US2022121884A1_D24192.tif" /><img file="US2022121884A1_D24193.tif" /><img file="US2022121884A1_D24194.tif" /><img file="US2022121884A1_D24195.tif" /><img file="US2022121884A1_D24196.tif" /><img file="US2022121884A1_D24197.tif" /><img file="US2022121884A1_D24198.tif" /><img file="US2022121884A1_D24199.tif" /><img file="US2022121884A1_D24200.tif" /><img file="US2022121884A1_D24201.tif" /><img file="US2022121884A1_D24202.tif" /><img file="US2022121884A1_D24203.tif" /><img file="US2022121884A1_D24204.tif" />
While most α<sub>i</sub>'s are typically zero, the performance of quadratic (QD) programming solvers suffer for large datasets due to large size of (N×N) kernel matrix with <img file="US2022121884A1_D24205.tif" />(x<sub>i</sub>, x<sub>j</sub>) elements. Various embodiments can address this issue, such as “chunking” to break down a larger QD problem into series of smaller ones, or breaking the problem to the smallest chunk in pair-wise sequential minimal optimization. In addition, the solver repeats the optimization by varying the values of C and/or kernel parameter(s) within a wide exponential range, and a grid search is used to determine the optimum hyperparameter(s) likely to minimize out of sample error (e.g., estimated by validation dataset). Another embodiment eliminates the subset of input dataset, via fuzzy clustering, to reduce the workload.
1 Preprocessing for SVM Using Center of Mass:
While any data point might be a support vector (as anticipated by (27)), we present a preprocessing approach to quickly identify the potential SVs in linear SVM, as the initial starting point for QD solvers in order to speed up the optimization process. The approach also estimates the margin and C to narrow the range of C's needed for use with validation. An extension of this approach to non-linear SVM is suggested where the assumption is that relatively few SVs would support the hyperplane having a relatively low dimensionality.
1.1 Leverage Model of Lagrange Multipliers:
The relations (24) and (25) suggest a view of leverage for the data points (depicted in solid black in <figref idref="DRAWINGS">FIG. 254</figref>) at or inside the margin about the hyperplane.
Per (28), α for the points inside the margin gets limited to C, while those at the margin may have α between 0 and C. Furthermore, α<sub>i</sub>y<sub>i </sub>provides the polarity to the “force” α<sub>i </sub>excreted on the margin by the corresponding data point. For example, such force by “circle” class (having y=+1) is pointing down, while those from “square” class (with y=−1) are pointing in opposite direction. Equation (25) may be rewritten as a force balance equation:
<maths id="MATH-US-00122" num="00122"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><munder><mo>∑</mo><msub><mi>i</mi><mo>+</mo></msub></munder><mo></mo><msub><mi>α</mi><msub><mi>i</mi><mo>+</mo></msub></msub></mrow><mo>=</mo><mrow><munder><mo>∑</mo><msub><mi>i</mi><mo>-</mo></msub></munder><mo></mo><mrow><msub><mi>α</mi><msub><mi>i</mi><mo>-</mo></msub></msub><mo></mo><mrow><mo>(</mo><mrow><mo>=</mo><mrow><mfrac><mn>1</mn><mn>2</mn></mfrac><mo></mo><mrow><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>1</mn></mrow><mi>N</mi></munderover><mo></mo><msub><mi>α</mi><mi>i</mi></msub></mrow></mrow></mrow><mo>)</mo></mrow></mrow></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mn>30</mn><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2022121884A1_D24206.tif" /><img file="US2022121884A1_D24207.tif" /><img file="US2022121884A1_D24208.tif" /><img file="US2022121884A1_D24209.tif" /><img file="US2022121884A1_D24210.tif" /><img file="US2022121884A1_D24211.tif" /><img file="US2022121884A1_D24212.tif" /><img file="US2022121884A1_D24213.tif" /><img file="US2022121884A1_D24214.tif" /><img file="US2022121884A1_D24215.tif" /><img file="US2022121884A1_D24216.tif" /><img file="US2022121884A1_D24217.tif" /><img file="US2022121884A1_D24218.tif" /><img file="US2022121884A1_D24219.tif" /><img file="US2022121884A1_D24220.tif" /><img file="US2022121884A1_D24221.tif" /><img file="US2022121884A1_D24222.tif" /><img file="US2022121884A1_D24223.tif" /><img file="US2022121884A1_D24224.tif" /><img file="US2022121884A1_D24225.tif" /><img file="US2022121884A1_D24226.tif" /><img file="US2022121884A1_D24227.tif" /><img file="US2022121884A1_D24228.tif" /><img file="US2022121884A1_D24229.tif" /><img file="US2022121884A1_D24230.tif" /><img file="US2022121884A1_D24231.tif" /><img file="US2022121884A1_D24232.tif" /><img file="US2022121884A1_D24233.tif" /><img file="US2022121884A1_D24234.tif" /><img file="US2022121884A1_D24235.tif" /><img file="US2022121884A1_D24236.tif" /><img file="US2022121884A1_D24237.tif" /><img file="US2022121884A1_D24238.tif" /><img file="US2022121884A1_D24239.tif" /><img file="US2022121884A1_D24240.tif" /><img file="US2022121884A1_D24241.tif" /><img file="US2022121884A1_D24242.tif" /><img file="US2022121884A1_D24243.tif" /><img file="US2022121884A1_D24244.tif" /><img file="US2022121884A1_D24245.tif" /><img file="US2022121884A1_D24246.tif" /><img file="US2022121884A1_D24247.tif" /><img file="US2022121884A1_D24248.tif" /><img file="US2022121884A1_D24249.tif" /><img file="US2022121884A1_D24250.tif" /><img file="US2022121884A1_D24251.tif" /><img file="US2022121884A1_D24252.tif" /><img file="US2022121884A1_D24253.tif" /><img file="US2022121884A1_D24254.tif" /><img file="US2022121884A1_D24255.tif" /><img file="US2022121884A1_D24256.tif" /><img file="US2022121884A1_D24257.tif" /><img file="US2022121884A1_D24258.tif" /><img file="US2022121884A1_D24259.tif" /><img file="US2022121884A1_D24260.tif" /><img file="US2022121884A1_D24261.tif" /><img file="US2022121884A1_D24262.tif" /><img file="US2022121884A1_D24263.tif" /><img file="US2022121884A1_D24264.tif" /><img file="US2022121884A1_D24265.tif" /><img file="US2022121884A1_D24266.tif" /><img file="US2022121884A1_D24267.tif" /><img file="US2022121884A1_D24268.tif" /><img file="US2022121884A1_D24269.tif" /><img file="US2022121884A1_D24270.tif" /><img file="US2022121884A1_D24271.tif" /><img file="US2022121884A1_D24272.tif" /><img file="US2022121884A1_D24273.tif" /><img file="US2022121884A1_D24274.tif" /><img file="US2022121884A1_D24275.tif" /><img file="US2022121884A1_D24276.tif" /><img file="US2022121884A1_D24277.tif" /><img file="US2022121884A1_D24278.tif" /><img file="US2022121884A1_D24279.tif" /><img file="US2022121884A1_D24280.tif" /><img file="US2022121884A1_D24281.tif" /><img file="US2022121884A1_D24282.tif" /><img file="US2022121884A1_D24283.tif" /><img file="US2022121884A1_D24284.tif" /><img file="US2022121884A1_D24285.tif" /><img file="US2022121884A1_D24286.tif" /><img file="US2022121884A1_D24287.tif" /><img file="US2022121884A1_D24288.tif" /><img file="US2022121884A1_D24289.tif" /><img file="US2022121884A1_D24290.tif" /><img file="US2022121884A1_D24291.tif" /><img file="US2022121884A1_D24292.tif" /><img file="US2022121884A1_D24293.tif" /><img file="US2022121884A1_D24294.tif" /><img file="US2022121884A1_D24295.tif" /><img file="US2022121884A1_D24296.tif" /><img file="US2022121884A1_D24297.tif" /><img file="US2022121884A1_D24298.tif" /><img file="US2022121884A1_D24299.tif" /><img file="US2022121884A1_D24300.tif" /><img file="US2022121884A1_D24301.tif" /><img file="US2022121884A1_D24302.tif" /><img file="US2022121884A1_D24303.tif" /><img file="US2022121884A1_D24304.tif" /><img file="US2022121884A1_D24305.tif" /><img file="US2022121884A1_D24306.tif" /><img file="US2022121884A1_D24307.tif" /><img file="US2022121884A1_D24308.tif" /><img file="US2022121884A1_D24309.tif" /><img file="US2022121884A1_D24310.tif" /><img file="US2022121884A1_D24311.tif" /><img file="US2022121884A1_D24312.tif" /><img file="US2022121884A1_D24313.tif" /><img file="US2022121884A1_D24314.tif" /><img file="US2022121884A1_D24315.tif" /><img file="US2022121884A1_D24316.tif" /><img file="US2022121884A1_D24317.tif" />
where i<sub>+</sub> and i<sub>−</sub> are indexes for non-zero α<sub>i</sub>'s corresponding to “circle” and “square” classes (i.e., y=+1 and −1), respectively. The soft margin SVM that allows errors (with slack) limits the value of α to C (tradeoff parameter). This can be interpreted as the “skin” of the soft margin only being able to support a point force up to C before getting penetrated. In other words, the force on the margin builds up from 0 to C, as the point is “pushed” from outside the margin through the “skin”.
The “force” model (with a playing the role of force) can be extended to a “leverage” model (with torque) by observing that the RHS of (24) resembles a torque α<sub>i</sub>y<sub>i</sub>x<sub>i </sub>having x<sub>i </sub>as its leverage. To exploit this property, we project (24) on a direction perpendicular to w(denoted by unit vector ŵ<sub>⊥</sub>):
<maths id="MATH-US-00123" num="00123"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>1</mn></mrow><mi>N</mi></munderover><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><msub><mi>α</mi><mi>i</mi></msub><mo></mo><mrow><msub><mi>y</mi><mi>i</mi></msub><mo></mo><mrow><mo>(</mo><mrow><msub><mi>x</mi><mi>i</mi></msub><mo>·</mo><msub><mover><mi>w</mi><mo>^</mo></mover><mo>⊥</mo></msub></mrow><mo>)</mo></mrow></mrow></mrow></mrow><mo>=</mo><mrow><mrow><mrow><mo>(</mo><mrow><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>1</mn></mrow><mi>N</mi></munderover><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><msub><mi>α</mi><mi>i</mi></msub><mo></mo><msub><mi>y</mi><mi>i</mi></msub><mo></mo><msub><mi>x</mi><mi>i</mi></msub></mrow></mrow><mo>)</mo></mrow><mo>·</mo><msub><mover><mi>w</mi><mo>^</mo></mover><mo>⊥</mo></msub></mrow><mo>=</mo><mrow><mrow><mi>w</mi><mo>·</mo><msub><mover><mi>w</mi><mo>^</mo></mover><mo>⊥</mo></msub></mrow><mo>=</mo><mn>0</mn></mrow></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mn>31</mn><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2022121884A1_D24318.tif" /><img file="US2022121884A1_D24319.tif" /><img file="US2022121884A1_D24320.tif" /><img file="US2022121884A1_D24321.tif" /><img file="US2022121884A1_D24322.tif" /><img file="US2022121884A1_D24323.tif" /><img file="US2022121884A1_D24324.tif" /><img file="US2022121884A1_D24325.tif" /><img file="US2022121884A1_D24326.tif" /><img file="US2022121884A1_D24327.tif" /><img file="US2022121884A1_D24328.tif" /><img file="US2022121884A1_D24329.tif" /><img file="US2022121884A1_D24330.tif" /><img file="US2022121884A1_D24331.tif" /><img file="US2022121884A1_D24332.tif" /><img file="US2022121884A1_D24333.tif" /><img file="US2022121884A1_D24334.tif" /><img file="US2022121884A1_D24335.tif" /><img file="US2022121884A1_D24336.tif" /><img file="US2022121884A1_D24337.tif" /><img file="US2022121884A1_D24338.tif" /><img file="US2022121884A1_D24339.tif" /><img file="US2022121884A1_D24340.tif" /><img file="US2022121884A1_D24341.tif" /><img file="US2022121884A1_D24342.tif" /><img file="US2022121884A1_D24343.tif" /><img file="US2022121884A1_D24344.tif" /><img file="US2022121884A1_D24345.tif" /><img file="US2022121884A1_D24346.tif" /><img file="US2022121884A1_D24347.tif" /><img file="US2022121884A1_D24348.tif" /><img file="US2022121884A1_D24349.tif" /><img file="US2022121884A1_D24350.tif" /><img file="US2022121884A1_D24351.tif" /><img file="US2022121884A1_D24352.tif" /><img file="US2022121884A1_D24353.tif" /><img file="US2022121884A1_D24354.tif" /><img file="US2022121884A1_D24355.tif" /><img file="US2022121884A1_D24356.tif" /><img file="US2022121884A1_D24357.tif" /><img file="US2022121884A1_D24358.tif" /><img file="US2022121884A1_D24359.tif" /><img file="US2022121884A1_D24360.tif" /><img file="US2022121884A1_D24361.tif" /><img file="US2022121884A1_D24362.tif" /><img file="US2022121884A1_D24363.tif" /><img file="US2022121884A1_D24364.tif" /><img file="US2022121884A1_D24365.tif" /><img file="US2022121884A1_D24366.tif" /><img file="US2022121884A1_D24367.tif" /><img file="US2022121884A1_D24368.tif" /><img file="US2022121884A1_D24369.tif" /><img file="US2022121884A1_D24370.tif" /><img file="US2022121884A1_D24371.tif" /><img file="US2022121884A1_D24372.tif" /><img file="US2022121884A1_D24373.tif" /><img file="US2022121884A1_D24374.tif" /><img file="US2022121884A1_D24375.tif" /><img file="US2022121884A1_D24376.tif" /><img file="US2022121884A1_D24377.tif" /><img file="US2022121884A1_D24378.tif" /><img file="US2022121884A1_D24379.tif" /><img file="US2022121884A1_D24380.tif" /><img file="US2022121884A1_D24381.tif" /><img file="US2022121884A1_D24382.tif" /><img file="US2022121884A1_D24383.tif" /><img file="US2022121884A1_D24384.tif" /><img file="US2022121884A1_D24385.tif" /><img file="US2022121884A1_D24386.tif" /><img file="US2022121884A1_D24387.tif" /><img file="US2022121884A1_D24388.tif" /><img file="US2022121884A1_D24389.tif" /><img file="US2022121884A1_D24390.tif" /><img file="US2022121884A1_D24391.tif" /><img file="US2022121884A1_D24392.tif" /><img file="US2022121884A1_D24393.tif" /><img file="US2022121884A1_D24394.tif" /><img file="US2022121884A1_D24395.tif" /><img file="US2022121884A1_D24396.tif" /><img file="US2022121884A1_D24397.tif" /><img file="US2022121884A1_D24398.tif" /><img file="US2022121884A1_D24399.tif" /><img file="US2022121884A1_D24400.tif" /><img file="US2022121884A1_D24401.tif" /><img file="US2022121884A1_D24402.tif" /><img file="US2022121884A1_D24403.tif" /><img file="US2022121884A1_D24404.tif" /><img file="US2022121884A1_D24405.tif" /><img file="US2022121884A1_D24406.tif" /><img file="US2022121884A1_D24407.tif" /><img file="US2022121884A1_D24408.tif" /><img file="US2022121884A1_D24409.tif" /><img file="US2022121884A1_D24410.tif" /><img file="US2022121884A1_D24411.tif" /><img file="US2022121884A1_D24412.tif" /><img file="US2022121884A1_D24413.tif" /><img file="US2022121884A1_D24414.tif" /><img file="US2022121884A1_D24415.tif" /><img file="US2022121884A1_D24416.tif" /><img file="US2022121884A1_D24417.tif" /><img file="US2022121884A1_D24418.tif" /><img file="US2022121884A1_D24419.tif" /><img file="US2022121884A1_D24420.tif" /><img file="US2022121884A1_D24421.tif" /><img file="US2022121884A1_D24422.tif" /><img file="US2022121884A1_D24423.tif" /><img file="US2022121884A1_D24424.tif" /><img file="US2022121884A1_D24425.tif" /><img file="US2022121884A1_D24426.tif" /><img file="US2022121884A1_D24427.tif" /><img file="US2022121884A1_D24428.tif" /><img file="US2022121884A1_D24429.tif" />
where m is the margin. Note that in D dimensional space of w, there are (D-1) independent ŵ<sub>⊥</sub> per ŵ (unit vector in direction of w, also denoted as ŵ<sub>∥</sub>. Equation (31) implies that, at the solution, the torque from the forces (α<sub>i</sub>y<sub>i</sub>) balance so not to tilt ŵ in the direction of ŵ<sub>⊥</sub>. It should be noted that if x<sub>i</sub>'s are offset by a arbitrary fixed vector q, Equation (24) (as well as (31)) remain invariant under such translation due to (25):
<maths id="MATH-US-00124" num="00124"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>1</mn></mrow><mi>N</mi></munderover><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><msub><mi>α</mi><mi>i</mi></msub><mo></mo><mrow><msub><mi>y</mi><mi>i</mi></msub><mo></mo><mrow><mo>(</mo><mrow><msub><mi>x</mi><mi>i</mi></msub><mo>-</mo><mi>q</mi></mrow><mo>)</mo></mrow></mrow></mrow></mrow><mo>=</mo><mrow><mrow><mrow><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>1</mn></mrow><mi>N</mi></munderover><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><msub><mi>α</mi><mi>i</mi></msub><mo></mo><msub><mi>y</mi><mi>i</mi></msub><mo></mo><msub><mi>x</mi><mi>i</mi></msub></mrow></mrow><mo>-</mo><mrow><mrow><mo>(</mo><mrow><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>1</mn></mrow><mi>N</mi></munderover><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><msub><mi>α</mi><mi>i</mi></msub><mo></mo><msub><mi>y</mi><mi>i</mi></msub></mrow></mrow><mo>)</mo></mrow><mo></mo><mi>q</mi></mrow></mrow><mo>=</mo><mrow><mrow><mi>w</mi><mo>-</mo><mn>0</mn></mrow><mo>=</mo><mi>w</mi></mrow></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mn>32</mn><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2022121884A1_D24430.tif" /><img file="US2022121884A1_D24431.tif" /><img file="US2022121884A1_D24432.tif" /><img file="US2022121884A1_D24433.tif" /><img file="US2022121884A1_D24434.tif" /><img file="US2022121884A1_D24435.tif" /><img file="US2022121884A1_D24436.tif" /><img file="US2022121884A1_D24437.tif" /><img file="US2022121884A1_D24438.tif" /><img file="US2022121884A1_D24439.tif" /><img file="US2022121884A1_D24440.tif" /><img file="US2022121884A1_D24441.tif" /><img file="US2022121884A1_D24442.tif" /><img file="US2022121884A1_D24443.tif" /><img file="US2022121884A1_D24444.tif" /><img file="US2022121884A1_D24445.tif" /><img file="US2022121884A1_D24446.tif" /><img file="US2022121884A1_D24447.tif" /><img file="US2022121884A1_D24448.tif" /><img file="US2022121884A1_D24449.tif" /><img file="US2022121884A1_D24450.tif" /><img file="US2022121884A1_D24451.tif" /><img file="US2022121884A1_D24452.tif" /><img file="US2022121884A1_D24453.tif" /><img file="US2022121884A1_D24454.tif" /><img file="US2022121884A1_D24455.tif" /><img file="US2022121884A1_D24456.tif" /><img file="US2022121884A1_D24457.tif" /><img file="US2022121884A1_D24458.tif" /><img file="US2022121884A1_D24459.tif" /><img file="US2022121884A1_D24460.tif" /><img file="US2022121884A1_D24461.tif" /><img file="US2022121884A1_D24462.tif" /><img file="US2022121884A1_D24463.tif" /><img file="US2022121884A1_D24464.tif" /><img file="US2022121884A1_D24465.tif" /><img file="US2022121884A1_D24466.tif" /><img file="US2022121884A1_D24467.tif" /><img file="US2022121884A1_D24468.tif" /><img file="US2022121884A1_D24469.tif" /><img file="US2022121884A1_D24470.tif" /><img file="US2022121884A1_D24471.tif" /><img file="US2022121884A1_D24472.tif" /><img file="US2022121884A1_D24473.tif" /><img file="US2022121884A1_D24474.tif" /><img file="US2022121884A1_D24475.tif" /><img file="US2022121884A1_D24476.tif" /><img file="US2022121884A1_D24477.tif" /><img file="US2022121884A1_D24478.tif" /><img file="US2022121884A1_D24479.tif" /><img file="US2022121884A1_D24480.tif" /><img file="US2022121884A1_D24481.tif" /><img file="US2022121884A1_D24482.tif" /><img file="US2022121884A1_D24483.tif" /><img file="US2022121884A1_D24484.tif" /><img file="US2022121884A1_D24485.tif" /><img file="US2022121884A1_D24486.tif" /><img file="US2022121884A1_D24487.tif" /><img file="US2022121884A1_D24488.tif" /><img file="US2022121884A1_D24489.tif" /><img file="US2022121884A1_D24490.tif" /><img file="US2022121884A1_D24491.tif" /><img file="US2022121884A1_D24492.tif" /><img file="US2022121884A1_D24493.tif" /><img file="US2022121884A1_D24494.tif" /><img file="US2022121884A1_D24495.tif" /><img file="US2022121884A1_D24496.tif" /><img file="US2022121884A1_D24497.tif" /><img file="US2022121884A1_D24498.tif" /><img file="US2022121884A1_D24499.tif" /><img file="US2022121884A1_D24500.tif" /><img file="US2022121884A1_D24501.tif" /><img file="US2022121884A1_D24502.tif" /><img file="US2022121884A1_D24503.tif" /><img file="US2022121884A1_D24504.tif" /><img file="US2022121884A1_D24505.tif" /><img file="US2022121884A1_D24506.tif" /><img file="US2022121884A1_D24507.tif" /><img file="US2022121884A1_D24508.tif" /><img file="US2022121884A1_D24509.tif" /><img file="US2022121884A1_D24510.tif" /><img file="US2022121884A1_D24511.tif" /><img file="US2022121884A1_D24512.tif" /><img file="US2022121884A1_D24513.tif" /><img file="US2022121884A1_D24514.tif" /><img file="US2022121884A1_D24515.tif" /><img file="US2022121884A1_D24516.tif" /><img file="US2022121884A1_D24517.tif" /><img file="US2022121884A1_D24518.tif" /><img file="US2022121884A1_D24519.tif" /><img file="US2022121884A1_D24520.tif" /><img file="US2022121884A1_D24521.tif" /><img file="US2022121884A1_D24522.tif" /><img file="US2022121884A1_D24523.tif" /><img file="US2022121884A1_D24524.tif" /><img file="US2022121884A1_D24525.tif" /><img file="US2022121884A1_D24526.tif" /><img file="US2022121884A1_D24527.tif" /><img file="US2022121884A1_D24528.tif" /><img file="US2022121884A1_D24529.tif" /><img file="US2022121884A1_D24530.tif" /><img file="US2022121884A1_D24531.tif" /><img file="US2022121884A1_D24532.tif" /><img file="US2022121884A1_D24533.tif" /><img file="US2022121884A1_D24534.tif" /><img file="US2022121884A1_D24535.tif" /><img file="US2022121884A1_D24536.tif" /><img file="US2022121884A1_D24537.tif" /><img file="US2022121884A1_D24538.tif" /><img file="US2022121884A1_D24539.tif" /><img file="US2022121884A1_D24540.tif" /><img file="US2022121884A1_D24541.tif" />
By placing q on the hyperplane (u=0), Equation (31) demonstrates that the torques balance around such a pivot point in any of ŵ<sub>⊥</sub> direction(s), as for example depicted in <figref idref="DRAWINGS">FIG. 255</figref>.
This also implies that the “center of mass” for “circle class” (for solid circles) should have the same projection on ŵ<sub>⊥</sub> as the center of mass for “square class” (solid squares), when the optimum solution is at hand. This is because the torque from a set of points from one class can be represented from the torque from their corresponding center of mass. Note that the center of mass for such points is weighted by their corresponding force (α) as shown below:
<maths id="MATH-US-00125" num="00125"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><mrow><mrow><mo>(</mo><mrow><munder><mo>∑</mo><msub><mi>i</mi><mo>+</mo></msub></munder><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><msub><mi>α</mi><msub><mi>i</mi><mo>+</mo></msub></msub></mrow><mo>)</mo></mrow><mo>·</mo><msub><mi>COM</mi><mo>+</mo></msub></mrow><mo>=</mo><mrow><munder><mo>∑</mo><msub><mi>i</mi><mo>+</mo></msub></munder><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><msub><mi>α</mi><msub><mi>i</mi><mo>+</mo></msub></msub><mo></mo><msub><mi>x</mi><msub><mi>i</mi><mo>+</mo></msub></msub></mrow></mrow></mrow><mo>,</mo><mrow><mrow><mrow><mo>(</mo><mrow><munder><mo>∑</mo><msub><mi>i</mi><mo>-</mo></msub></munder><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><msub><mi>α</mi><msub><mi>i</mi><mo>-</mo></msub></msub></mrow><mo>)</mo></mrow><mo>·</mo><msub><mi>COM</mi><mo>-</mo></msub></mrow><mo>=</mo><mrow><munder><mo>∑</mo><msub><mi>i</mi><mo>-</mo></msub></munder><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><msub><mi>α</mi><msub><mi>i</mi><mo>-</mo></msub></msub><mo></mo><msub><mi>x</mi><msub><mi>i</mi><mo>-</mo></msub></msub></mrow></mrow></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mn>33</mn><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2022121884A1_D24542.tif" /><img file="US2022121884A1_D24543.tif" /><img file="US2022121884A1_D24544.tif" /><img file="US2022121884A1_D24545.tif" /><img file="US2022121884A1_D24546.tif" /><img file="US2022121884A1_D24547.tif" /><img file="US2022121884A1_D24548.tif" /><img file="US2022121884A1_D24549.tif" /><img file="US2022121884A1_D24550.tif" /><img file="US2022121884A1_D24551.tif" /><img file="US2022121884A1_D24552.tif" /><img file="US2022121884A1_D24553.tif" /><img file="US2022121884A1_D24554.tif" /><img file="US2022121884A1_D24555.tif" /><img file="US2022121884A1_D24556.tif" /><img file="US2022121884A1_D24557.tif" /><img file="US2022121884A1_D24558.tif" /><img file="US2022121884A1_D24559.tif" /><img file="US2022121884A1_D24560.tif" /><img file="US2022121884A1_D24561.tif" /><img file="US2022121884A1_D24562.tif" /><img file="US2022121884A1_D24563.tif" /><img file="US2022121884A1_D24564.tif" /><img file="US2022121884A1_D24565.tif" /><img file="US2022121884A1_D24566.tif" /><img file="US2022121884A1_D24567.tif" /><img file="US2022121884A1_D24568.tif" /><img file="US2022121884A1_D24569.tif" /><img file="US2022121884A1_D24570.tif" /><img file="US2022121884A1_D24571.tif" /><img file="US2022121884A1_D24572.tif" /><img file="US2022121884A1_D24573.tif" /><img file="US2022121884A1_D24574.tif" /><img file="US2022121884A1_D24575.tif" /><img file="US2022121884A1_D24576.tif" /><img file="US2022121884A1_D24577.tif" /><img file="US2022121884A1_D24578.tif" /><img file="US2022121884A1_D24579.tif" /><img file="US2022121884A1_D24580.tif" /><img file="US2022121884A1_D24581.tif" /><img file="US2022121884A1_D24582.tif" /><img file="US2022121884A1_D24583.tif" /><img file="US2022121884A1_D24584.tif" /><img file="US2022121884A1_D24585.tif" /><img file="US2022121884A1_D24586.tif" /><img file="US2022121884A1_D24587.tif" /><img file="US2022121884A1_D24588.tif" /><img file="US2022121884A1_D24589.tif" /><img file="US2022121884A1_D24590.tif" /><img file="US2022121884A1_D24591.tif" /><img file="US2022121884A1_D24592.tif" /><img file="US2022121884A1_D24593.tif" /><img file="US2022121884A1_D24594.tif" /><img file="US2022121884A1_D24595.tif" /><img file="US2022121884A1_D24596.tif" /><img file="US2022121884A1_D24597.tif" /><img file="US2022121884A1_D24598.tif" /><img file="US2022121884A1_D24599.tif" /><img file="US2022121884A1_D24600.tif" /><img file="US2022121884A1_D24601.tif" /><img file="US2022121884A1_D24602.tif" /><img file="US2022121884A1_D24603.tif" /><img file="US2022121884A1_D24604.tif" /><img file="US2022121884A1_D24605.tif" /><img file="US2022121884A1_D24606.tif" /><img file="US2022121884A1_D24607.tif" /><img file="US2022121884A1_D24608.tif" /><img file="US2022121884A1_D24609.tif" /><img file="US2022121884A1_D24610.tif" /><img file="US2022121884A1_D24611.tif" /><img file="US2022121884A1_D24612.tif" /><img file="US2022121884A1_D24613.tif" /><img file="US2022121884A1_D24614.tif" /><img file="US2022121884A1_D24615.tif" /><img file="US2022121884A1_D24616.tif" /><img file="US2022121884A1_D24617.tif" /><img file="US2022121884A1_D24618.tif" /><img file="US2022121884A1_D24619.tif" /><img file="US2022121884A1_D24620.tif" /><img file="US2022121884A1_D24621.tif" /><img file="US2022121884A1_D24622.tif" /><img file="US2022121884A1_D24623.tif" /><img file="US2022121884A1_D24624.tif" /><img file="US2022121884A1_D24625.tif" /><img file="US2022121884A1_D24626.tif" /><img file="US2022121884A1_D24627.tif" /><img file="US2022121884A1_D24628.tif" /><img file="US2022121884A1_D24629.tif" /><img file="US2022121884A1_D24630.tif" /><img file="US2022121884A1_D24631.tif" /><img file="US2022121884A1_D24632.tif" /><img file="US2022121884A1_D24633.tif" /><img file="US2022121884A1_D24634.tif" /><img file="US2022121884A1_D24635.tif" /><img file="US2022121884A1_D24636.tif" /><img file="US2022121884A1_D24637.tif" /><img file="US2022121884A1_D24638.tif" /><img file="US2022121884A1_D24639.tif" /><img file="US2022121884A1_D24640.tif" /><img file="US2022121884A1_D24641.tif" /><img file="US2022121884A1_D24642.tif" /><img file="US2022121884A1_D24643.tif" /><img file="US2022121884A1_D24644.tif" /><img file="US2022121884A1_D24645.tif" /><img file="US2022121884A1_D24646.tif" /><img file="US2022121884A1_D24647.tif" /><img file="US2022121884A1_D24648.tif" /><img file="US2022121884A1_D24649.tif" /><img file="US2022121884A1_D24650.tif" /><img file="US2022121884A1_D24651.tif" /><img file="US2022121884A1_D24652.tif" /><img file="US2022121884A1_D24653.tif" />
Given (30) and (24), Equation (31) may be written as follows:
<br />COM<sub>+</sub><i>·ŵ</i><sub>⊥</sub>=COM<sub>−</sub><i>·ŵ</i><sub>⊥</sub> or (COM<sub>+</sub>-COM<sub>−</sub>) ·ŵ<sub>195 </sub>=0 (34)
In cases that the number of points violating the margin (from both classes) are significantly higher than those exactly on the margin, one can assume that most of α<sub>i</sub>'s are limited to C, and the determination of the center of mass is simplified to a class member head count (violating the margin) and its projection on ŵ<sub>⊥</sub>.
It is noteworthy that the projection on the direction of w (i.e., ŵ or ŵ<sub>∥</sub>) produces the inverse of margin:
<maths id="MATH-US-00126" num="00126"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>1</mn></mrow><mi>N</mi></munderover><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><msub><mi>α</mi><mi>i</mi></msub><mo></mo><mrow><msub><mi>y</mi><mi>i</mi></msub><mo></mo><mrow><mo>(</mo><mrow><msub><mi>x</mi><mi>i</mi></msub><mo>·</mo><msub><mover><mi>w</mi><mo>^</mo></mover><mo></mo></msub></mrow><mo>)</mo></mrow></mrow></mrow></mrow><mo>=</mo><mrow><mrow><mrow><mo>(</mo><mrow><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>1</mn></mrow><mi>N</mi></munderover><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><msub><mi>α</mi><mi>i</mi></msub><mo></mo><msub><mi>y</mi><mi>i</mi></msub><mo></mo><msub><mi>x</mi><mi>i</mi></msub></mrow></mrow><mo>)</mo></mrow><mo>·</mo><msub><mover><mi>w</mi><mo>^</mo></mover><mo></mo></msub></mrow><mo>=</mo><mrow><mrow><mi>w</mi><mo>·</mo><msub><mover><mi>w</mi><mo>^</mo></mover><mrow><mo></mo><mo></mo></mrow></msub></mrow><mo>=</mo><mrow><mrow><mo></mo><mi>w</mi><mo></mo></mrow><mo>=</mo><msup><mi>m</mi><mrow><mo>-</mo><mn>1</mn></mrow></msup></mrow></mrow></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mn>35</mn><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2022121884A1_D24654.tif" /><img file="US2022121884A1_D24655.tif" /><img file="US2022121884A1_D24656.tif" /><img file="US2022121884A1_D24657.tif" /><img file="US2022121884A1_D24658.tif" /><img file="US2022121884A1_D24659.tif" /><img file="US2022121884A1_D24660.tif" /><img file="US2022121884A1_D24661.tif" /><img file="US2022121884A1_D24662.tif" /><img file="US2022121884A1_D24663.tif" /><img file="US2022121884A1_D24664.tif" /><img file="US2022121884A1_D24665.tif" /><img file="US2022121884A1_D24666.tif" /><img file="US2022121884A1_D24667.tif" /><img file="US2022121884A1_D24668.tif" /><img file="US2022121884A1_D24669.tif" /><img file="US2022121884A1_D24670.tif" /><img file="US2022121884A1_D24671.tif" /><img file="US2022121884A1_D24672.tif" /><img file="US2022121884A1_D24673.tif" /><img file="US2022121884A1_D24674.tif" /><img file="US2022121884A1_D24675.tif" /><img file="US2022121884A1_D24676.tif" /><img file="US2022121884A1_D24677.tif" /><img file="US2022121884A1_D24678.tif" /><img file="US2022121884A1_D24679.tif" /><img file="US2022121884A1_D24680.tif" /><img file="US2022121884A1_D24681.tif" /><img file="US2022121884A1_D24682.tif" /><img file="US2022121884A1_D24683.tif" /><img file="US2022121884A1_D24684.tif" /><img file="US2022121884A1_D24685.tif" /><img file="US2022121884A1_D24686.tif" /><img file="US2022121884A1_D24687.tif" /><img file="US2022121884A1_D24688.tif" /><img file="US2022121884A1_D24689.tif" /><img file="US2022121884A1_D24690.tif" /><img file="US2022121884A1_D24691.tif" /><img file="US2022121884A1_D24692.tif" /><img file="US2022121884A1_D24693.tif" /><img file="US2022121884A1_D24694.tif" /><img file="US2022121884A1_D24695.tif" /><img file="US2022121884A1_D24696.tif" /><img file="US2022121884A1_D24697.tif" /><img file="US2022121884A1_D24698.tif" /><img file="US2022121884A1_D24699.tif" /><img file="US2022121884A1_D24700.tif" /><img file="US2022121884A1_D24701.tif" /><img file="US2022121884A1_D24702.tif" /><img file="US2022121884A1_D24703.tif" /><img file="US2022121884A1_D24704.tif" /><img file="US2022121884A1_D24705.tif" /><img file="US2022121884A1_D24706.tif" /><img file="US2022121884A1_D24707.tif" /><img file="US2022121884A1_D24708.tif" /><img file="US2022121884A1_D24709.tif" /><img file="US2022121884A1_D24710.tif" /><img file="US2022121884A1_D24711.tif" /><img file="US2022121884A1_D24712.tif" /><img file="US2022121884A1_D24713.tif" /><img file="US2022121884A1_D24714.tif" /><img file="US2022121884A1_D24715.tif" /><img file="US2022121884A1_D24716.tif" /><img file="US2022121884A1_D24717.tif" /><img file="US2022121884A1_D24718.tif" /><img file="US2022121884A1_D24719.tif" /><img file="US2022121884A1_D24720.tif" /><img file="US2022121884A1_D24721.tif" /><img file="US2022121884A1_D24722.tif" /><img file="US2022121884A1_D24723.tif" /><img file="US2022121884A1_D24724.tif" /><img file="US2022121884A1_D24725.tif" /><img file="US2022121884A1_D24726.tif" /><img file="US2022121884A1_D24727.tif" /><img file="US2022121884A1_D24728.tif" /><img file="US2022121884A1_D24729.tif" /><img file="US2022121884A1_D24730.tif" /><img file="US2022121884A1_D24731.tif" /><img file="US2022121884A1_D24732.tif" /><img file="US2022121884A1_D24733.tif" /><img file="US2022121884A1_D24734.tif" /><img file="US2022121884A1_D24735.tif" /><img file="US2022121884A1_D24736.tif" /><img file="US2022121884A1_D24737.tif" /><img file="US2022121884A1_D24738.tif" /><img file="US2022121884A1_D24739.tif" /><img file="US2022121884A1_D24740.tif" /><img file="US2022121884A1_D24741.tif" /><img file="US2022121884A1_D24742.tif" /><img file="US2022121884A1_D24743.tif" /><img file="US2022121884A1_D24744.tif" /><img file="US2022121884A1_D24745.tif" /><img file="US2022121884A1_D24746.tif" /><img file="US2022121884A1_D24747.tif" /><img file="US2022121884A1_D24748.tif" /><img file="US2022121884A1_D24749.tif" /><img file="US2022121884A1_D24750.tif" /><img file="US2022121884A1_D24751.tif" /><img file="US2022121884A1_D24752.tif" /><img file="US2022121884A1_D24753.tif" /><img file="US2022121884A1_D24754.tif" /><img file="US2022121884A1_D24755.tif" /><img file="US2022121884A1_D24756.tif" /><img file="US2022121884A1_D24757.tif" /><img file="US2022121884A1_D24758.tif" /><img file="US2022121884A1_D24759.tif" /><img file="US2022121884A1_D24760.tif" /><img file="US2022121884A1_D24761.tif" /><img file="US2022121884A1_D24762.tif" /><img file="US2022121884A1_D24763.tif" /><img file="US2022121884A1_D24764.tif" /><img file="US2022121884A1_D24765.tif" />
To setup the problem, for the first iteration, COM<sub>±</sub> are determined from all class data points via (33) (by ignoring α<sub>i</sub>'s, e.g., by setting them to 1). The initial w<sub>init </sub>is estimated as follows:
<maths id="MATH-US-00127" num="00127"><math overflow="scroll"><mtable><mtr><mtd><mrow><msub><mover><mi>w</mi><mo>^</mo></mover><mi>init</mi></msub><mo>=</mo><mfrac><mrow><msub><mi>COM</mi><mo>+</mo></msub><mo>-</mo><msub><mi>COM</mi><mo>-</mo></msub></mrow><mrow><mo></mo><mrow><msub><mi>COM</mi><mo>+</mo></msub><mo>-</mo><msub><mi>COM</mi><mo>-</mo></msub></mrow><mo></mo></mrow></mfrac></mrow></mtd><mtd><mrow><mo>(</mo><mn>36</mn><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2022121884A1_D24766.tif" /><img file="US2022121884A1_D24767.tif" /><img file="US2022121884A1_D24768.tif" /><img file="US2022121884A1_D24769.tif" /><img file="US2022121884A1_D24770.tif" /><img file="US2022121884A1_D24771.tif" /><img file="US2022121884A1_D24772.tif" /><img file="US2022121884A1_D24773.tif" /><img file="US2022121884A1_D24774.tif" /><img file="US2022121884A1_D24775.tif" /><img file="US2022121884A1_D24776.tif" /><img file="US2022121884A1_D24777.tif" /><img file="US2022121884A1_D24778.tif" /><img file="US2022121884A1_D24779.tif" /><img file="US2022121884A1_D24780.tif" /><img file="US2022121884A1_D24781.tif" /><img file="US2022121884A1_D24782.tif" /><img file="US2022121884A1_D24783.tif" /><img file="US2022121884A1_D24784.tif" /><img file="US2022121884A1_D24785.tif" /><img file="US2022121884A1_D24786.tif" /><img file="US2022121884A1_D24787.tif" /><img file="US2022121884A1_D24788.tif" /><img file="US2022121884A1_D24789.tif" /><img file="US2022121884A1_D24790.tif" /><img file="US2022121884A1_D24791.tif" /><img file="US2022121884A1_D24792.tif" /><img file="US2022121884A1_D24793.tif" /><img file="US2022121884A1_D24794.tif" /><img file="US2022121884A1_D24795.tif" /><img file="US2022121884A1_D24796.tif" /><img file="US2022121884A1_D24797.tif" /><img file="US2022121884A1_D24798.tif" /><img file="US2022121884A1_D24799.tif" /><img file="US2022121884A1_D24800.tif" /><img file="US2022121884A1_D24801.tif" /><img file="US2022121884A1_D24802.tif" /><img file="US2022121884A1_D24803.tif" /><img file="US2022121884A1_D24804.tif" /><img file="US2022121884A1_D24805.tif" /><img file="US2022121884A1_D24806.tif" /><img file="US2022121884A1_D24807.tif" /><img file="US2022121884A1_D24808.tif" /><img file="US2022121884A1_D24809.tif" /><img file="US2022121884A1_D24810.tif" /><img file="US2022121884A1_D24811.tif" /><img file="US2022121884A1_D24812.tif" /><img file="US2022121884A1_D24813.tif" /><img file="US2022121884A1_D24814.tif" /><img file="US2022121884A1_D24815.tif" /><img file="US2022121884A1_D24816.tif" /><img file="US2022121884A1_D24817.tif" /><img file="US2022121884A1_D24818.tif" /><img file="US2022121884A1_D24819.tif" /><img file="US2022121884A1_D24820.tif" /><img file="US2022121884A1_D24821.tif" /><img file="US2022121884A1_D24822.tif" /><img file="US2022121884A1_D24823.tif" /><img file="US2022121884A1_D24824.tif" /><img file="US2022121884A1_D24825.tif" /><img file="US2022121884A1_D24826.tif" /><img file="US2022121884A1_D24827.tif" /><img file="US2022121884A1_D24828.tif" /><img file="US2022121884A1_D24829.tif" /><img file="US2022121884A1_D24830.tif" /><img file="US2022121884A1_D24831.tif" /><img file="US2022121884A1_D24832.tif" /><img file="US2022121884A1_D24833.tif" /><img file="US2022121884A1_D24834.tif" /><img file="US2022121884A1_D24835.tif" /><img file="US2022121884A1_D24836.tif" /><img file="US2022121884A1_D24837.tif" /><img file="US2022121884A1_D24838.tif" /><img file="US2022121884A1_D24839.tif" /><img file="US2022121884A1_D24840.tif" /><img file="US2022121884A1_D24841.tif" /><img file="US2022121884A1_D24842.tif" /><img file="US2022121884A1_D24843.tif" /><img file="US2022121884A1_D24844.tif" /><img file="US2022121884A1_D24845.tif" /><img file="US2022121884A1_D24846.tif" /><img file="US2022121884A1_D24847.tif" /><img file="US2022121884A1_D24848.tif" /><img file="US2022121884A1_D24849.tif" /><img file="US2022121884A1_D24850.tif" /><img file="US2022121884A1_D24851.tif" /><img file="US2022121884A1_D24852.tif" /><img file="US2022121884A1_D24853.tif" /><img file="US2022121884A1_D24854.tif" /><img file="US2022121884A1_D24855.tif" /><img file="US2022121884A1_D24856.tif" /><img file="US2022121884A1_D24857.tif" /><img file="US2022121884A1_D24858.tif" /><img file="US2022121884A1_D24859.tif" /><img file="US2022121884A1_D24860.tif" /><img file="US2022121884A1_D24861.tif" /><img file="US2022121884A1_D24862.tif" /><img file="US2022121884A1_D24863.tif" /><img file="US2022121884A1_D24864.tif" /><img file="US2022121884A1_D24865.tif" /><img file="US2022121884A1_D24866.tif" /><img file="US2022121884A1_D24867.tif" /><img file="US2022121884A1_D24868.tif" /><img file="US2022121884A1_D24869.tif" /><img file="US2022121884A1_D24870.tif" /><img file="US2022121884A1_D24871.tif" /><img file="US2022121884A1_D24872.tif" /><img file="US2022121884A1_D24873.tif" /><img file="US2022121884A1_D24874.tif" /><img file="US2022121884A1_D24875.tif" /><img file="US2022121884A1_D24876.tif" /><img file="US2022121884A1_D24877.tif" />
A set of ŵ<sub>≣</sub>'s is determined for ŵ<sub>init</sub>, for example by reconstructing a successive pair-wise rotation matrices that aligns the unit vector associated with the last coordinate to ŵ<sub>unit</sub>. Same transformation provides a set of (<img file="US2022121884A1_D24878.tif" />-1) orthonormal by operating on the other unit vectors of other (<img file="US2022121884A1_D24879.tif" />-1) dimensions.
1.2 Scanning Through Ordered Projection Values:
Next, x<sub>i</sub>'s are projected onto ŵ<sub>init </sub>(or ŵ<sub>∥</sub>) (see <figref idref="DRAWINGS">FIG. 256</figref>), and they are sorted based on the projected values (p<sub>i</sub>):
<br />p<sub>i</sub>=x<sub>i</sub>·ŵ<sub>∥</sub> (37)
Next, for a given set of percentage of population (e.g., 1%, 5%, 10%, 20% . . . of the class with less members), scan/count from low end of p<sub>i </sub>for y=+1 class (denoted as p<sub>start+</sub>) and high end of p<sub>i </sub>for y=−1 class (denoted as p<sub>start−</sub>) as shown in <figref idref="DRAWINGS">FIG. 256</figref>. The count can also be sequential from each sorted list, for example, based on margin or percentage change. If the data set happens to be separable by ŵ<sub>∥</sub>, p<sub>start+</sub> is more than p<sub>start−</sub>, and their average (denoted as p<sub>m0</sub>) marks the hyperplane candidate for zero error, and half of their difference corresponds to its margin.
If p<sub>start+</sub> is less than p<sub>start−</sub> (i.e., not linearly separable in ŵ<sub>∥</sub> direction), the count/scan continues until the class markers on projected pass each other. In such a case, the prior position of the markers (before passing each other), p<sub>m0+</sub> and p<sub>m0−</sub>, are used to mark a zero-margin hyperplane candidate under ŵ<sub>∥</sub>, for example by taking an average value. The slack error is tracked by simply adding the projected values during the scan/count (to be later offset and scaled by the position of the hyperplane and size of the margin, respectively) as shown in (43) and (41). At given class counter positions, p<sub>m1+</sub> and p<sub>m1−</sub> (see <figref idref="DRAWINGS">FIG. 256</figref>), the hyperplane parameters are estimated as follows:
<maths id="MATH-US-00128" num="00128"><math overflow="scroll"><mtable><mtr><mtd><mrow><mi>m</mi><mo>=</mo><mrow><mrow><mfrac><mn>1</mn><mn>2</mn></mfrac><mo></mo><mrow><mo>(</mo><mrow><msub><mi>p</mi><mrow><mrow><mi>m</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>1</mn></mrow><mo>+</mo></mrow></msub><mo>-</mo><msub><mi>p</mi><mrow><mrow><mi>m</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>1</mn></mrow><mo>-</mo></mrow></msub></mrow><mo>)</mo></mrow><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>and</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>w</mi></mrow><mo>=</mo><mrow><mrow><mrow><mo></mo><mi>w</mi><mo></mo></mrow><mo></mo><msub><mover><mi>w</mi><mo>^</mo></mover><mo></mo></msub></mrow><mo>=</mo><mrow><msup><mi>m</mi><mrow><mo>-</mo><mn>1</mn></mrow></msup><mo></mo><msub><mover><mi>w</mi><mo>^</mo></mover><mo></mo></msub></mrow></mrow></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mn>38</mn><mo>)</mo></mrow></mtd></mtr><mtr><mtd><mrow><mi>b</mi><mo>=</mo><mrow><mrow><mrow><mi>u</mi><mo>-</mo><mfrac><mrow><msub><mover><mi>w</mi><mo>^</mo></mover><mo></mo></msub><mo>·</mo><mi>x</mi></mrow><mi>m</mi></mfrac></mrow><mo></mo><msub><mo>❘</mo><mrow><mi>at</mi><mo></mo><mstyle><mspace width="0.6em" height="0.6ex" /></mstyle><mo></mo><mi>hyperplane</mi></mrow></msub></mrow><mo>=</mo><mrow><mrow><mn>0</mn><mo>-</mo><mfrac><mrow><mrow><mo>(</mo><mtable><mtr><mtd><mrow><msub><mi>p</mi><mrow><mrow><mi>m</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>1</mn></mrow><mo>+</mo></mrow></msub><mo>+</mo></mrow></mtd></mtr><mtr><mtd><msub><mi>p</mi><mrow><mrow><mi>m</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>1</mn></mrow><mo>-</mo></mrow></msub></mtd></mtr></mtable><mo>)</mo></mrow><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle></mrow><mrow><mn>2</mn><mo></mo><mstyle><mspace width="0.6em" height="0.6ex" /></mstyle><mo></mo><mi>m</mi></mrow></mfrac></mrow><mo>=</mo><mfrac><mrow><msub><mi>p</mi><mrow><mrow><mi>m</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>1</mn></mrow><mo>+</mo></mrow></msub><mo>+</mo><msub><mi>p</mi><mrow><mrow><mi>m</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>1</mn></mrow><mo>-</mo></mrow></msub></mrow><mrow><msub><mi>p</mi><mrow><mrow><mi>m</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>1</mn></mrow><mo>+</mo></mrow></msub><mo>-</mo><msub><mi>p</mi><mrow><mrow><mi>m</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>1</mn></mrow><mo>-</mo></mrow></msub></mrow></mfrac></mrow></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mn>39</mn><mo>)</mo></mrow></mtd></mtr><mtr><mtd><mrow><mrow><mrow><munder><mrow><mrow><mi>Est</mi><mo>.</mo><mi>Slack</mi></mrow><mo></mo><mstyle><mspace width="0.6em" height="0.6ex" /></mstyle><mo></mo><mi>Err</mi></mrow><mrow><mo>(</mo><mrow><mi>scaled</mi><mo></mo><mstyle><mspace width="0.6em" height="0.6ex" /></mstyle><mo></mo><mi>by</mi><mo></mo><mstyle><mspace width="0.6em" height="0.6ex" /></mstyle><mo></mo><mi>C</mi></mrow><mo>)</mo></mrow></munder><mo>≈</mo><mrow><mi>C</mi><mo>·</mo><mrow><mo>[</mo><mrow><mrow><msub><mi>ℱ</mi><mo>+</mo></msub><mo></mo><mrow><mo>(</mo><msub><mi>N</mi><mrow><mrow><mi>m</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>1</mn></mrow><mo>+</mo></mrow></msub><mo>)</mo></mrow></mrow><mo>+</mo><mrow><msub><mi>ℱ</mi><mo>-</mo></msub><mo></mo><mrow><mo>(</mo><msub><mi>N</mi><mrow><mrow><mi>m</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>1</mn></mrow><mo>-</mo></mrow></msub><mo>)</mo></mrow></mrow></mrow><mo>]</mo></mrow></mrow></mrow><mo>,</mo><mi>where</mi></mrow><mo></mo><mstyle><mtext></mtext></mstyle><mo></mo><mtable><mtr><mtd><mrow><mrow><msub><mi>ℱ</mi><mo>±</mo></msub><mo></mo><mrow><mo>(</mo><msub><mi>N</mi><mrow><mrow><mi>m</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>1</mn></mrow><mo>±</mo></mrow></msub><mo>)</mo></mrow></mrow><mo>=</mo><mi /><mo></mo><mrow><msub><mi>N</mi><mrow><mrow><mi>m</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>1</mn></mrow><mo>±</mo></mrow></msub><mo>·</mo><mrow><mo>[</mo><mrow><mfrac><mn>1</mn><mi>m</mi></mfrac><mo></mo><mrow><mrow><mo>(</mo><mrow><msub><mi>p</mi><mrow><mrow><mi>m</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>1</mn></mrow><mo>±</mo></mrow></msub><mo>-</mo><mrow><mfrac><mn>1</mn><msub><mi>N</mi><mrow><mrow><mi>m</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>1</mn></mrow><mo>±</mo></mrow></msub></mfrac><mo></mo><mrow><munder><mo>∑</mo><munder><msub><mi>i</mi><mo>±</mo></msub><mi>scanned</mi></munder></munder><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><msub><mi>p</mi><msub><mi>i</mi><mo>±</mo></msub></msub></mrow></mrow></mrow><mo>)</mo></mrow><mo>·</mo><msub><mi>y</mi><mo>±</mo></msub></mrow></mrow><mo>]</mo></mrow></mrow></mrow></mtd></mtr><mtr><mtd><mrow><mo>=</mo><mi /><mo></mo><mrow><msub><mi>N</mi><mrow><mrow><mi>m</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>1</mn></mrow><mo>±</mo></mrow></msub><mo>·</mo><mrow><mo>[</mo><mrow><mfrac><mn>1</mn><mi>m</mi></mfrac><mo></mo><mrow><mo>(</mo><mrow><msub><mi>p</mi><mrow><mrow><mi>m</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>1</mn></mrow><mo>±</mo></mrow></msub><mo>-</mo><mrow><msub><mi>COM</mi><mrow><mi>scanned</mi><mo>±</mo></mrow></msub><mo>·</mo><msub><mover><mi>w</mi><mo>^</mo></mover><mo></mo></msub></mrow></mrow><mo>)</mo></mrow></mrow><mo>]</mo></mrow></mrow></mrow></mtd></mtr></mtable></mrow></mtd><mtd><mrow><mo>(</mo><mn>40</mn><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2022121884A1_D24880.tif" /><img file="US2022121884A1_D24881.tif" /><img file="US2022121884A1_D24882.tif" /><img file="US2022121884A1_D24883.tif" /><img file="US2022121884A1_D24884.tif" /><img file="US2022121884A1_D24885.tif" /><img file="US2022121884A1_D24886.tif" /><img file="US2022121884A1_D24887.tif" /><img file="US2022121884A1_D24888.tif" /><img file="US2022121884A1_D24889.tif" /><img file="US2022121884A1_D24890.tif" /><img file="US2022121884A1_D24891.tif" /><img file="US2022121884A1_D24892.tif" /><img file="US2022121884A1_D24893.tif" /><img file="US2022121884A1_D24894.tif" /><img file="US2022121884A1_D24895.tif" /><img file="US2022121884A1_D24896.tif" /><img file="US2022121884A1_D24897.tif" /><img file="US2022121884A1_D24898.tif" /><img file="US2022121884A1_D24899.tif" /><img file="US2022121884A1_D24900.tif" /><img file="US2022121884A1_D24901.tif" /><img file="US2022121884A1_D24902.tif" /><img file="US2022121884A1_D24903.tif" /><img file="US2022121884A1_D24904.tif" /><img file="US2022121884A1_D24905.tif" /><img file="US2022121884A1_D24906.tif" /><img file="US2022121884A1_D24907.tif" /><img file="US2022121884A1_D24908.tif" /><img file="US2022121884A1_D24909.tif" /><img file="US2022121884A1_D24910.tif" /><img file="US2022121884A1_D24911.tif" /><img file="US2022121884A1_D24912.tif" /><img file="US2022121884A1_D24913.tif" /><img file="US2022121884A1_D24914.tif" /><img file="US2022121884A1_D24915.tif" /><img file="US2022121884A1_D24916.tif" /><img file="US2022121884A1_D24917.tif" /><img file="US2022121884A1_D24918.tif" /><img file="US2022121884A1_D24919.tif" /><img file="US2022121884A1_D24920.tif" /><img file="US2022121884A1_D24921.tif" /><img file="US2022121884A1_D24922.tif" /><img file="US2022121884A1_D24923.tif" /><img file="US2022121884A1_D24924.tif" /><img file="US2022121884A1_D24925.tif" /><img file="US2022121884A1_D24926.tif" /><img file="US2022121884A1_D24927.tif" /><img file="US2022121884A1_D24928.tif" /><img file="US2022121884A1_D24929.tif" /><img file="US2022121884A1_D24930.tif" /><img file="US2022121884A1_D24931.tif" /><img file="US2022121884A1_D24932.tif" /><img file="US2022121884A1_D24933.tif" /><img file="US2022121884A1_D24934.tif" /><img file="US2022121884A1_D24935.tif" /><img file="US2022121884A1_D24936.tif" /><img file="US2022121884A1_D24937.tif" /><img file="US2022121884A1_D24938.tif" /><img file="US2022121884A1_D24939.tif" /><img file="US2022121884A1_D24940.tif" /><img file="US2022121884A1_D24941.tif" /><img file="US2022121884A1_D24942.tif" /><img file="US2022121884A1_D24943.tif" /><img file="US2022121884A1_D24944.tif" /><img file="US2022121884A1_D24945.tif" /><img file="US2022121884A1_D24946.tif" /><img file="US2022121884A1_D24947.tif" /><img file="US2022121884A1_D24948.tif" /><img file="US2022121884A1_D24949.tif" /><img file="US2022121884A1_D24950.tif" /><img file="US2022121884A1_D24951.tif" /><img file="US2022121884A1_D24952.tif" /><img file="US2022121884A1_D24953.tif" /><img file="US2022121884A1_D24954.tif" /><img file="US2022121884A1_D24955.tif" /><img file="US2022121884A1_D24956.tif" /><img file="US2022121884A1_D24957.tif" /><img file="US2022121884A1_D24958.tif" /><img file="US2022121884A1_D24959.tif" /><img file="US2022121884A1_D24960.tif" /><img file="US2022121884A1_D24961.tif" /><img file="US2022121884A1_D24962.tif" /><img file="US2022121884A1_D24963.tif" /><img file="US2022121884A1_D24964.tif" /><img file="US2022121884A1_D24965.tif" /><img file="US2022121884A1_D24966.tif" /><img file="US2022121884A1_D24967.tif" /><img file="US2022121884A1_D24968.tif" /><img file="US2022121884A1_D24969.tif" /><img file="US2022121884A1_D24970.tif" /><img file="US2022121884A1_D24971.tif" /><img file="US2022121884A1_D24972.tif" /><img file="US2022121884A1_D24973.tif" /><img file="US2022121884A1_D24974.tif" /><img file="US2022121884A1_D24975.tif" /><img file="US2022121884A1_D24976.tif" /><img file="US2022121884A1_D24977.tif" /><img file="US2022121884A1_D24978.tif" /><img file="US2022121884A1_D24979.tif" /><img file="US2022121884A1_D24980.tif" /><img file="US2022121884A1_D24981.tif" /><img file="US2022121884A1_D24982.tif" /><img file="US2022121884A1_D24983.tif" /><img file="US2022121884A1_D24984.tif" /><img file="US2022121884A1_D24985.tif" /><img file="US2022121884A1_D24986.tif" /><img file="US2022121884A1_D24987.tif" /><img file="US2022121884A1_D24988.tif" /><img file="US2022121884A1_D24989.tif" /><img file="US2022121884A1_D24990.tif" /><img file="US2022121884A1_D24991.tif" />
where N<sub>m1+</sub> and are N<sub>m1−</sub> number of class points counted/scanned corresponding to p<sub>m1+</sub> and p<sub>m1−</sub> projection class markers. COM<sub>scanned±</sub> is the center of mass for the scanned data point for a class. In a synchronous counting between classes, where the counts are the same (N<sub>m1</sub>) and the class errors are weighted equally, the estimated slack error is:
<maths id="MATH-US-00129" num="00129"><math overflow="scroll"><mtable><mtr><mtd><mtable><mtr><mtd><mrow><munder><mrow><mrow><mi>Est</mi><mo>.</mo><mi>Slack</mi></mrow><mo></mo><mstyle><mspace width="0.6em" height="0.6ex" /></mstyle><mo></mo><mi>Err</mi></mrow><mrow><mo>(</mo><mrow><mi>scaled</mi><mo></mo><mstyle><mspace width="0.6em" height="0.6ex" /></mstyle><mo></mo><mi>by</mi><mo></mo><mstyle><mspace width="0.6em" height="0.6ex" /></mstyle><mo></mo><mi>C</mi></mrow><mo>)</mo></mrow></munder><mo>≈</mo><mi /><mo></mo><mrow><mi>C</mi><mo>·</mo><msub><mi>N</mi><mrow><mi>m</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>1</mn></mrow></msub><mo>·</mo></mrow></mrow></mtd></mtr><mtr><mtd><mrow><mi /><mo></mo><mrow><mo>[</mo><mrow><mn>2</mn><mo>-</mo><mrow><mfrac><mn>1</mn><mrow><mi>m</mi><mo>·</mo><msub><mi>N</mi><mrow><mi>m</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>1</mn></mrow></msub></mrow></mfrac><mo></mo><mrow><mo>(</mo><mrow><mrow><munder><mo>∑</mo><munder><msub><mi>i</mi><mo>+</mo></msub><mi>scanned</mi></munder></munder><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><msub><mi>p</mi><msub><mi>i</mi><mo>+</mo></msub></msub></mrow><mo>-</mo><mrow><munder><mo>∑</mo><munder><msub><mi>i</mi><mo>-</mo></msub><mi>scanned</mi></munder></munder><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><msub><mi>p</mi><msub><mi>i</mi><mo>-</mo></msub></msub></mrow></mrow><mo>)</mo></mrow></mrow></mrow><mo>]</mo></mrow></mrow></mtd></mtr><mtr><mtd><mrow><mo>=</mo><mi /><mo></mo><mrow><mi>C</mi><mo>·</mo><msub><mi>N</mi><mrow><mi>m</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>1</mn></mrow></msub><mo>·</mo></mrow></mrow></mtd></mtr><mtr><mtd><mrow><mi /><mo></mo><mrow><mo>[</mo><mrow><mn>2</mn><mo>-</mo><mrow><mfrac><mn>1</mn><mi>m</mi></mfrac><mo></mo><mrow><mrow><mo>(</mo><mrow><msub><mi>COM</mi><mrow><mi>scanned</mi><mo>+</mo></mrow></msub><mo>-</mo><msub><mi>COM</mi><mrow><mi>scanned</mi><mo>-</mo></mrow></msub></mrow><mo>)</mo></mrow><mo>·</mo><msub><mover><mi>w</mi><mo>^</mo></mover><mo></mo></msub></mrow></mrow></mrow><mo>]</mo></mrow></mrow></mtd></mtr></mtable></mtd><mtd><mrow><mo>(</mo><mn>41</mn><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2022121884A1_D24992.tif" /><img file="US2022121884A1_D24993.tif" /><img file="US2022121884A1_D24994.tif" /><img file="US2022121884A1_D24995.tif" /><img file="US2022121884A1_D24996.tif" /><img file="US2022121884A1_D24997.tif" /><img file="US2022121884A1_D24998.tif" /><img file="US2022121884A1_D24999.tif" /><img file="US2022121884A1_D25000.tif" /><img file="US2022121884A1_D25001.tif" /><img file="US2022121884A1_D25002.tif" /><img file="US2022121884A1_D25003.tif" /><img file="US2022121884A1_D25004.tif" /><img file="US2022121884A1_D25005.tif" /><img file="US2022121884A1_D25006.tif" /><img file="US2022121884A1_D25007.tif" /><img file="US2022121884A1_D25008.tif" /><img file="US2022121884A1_D25009.tif" /><img file="US2022121884A1_D25010.tif" /><img file="US2022121884A1_D25011.tif" /><img file="US2022121884A1_D25012.tif" /><img file="US2022121884A1_D25013.tif" /><img file="US2022121884A1_D25014.tif" /><img file="US2022121884A1_D25015.tif" /><img file="US2022121884A1_D25016.tif" /><img file="US2022121884A1_D25017.tif" /><img file="US2022121884A1_D25018.tif" /><img file="US2022121884A1_D25019.tif" /><img file="US2022121884A1_D25020.tif" /><img file="US2022121884A1_D25021.tif" /><img file="US2022121884A1_D25022.tif" /><img file="US2022121884A1_D25023.tif" /><img file="US2022121884A1_D25024.tif" /><img file="US2022121884A1_D25025.tif" /><img file="US2022121884A1_D25026.tif" /><img file="US2022121884A1_D25027.tif" /><img file="US2022121884A1_D25028.tif" /><img file="US2022121884A1_D25029.tif" /><img file="US2022121884A1_D25030.tif" /><img file="US2022121884A1_D25031.tif" /><img file="US2022121884A1_D25032.tif" /><img file="US2022121884A1_D25033.tif" /><img file="US2022121884A1_D25034.tif" /><img file="US2022121884A1_D25035.tif" /><img file="US2022121884A1_D25036.tif" /><img file="US2022121884A1_D25037.tif" /><img file="US2022121884A1_D25038.tif" /><img file="US2022121884A1_D25039.tif" /><img file="US2022121884A1_D25040.tif" /><img file="US2022121884A1_D25041.tif" /><img file="US2022121884A1_D25042.tif" /><img file="US2022121884A1_D25043.tif" /><img file="US2022121884A1_D25044.tif" /><img file="US2022121884A1_D25045.tif" /><img file="US2022121884A1_D25046.tif" /><img file="US2022121884A1_D25047.tif" /><img file="US2022121884A1_D25048.tif" /><img file="US2022121884A1_D25049.tif" /><img file="US2022121884A1_D25050.tif" /><img file="US2022121884A1_D25051.tif" /><img file="US2022121884A1_D25052.tif" /><img file="US2022121884A1_D25053.tif" /><img file="US2022121884A1_D25054.tif" /><img file="US2022121884A1_D25055.tif" /><img file="US2022121884A1_D25056.tif" /><img file="US2022121884A1_D25057.tif" /><img file="US2022121884A1_D25058.tif" /><img file="US2022121884A1_D25059.tif" /><img file="US2022121884A1_D25060.tif" /><img file="US2022121884A1_D25061.tif" /><img file="US2022121884A1_D25062.tif" /><img file="US2022121884A1_D25063.tif" /><img file="US2022121884A1_D25064.tif" /><img file="US2022121884A1_D25065.tif" /><img file="US2022121884A1_D25066.tif" /><img file="US2022121884A1_D25067.tif" /><img file="US2022121884A1_D25068.tif" /><img file="US2022121884A1_D25069.tif" /><img file="US2022121884A1_D25070.tif" /><img file="US2022121884A1_D25071.tif" /><img file="US2022121884A1_D25072.tif" /><img file="US2022121884A1_D25073.tif" /><img file="US2022121884A1_D25074.tif" /><img file="US2022121884A1_D25075.tif" /><img file="US2022121884A1_D25076.tif" /><img file="US2022121884A1_D25077.tif" /><img file="US2022121884A1_D25078.tif" /><img file="US2022121884A1_D25079.tif" /><img file="US2022121884A1_D25080.tif" /><img file="US2022121884A1_D25081.tif" /><img file="US2022121884A1_D25082.tif" /><img file="US2022121884A1_D25083.tif" /><img file="US2022121884A1_D25084.tif" /><img file="US2022121884A1_D25085.tif" /><img file="US2022121884A1_D25086.tif" /><img file="US2022121884A1_D25087.tif" /><img file="US2022121884A1_D25088.tif" /><img file="US2022121884A1_D25089.tif" /><img file="US2022121884A1_D25090.tif" /><img file="US2022121884A1_D25091.tif" /><img file="US2022121884A1_D25092.tif" /><img file="US2022121884A1_D25093.tif" /><img file="US2022121884A1_D25094.tif" /><img file="US2022121884A1_D25095.tif" /><img file="US2022121884A1_D25096.tif" /><img file="US2022121884A1_D25097.tif" /><img file="US2022121884A1_D25098.tif" /><img file="US2022121884A1_D25099.tif" /><img file="US2022121884A1_D25100.tif" /><img file="US2022121884A1_D25101.tif" /><img file="US2022121884A1_D25102.tif" /><img file="US2022121884A1_D25103.tif" />
In this scheme, during one scan/count, various error levels are estimated for a given count N<sub>m1 </sub>or percentage of the population (based on N<sub>m1</sub>). Summations over p<sub>i</sub>'s in (40) and (41) represent a cumulative running sum as the counting progresses. Similarly, COM<sub>±</sub> or their projections on ŵ<sub>⊥,k </sub>or ŵ<sub>∥</sub> are determined as running sums based on the scanned data points. Objective function (22) and its elements as well as misclassification ratio (MR) data points can be estimated and tracked:
<maths id="MATH-US-00130" num="00130"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><mi>Obj</mi><mo></mo><mstyle><mspace width="0.6em" height="0.6ex" /></mstyle><mo></mo><mrow><mi>Func</mi><mo>.</mo></mrow></mrow><mo>≈</mo><mrow><mfrac><mn>1</mn><mrow><mn>2</mn><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><msup><mi>m</mi><mn>2</mn></msup></mrow></mfrac><mo>+</mo><munder><mrow><mrow><mi>Est</mi><mo>.</mo><mi>Slack</mi></mrow><mo></mo><mstyle><mspace width="0.6em" height="0.6ex" /></mstyle><mo></mo><mi>Err</mi></mrow><mrow><mo>(</mo><mrow><mi>scaled</mi><mo></mo><mstyle><mspace width="0.6em" height="0.6ex" /></mstyle><mo></mo><mi>by</mi><mo></mo><mstyle><mspace width="0.6em" height="0.6ex" /></mstyle><mo></mo><mi>C</mi></mrow><mo>)</mo></mrow></munder></mrow><mo>≈</mo><mrow><mfrac><mn>1</mn><mrow><mn>2</mn><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><msup><mi>m</mi><mn>2</mn></msup></mrow></mfrac><mo>+</mo><mrow><mi>C</mi><mo>·</mo><mrow><mo>[</mo><mrow><mrow><msub><mi>ℱ</mi><mo>+</mo></msub><mo></mo><mrow><mo>(</mo><msub><mi>N</mi><mrow><mrow><mi>m</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>1</mn></mrow><mo>+</mo></mrow></msub><mo>)</mo></mrow></mrow><mo>+</mo><mrow><msub><mi>ℱ</mi><mo>-</mo></msub><mo></mo><mrow><mo>(</mo><msub><mi>N</mi><mrow><mrow><mi>m</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>1</mn></mrow><mo>-</mo></mrow></msub><mo>)</mo></mrow></mrow></mrow><mo>]</mo></mrow></mrow></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mn>42</mn><mo>)</mo></mrow></mtd></mtr><mtr><mtd><mrow><mi>MR</mi><mo>≈</mo><mrow><mfrac><mn>1</mn><mi>N</mi></mfrac><mo>[</mo><mrow><mrow><mi>IndexLookup</mi><mo>(</mo><mfrac><mtable><mtr><mtd><mrow><msub><mi>p</mi><mrow><mrow><mi>m</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>1</mn></mrow><mo>+</mo></mrow></msub><mo>+</mo></mrow></mtd></mtr><mtr><mtd><msub><mi>p</mi><mrow><mrow><mi>m</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>1</mn></mrow><mo>-</mo></mrow></msub></mtd></mtr></mtable><mn>2</mn></mfrac><mo>)</mo></mrow><mo></mo><msub><mo>❘</mo><mo>+</mo></msub><mo></mo><mrow><mrow><mo>+</mo><mrow><mi>IndexLookupRev</mi><mo>(</mo><mfrac><mtable><mtr><mtd><mrow><msub><mi>p</mi><mrow><mrow><mi>m</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>1</mn></mrow><mo>+</mo></mrow></msub><mo>+</mo></mrow></mtd></mtr><mtr><mtd><msub><mi>p</mi><mrow><mrow><mi>m</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mn>1</mn></mrow><mo>-</mo></mrow></msub></mtd></mtr></mtable><mn>2</mn></mfrac><mo>)</mo></mrow></mrow><mo></mo><msub><mo>❘</mo><mo>-</mo></msub></mrow></mrow><mo>]</mo></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mn>43</mn><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2022121884A1_D25104.tif" /><img file="US2022121884A1_D25105.tif" /><img file="US2022121884A1_D25106.tif" /><img file="US2022121884A1_D25107.tif" /><img file="US2022121884A1_D25108.tif" /><img file="US2022121884A1_D25109.tif" /><img file="US2022121884A1_D25110.tif" /><img file="US2022121884A1_D25111.tif" /><img file="US2022121884A1_D25112.tif" /><img file="US2022121884A1_D25113.tif" /><img file="US2022121884A1_D25114.tif" /><img file="US2022121884A1_D25115.tif" /><img file="US2022121884A1_D25116.tif" /><img file="US2022121884A1_D25117.tif" /><img file="US2022121884A1_D25118.tif" /><img file="US2022121884A1_D25119.tif" /><img file="US2022121884A1_D25120.tif" /><img file="US2022121884A1_D25121.tif" /><img file="US2022121884A1_D25122.tif" /><img file="US2022121884A1_D25123.tif" /><img file="US2022121884A1_D25124.tif" /><img file="US2022121884A1_D25125.tif" /><img file="US2022121884A1_D25126.tif" /><img file="US2022121884A1_D25127.tif" /><img file="US2022121884A1_D25128.tif" /><img file="US2022121884A1_D25129.tif" /><img file="US2022121884A1_D25130.tif" /><img file="US2022121884A1_D25131.tif" /><img file="US2022121884A1_D25132.tif" /><img file="US2022121884A1_D25133.tif" /><img file="US2022121884A1_D25134.tif" /><img file="US2022121884A1_D25135.tif" /><img file="US2022121884A1_D25136.tif" /><img file="US2022121884A1_D25137.tif" /><img file="US2022121884A1_D25138.tif" /><img file="US2022121884A1_D25139.tif" /><img file="US2022121884A1_D25140.tif" /><img file="US2022121884A1_D25141.tif" /><img file="US2022121884A1_D25142.tif" /><img file="US2022121884A1_D25143.tif" /><img file="US2022121884A1_D25144.tif" /><img file="US2022121884A1_D25145.tif" /><img file="US2022121884A1_D25146.tif" /><img file="US2022121884A1_D25147.tif" /><img file="US2022121884A1_D25148.tif" /><img file="US2022121884A1_D25149.tif" /><img file="US2022121884A1_D25150.tif" /><img file="US2022121884A1_D25151.tif" /><img file="US2022121884A1_D25152.tif" /><img file="US2022121884A1_D25153.tif" /><img file="US2022121884A1_D25154.tif" /><img file="US2022121884A1_D25155.tif" /><img file="US2022121884A1_D25156.tif" /><img file="US2022121884A1_D25157.tif" /><img file="US2022121884A1_D25158.tif" /><img file="US2022121884A1_D25159.tif" /><img file="US2022121884A1_D25160.tif" /><img file="US2022121884A1_D25161.tif" /><img file="US2022121884A1_D25162.tif" /><img file="US2022121884A1_D25163.tif" /><img file="US2022121884A1_D25164.tif" /><img file="US2022121884A1_D25165.tif" /><img file="US2022121884A1_D25166.tif" /><img file="US2022121884A1_D25167.tif" /><img file="US2022121884A1_D25168.tif" /><img file="US2022121884A1_D25169.tif" /><img file="US2022121884A1_D25170.tif" /><img file="US2022121884A1_D25171.tif" /><img file="US2022121884A1_D25172.tif" /><img file="US2022121884A1_D25173.tif" /><img file="US2022121884A1_D25174.tif" /><img file="US2022121884A1_D25175.tif" /><img file="US2022121884A1_D25176.tif" /><img file="US2022121884A1_D25177.tif" /><img file="US2022121884A1_D25178.tif" /><img file="US2022121884A1_D25179.tif" /><img file="US2022121884A1_D25180.tif" /><img file="US2022121884A1_D25181.tif" /><img file="US2022121884A1_D25182.tif" /><img file="US2022121884A1_D25183.tif" /><img file="US2022121884A1_D25184.tif" /><img file="US2022121884A1_D25185.tif" /><img file="US2022121884A1_D25186.tif" /><img file="US2022121884A1_D25187.tif" /><img file="US2022121884A1_D25188.tif" /><img file="US2022121884A1_D25189.tif" /><img file="US2022121884A1_D25190.tif" /><img file="US2022121884A1_D25191.tif" /><img file="US2022121884A1_D25192.tif" /><img file="US2022121884A1_D25193.tif" /><img file="US2022121884A1_D25194.tif" /><img file="US2022121884A1_D25195.tif" /><img file="US2022121884A1_D25196.tif" /><img file="US2022121884A1_D25197.tif" /><img file="US2022121884A1_D25198.tif" /><img file="US2022121884A1_D25199.tif" /><img file="US2022121884A1_D25200.tif" /><img file="US2022121884A1_D25201.tif" /><img file="US2022121884A1_D25202.tif" /><img file="US2022121884A1_D25203.tif" /><img file="US2022121884A1_D25204.tif" /><img file="US2022121884A1_D25205.tif" /><img file="US2022121884A1_D25206.tif" /><img file="US2022121884A1_D25207.tif" /><img file="US2022121884A1_D25208.tif" /><img file="US2022121884A1_D25209.tif" /><img file="US2022121884A1_D25210.tif" /><img file="US2022121884A1_D25211.tif" /><img file="US2022121884A1_D25212.tif" /><img file="US2022121884A1_D25213.tif" /><img file="US2022121884A1_D25214.tif" /><img file="US2022121884A1_D25215.tif" />
where indexLookup and IndexLookupRev determine the number of misclassified data points in each class, by looking up the index of the projection value of hyperplane in the ordered list of the projected values of x<sub>i</sub>'s onto ŵ<sub>∥</sub>.
Per (38) and (43), a relationship between margin in and in-sample misclassification rate MCR is determined for each candidate ŵ<sub>∥</sub> being iterated, based on the scan through various values of N<sub>m1∓</sub>. In addition, <img file="US2022121884A1_D25216.tif" /><sub>∓</sub>(N<sub>m1∓</sub>) as a measure of slack error is made independent of C, per (40). Therefore, the relationship between the objective function (42) and C may conveniently be determined for a candidate ŵ<sub>∥</sub> without rescanning the dataset. Thus, a range of appropriate C may be estimated, for example, as an order of magnitude below and above the range of (2m<sup>2</sup>[F<sub>+</sub>(N<sub>m1+</sub>)+F<sub>−</sub>(N<sub>m1−</sub>)])<sup>−1 </sup>for various N<sub>m1∓</sub> encountered during the same scan.
1.3 Predictive Based on Center of Mass and In/Out Adjustments:
For data points on the margin boundary, (24) and (31) may be used to determine the effect of trade off Δα between two margin points x<sub>i</sub>and x<sub>2 </sub>of the same class (e.g., y=+1) with opposite Δα:
<maths id="MATH-US-00131" num="00131"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><mi>Δ</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>w</mi></mrow><mo>=</mo><mrow><mrow><mi>Δ</mi><mo></mo><mrow><mo>(</mo><mrow><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>1</mn></mrow><mi>N</mi></munderover><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><msub><mi>α</mi><mi>i</mi></msub><mo></mo><msub><mi>y</mi><mi>i</mi></msub><mo></mo><msub><mi>x</mi><mi>i</mi></msub></mrow></mrow><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mi>Δ</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>α</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><mi>y</mi><mo></mo><mrow><mo>(</mo><mrow><msub><mi>x</mi><mn>2</mn></msub><mo>-</mo><msub><mi>x</mi><mn>1</mn></msub></mrow><mo>)</mo></mrow></mrow></mrow></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mn>44</mn><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2022121884A1_D25217.tif" /><img file="US2022121884A1_D25218.tif" /><img file="US2022121884A1_D25219.tif" /><img file="US2022121884A1_D25220.tif" /><img file="US2022121884A1_D25221.tif" /><img file="US2022121884A1_D25222.tif" /><img file="US2022121884A1_D25223.tif" /><img file="US2022121884A1_D25224.tif" /><img file="US2022121884A1_D25225.tif" /><img file="US2022121884A1_D25226.tif" /><img file="US2022121884A1_D25227.tif" /><img file="US2022121884A1_D25228.tif" /><img file="US2022121884A1_D25229.tif" /><img file="US2022121884A1_D25230.tif" /><img file="US2022121884A1_D25231.tif" /><img file="US2022121884A1_D25232.tif" /><img file="US2022121884A1_D25233.tif" /><img file="US2022121884A1_D25234.tif" /><img file="US2022121884A1_D25235.tif" /><img file="US2022121884A1_D25236.tif" /><img file="US2022121884A1_D25237.tif" /><img file="US2022121884A1_D25238.tif" /><img file="US2022121884A1_D25239.tif" /><img file="US2022121884A1_D25240.tif" /><img file="US2022121884A1_D25241.tif" /><img file="US2022121884A1_D25242.tif" /><img file="US2022121884A1_D25243.tif" /><img file="US2022121884A1_D25244.tif" /><img file="US2022121884A1_D25245.tif" /><img file="US2022121884A1_D25246.tif" /><img file="US2022121884A1_D25247.tif" /><img file="US2022121884A1_D25248.tif" /><img file="US2022121884A1_D25249.tif" /><img file="US2022121884A1_D25250.tif" /><img file="US2022121884A1_D25251.tif" /><img file="US2022121884A1_D25252.tif" /><img file="US2022121884A1_D25253.tif" /><img file="US2022121884A1_D25254.tif" /><img file="US2022121884A1_D25255.tif" /><img file="US2022121884A1_D25256.tif" /><img file="US2022121884A1_D25257.tif" /><img file="US2022121884A1_D25258.tif" /><img file="US2022121884A1_D25259.tif" /><img file="US2022121884A1_D25260.tif" /><img file="US2022121884A1_D25261.tif" /><img file="US2022121884A1_D25262.tif" /><img file="US2022121884A1_D25263.tif" /><img file="US2022121884A1_D25264.tif" /><img file="US2022121884A1_D25265.tif" /><img file="US2022121884A1_D25266.tif" /><img file="US2022121884A1_D25267.tif" /><img file="US2022121884A1_D25268.tif" /><img file="US2022121884A1_D25269.tif" /><img file="US2022121884A1_D25270.tif" /><img file="US2022121884A1_D25271.tif" /><img file="US2022121884A1_D25272.tif" /><img file="US2022121884A1_D25273.tif" /><img file="US2022121884A1_D25274.tif" /><img file="US2022121884A1_D25275.tif" /><img file="US2022121884A1_D25276.tif" /><img file="US2022121884A1_D25277.tif" /><img file="US2022121884A1_D25278.tif" /><img file="US2022121884A1_D25279.tif" /><img file="US2022121884A1_D25280.tif" /><img file="US2022121884A1_D25281.tif" /><img file="US2022121884A1_D25282.tif" /><img file="US2022121884A1_D25283.tif" /><img file="US2022121884A1_D25284.tif" /><img file="US2022121884A1_D25285.tif" /><img file="US2022121884A1_D25286.tif" /><img file="US2022121884A1_D25287.tif" /><img file="US2022121884A1_D25288.tif" /><img file="US2022121884A1_D25289.tif" /><img file="US2022121884A1_D25290.tif" /><img file="US2022121884A1_D25291.tif" /><img file="US2022121884A1_D25292.tif" /><img file="US2022121884A1_D25293.tif" /><img file="US2022121884A1_D25294.tif" /><img file="US2022121884A1_D25295.tif" /><img file="US2022121884A1_D25296.tif" /><img file="US2022121884A1_D25297.tif" /><img file="US2022121884A1_D25298.tif" /><img file="US2022121884A1_D25299.tif" /><img file="US2022121884A1_D25300.tif" /><img file="US2022121884A1_D25301.tif" /><img file="US2022121884A1_D25302.tif" /><img file="US2022121884A1_D25303.tif" /><img file="US2022121884A1_D25304.tif" /><img file="US2022121884A1_D25305.tif" /><img file="US2022121884A1_D25306.tif" /><img file="US2022121884A1_D25307.tif" /><img file="US2022121884A1_D25308.tif" /><img file="US2022121884A1_D25309.tif" /><img file="US2022121884A1_D25310.tif" /><img file="US2022121884A1_D25311.tif" /><img file="US2022121884A1_D25312.tif" /><img file="US2022121884A1_D25313.tif" /><img file="US2022121884A1_D25314.tif" /><img file="US2022121884A1_D25315.tif" /><img file="US2022121884A1_D25316.tif" /><img file="US2022121884A1_D25317.tif" /><img file="US2022121884A1_D25318.tif" /><img file="US2022121884A1_D25319.tif" /><img file="US2022121884A1_D25320.tif" /><img file="US2022121884A1_D25321.tif" /><img file="US2022121884A1_D25322.tif" /><img file="US2022121884A1_D25323.tif" /><img file="US2022121884A1_D25324.tif" /><img file="US2022121884A1_D25325.tif" /><img file="US2022121884A1_D25326.tif" /><img file="US2022121884A1_D25327.tif" /><img file="US2022121884A1_D25328.tif" />
Given x<sub>1</sub>and x<sub>2 </sub>are on the margin, (x<sub>2</sub>-x<sub>1</sub>) is perpendicular to ŵ<sub>∥</sub>. Therefore, the effect is a tilt to w in the direction of (x<sub>2</sub>-x<sub>1</sub>). The amount of tilt is proportional to ∥d<sub>2</sub>-x<sub>1</sub>∥, i.e., the tradeoff in α for far away points has larger impact on tilting w. The concept applies to points of different classes (having the same Δα per (30) and opposite signs for y's). Based on (44), we describe an efficient method for providing Δw for the subsequent iteration.
In addition to projection of data points on ŵ<sub>∥</sub>, the data point(s) x<sub>i </sub>are also projected on ŵ<sub>∓</sub>'s, and sorted accordingly (see for example <figref idref="DRAWINGS">FIG. 255</figref>):
<br />p<sub>i,k</sub>=x<sub>i</sub>·ŵ<sub>⊥,k </sub> (45)
where k indexes over (D-1) independent ŵ<sub>⊥</sub>'s corresponding to ŵ<sub>∥</sub>. For a given ŵ<sub>∥</sub>, assume the margin, m<sub>opt</sub>, and offset, b<sub>opt</sub>, are optimized as to (42) for a given C, per previous section. Thus, an update to ŵ<sub>∥</sub> should be in form of a small tilt, Δw, perpendicular to ŵ<sub>∥</sub> (see <figref idref="DRAWINGS">FIG. 257</figref>).
The small tilt maintains the magnitude of ŵ<sub>∥</sub>, and therefore, the corresponding portion of the objective function
<maths id="MATH-US-00132" num="00132"><math overflow="scroll"><mrow><mo>(</mo><mfrac><mn>1</mn><mrow><mn>2</mn><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><msup><mi>m</mi><mn>2</mn></msup></mrow></mfrac><mo>)</mo></mrow></math></maths><img file="US2022121884A1_D25329.tif" /><img file="US2022121884A1_D25330.tif" /><img file="US2022121884A1_D25331.tif" /><img file="US2022121884A1_D25332.tif" /><img file="US2022121884A1_D25333.tif" /><img file="US2022121884A1_D25334.tif" /><img file="US2022121884A1_D25335.tif" /><img file="US2022121884A1_D25336.tif" /><img file="US2022121884A1_D25337.tif" /><img file="US2022121884A1_D25338.tif" /><img file="US2022121884A1_D25339.tif" /><img file="US2022121884A1_D25340.tif" /><img file="US2022121884A1_D25341.tif" /><img file="US2022121884A1_D25342.tif" /><img file="US2022121884A1_D25343.tif" /><img file="US2022121884A1_D25344.tif" /><img file="US2022121884A1_D25345.tif" /><img file="US2022121884A1_D25346.tif" /><img file="US2022121884A1_D25347.tif" /><img file="US2022121884A1_D25348.tif" /><img file="US2022121884A1_D25349.tif" /><img file="US2022121884A1_D25350.tif" /><img file="US2022121884A1_D25351.tif" /><img file="US2022121884A1_D25352.tif" /><img file="US2022121884A1_D25353.tif" /><img file="US2022121884A1_D25354.tif" /><img file="US2022121884A1_D25355.tif" /><img file="US2022121884A1_D25356.tif" /><img file="US2022121884A1_D25357.tif" /><img file="US2022121884A1_D25358.tif" /><img file="US2022121884A1_D25359.tif" /><img file="US2022121884A1_D25360.tif" /><img file="US2022121884A1_D25361.tif" /><img file="US2022121884A1_D25362.tif" /><img file="US2022121884A1_D25363.tif" /><img file="US2022121884A1_D25364.tif" /><img file="US2022121884A1_D25365.tif" /><img file="US2022121884A1_D25366.tif" /><img file="US2022121884A1_D25367.tif" /><img file="US2022121884A1_D25368.tif" /><img file="US2022121884A1_D25369.tif" /><img file="US2022121884A1_D25370.tif" /><img file="US2022121884A1_D25371.tif" /><img file="US2022121884A1_D25372.tif" /><img file="US2022121884A1_D25373.tif" /><img file="US2022121884A1_D25374.tif" /><img file="US2022121884A1_D25375.tif" /><img file="US2022121884A1_D25376.tif" /><img file="US2022121884A1_D25377.tif" /><img file="US2022121884A1_D25378.tif" /><img file="US2022121884A1_D25379.tif" /><img file="US2022121884A1_D25380.tif" /><img file="US2022121884A1_D25381.tif" /><img file="US2022121884A1_D25382.tif" /><img file="US2022121884A1_D25383.tif" /><img file="US2022121884A1_D25384.tif" /><img file="US2022121884A1_D25385.tif" /><img file="US2022121884A1_D25386.tif" /><img file="US2022121884A1_D25387.tif" /><img file="US2022121884A1_D25388.tif" /><img file="US2022121884A1_D25389.tif" /><img file="US2022121884A1_D25390.tif" /><img file="US2022121884A1_D25391.tif" /><img file="US2022121884A1_D25392.tif" /><img file="US2022121884A1_D25393.tif" /><img file="US2022121884A1_D25394.tif" /><img file="US2022121884A1_D25395.tif" /><img file="US2022121884A1_D25396.tif" /><img file="US2022121884A1_D25397.tif" /><img file="US2022121884A1_D25398.tif" /><img file="US2022121884A1_D25399.tif" /><img file="US2022121884A1_D25400.tif" /><img file="US2022121884A1_D25401.tif" /><img file="US2022121884A1_D25402.tif" /><img file="US2022121884A1_D25403.tif" /><img file="US2022121884A1_D25404.tif" /><img file="US2022121884A1_D25405.tif" /><img file="US2022121884A1_D25406.tif" /><img file="US2022121884A1_D25407.tif" /><img file="US2022121884A1_D25408.tif" /><img file="US2022121884A1_D25409.tif" /><img file="US2022121884A1_D25410.tif" /><img file="US2022121884A1_D25411.tif" /><img file="US2022121884A1_D25412.tif" /><img file="US2022121884A1_D25413.tif" /><img file="US2022121884A1_D25414.tif" /><img file="US2022121884A1_D25415.tif" /><img file="US2022121884A1_D25416.tif" /><img file="US2022121884A1_D25417.tif" /><img file="US2022121884A1_D25418.tif" /><img file="US2022121884A1_D25419.tif" /><img file="US2022121884A1_D25420.tif" /><img file="US2022121884A1_D25421.tif" /><img file="US2022121884A1_D25422.tif" /><img file="US2022121884A1_D25423.tif" /><img file="US2022121884A1_D25424.tif" /><img file="US2022121884A1_D25425.tif" /><img file="US2022121884A1_D25426.tif" /><img file="US2022121884A1_D25427.tif" /><img file="US2022121884A1_D25428.tif" /><img file="US2022121884A1_D25429.tif" /><img file="US2022121884A1_D25430.tif" /><img file="US2022121884A1_D25431.tif" /><img file="US2022121884A1_D25432.tif" /><img file="US2022121884A1_D25433.tif" /><img file="US2022121884A1_D25434.tif" /><img file="US2022121884A1_D25435.tif" /><img file="US2022121884A1_D25436.tif" /><img file="US2022121884A1_D25437.tif" /><img file="US2022121884A1_D25438.tif" /><img file="US2022121884A1_D25439.tif" /><img file="US2022121884A1_D25440.tif" />
does not change. However, the tilt impacts slack errors (see (22)) in three ways based on: a) points staying in violation of the margin having different slack error, b) points going out of margin violation reducing slack error, and c) points coming into margin and increasing slack error, as depicted in <figref idref="DRAWINGS">FIG. 257</figref>.
Assuming the tilt pivot point, PV, is located on the hyperplane, the change in u<sub>i </sub>due to Δw becomes:
<br />Δ<i>u</i><sub>i</sub><i>=Δw</i>·(<i>x</i><sub>i</sub><i>−PV</i>) (46)
Let Δw be aligned to ŵ<sub>⊥,k</sub>, so that Δw=∥Δw∥ŵ<sub>⊥,k</sub>. Then:
<br />Δ<i>u</i><sub>i</sub><i>=∥Δw</i>∥(<i>p</i><sub>i,k</sub><i>−PV·ŵ</i><sub>⊥,k</sub>) (47)
Let S<sub>in-pri </sub>be a set of in-margin data points prior to the tilt (i.e., including those that stay in and go out after the tilt). The total change in plane numbers is:
<maths id="MATH-US-00133" num="00133"><math overflow="scroll"><mtable><mtr><mtd><mtable><mtr><mtd><mrow><mrow><munder><mo>∑</mo><mrow><msub><mi>i</mi><mo>±</mo></msub><mo>∈</mo><msub><mi>S</mi><mrow><mi>in</mi><mo>-</mo><mi>pri</mi></mrow></msub></mrow></munder><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><mi>Δ</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><msub><mi>u</mi><mi>i</mi></msub></mrow></mrow><mo>=</mo><mi /><mo></mo><mrow><mrow><mo></mo><mrow><mi>Δ</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>w</mi></mrow><mo></mo></mrow><mo></mo><mrow><mo>(</mo><mrow><mrow><munder><mo>∑</mo><mrow><msub><mi>i</mi><mo>±</mo></msub><mo>∈</mo><msub><mi>S</mi><mrow><mi>in</mi><mo>-</mo><mi>pri</mi></mrow></msub></mrow></munder><mo></mo><msub><mi>p</mi><mrow><msub><mi>i</mi><mo>±</mo></msub><mo>,</mo><mi>k</mi></mrow></msub></mrow><mo>-</mo><mrow><msub><mi>N</mi><mrow><mi>in</mi><mo>-</mo><msub><mi>pri</mi><mo>±</mo></msub></mrow></msub><mo></mo><mi>P</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><mi>V</mi><mo>·</mo><msub><mover><mi>w</mi><mo>^</mo></mover><mrow><mo>⊥</mo><mrow><mo>,</mo><mi>k</mi></mrow></mrow></msub></mrow></mrow></mrow><mo>)</mo></mrow></mrow></mrow></mtd></mtr><mtr><mtd><mrow><mo>=</mo><mi /><mo></mo><mrow><mrow><mo></mo><mrow><mi>Δ</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>w</mi></mrow><mo></mo></mrow><mo>·</mo><mrow><msub><mi>N</mi><mrow><mi>in</mi><mo>-</mo><msub><mi>pri</mi><mo>±</mo></msub></mrow></msub><mo></mo><mrow><mo>(</mo><mrow><msub><mi>COM</mi><mo>±</mo></msub><mo>-</mo><mi>PV</mi></mrow><mo>)</mo></mrow></mrow><mo>·</mo><msub><mover><mi>w</mi><mo>^</mo></mover><mrow><mo>⊥</mo><mrow><mo>,</mo><mi>k</mi></mrow></mrow></msub></mrow></mrow></mtd></mtr></mtable></mtd><mtd><mrow><mo>(</mo><mn>48</mn><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2022121884A1_D25441.tif" /><img file="US2022121884A1_D25442.tif" /><img file="US2022121884A1_D25443.tif" /><img file="US2022121884A1_D25444.tif" /><img file="US2022121884A1_D25445.tif" /><img file="US2022121884A1_D25446.tif" /><img file="US2022121884A1_D25447.tif" /><img file="US2022121884A1_D25448.tif" /><img file="US2022121884A1_D25449.tif" /><img file="US2022121884A1_D25450.tif" /><img file="US2022121884A1_D25451.tif" /><img file="US2022121884A1_D25452.tif" /><img file="US2022121884A1_D25453.tif" /><img file="US2022121884A1_D25454.tif" /><img file="US2022121884A1_D25455.tif" /><img file="US2022121884A1_D25456.tif" /><img file="US2022121884A1_D25457.tif" /><img file="US2022121884A1_D25458.tif" /><img file="US2022121884A1_D25459.tif" /><img file="US2022121884A1_D25460.tif" /><img file="US2022121884A1_D25461.tif" /><img file="US2022121884A1_D25462.tif" /><img file="US2022121884A1_D25463.tif" /><img file="US2022121884A1_D25464.tif" /><img file="US2022121884A1_D25465.tif" /><img file="US2022121884A1_D25466.tif" /><img file="US2022121884A1_D25467.tif" /><img file="US2022121884A1_D25468.tif" /><img file="US2022121884A1_D25469.tif" /><img file="US2022121884A1_D25470.tif" /><img file="US2022121884A1_D25471.tif" /><img file="US2022121884A1_D25472.tif" /><img file="US2022121884A1_D25473.tif" /><img file="US2022121884A1_D25474.tif" /><img file="US2022121884A1_D25475.tif" /><img file="US2022121884A1_D25476.tif" /><img file="US2022121884A1_D25477.tif" /><img file="US2022121884A1_D25478.tif" /><img file="US2022121884A1_D25479.tif" /><img file="US2022121884A1_D25480.tif" /><img file="US2022121884A1_D25481.tif" /><img file="US2022121884A1_D25482.tif" /><img file="US2022121884A1_D25483.tif" /><img file="US2022121884A1_D25484.tif" /><img file="US2022121884A1_D25485.tif" /><img file="US2022121884A1_D25486.tif" /><img file="US2022121884A1_D25487.tif" /><img file="US2022121884A1_D25488.tif" /><img file="US2022121884A1_D25489.tif" /><img file="US2022121884A1_D25490.tif" /><img file="US2022121884A1_D25491.tif" /><img file="US2022121884A1_D25492.tif" /><img file="US2022121884A1_D25493.tif" /><img file="US2022121884A1_D25494.tif" /><img file="US2022121884A1_D25495.tif" /><img file="US2022121884A1_D25496.tif" /><img file="US2022121884A1_D25497.tif" /><img file="US2022121884A1_D25498.tif" /><img file="US2022121884A1_D25499.tif" /><img file="US2022121884A1_D25500.tif" /><img file="US2022121884A1_D25501.tif" /><img file="US2022121884A1_D25502.tif" /><img file="US2022121884A1_D25503.tif" /><img file="US2022121884A1_D25504.tif" /><img file="US2022121884A1_D25505.tif" /><img file="US2022121884A1_D25506.tif" /><img file="US2022121884A1_D25507.tif" /><img file="US2022121884A1_D25508.tif" /><img file="US2022121884A1_D25509.tif" /><img file="US2022121884A1_D25510.tif" /><img file="US2022121884A1_D25511.tif" /><img file="US2022121884A1_D25512.tif" /><img file="US2022121884A1_D25513.tif" /><img file="US2022121884A1_D25514.tif" /><img file="US2022121884A1_D25515.tif" /><img file="US2022121884A1_D25516.tif" /><img file="US2022121884A1_D25517.tif" /><img file="US2022121884A1_D25518.tif" /><img file="US2022121884A1_D25519.tif" /><img file="US2022121884A1_D25520.tif" /><img file="US2022121884A1_D25521.tif" /><img file="US2022121884A1_D25522.tif" /><img file="US2022121884A1_D25523.tif" /><img file="US2022121884A1_D25524.tif" /><img file="US2022121884A1_D25525.tif" /><img file="US2022121884A1_D25526.tif" /><img file="US2022121884A1_D25527.tif" /><img file="US2022121884A1_D25528.tif" /><img file="US2022121884A1_D25529.tif" /><img file="US2022121884A1_D25530.tif" /><img file="US2022121884A1_D25531.tif" /><img file="US2022121884A1_D25532.tif" /><img file="US2022121884A1_D25533.tif" /><img file="US2022121884A1_D25534.tif" /><img file="US2022121884A1_D25535.tif" /><img file="US2022121884A1_D25536.tif" /><img file="US2022121884A1_D25537.tif" /><img file="US2022121884A1_D25538.tif" /><img file="US2022121884A1_D25539.tif" /><img file="US2022121884A1_D25540.tif" /><img file="US2022121884A1_D25541.tif" /><img file="US2022121884A1_D25542.tif" /><img file="US2022121884A1_D25543.tif" /><img file="US2022121884A1_D25544.tif" /><img file="US2022121884A1_D25545.tif" /><img file="US2022121884A1_D25546.tif" /><img file="US2022121884A1_D25547.tif" /><img file="US2022121884A1_D25548.tif" /><img file="US2022121884A1_D25549.tif" /><img file="US2022121884A1_D25550.tif" /><img file="US2022121884A1_D25551.tif" /><img file="US2022121884A1_D25552.tif" />
where N<sub>in-pri</sub><sub><sub2>±</sub2></sub> denotes the number of data points from each class in S<sub>in-pri</sub>; i<sub>±</sub> indexes points over each class; and COM<sub>±</sub> is the center of mass for each class of data point in S<sub>in-pri</sub>, given by
<maths id="MATH-US-00134" num="00134"><math overflow="scroll"><mrow><msub><mi>COM</mi><mo>±</mo></msub><mo>=</mo><mrow><mfrac><mn>1</mn><msub><mi>N</mi><mrow><mi>in</mi><mo>-</mo><msub><mi>pri</mi><mo>±</mo></msub></mrow></msub></mfrac><mo></mo><mrow><munder><mo>∑</mo><mrow><msub><mi>i</mi><mo>±</mo></msub><mo>∈</mo><msub><mi>S</mi><mrow><mi>in</mi><mo>-</mo><mi>pri</mi></mrow></msub></mrow></munder><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><msub><mi>x</mi><msub><mi>i</mi><mo>±</mo></msub></msub></mrow></mrow></mrow></math></maths><img file="US2022121884A1_D25553.tif" /><img file="US2022121884A1_D25554.tif" /><img file="US2022121884A1_D25555.tif" /><img file="US2022121884A1_D25556.tif" /><img file="US2022121884A1_D25557.tif" /><img file="US2022121884A1_D25558.tif" /><img file="US2022121884A1_D25559.tif" /><img file="US2022121884A1_D25560.tif" /><img file="US2022121884A1_D25561.tif" /><img file="US2022121884A1_D25562.tif" /><img file="US2022121884A1_D25563.tif" /><img file="US2022121884A1_D25564.tif" /><img file="US2022121884A1_D25565.tif" /><img file="US2022121884A1_D25566.tif" /><img file="US2022121884A1_D25567.tif" /><img file="US2022121884A1_D25568.tif" /><img file="US2022121884A1_D25569.tif" /><img file="US2022121884A1_D25570.tif" /><img file="US2022121884A1_D25571.tif" /><img file="US2022121884A1_D25572.tif" /><img file="US2022121884A1_D25573.tif" /><img file="US2022121884A1_D25574.tif" /><img file="US2022121884A1_D25575.tif" /><img file="US2022121884A1_D25576.tif" /><img file="US2022121884A1_D25577.tif" /><img file="US2022121884A1_D25578.tif" /><img file="US2022121884A1_D25579.tif" /><img file="US2022121884A1_D25580.tif" /><img file="US2022121884A1_D25581.tif" /><img file="US2022121884A1_D25582.tif" /><img file="US2022121884A1_D25583.tif" /><img file="US2022121884A1_D25584.tif" /><img file="US2022121884A1_D25585.tif" /><img file="US2022121884A1_D25586.tif" /><img file="US2022121884A1_D25587.tif" /><img file="US2022121884A1_D25588.tif" /><img file="US2022121884A1_D25589.tif" /><img file="US2022121884A1_D25590.tif" /><img file="US2022121884A1_D25591.tif" /><img file="US2022121884A1_D25592.tif" /><img file="US2022121884A1_D25593.tif" /><img file="US2022121884A1_D25594.tif" /><img file="US2022121884A1_D25595.tif" /><img file="US2022121884A1_D25596.tif" /><img file="US2022121884A1_D25597.tif" /><img file="US2022121884A1_D25598.tif" /><img file="US2022121884A1_D25599.tif" /><img file="US2022121884A1_D25600.tif" /><img file="US2022121884A1_D25601.tif" /><img file="US2022121884A1_D25602.tif" /><img file="US2022121884A1_D25603.tif" /><img file="US2022121884A1_D25604.tif" /><img file="US2022121884A1_D25605.tif" /><img file="US2022121884A1_D25606.tif" /><img file="US2022121884A1_D25607.tif" /><img file="US2022121884A1_D25608.tif" /><img file="US2022121884A1_D25609.tif" /><img file="US2022121884A1_D25610.tif" /><img file="US2022121884A1_D25611.tif" /><img file="US2022121884A1_D25612.tif" /><img file="US2022121884A1_D25613.tif" /><img file="US2022121884A1_D25614.tif" /><img file="US2022121884A1_D25615.tif" /><img file="US2022121884A1_D25616.tif" /><img file="US2022121884A1_D25617.tif" /><img file="US2022121884A1_D25618.tif" /><img file="US2022121884A1_D25619.tif" /><img file="US2022121884A1_D25620.tif" /><img file="US2022121884A1_D25621.tif" /><img file="US2022121884A1_D25622.tif" /><img file="US2022121884A1_D25623.tif" /><img file="US2022121884A1_D25624.tif" /><img file="US2022121884A1_D25625.tif" /><img file="US2022121884A1_D25626.tif" /><img file="US2022121884A1_D25627.tif" /><img file="US2022121884A1_D25628.tif" /><img file="US2022121884A1_D25629.tif" /><img file="US2022121884A1_D25630.tif" /><img file="US2022121884A1_D25631.tif" /><img file="US2022121884A1_D25632.tif" /><img file="US2022121884A1_D25633.tif" /><img file="US2022121884A1_D25634.tif" /><img file="US2022121884A1_D25635.tif" /><img file="US2022121884A1_D25636.tif" /><img file="US2022121884A1_D25637.tif" /><img file="US2022121884A1_D25638.tif" /><img file="US2022121884A1_D25639.tif" /><img file="US2022121884A1_D25640.tif" /><img file="US2022121884A1_D25641.tif" /><img file="US2022121884A1_D25642.tif" /><img file="US2022121884A1_D25643.tif" /><img file="US2022121884A1_D25644.tif" /><img file="US2022121884A1_D25645.tif" /><img file="US2022121884A1_D25646.tif" /><img file="US2022121884A1_D25647.tif" /><img file="US2022121884A1_D25648.tif" /><img file="US2022121884A1_D25649.tif" /><img file="US2022121884A1_D25650.tif" /><img file="US2022121884A1_D25651.tif" /><img file="US2022121884A1_D25652.tif" /><img file="US2022121884A1_D25653.tif" /><img file="US2022121884A1_D25654.tif" /><img file="US2022121884A1_D25655.tif" /><img file="US2022121884A1_D25656.tif" /><img file="US2022121884A1_D25657.tif" /><img file="US2022121884A1_D25658.tif" /><img file="US2022121884A1_D25659.tif" /><img file="US2022121884A1_D25660.tif" /><img file="US2022121884A1_D25661.tif" /><img file="US2022121884A1_D25662.tif" /><img file="US2022121884A1_D25663.tif" /><img file="US2022121884A1_D25664.tif" />
The change in slack error for S<sub>in-pri </sub>becomes:
<maths id="MATH-US-00135" num="00135"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><munder><mo>∑</mo><mrow><mi>i</mi><mo>∈</mo><msub><mi>S</mi><mrow><mi>in</mi><mo>-</mo><mi>pri</mi></mrow></msub></mrow></munder><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><mi>Δ</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><msub><mi>ξ</mi><mi>i</mi></msub></mrow></mrow><mo>=</mo><mrow><mrow><munder><mo>∑</mo><mrow><mi>i</mi><mo>∈</mo><msub><mi>S</mi><mrow><mi>in</mi><mo>-</mo><mi>pri</mi></mrow></msub></mrow></munder><mo></mo><mrow><mrow><mrow><mo>-</mo><msub><mi>y</mi><mi>i</mi></msub></mrow><mo>·</mo><mi>Δ</mi></mrow><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><msub><mi>u</mi><mi>i</mi></msub></mrow></mrow><mo>=</mo><mrow><mrow><mo>-</mo><mrow><mo></mo><mrow><mi>Δ</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>w</mi></mrow><mo></mo></mrow></mrow><mo>·</mo><mrow><msub><mi>N</mi><mrow><mi>in</mi><mo>-</mo><mi>pri</mi></mrow></msub><mo></mo><mrow><mo>(</mo><mrow><msub><mi>COM</mi><mo>+</mo></msub><mo>-</mo><msub><mi>COM</mi><mo>-</mo></msub></mrow><mo>)</mo></mrow></mrow><mo>·</mo><msub><mover><mi>w</mi><mo>^</mo></mover><mrow><mo>⊥</mo><mrow><mo>,</mo><mi>k</mi></mrow></mrow></msub></mrow></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mn>49</mn><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2022121884A1_D25665.tif" /><img file="US2022121884A1_D25666.tif" /><img file="US2022121884A1_D25667.tif" /><img file="US2022121884A1_D25668.tif" /><img file="US2022121884A1_D25669.tif" /><img file="US2022121884A1_D25670.tif" /><img file="US2022121884A1_D25671.tif" /><img file="US2022121884A1_D25672.tif" /><img file="US2022121884A1_D25673.tif" /><img file="US2022121884A1_D25674.tif" /><img file="US2022121884A1_D25675.tif" /><img file="US2022121884A1_D25676.tif" /><img file="US2022121884A1_D25677.tif" /><img file="US2022121884A1_D25678.tif" /><img file="US2022121884A1_D25679.tif" /><img file="US2022121884A1_D25680.tif" /><img file="US2022121884A1_D25681.tif" /><img file="US2022121884A1_D25682.tif" /><img file="US2022121884A1_D25683.tif" /><img file="US2022121884A1_D25684.tif" /><img file="US2022121884A1_D25685.tif" /><img file="US2022121884A1_D25686.tif" /><img file="US2022121884A1_D25687.tif" /><img file="US2022121884A1_D25688.tif" /><img file="US2022121884A1_D25689.tif" /><img file="US2022121884A1_D25690.tif" /><img file="US2022121884A1_D25691.tif" /><img file="US2022121884A1_D25692.tif" /><img file="US2022121884A1_D25693.tif" /><img file="US2022121884A1_D25694.tif" /><img file="US2022121884A1_D25695.tif" /><img file="US2022121884A1_D25696.tif" /><img file="US2022121884A1_D25697.tif" /><img file="US2022121884A1_D25698.tif" /><img file="US2022121884A1_D25699.tif" /><img file="US2022121884A1_D25700.tif" /><img file="US2022121884A1_D25701.tif" /><img file="US2022121884A1_D25702.tif" /><img file="US2022121884A1_D25703.tif" /><img file="US2022121884A1_D25704.tif" /><img file="US2022121884A1_D25705.tif" /><img file="US2022121884A1_D25706.tif" /><img file="US2022121884A1_D25707.tif" /><img file="US2022121884A1_D25708.tif" /><img file="US2022121884A1_D25709.tif" /><img file="US2022121884A1_D25710.tif" /><img file="US2022121884A1_D25711.tif" /><img file="US2022121884A1_D25712.tif" /><img file="US2022121884A1_D25713.tif" /><img file="US2022121884A1_D25714.tif" /><img file="US2022121884A1_D25715.tif" /><img file="US2022121884A1_D25716.tif" /><img file="US2022121884A1_D25717.tif" /><img file="US2022121884A1_D25718.tif" /><img file="US2022121884A1_D25719.tif" /><img file="US2022121884A1_D25720.tif" /><img file="US2022121884A1_D25721.tif" /><img file="US2022121884A1_D25722.tif" /><img file="US2022121884A1_D25723.tif" /><img file="US2022121884A1_D25724.tif" /><img file="US2022121884A1_D25725.tif" /><img file="US2022121884A1_D25726.tif" /><img file="US2022121884A1_D25727.tif" /><img file="US2022121884A1_D25728.tif" /><img file="US2022121884A1_D25729.tif" /><img file="US2022121884A1_D25730.tif" /><img file="US2022121884A1_D25731.tif" /><img file="US2022121884A1_D25732.tif" /><img file="US2022121884A1_D25733.tif" /><img file="US2022121884A1_D25734.tif" /><img file="US2022121884A1_D25735.tif" /><img file="US2022121884A1_D25736.tif" /><img file="US2022121884A1_D25737.tif" /><img file="US2022121884A1_D25738.tif" /><img file="US2022121884A1_D25739.tif" /><img file="US2022121884A1_D25740.tif" /><img file="US2022121884A1_D25741.tif" /><img file="US2022121884A1_D25742.tif" /><img file="US2022121884A1_D25743.tif" /><img file="US2022121884A1_D25744.tif" /><img file="US2022121884A1_D25745.tif" /><img file="US2022121884A1_D25746.tif" /><img file="US2022121884A1_D25747.tif" /><img file="US2022121884A1_D25748.tif" /><img file="US2022121884A1_D25749.tif" /><img file="US2022121884A1_D25750.tif" /><img file="US2022121884A1_D25751.tif" /><img file="US2022121884A1_D25752.tif" /><img file="US2022121884A1_D25753.tif" /><img file="US2022121884A1_D25754.tif" /><img file="US2022121884A1_D25755.tif" /><img file="US2022121884A1_D25756.tif" /><img file="US2022121884A1_D25757.tif" /><img file="US2022121884A1_D25758.tif" /><img file="US2022121884A1_D25759.tif" /><img file="US2022121884A1_D25760.tif" /><img file="US2022121884A1_D25761.tif" /><img file="US2022121884A1_D25762.tif" /><img file="US2022121884A1_D25763.tif" /><img file="US2022121884A1_D25764.tif" /><img file="US2022121884A1_D25765.tif" /><img file="US2022121884A1_D25766.tif" /><img file="US2022121884A1_D25767.tif" /><img file="US2022121884A1_D25768.tif" /><img file="US2022121884A1_D25769.tif" /><img file="US2022121884A1_D25770.tif" /><img file="US2022121884A1_D25771.tif" /><img file="US2022121884A1_D25772.tif" /><img file="US2022121884A1_D25773.tif" /><img file="US2022121884A1_D25774.tif" /><img file="US2022121884A1_D25775.tif" /><img file="US2022121884A1_D25776.tif" />
where it is assumed that N<sub>in-pri</sub>, are equal and denoted by N<sub>in-pri </sub>(resulting in elimination of PV). As depicted in <figref idref="DRAWINGS">FIG. 258</figref>, the imbalance in COM<sub>±</sub> can be used to reorient ŵ<sub>∥</sub> via Δw in reducing the slack error.
However, the expression for Δξ is now adjusted by those points going out and coming into the margin after the tilt by considering both u<sub>i </sub>and Δu<sub>i </sub>to account for double counting of those going out (denoted by S<sub>out-after</sub>) which were included in S<sub>in-pri</sub>, as well as those coming into the margin after the tilt (denoted by S<sub>in-after</sub>).
<maths id="MATH-US-00136" num="00136"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><munder><mo>∑</mo><mrow><mi>i</mi><mo>∈</mo><msub><mi>S</mi><mrow><mi>in</mi><mo>-</mo><mi>after</mi></mrow></msub></mrow></munder><mo></mo><mrow><mi>Δ</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><msub><mi>ξ</mi><mi>i</mi></msub></mrow></mrow><mo>=</mo><mrow><munder><mo>∑</mo><mrow><mi>i</mi><mo>∈</mo><msub><mi>S</mi><mrow><mi>in</mi><mo>-</mo><mi>after</mi></mrow></msub></mrow></munder><mo></mo><mrow><mo>(</mo><mrow><mn>1</mn><mo>-</mo><mrow><msub><mi>y</mi><mi>i</mi></msub><mo>·</mo><mrow><mo>(</mo><mrow><msub><mi>u</mi><mi>i</mi></msub><mo>+</mo><mrow><mi>Δ</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><msub><mi>u</mi><mi>i</mi></msub></mrow></mrow><mo>)</mo></mrow></mrow></mrow><mo>)</mo></mrow></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mrow><mn>50</mn><mo></mo><mi>a</mi></mrow><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2022121884A1_D25777.tif" /><img file="US2022121884A1_D25778.tif" /><img file="US2022121884A1_D25779.tif" /><img file="US2022121884A1_D25780.tif" /><img file="US2022121884A1_D25781.tif" /><img file="US2022121884A1_D25782.tif" /><img file="US2022121884A1_D25783.tif" /><img file="US2022121884A1_D25784.tif" /><img file="US2022121884A1_D25785.tif" /><img file="US2022121884A1_D25786.tif" /><img file="US2022121884A1_D25787.tif" /><img file="US2022121884A1_D25788.tif" /><img file="US2022121884A1_D25789.tif" /><img file="US2022121884A1_D25790.tif" /><img file="US2022121884A1_D25791.tif" /><img file="US2022121884A1_D25792.tif" /><img file="US2022121884A1_D25793.tif" /><img file="US2022121884A1_D25794.tif" /><img file="US2022121884A1_D25795.tif" /><img file="US2022121884A1_D25796.tif" /><img file="US2022121884A1_D25797.tif" /><img file="US2022121884A1_D25798.tif" /><img file="US2022121884A1_D25799.tif" /><img file="US2022121884A1_D25800.tif" /><img file="US2022121884A1_D25801.tif" /><img file="US2022121884A1_D25802.tif" /><img file="US2022121884A1_D25803.tif" /><img file="US2022121884A1_D25804.tif" /><img file="US2022121884A1_D25805.tif" /><img file="US2022121884A1_D25806.tif" /><img file="US2022121884A1_D25807.tif" /><img file="US2022121884A1_D25808.tif" /><img file="US2022121884A1_D25809.tif" /><img file="US2022121884A1_D25810.tif" /><img file="US2022121884A1_D25811.tif" /><img file="US2022121884A1_D25812.tif" /><img file="US2022121884A1_D25813.tif" /><img file="US2022121884A1_D25814.tif" /><img file="US2022121884A1_D25815.tif" /><img file="US2022121884A1_D25816.tif" /><img file="US2022121884A1_D25817.tif" /><img file="US2022121884A1_D25818.tif" /><img file="US2022121884A1_D25819.tif" /><img file="US2022121884A1_D25820.tif" /><img file="US2022121884A1_D25821.tif" /><img file="US2022121884A1_D25822.tif" /><img file="US2022121884A1_D25823.tif" /><img file="US2022121884A1_D25824.tif" /><img file="US2022121884A1_D25825.tif" /><img file="US2022121884A1_D25826.tif" /><img file="US2022121884A1_D25827.tif" /><img file="US2022121884A1_D25828.tif" /><img file="US2022121884A1_D25829.tif" /><img file="US2022121884A1_D25830.tif" /><img file="US2022121884A1_D25831.tif" /><img file="US2022121884A1_D25832.tif" /><img file="US2022121884A1_D25833.tif" /><img file="US2022121884A1_D25834.tif" /><img file="US2022121884A1_D25835.tif" /><img file="US2022121884A1_D25836.tif" /><img file="US2022121884A1_D25837.tif" /><img file="US2022121884A1_D25838.tif" /><img file="US2022121884A1_D25839.tif" /><img file="US2022121884A1_D25840.tif" /><img file="US2022121884A1_D25841.tif" /><img file="US2022121884A1_D25842.tif" /><img file="US2022121884A1_D25843.tif" /><img file="US2022121884A1_D25844.tif" /><img file="US2022121884A1_D25845.tif" /><img file="US2022121884A1_D25846.tif" /><img file="US2022121884A1_D25847.tif" /><img file="US2022121884A1_D25848.tif" /><img file="US2022121884A1_D25849.tif" /><img file="US2022121884A1_D25850.tif" /><img file="US2022121884A1_D25851.tif" /><img file="US2022121884A1_D25852.tif" /><img file="US2022121884A1_D25853.tif" /><img file="US2022121884A1_D25854.tif" /><img file="US2022121884A1_D25855.tif" /><img file="US2022121884A1_D25856.tif" /><img file="US2022121884A1_D25857.tif" /><img file="US2022121884A1_D25858.tif" /><img file="US2022121884A1_D25859.tif" /><img file="US2022121884A1_D25860.tif" /><img file="US2022121884A1_D25861.tif" /><img file="US2022121884A1_D25862.tif" /><img file="US2022121884A1_D25863.tif" /><img file="US2022121884A1_D25864.tif" /><img file="US2022121884A1_D25865.tif" /><img file="US2022121884A1_D25866.tif" /><img file="US2022121884A1_D25867.tif" /><img file="US2022121884A1_D25868.tif" /><img file="US2022121884A1_D25869.tif" /><img file="US2022121884A1_D25870.tif" /><img file="US2022121884A1_D25871.tif" /><img file="US2022121884A1_D25872.tif" /><img file="US2022121884A1_D25873.tif" /><img file="US2022121884A1_D25874.tif" /><img file="US2022121884A1_D25875.tif" /><img file="US2022121884A1_D25876.tif" /><img file="US2022121884A1_D25877.tif" /><img file="US2022121884A1_D25878.tif" /><img file="US2022121884A1_D25879.tif" /><img file="US2022121884A1_D25880.tif" /><img file="US2022121884A1_D25881.tif" /><img file="US2022121884A1_D25882.tif" /><img file="US2022121884A1_D25883.tif" /><img file="US2022121884A1_D25884.tif" /><img file="US2022121884A1_D25885.tif" /><img file="US2022121884A1_D25886.tif" /><img file="US2022121884A1_D25887.tif" /><img file="US2022121884A1_D25888.tif" />
Further simplification results:
<maths id="MATH-US-00137" num="00137"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><munder><mo>∑</mo><mrow><mi>i</mi><mo>∈</mo><msub><mi>S</mi><mrow><mi>in</mi><mo>-</mo><mi>after</mi></mrow></msub></mrow></munder><mo></mo><mrow><mi>Δ</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><msub><mi>ξ</mi><mi>i</mi></msub></mrow></mrow><mo>=</mo><mrow><msub><mi>N</mi><mrow><mi>in</mi><mo>-</mo><mi>after</mi></mrow></msub><mo>-</mo><mrow><mrow><mo>(</mo><mrow><msub><mi>N</mi><mrow><mi>in</mi><mo>-</mo><msub><mi>after</mi><mo>+</mo></msub></mrow></msub><mo>-</mo><msub><mi>N</mi><mrow><mi>in</mi><mo>-</mo><msub><mi>after</mi><mo>-</mo></msub></mrow></msub></mrow><mo>)</mo></mrow><mo></mo><mrow><mo>(</mo><mrow><mi>b</mi><mo>-</mo><mrow><mrow><mo></mo><mrow><mi>Δ</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>w</mi></mrow><mo></mo></mrow><mo></mo><mi>P</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><mi>V</mi><mo>·</mo><msub><mover><mi>w</mi><mo>^</mo></mover><mrow><mo>⊥</mo><mrow><mo>,</mo><mi>k</mi></mrow></mrow></msub></mrow></mrow></mrow><mo>)</mo></mrow></mrow><mo>-</mo><mrow><munder><mo>∑</mo><mrow><msub><mi>i</mi><mo>+</mo></msub><mo>∈</mo><msub><mi>S</mi><mrow><mi>in</mi><mo>-</mo><msub><mi>after</mi><mo>+</mo></msub></mrow></msub></mrow></munder><mo></mo><mrow><mfrac><mn>1</mn><mi>m</mi></mfrac><mo></mo><mrow><mo>(</mo><mrow><msub><mi>p</mi><msub><mi>i</mi><mo>+</mo></msub></msub><mo>+</mo><mrow><mfrac><mrow><mo></mo><mrow><mi>Δ</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>w</mi></mrow><mo></mo></mrow><mrow><mo></mo><mi>w</mi><mo></mo></mrow></mfrac><mo></mo><msub><mi>p</mi><mrow><msub><mi>i</mi><mo>+</mo></msub><mo>,</mo><mi>k</mi></mrow></msub></mrow></mrow><mo>)</mo></mrow></mrow></mrow><mo>+</mo><mrow><munder><mo>∑</mo><mrow><msub><mi>i</mi><mo>-</mo></msub><mo>∈</mo><msub><mi>S</mi><mrow><mi>in</mi><mo>-</mo><msub><mi>after</mi><mo>-</mo></msub></mrow></msub></mrow></munder><mo></mo><mrow><mfrac><mn>1</mn><mi>m</mi></mfrac><mo></mo><mrow><mo>(</mo><mrow><msub><mi>p</mi><msub><mi>i</mi><mo>-</mo></msub></msub><mo>+</mo><mrow><mfrac><mrow><mo></mo><mrow><mi>Δ</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>w</mi></mrow><mo></mo></mrow><mrow><mo></mo><mi>w</mi><mo></mo></mrow></mfrac><mo></mo><msub><mi>p</mi><mrow><msub><mi>i</mi><mo>-</mo></msub><mo>,</mo><mi>k</mi></mrow></msub></mrow></mrow><mo>)</mo></mrow></mrow></mrow></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mrow><mn>50</mn><mo></mo><mi>b</mi></mrow><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2022121884A1_D25889.tif" /><img file="US2022121884A1_D25890.tif" /><img file="US2022121884A1_D25891.tif" /><img file="US2022121884A1_D25892.tif" /><img file="US2022121884A1_D25893.tif" /><img file="US2022121884A1_D25894.tif" /><img file="US2022121884A1_D25895.tif" /><img file="US2022121884A1_D25896.tif" /><img file="US2022121884A1_D25897.tif" /><img file="US2022121884A1_D25898.tif" /><img file="US2022121884A1_D25899.tif" /><img file="US2022121884A1_D25900.tif" /><img file="US2022121884A1_D25901.tif" /><img file="US2022121884A1_D25902.tif" /><img file="US2022121884A1_D25903.tif" /><img file="US2022121884A1_D25904.tif" /><img file="US2022121884A1_D25905.tif" /><img file="US2022121884A1_D25906.tif" /><img file="US2022121884A1_D25907.tif" /><img file="US2022121884A1_D25908.tif" /><img file="US2022121884A1_D25909.tif" /><img file="US2022121884A1_D25910.tif" /><img file="US2022121884A1_D25911.tif" /><img file="US2022121884A1_D25912.tif" /><img file="US2022121884A1_D25913.tif" /><img file="US2022121884A1_D25914.tif" /><img file="US2022121884A1_D25915.tif" /><img file="US2022121884A1_D25916.tif" /><img file="US2022121884A1_D25917.tif" /><img file="US2022121884A1_D25918.tif" /><img file="US2022121884A1_D25919.tif" /><img file="US2022121884A1_D25920.tif" /><img file="US2022121884A1_D25921.tif" /><img file="US2022121884A1_D25922.tif" /><img file="US2022121884A1_D25923.tif" /><img file="US2022121884A1_D25924.tif" /><img file="US2022121884A1_D25925.tif" /><img file="US2022121884A1_D25926.tif" /><img file="US2022121884A1_D25927.tif" /><img file="US2022121884A1_D25928.tif" /><img file="US2022121884A1_D25929.tif" /><img file="US2022121884A1_D25930.tif" /><img file="US2022121884A1_D25931.tif" /><img file="US2022121884A1_D25932.tif" /><img file="US2022121884A1_D25933.tif" /><img file="US2022121884A1_D25934.tif" /><img file="US2022121884A1_D25935.tif" /><img file="US2022121884A1_D25936.tif" /><img file="US2022121884A1_D25937.tif" /><img file="US2022121884A1_D25938.tif" /><img file="US2022121884A1_D25939.tif" /><img file="US2022121884A1_D25940.tif" /><img file="US2022121884A1_D25941.tif" /><img file="US2022121884A1_D25942.tif" /><img file="US2022121884A1_D25943.tif" /><img file="US2022121884A1_D25944.tif" /><img file="US2022121884A1_D25945.tif" /><img file="US2022121884A1_D25946.tif" /><img file="US2022121884A1_D25947.tif" /><img file="US2022121884A1_D25948.tif" /><img file="US2022121884A1_D25949.tif" /><img file="US2022121884A1_D25950.tif" /><img file="US2022121884A1_D25951.tif" /><img file="US2022121884A1_D25952.tif" /><img file="US2022121884A1_D25953.tif" /><img file="US2022121884A1_D25954.tif" /><img file="US2022121884A1_D25955.tif" /><img file="US2022121884A1_D25956.tif" /><img file="US2022121884A1_D25957.tif" /><img file="US2022121884A1_D25958.tif" /><img file="US2022121884A1_D25959.tif" /><img file="US2022121884A1_D25960.tif" /><img file="US2022121884A1_D25961.tif" /><img file="US2022121884A1_D25962.tif" /><img file="US2022121884A1_D25963.tif" /><img file="US2022121884A1_D25964.tif" /><img file="US2022121884A1_D25965.tif" /><img file="US2022121884A1_D25966.tif" /><img file="US2022121884A1_D25967.tif" /><img file="US2022121884A1_D25968.tif" /><img file="US2022121884A1_D25969.tif" /><img file="US2022121884A1_D25970.tif" /><img file="US2022121884A1_D25971.tif" /><img file="US2022121884A1_D25972.tif" /><img file="US2022121884A1_D25973.tif" /><img file="US2022121884A1_D25974.tif" /><img file="US2022121884A1_D25975.tif" /><img file="US2022121884A1_D25976.tif" /><img file="US2022121884A1_D25977.tif" /><img file="US2022121884A1_D25978.tif" /><img file="US2022121884A1_D25979.tif" /><img file="US2022121884A1_D25980.tif" /><img file="US2022121884A1_D25981.tif" /><img file="US2022121884A1_D25982.tif" /><img file="US2022121884A1_D25983.tif" /><img file="US2022121884A1_D25984.tif" /><img file="US2022121884A1_D25985.tif" /><img file="US2022121884A1_D25986.tif" /><img file="US2022121884A1_D25987.tif" /><img file="US2022121884A1_D25988.tif" /><img file="US2022121884A1_D25989.tif" /><img file="US2022121884A1_D25990.tif" /><img file="US2022121884A1_D25991.tif" /><img file="US2022121884A1_D25992.tif" /><img file="US2022121884A1_D25993.tif" /><img file="US2022121884A1_D25994.tif" /><img file="US2022121884A1_D25995.tif" /><img file="US2022121884A1_D25996.tif" /><img file="US2022121884A1_D25997.tif" /><img file="US2022121884A1_D25998.tif" /><img file="US2022121884A1_D25999.tif" /><img file="US2022121884A1_D26000.tif" />
where N<sub>in-after</sub><sub><sub2>±</sub2></sub> are the number data points for each class coming into the margin after the tilt, and N<sub>in-after </sub>is the sum of (N<sub>in-after</sub><sub><sub2>+</sub2></sub>+N<sub>in-after</sub><sub><sub2>−</sub2></sub>). The expression for the adjustment of slack error for data points going out of the margin is quite similar, except for minus sign (as the errors are reduced) and labels switching from in to out:
<maths id="MATH-US-00138" num="00138"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><munder><mo>∑</mo><mrow><mi>i</mi><mo>∈</mo><msub><mi>S</mi><mrow><mi>out</mi><mo>-</mo><mi>after</mi></mrow></msub></mrow></munder><mo></mo><msub><mi>Δξ</mi><mi>i</mi></msub></mrow><mo>=</mo><mrow><munder><mo>∑</mo><mrow><mi>i</mi><mo>∈</mo><msub><mi>S</mi><mrow><mi>out</mi><mo>-</mo><mi>after</mi></mrow></msub></mrow></munder><mo></mo><mrow><mo>(</mo><mrow><mrow><mo>-</mo><mn>1</mn></mrow><mo>+</mo><mrow><msub><mi>y</mi><mi>i</mi></msub><mo>·</mo><mrow><mo>(</mo><mrow><msub><mi>u</mi><mi>i</mi></msub><mo>+</mo><mrow><mi>Δ</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><msub><mi>u</mi><mi>i</mi></msub></mrow></mrow><mo>)</mo></mrow></mrow></mrow><mo>)</mo></mrow></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mn>51</mn><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2022121884A1_D26001.tif" /><img file="US2022121884A1_D26002.tif" /><img file="US2022121884A1_D26003.tif" /><img file="US2022121884A1_D26004.tif" /><img file="US2022121884A1_D26005.tif" /><img file="US2022121884A1_D26006.tif" /><img file="US2022121884A1_D26007.tif" /><img file="US2022121884A1_D26008.tif" /><img file="US2022121884A1_D26009.tif" /><img file="US2022121884A1_D26010.tif" /><img file="US2022121884A1_D26011.tif" /><img file="US2022121884A1_D26012.tif" /><img file="US2022121884A1_D26013.tif" /><img file="US2022121884A1_D26014.tif" /><img file="US2022121884A1_D26015.tif" /><img file="US2022121884A1_D26016.tif" /><img file="US2022121884A1_D26017.tif" /><img file="US2022121884A1_D26018.tif" /><img file="US2022121884A1_D26019.tif" /><img file="US2022121884A1_D26020.tif" /><img file="US2022121884A1_D26021.tif" /><img file="US2022121884A1_D26022.tif" /><img file="US2022121884A1_D26023.tif" /><img file="US2022121884A1_D26024.tif" /><img file="US2022121884A1_D26025.tif" /><img file="US2022121884A1_D26026.tif" /><img file="US2022121884A1_D26027.tif" /><img file="US2022121884A1_D26028.tif" /><img file="US2022121884A1_D26029.tif" /><img file="US2022121884A1_D26030.tif" /><img file="US2022121884A1_D26031.tif" /><img file="US2022121884A1_D26032.tif" /><img file="US2022121884A1_D26033.tif" /><img file="US2022121884A1_D26034.tif" /><img file="US2022121884A1_D26035.tif" /><img file="US2022121884A1_D26036.tif" /><img file="US2022121884A1_D26037.tif" /><img file="US2022121884A1_D26038.tif" /><img file="US2022121884A1_D26039.tif" /><img file="US2022121884A1_D26040.tif" /><img file="US2022121884A1_D26041.tif" /><img file="US2022121884A1_D26042.tif" /><img file="US2022121884A1_D26043.tif" /><img file="US2022121884A1_D26044.tif" /><img file="US2022121884A1_D26045.tif" /><img file="US2022121884A1_D26046.tif" /><img file="US2022121884A1_D26047.tif" /><img file="US2022121884A1_D26048.tif" /><img file="US2022121884A1_D26049.tif" /><img file="US2022121884A1_D26050.tif" /><img file="US2022121884A1_D26051.tif" /><img file="US2022121884A1_D26052.tif" /><img file="US2022121884A1_D26053.tif" /><img file="US2022121884A1_D26054.tif" /><img file="US2022121884A1_D26055.tif" /><img file="US2022121884A1_D26056.tif" /><img file="US2022121884A1_D26057.tif" /><img file="US2022121884A1_D26058.tif" /><img file="US2022121884A1_D26059.tif" /><img file="US2022121884A1_D26060.tif" /><img file="US2022121884A1_D26061.tif" /><img file="US2022121884A1_D26062.tif" /><img file="US2022121884A1_D26063.tif" /><img file="US2022121884A1_D26064.tif" /><img file="US2022121884A1_D26065.tif" /><img file="US2022121884A1_D26066.tif" /><img file="US2022121884A1_D26067.tif" /><img file="US2022121884A1_D26068.tif" /><img file="US2022121884A1_D26069.tif" /><img file="US2022121884A1_D26070.tif" /><img file="US2022121884A1_D26071.tif" /><img file="US2022121884A1_D26072.tif" /><img file="US2022121884A1_D26073.tif" /><img file="US2022121884A1_D26074.tif" /><img file="US2022121884A1_D26075.tif" /><img file="US2022121884A1_D26076.tif" /><img file="US2022121884A1_D26077.tif" /><img file="US2022121884A1_D26078.tif" /><img file="US2022121884A1_D26079.tif" /><img file="US2022121884A1_D26080.tif" /><img file="US2022121884A1_D26081.tif" /><img file="US2022121884A1_D26082.tif" /><img file="US2022121884A1_D26083.tif" /><img file="US2022121884A1_D26084.tif" /><img file="US2022121884A1_D26085.tif" /><img file="US2022121884A1_D26086.tif" /><img file="US2022121884A1_D26087.tif" /><img file="US2022121884A1_D26088.tif" /><img file="US2022121884A1_D26089.tif" /><img file="US2022121884A1_D26090.tif" /><img file="US2022121884A1_D26091.tif" /><img file="US2022121884A1_D26092.tif" /><img file="US2022121884A1_D26093.tif" /><img file="US2022121884A1_D26094.tif" /><img file="US2022121884A1_D26095.tif" /><img file="US2022121884A1_D26096.tif" /><img file="US2022121884A1_D26097.tif" /><img file="US2022121884A1_D26098.tif" /><img file="US2022121884A1_D26099.tif" /><img file="US2022121884A1_D26100.tif" /><img file="US2022121884A1_D26101.tif" /><img file="US2022121884A1_D26102.tif" /><img file="US2022121884A1_D26103.tif" /><img file="US2022121884A1_D26104.tif" /><img file="US2022121884A1_D26105.tif" /><img file="US2022121884A1_D26106.tif" /><img file="US2022121884A1_D26107.tif" /><img file="US2022121884A1_D26108.tif" /><img file="US2022121884A1_D26109.tif" /><img file="US2022121884A1_D26110.tif" /><img file="US2022121884A1_D26111.tif" /><img file="US2022121884A1_D26112.tif" />
Therefore, at each iteration, (49) may readily be evaluated for a given ∥Δw∥, based on tracking of the running sum of p<sub>i</sub><sub><sub2>±,</sub2></sub><sub>k </sub>in (48) or center of masses in (49), during the scanning of the ordered list of projected data (37). While (49) is explicitly proportional to ∥Δw∥, (50) and (51) are only indirectly related to ∥Δw∥, through N<sub>in-after </sub>and N<sub>out-after</sub>. It would be reasonable for most affected points be from regions far from the pivot point per (46) where Δu<sub>i </sub>is greater.
The following approach is adopted to control the tilt so that the scan of projected data along ŵ<sub>∥</sub> would provide the required data for evaluating (49), (50), and (51). Based on the scanning of p<sub>m1+</sub> and p<sub>m1−</sub> projection class markers, Equations (38)-(43) provide applicable hyperplane (if any) and its associated objective function and slack error for various N<sub>m1</sub>'s. Therefore, around the marker positions corresponding to margin, m<sub>opt</sub>, and offset, b<sub>opt</sub>, other neighboring markers provide information, e.g., for a larger margin m<sub>2</sub>, as depicted in <figref idref="DRAWINGS">FIG. 259</figref>.
The markers corresponding to m<sub>2 </sub>are adopted to effectively limit ∥Δw∥, so that the set of data points going into the margin (S<sub>in-after</sub>) due to the tilt would be limited to those data points entering margin m<sub>2 </sub>when margin is expanded from m<sub>opt </sub>in ŵ<sub>∥</sub> direction (denoted as S<sub>m</sub><sub><sub2>2</sub2></sub><sub>-m</sub><sub><sub2>opt</sub2></sub>), provided that:
<maths id="MATH-US-00139" num="00139"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><mfrac><mrow><mo></mo><mrow><mi>Δ</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>w</mi></mrow><mo></mo></mrow><mrow><mo></mo><mi>w</mi><mo></mo></mrow></mfrac><mo>≤</mo><mfrac><mrow><mi>Δ</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>L</mi></mrow><mi>L</mi></mfrac></mrow><mo>=</mo><mrow><mfrac><mrow><msub><mi>m</mi><mn>2</mn></msub><mo>-</mo><msub><mi>m</mi><mi>opt</mi></msub></mrow><mi>L</mi></mfrac><mo>=</mo><mfrac><mrow><mi>Δ</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>m</mi></mrow><mi>L</mi></mfrac></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mn>52</mn><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2022121884A1_D26113.tif" /><img file="US2022121884A1_D26114.tif" /><img file="US2022121884A1_D26115.tif" /><img file="US2022121884A1_D26116.tif" /><img file="US2022121884A1_D26117.tif" /><img file="US2022121884A1_D26118.tif" /><img file="US2022121884A1_D26119.tif" /><img file="US2022121884A1_D26120.tif" /><img file="US2022121884A1_D26121.tif" /><img file="US2022121884A1_D26122.tif" /><img file="US2022121884A1_D26123.tif" /><img file="US2022121884A1_D26124.tif" /><img file="US2022121884A1_D26125.tif" /><img file="US2022121884A1_D26126.tif" /><img file="US2022121884A1_D26127.tif" /><img file="US2022121884A1_D26128.tif" /><img file="US2022121884A1_D26129.tif" /><img file="US2022121884A1_D26130.tif" /><img file="US2022121884A1_D26131.tif" /><img file="US2022121884A1_D26132.tif" /><img file="US2022121884A1_D26133.tif" /><img file="US2022121884A1_D26134.tif" /><img file="US2022121884A1_D26135.tif" /><img file="US2022121884A1_D26136.tif" /><img file="US2022121884A1_D26137.tif" /><img file="US2022121884A1_D26138.tif" /><img file="US2022121884A1_D26139.tif" /><img file="US2022121884A1_D26140.tif" /><img file="US2022121884A1_D26141.tif" /><img file="US2022121884A1_D26142.tif" /><img file="US2022121884A1_D26143.tif" /><img file="US2022121884A1_D26144.tif" /><img file="US2022121884A1_D26145.tif" /><img file="US2022121884A1_D26146.tif" /><img file="US2022121884A1_D26147.tif" /><img file="US2022121884A1_D26148.tif" /><img file="US2022121884A1_D26149.tif" /><img file="US2022121884A1_D26150.tif" /><img file="US2022121884A1_D26151.tif" /><img file="US2022121884A1_D26152.tif" /><img file="US2022121884A1_D26153.tif" /><img file="US2022121884A1_D26154.tif" /><img file="US2022121884A1_D26155.tif" /><img file="US2022121884A1_D26156.tif" /><img file="US2022121884A1_D26157.tif" /><img file="US2022121884A1_D26158.tif" /><img file="US2022121884A1_D26159.tif" /><img file="US2022121884A1_D26160.tif" /><img file="US2022121884A1_D26161.tif" /><img file="US2022121884A1_D26162.tif" /><img file="US2022121884A1_D26163.tif" /><img file="US2022121884A1_D26164.tif" /><img file="US2022121884A1_D26165.tif" /><img file="US2022121884A1_D26166.tif" /><img file="US2022121884A1_D26167.tif" /><img file="US2022121884A1_D26168.tif" /><img file="US2022121884A1_D26169.tif" /><img file="US2022121884A1_D26170.tif" /><img file="US2022121884A1_D26171.tif" /><img file="US2022121884A1_D26172.tif" /><img file="US2022121884A1_D26173.tif" /><img file="US2022121884A1_D26174.tif" /><img file="US2022121884A1_D26175.tif" /><img file="US2022121884A1_D26176.tif" /><img file="US2022121884A1_D26177.tif" /><img file="US2022121884A1_D26178.tif" /><img file="US2022121884A1_D26179.tif" /><img file="US2022121884A1_D26180.tif" /><img file="US2022121884A1_D26181.tif" /><img file="US2022121884A1_D26182.tif" /><img file="US2022121884A1_D26183.tif" /><img file="US2022121884A1_D26184.tif" /><img file="US2022121884A1_D26185.tif" /><img file="US2022121884A1_D26186.tif" /><img file="US2022121884A1_D26187.tif" /><img file="US2022121884A1_D26188.tif" /><img file="US2022121884A1_D26189.tif" /><img file="US2022121884A1_D26190.tif" /><img file="US2022121884A1_D26191.tif" /><img file="US2022121884A1_D26192.tif" /><img file="US2022121884A1_D26193.tif" /><img file="US2022121884A1_D26194.tif" /><img file="US2022121884A1_D26195.tif" /><img file="US2022121884A1_D26196.tif" /><img file="US2022121884A1_D26197.tif" /><img file="US2022121884A1_D26198.tif" /><img file="US2022121884A1_D26199.tif" /><img file="US2022121884A1_D26200.tif" /><img file="US2022121884A1_D26201.tif" /><img file="US2022121884A1_D26202.tif" /><img file="US2022121884A1_D26203.tif" /><img file="US2022121884A1_D26204.tif" /><img file="US2022121884A1_D26205.tif" /><img file="US2022121884A1_D26206.tif" /><img file="US2022121884A1_D26207.tif" /><img file="US2022121884A1_D26208.tif" /><img file="US2022121884A1_D26209.tif" /><img file="US2022121884A1_D26210.tif" /><img file="US2022121884A1_D26211.tif" /><img file="US2022121884A1_D26212.tif" /><img file="US2022121884A1_D26213.tif" /><img file="US2022121884A1_D26214.tif" /><img file="US2022121884A1_D26215.tif" /><img file="US2022121884A1_D26216.tif" /><img file="US2022121884A1_D26217.tif" /><img file="US2022121884A1_D26218.tif" /><img file="US2022121884A1_D26219.tif" /><img file="US2022121884A1_D26220.tif" /><img file="US2022121884A1_D26221.tif" /><img file="US2022121884A1_D26222.tif" /><img file="US2022121884A1_D26223.tif" /><img file="US2022121884A1_D26224.tif" />
where L is the full extent of data points in ŵ<sub>⊥,k </sub>direction from the pivot point, and the pivot may be taken at the extremes of the range or near a center of mass (e.g., where COM<sub>±</sub> project on ŵ<sub>⊥,k</sub>). Practically, the margin markers which control the margin boundaries are used to determine the limit for ΔL. For example,
<maths id="MATH-US-00140" num="00140"><math overflow="scroll"><mtable><mtr><mtd><mrow><mfrac><mrow><mo></mo><mrow><mi>Δ</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>w</mi></mrow><mo></mo></mrow><mrow><mo></mo><mi>w</mi><mo></mo></mrow></mfrac><mo>≤</mo><mfrac><mrow><msub><mi>p</mi><mrow><mi>m2</mi><mo>±</mo></mrow></msub><mo>-</mo><msub><mi>p</mi><mrow><mi>opt</mi><mo>±</mo></mrow></msub></mrow><mi>L</mi></mfrac></mrow></mtd><mtd><mrow><mo>(</mo><mn>53</mn><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2022121884A1_D26225.tif" /><img file="US2022121884A1_D26226.tif" /><img file="US2022121884A1_D26227.tif" /><img file="US2022121884A1_D26228.tif" /><img file="US2022121884A1_D26229.tif" /><img file="US2022121884A1_D26230.tif" /><img file="US2022121884A1_D26231.tif" /><img file="US2022121884A1_D26232.tif" /><img file="US2022121884A1_D26233.tif" /><img file="US2022121884A1_D26234.tif" /><img file="US2022121884A1_D26235.tif" /><img file="US2022121884A1_D26236.tif" /><img file="US2022121884A1_D26237.tif" /><img file="US2022121884A1_D26238.tif" /><img file="US2022121884A1_D26239.tif" /><img file="US2022121884A1_D26240.tif" /><img file="US2022121884A1_D26241.tif" /><img file="US2022121884A1_D26242.tif" /><img file="US2022121884A1_D26243.tif" /><img file="US2022121884A1_D26244.tif" /><img file="US2022121884A1_D26245.tif" /><img file="US2022121884A1_D26246.tif" /><img file="US2022121884A1_D26247.tif" /><img file="US2022121884A1_D26248.tif" /><img file="US2022121884A1_D26249.tif" /><img file="US2022121884A1_D26250.tif" /><img file="US2022121884A1_D26251.tif" /><img file="US2022121884A1_D26252.tif" /><img file="US2022121884A1_D26253.tif" /><img file="US2022121884A1_D26254.tif" /><img file="US2022121884A1_D26255.tif" /><img file="US2022121884A1_D26256.tif" /><img file="US2022121884A1_D26257.tif" /><img file="US2022121884A1_D26258.tif" /><img file="US2022121884A1_D26259.tif" /><img file="US2022121884A1_D26260.tif" /><img file="US2022121884A1_D26261.tif" /><img file="US2022121884A1_D26262.tif" /><img file="US2022121884A1_D26263.tif" /><img file="US2022121884A1_D26264.tif" /><img file="US2022121884A1_D26265.tif" /><img file="US2022121884A1_D26266.tif" /><img file="US2022121884A1_D26267.tif" /><img file="US2022121884A1_D26268.tif" /><img file="US2022121884A1_D26269.tif" /><img file="US2022121884A1_D26270.tif" /><img file="US2022121884A1_D26271.tif" /><img file="US2022121884A1_D26272.tif" /><img file="US2022121884A1_D26273.tif" /><img file="US2022121884A1_D26274.tif" /><img file="US2022121884A1_D26275.tif" /><img file="US2022121884A1_D26276.tif" /><img file="US2022121884A1_D26277.tif" /><img file="US2022121884A1_D26278.tif" /><img file="US2022121884A1_D26279.tif" /><img file="US2022121884A1_D26280.tif" /><img file="US2022121884A1_D26281.tif" /><img file="US2022121884A1_D26282.tif" /><img file="US2022121884A1_D26283.tif" /><img file="US2022121884A1_D26284.tif" /><img file="US2022121884A1_D26285.tif" /><img file="US2022121884A1_D26286.tif" /><img file="US2022121884A1_D26287.tif" /><img file="US2022121884A1_D26288.tif" /><img file="US2022121884A1_D26289.tif" /><img file="US2022121884A1_D26290.tif" /><img file="US2022121884A1_D26291.tif" /><img file="US2022121884A1_D26292.tif" /><img file="US2022121884A1_D26293.tif" /><img file="US2022121884A1_D26294.tif" /><img file="US2022121884A1_D26295.tif" /><img file="US2022121884A1_D26296.tif" /><img file="US2022121884A1_D26297.tif" /><img file="US2022121884A1_D26298.tif" /><img file="US2022121884A1_D26299.tif" /><img file="US2022121884A1_D26300.tif" /><img file="US2022121884A1_D26301.tif" /><img file="US2022121884A1_D26302.tif" /><img file="US2022121884A1_D26303.tif" /><img file="US2022121884A1_D26304.tif" /><img file="US2022121884A1_D26305.tif" /><img file="US2022121884A1_D26306.tif" /><img file="US2022121884A1_D26307.tif" /><img file="US2022121884A1_D26308.tif" /><img file="US2022121884A1_D26309.tif" /><img file="US2022121884A1_D26310.tif" /><img file="US2022121884A1_D26311.tif" /><img file="US2022121884A1_D26312.tif" /><img file="US2022121884A1_D26313.tif" /><img file="US2022121884A1_D26314.tif" /><img file="US2022121884A1_D26315.tif" /><img file="US2022121884A1_D26316.tif" /><img file="US2022121884A1_D26317.tif" /><img file="US2022121884A1_D26318.tif" /><img file="US2022121884A1_D26319.tif" /><img file="US2022121884A1_D26320.tif" /><img file="US2022121884A1_D26321.tif" /><img file="US2022121884A1_D26322.tif" /><img file="US2022121884A1_D26323.tif" /><img file="US2022121884A1_D26324.tif" /><img file="US2022121884A1_D26325.tif" /><img file="US2022121884A1_D26326.tif" /><img file="US2022121884A1_D26327.tif" /><img file="US2022121884A1_D26328.tif" /><img file="US2022121884A1_D26329.tif" /><img file="US2022121884A1_D26330.tif" /><img file="US2022121884A1_D26331.tif" /><img file="US2022121884A1_D26332.tif" /><img file="US2022121884A1_D26333.tif" /><img file="US2022121884A1_D26334.tif" /><img file="US2022121884A1_D26335.tif" /><img file="US2022121884A1_D26336.tif" />
where p<sub>m2±</sub> and p<sub>opt+</sub> are the projections of the margin m<sub>2 </sub>and m<sub>opt </sub>on ŵ<sub>∥</sub>. Consequently, S<sub>in-after </sub>⊂ S<sub>m</sub><sub><sub2>2</sub2></sub><sub>−m</sub><sub><sub2>opt</sub2></sub>, and therefore, a search for elements are S<sub>in-after </sub>becomes limited to a relatively small dataset S<sub>m</sub><sub><sub2>2</sub2></sub><sub>−m</sub><sub><sub2>opt</sub2></sub>. In evaluating (52), it is first checked whether a given point in S<sub>m</sub><sub><sub2>2</sub2></sub><sub>−m</sub><sub><sub2>opt </sub2></sub>has entered the tilted margin (e.g., via evaluating y<sub>i</sub>u<sub>i </sub>or using 47)). Similar check is made for determining S<sub>out-after </sub>using (47) where the updated u<sub>i </sub>indicates whether a point in S<sub>in-pri </sub>has moved out of margin (i.e., to S<sub>out-after</sub>).
To determine if objective function may be minimized by tilting w, (49), (50), and (51) are added for a given ∥Δw∥ to check if the total slack error (denoted as a functional Δξ<sub>⊥,k</sub>(∥Δw∥)) is reduced for a particular ŵ<sub>⊥,k</sub>. If so, Δw adopts a component from ŵ<sub>⊥,k </sub>in proportion to the corresponding error reduction:
<maths id="MATH-US-00141" num="00141"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><mi>Δ</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>w</mi></mrow><mo>=</mo><mrow><mi>η</mi><mo></mo><mrow><munder><mo>∑</mo><mrow><mo>∀</mo><msub><mover><mi>w</mi><mo>^</mo></mover><mrow><mo>⊥</mo><mrow><mo>,</mo><mi>k</mi></mrow></mrow></msub></mrow></munder><mo></mo><mrow><mrow><mo>(</mo><mrow><mo>-</mo><mrow><msub><mi>Δξ</mi><mrow><mo>⊥</mo><mrow><mo>,</mo><mi>k</mi></mrow></mrow></msub><mo></mo><mrow><mo>(</mo><mrow><mo></mo><mrow><mi>Δ</mi><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mi>w</mi></mrow><mo></mo></mrow><mo>)</mo></mrow></mrow></mrow><mo>)</mo></mrow><mo></mo><msub><mover><mi>w</mi><mo>^</mo></mover><mrow><mo>⊥</mo><mrow><mo>,</mo><mi>k</mi></mrow></mrow></msub></mrow></mrow></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mn>54</mn><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2022121884A1_D26337.tif" /><img file="US2022121884A1_D26338.tif" /><img file="US2022121884A1_D26339.tif" /><img file="US2022121884A1_D26340.tif" /><img file="US2022121884A1_D26341.tif" /><img file="US2022121884A1_D26342.tif" /><img file="US2022121884A1_D26343.tif" /><img file="US2022121884A1_D26344.tif" /><img file="US2022121884A1_D26345.tif" /><img file="US2022121884A1_D26346.tif" /><img file="US2022121884A1_D26347.tif" /><img file="US2022121884A1_D26348.tif" /><img file="US2022121884A1_D26349.tif" /><img file="US2022121884A1_D26350.tif" /><img file="US2022121884A1_D26351.tif" /><img file="US2022121884A1_D26352.tif" /><img file="US2022121884A1_D26353.tif" /><img file="US2022121884A1_D26354.tif" /><img file="US2022121884A1_D26355.tif" /><img file="US2022121884A1_D26356.tif" /><img file="US2022121884A1_D26357.tif" /><img file="US2022121884A1_D26358.tif" /><img file="US2022121884A1_D26359.tif" /><img file="US2022121884A1_D26360.tif" /><img file="US2022121884A1_D26361.tif" /><img file="US2022121884A1_D26362.tif" /><img file="US2022121884A1_D26363.tif" /><img file="US2022121884A1_D26364.tif" /><img file="US2022121884A1_D26365.tif" /><img file="US2022121884A1_D26366.tif" /><img file="US2022121884A1_D26367.tif" /><img file="US2022121884A1_D26368.tif" /><img file="US2022121884A1_D26369.tif" /><img file="US2022121884A1_D26370.tif" /><img file="US2022121884A1_D26371.tif" /><img file="US2022121884A1_D26372.tif" /><img file="US2022121884A1_D26373.tif" /><img file="US2022121884A1_D26374.tif" /><img file="US2022121884A1_D26375.tif" /><img file="US2022121884A1_D26376.tif" /><img file="US2022121884A1_D26377.tif" /><img file="US2022121884A1_D26378.tif" /><img file="US2022121884A1_D26379.tif" /><img file="US2022121884A1_D26380.tif" /><img file="US2022121884A1_D26381.tif" /><img file="US2022121884A1_D26382.tif" /><img file="US2022121884A1_D26383.tif" /><img file="US2022121884A1_D26384.tif" /><img file="US2022121884A1_D26385.tif" /><img file="US2022121884A1_D26386.tif" /><img file="US2022121884A1_D26387.tif" /><img file="US2022121884A1_D26388.tif" /><img file="US2022121884A1_D26389.tif" /><img file="US2022121884A1_D26390.tif" /><img file="US2022121884A1_D26391.tif" /><img file="US2022121884A1_D26392.tif" /><img file="US2022121884A1_D26393.tif" /><img file="US2022121884A1_D26394.tif" /><img file="US2022121884A1_D26395.tif" /><img file="US2022121884A1_D26396.tif" /><img file="US2022121884A1_D26397.tif" /><img file="US2022121884A1_D26398.tif" /><img file="US2022121884A1_D26399.tif" /><img file="US2022121884A1_D26400.tif" /><img file="US2022121884A1_D26401.tif" /><img file="US2022121884A1_D26402.tif" /><img file="US2022121884A1_D26403.tif" /><img file="US2022121884A1_D26404.tif" /><img file="US2022121884A1_D26405.tif" /><img file="US2022121884A1_D26406.tif" /><img file="US2022121884A1_D26407.tif" /><img file="US2022121884A1_D26408.tif" /><img file="US2022121884A1_D26409.tif" /><img file="US2022121884A1_D26410.tif" /><img file="US2022121884A1_D26411.tif" /><img file="US2022121884A1_D26412.tif" /><img file="US2022121884A1_D26413.tif" /><img file="US2022121884A1_D26414.tif" /><img file="US2022121884A1_D26415.tif" /><img file="US2022121884A1_D26416.tif" /><img file="US2022121884A1_D26417.tif" /><img file="US2022121884A1_D26418.tif" /><img file="US2022121884A1_D26419.tif" /><img file="US2022121884A1_D26420.tif" /><img file="US2022121884A1_D26421.tif" /><img file="US2022121884A1_D26422.tif" /><img file="US2022121884A1_D26423.tif" /><img file="US2022121884A1_D26424.tif" /><img file="US2022121884A1_D26425.tif" /><img file="US2022121884A1_D26426.tif" /><img file="US2022121884A1_D26427.tif" /><img file="US2022121884A1_D26428.tif" /><img file="US2022121884A1_D26429.tif" /><img file="US2022121884A1_D26430.tif" /><img file="US2022121884A1_D26431.tif" /><img file="US2022121884A1_D26432.tif" /><img file="US2022121884A1_D26433.tif" /><img file="US2022121884A1_D26434.tif" /><img file="US2022121884A1_D26435.tif" /><img file="US2022121884A1_D26436.tif" /><img file="US2022121884A1_D26437.tif" /><img file="US2022121884A1_D26438.tif" /><img file="US2022121884A1_D26439.tif" /><img file="US2022121884A1_D26440.tif" /><img file="US2022121884A1_D26441.tif" /><img file="US2022121884A1_D26442.tif" /><img file="US2022121884A1_D26443.tif" /><img file="US2022121884A1_D26444.tif" /><img file="US2022121884A1_D26445.tif" /><img file="US2022121884A1_D26446.tif" /><img file="US2022121884A1_D26447.tif" /><img file="US2022121884A1_D26448.tif" />
where η is a learning step parameter. In one approach, the contribution to Δw is made if (Δξ<sub>⊥,k</sub>(∥Δw∥), ≤−∈) where ∈ is a threshold parameter. In another approach, the contribution is made when (|Δξ<sub>⊥,k</sub>(∥Δw∥)|≥ ∈) , allowing for taking the step in an opposite direction that of increasing slack error.
The next step of iteration is performed by updating the candidate w according to (54), and it stops for example when the objective function (42) does not improve significantly or a maximum iteration count has reached.
1.4 Estimation of Lagrange Multipliers:
Based on the above preprocessing iterations, a set of candidate hyperplanes are generated for various values of C. According to KKT condition (28), α<sub>i</sub>'s are generated for bounded parameters (i.e., α<sub>i</sub>=0 or C). For any data point at margin, initialize α<sub>i </sub>to C/2, and/or use (31) to determine such α<sub>i</sub>'s based on the distribution of unbounded parameters across ŵ<sub>⊥,k</sub>.
One of the advantages of this approach is that quite immediately in its iterations, proper scale of C is readily determined.
2 Extension to Non-Linear SVM:
2.1 A Case of RBF (Gaussian) Kernel:
Equation (27) after kernel substitution for feature space becomes:
<maths id="MATH-US-00142" num="00142"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><msup><mi>ℒ</mi><mi>′</mi></msup><mo></mo><mrow><mo>(</mo><mi>α</mi><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mrow><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>1</mn></mrow><mi>N</mi></munderover><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><msub><mi>α</mi><mi>i</mi></msub></mrow><mo>-</mo><mrow><mfrac><mn>1</mn><mn>2</mn></mfrac><mo></mo><mrow><munderover><mo>∑</mo><mrow><mi>i</mi><mo>=</mo><mn>1</mn></mrow><mi>N</mi></munderover><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><munderover><mo>∑</mo><mrow><mi>j</mi><mo>=</mo><mn>1</mn></mrow><mi>N</mi></munderover><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><msub><mi>α</mi><mi>i</mi></msub><mo></mo><msub><mi>α</mi><mi>j</mi></msub><mo></mo><msub><mi>y</mi><mi>i</mi></msub><mo></mo><msub><mi>y</mi><mi>j</mi></msub><mo></mo><mrow><mi>𝒦</mi><mo></mo><mrow><mo>(</mo><mrow><msub><mi>x</mi><mi>i</mi></msub><mo>,</mo><msub><mi>x</mi><mi>j</mi></msub></mrow><mo>)</mo></mrow></mrow></mrow></mrow></mrow></mrow></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mn>55</mn><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2022121884A1_D26449.tif" /><img file="US2022121884A1_D26450.tif" /><img file="US2022121884A1_D26451.tif" /><img file="US2022121884A1_D26452.tif" /><img file="US2022121884A1_D26453.tif" /><img file="US2022121884A1_D26454.tif" /><img file="US2022121884A1_D26455.tif" /><img file="US2022121884A1_D26456.tif" /><img file="US2022121884A1_D26457.tif" /><img file="US2022121884A1_D26458.tif" /><img file="US2022121884A1_D26459.tif" /><img file="US2022121884A1_D26460.tif" /><img file="US2022121884A1_D26461.tif" /><img file="US2022121884A1_D26462.tif" /><img file="US2022121884A1_D26463.tif" /><img file="US2022121884A1_D26464.tif" /><img file="US2022121884A1_D26465.tif" /><img file="US2022121884A1_D26466.tif" /><img file="US2022121884A1_D26467.tif" /><img file="US2022121884A1_D26468.tif" /><img file="US2022121884A1_D26469.tif" /><img file="US2022121884A1_D26470.tif" /><img file="US2022121884A1_D26471.tif" /><img file="US2022121884A1_D26472.tif" /><img file="US2022121884A1_D26473.tif" /><img file="US2022121884A1_D26474.tif" /><img file="US2022121884A1_D26475.tif" /><img file="US2022121884A1_D26476.tif" /><img file="US2022121884A1_D26477.tif" /><img file="US2022121884A1_D26478.tif" /><img file="US2022121884A1_D26479.tif" /><img file="US2022121884A1_D26480.tif" /><img file="US2022121884A1_D26481.tif" /><img file="US2022121884A1_D26482.tif" /><img file="US2022121884A1_D26483.tif" /><img file="US2022121884A1_D26484.tif" /><img file="US2022121884A1_D26485.tif" /><img file="US2022121884A1_D26486.tif" /><img file="US2022121884A1_D26487.tif" /><img file="US2022121884A1_D26488.tif" /><img file="US2022121884A1_D26489.tif" /><img file="US2022121884A1_D26490.tif" /><img file="US2022121884A1_D26491.tif" /><img file="US2022121884A1_D26492.tif" /><img file="US2022121884A1_D26493.tif" /><img file="US2022121884A1_D26494.tif" /><img file="US2022121884A1_D26495.tif" /><img file="US2022121884A1_D26496.tif" /><img file="US2022121884A1_D26497.tif" /><img file="US2022121884A1_D26498.tif" /><img file="US2022121884A1_D26499.tif" /><img file="US2022121884A1_D26500.tif" /><img file="US2022121884A1_D26501.tif" /><img file="US2022121884A1_D26502.tif" /><img file="US2022121884A1_D26503.tif" /><img file="US2022121884A1_D26504.tif" /><img file="US2022121884A1_D26505.tif" /><img file="US2022121884A1_D26506.tif" /><img file="US2022121884A1_D26507.tif" /><img file="US2022121884A1_D26508.tif" /><img file="US2022121884A1_D26509.tif" /><img file="US2022121884A1_D26510.tif" /><img file="US2022121884A1_D26511.tif" /><img file="US2022121884A1_D26512.tif" /><img file="US2022121884A1_D26513.tif" /><img file="US2022121884A1_D26514.tif" /><img file="US2022121884A1_D26515.tif" /><img file="US2022121884A1_D26516.tif" /><img file="US2022121884A1_D26517.tif" /><img file="US2022121884A1_D26518.tif" /><img file="US2022121884A1_D26519.tif" /><img file="US2022121884A1_D26520.tif" /><img file="US2022121884A1_D26521.tif" /><img file="US2022121884A1_D26522.tif" /><img file="US2022121884A1_D26523.tif" /><img file="US2022121884A1_D26524.tif" /><img file="US2022121884A1_D26525.tif" /><img file="US2022121884A1_D26526.tif" /><img file="US2022121884A1_D26527.tif" /><img file="US2022121884A1_D26528.tif" /><img file="US2022121884A1_D26529.tif" /><img file="US2022121884A1_D26530.tif" /><img file="US2022121884A1_D26531.tif" /><img file="US2022121884A1_D26532.tif" /><img file="US2022121884A1_D26533.tif" /><img file="US2022121884A1_D26534.tif" /><img file="US2022121884A1_D26535.tif" /><img file="US2022121884A1_D26536.tif" /><img file="US2022121884A1_D26537.tif" /><img file="US2022121884A1_D26538.tif" /><img file="US2022121884A1_D26539.tif" /><img file="US2022121884A1_D26540.tif" /><img file="US2022121884A1_D26541.tif" /><img file="US2022121884A1_D26542.tif" /><img file="US2022121884A1_D26543.tif" /><img file="US2022121884A1_D26544.tif" /><img file="US2022121884A1_D26545.tif" /><img file="US2022121884A1_D26546.tif" /><img file="US2022121884A1_D26547.tif" /><img file="US2022121884A1_D26548.tif" /><img file="US2022121884A1_D26549.tif" /><img file="US2022121884A1_D26550.tif" /><img file="US2022121884A1_D26551.tif" /><img file="US2022121884A1_D26552.tif" /><img file="US2022121884A1_D26553.tif" /><img file="US2022121884A1_D26554.tif" /><img file="US2022121884A1_D26555.tif" /><img file="US2022121884A1_D26556.tif" /><img file="US2022121884A1_D26557.tif" /><img file="US2022121884A1_D26558.tif" /><img file="US2022121884A1_D26559.tif" /><img file="US2022121884A1_D26560.tif" />
In the following approach, instead of attempting to break the problem of (N×N) quadratic form in 27), we make an assumption that in a relatively low dimensional space scenario, there are significantly more points in the margin than those exactly at the margin, and we attempt to find an approximate solution in the non-linear space via a low dimensional decomposition.
To have low number of support vectors with RBF (Gaussian) kernel, the data points need to be well represented or covered in <img file="US2022121884A1_D26561.tif" /><sup>d </sup>via several kernels centered around few central points to be uniquely identifiable, e.g., through triangulation. This requirement helps to ensure that in the feature space the dimensions represented by the central points provide dimensional coverage for other data points in the dataset. Therefore, in <img file="US2022121884A1_D26562.tif" /><sup>d</sup>, we assign at least d+1 such centers to basically allow for triangulation. However, the requirement calls for coverage as well, so that a given point in the dataset would have non-trivial kernel values with respect to at least d+1 central points. RBF (proximity) kernel in input space is between (0, 1], with the coverage dependent on the bandwidth parameter a as shown in (56):
<maths id="MATH-US-00143" num="00143"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><mrow><mi>𝒦</mi><mo></mo><mrow><mo>(</mo><mrow><msub><mi>x</mi><mi>i</mi></msub><mo>,</mo><msub><mi>x</mi><mi>j</mi></msub></mrow><mo>)</mo></mrow></mrow><mo>=</mo><mrow><mi>exp</mi><mo></mo><mrow><mo>(</mo><mrow><mrow><mo>-</mo><mi>γ</mi></mrow><mo></mo><msup><mrow><mo></mo><mrow><msub><mi>x</mi><mi>i</mi></msub><mo>-</mo><msub><mi>x</mi><mi>j</mi></msub></mrow><mo></mo></mrow><mn>2</mn></msup></mrow><mo>)</mo></mrow></mrow></mrow><mo>,</mo><mrow><mi>γ</mi><mo>=</mo><mfrac><mn>1</mn><mrow><mn>2</mn><mo></mo><msup><mi>σ</mi><mn>2</mn></msup></mrow></mfrac></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mn>56</mn><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2022121884A1_D26563.tif" /><img file="US2022121884A1_D26564.tif" /><img file="US2022121884A1_D26565.tif" /><img file="US2022121884A1_D26566.tif" /><img file="US2022121884A1_D26567.tif" /><img file="US2022121884A1_D26568.tif" /><img file="US2022121884A1_D26569.tif" /><img file="US2022121884A1_D26570.tif" /><img file="US2022121884A1_D26571.tif" /><img file="US2022121884A1_D26572.tif" /><img file="US2022121884A1_D26573.tif" /><img file="US2022121884A1_D26574.tif" /><img file="US2022121884A1_D26575.tif" /><img file="US2022121884A1_D26576.tif" /><img file="US2022121884A1_D26577.tif" /><img file="US2022121884A1_D26578.tif" /><img file="US2022121884A1_D26579.tif" /><img file="US2022121884A1_D26580.tif" /><img file="US2022121884A1_D26581.tif" /><img file="US2022121884A1_D26582.tif" /><img file="US2022121884A1_D26583.tif" /><img file="US2022121884A1_D26584.tif" /><img file="US2022121884A1_D26585.tif" /><img file="US2022121884A1_D26586.tif" /><img file="US2022121884A1_D26587.tif" /><img file="US2022121884A1_D26588.tif" /><img file="US2022121884A1_D26589.tif" /><img file="US2022121884A1_D26590.tif" /><img file="US2022121884A1_D26591.tif" /><img file="US2022121884A1_D26592.tif" /><img file="US2022121884A1_D26593.tif" /><img file="US2022121884A1_D26594.tif" /><img file="US2022121884A1_D26595.tif" /><img file="US2022121884A1_D26596.tif" /><img file="US2022121884A1_D26597.tif" /><img file="US2022121884A1_D26598.tif" /><img file="US2022121884A1_D26599.tif" /><img file="US2022121884A1_D26600.tif" /><img file="US2022121884A1_D26601.tif" /><img file="US2022121884A1_D26602.tif" /><img file="US2022121884A1_D26603.tif" /><img file="US2022121884A1_D26604.tif" /><img file="US2022121884A1_D26605.tif" /><img file="US2022121884A1_D26606.tif" /><img file="US2022121884A1_D26607.tif" /><img file="US2022121884A1_D26608.tif" /><img file="US2022121884A1_D26609.tif" /><img file="US2022121884A1_D26610.tif" /><img file="US2022121884A1_D26611.tif" /><img file="US2022121884A1_D26612.tif" /><img file="US2022121884A1_D26613.tif" /><img file="US2022121884A1_D26614.tif" /><img file="US2022121884A1_D26615.tif" /><img file="US2022121884A1_D26616.tif" /><img file="US2022121884A1_D26617.tif" /><img file="US2022121884A1_D26618.tif" /><img file="US2022121884A1_D26619.tif" /><img file="US2022121884A1_D26620.tif" /><img file="US2022121884A1_D26621.tif" /><img file="US2022121884A1_D26622.tif" /><img file="US2022121884A1_D26623.tif" /><img file="US2022121884A1_D26624.tif" /><img file="US2022121884A1_D26625.tif" /><img file="US2022121884A1_D26626.tif" /><img file="US2022121884A1_D26627.tif" /><img file="US2022121884A1_D26628.tif" /><img file="US2022121884A1_D26629.tif" /><img file="US2022121884A1_D26630.tif" /><img file="US2022121884A1_D26631.tif" /><img file="US2022121884A1_D26632.tif" /><img file="US2022121884A1_D26633.tif" /><img file="US2022121884A1_D26634.tif" /><img file="US2022121884A1_D26635.tif" /><img file="US2022121884A1_D26636.tif" /><img file="US2022121884A1_D26637.tif" /><img file="US2022121884A1_D26638.tif" /><img file="US2022121884A1_D26639.tif" /><img file="US2022121884A1_D26640.tif" /><img file="US2022121884A1_D26641.tif" /><img file="US2022121884A1_D26642.tif" /><img file="US2022121884A1_D26643.tif" /><img file="US2022121884A1_D26644.tif" /><img file="US2022121884A1_D26645.tif" /><img file="US2022121884A1_D26646.tif" /><img file="US2022121884A1_D26647.tif" /><img file="US2022121884A1_D26648.tif" /><img file="US2022121884A1_D26649.tif" /><img file="US2022121884A1_D26650.tif" /><img file="US2022121884A1_D26651.tif" /><img file="US2022121884A1_D26652.tif" /><img file="US2022121884A1_D26653.tif" /><img file="US2022121884A1_D26654.tif" /><img file="US2022121884A1_D26655.tif" /><img file="US2022121884A1_D26656.tif" /><img file="US2022121884A1_D26657.tif" /><img file="US2022121884A1_D26658.tif" /><img file="US2022121884A1_D26659.tif" /><img file="US2022121884A1_D26660.tif" /><img file="US2022121884A1_D26661.tif" /><img file="US2022121884A1_D26662.tif" /><img file="US2022121884A1_D26663.tif" /><img file="US2022121884A1_D26664.tif" /><img file="US2022121884A1_D26665.tif" /><img file="US2022121884A1_D26666.tif" /><img file="US2022121884A1_D26667.tif" /><img file="US2022121884A1_D26668.tif" /><img file="US2022121884A1_D26669.tif" /><img file="US2022121884A1_D26670.tif" /><img file="US2022121884A1_D26671.tif" /><img file="US2022121884A1_D26672.tif" /><img file="US2022121884A1_D26673.tif" /><img file="US2022121884A1_D26674.tif" />
Therefore, the coverage of each central point extends to at most several σ's. Too small a σ creates islands out of each input dataset, resulting in high dimensionality, high number of SVs, and relatively high out of sample error. In other words, the learning process memorizes the training data instead of learning the overall pattern for small σ. On the other hand, too large a σ, it will have difficulty negotiating stronger curves than the shape of the kernel allows.
Let there be ι such centers in <img file="US2022121884A1_D26675.tif" /><sup>d </sup>covering the input dataset, denoted as G<sub>j </sub>with j=1 to ι. Because of coverage of every x<sub>i</sub>, the set of <img file="US2022121884A1_D26676.tif" />(x<sub>i</sub>, G<sub>i</sub>)'s representing proximity to the centers triangulate x<sub>i </sub>with sufficient accuracy. Therefore, in the transform space Z there are at least d+1 non-trivial dot products between z<sub>i </sub>and H<sub>j </sub>(i.e., the respective transformed counterparts of x<sub>i </sub>and G<sub>j</sub>) to provide dimensionality coverage:
<br /><img file="US2022121884A1_D26677.tif" />(<i>x</i><sub>i</sub><i>, G</i><sub>j</sub>)=<i>z</i><sub>i</sub><i>·H</i><sub>j </sub> (57)
Because of triangulation, H<sub>j </sub>define ι dimensional space in feature space capable of supporting similar number of SVs. Note that given neighboring G<sub>j </sub>are within coverage of their closest centers as well (with non-trivial cross kernel), the set of H<sub>j</sub>'s do not quite form an orthogonal basis in Z. However, with modifications in Zdomain, an orthonormal set of feature vectors {circumflex over (υ)}<sub>j </sub>may be constructed based on H<sub>j</sub>. The first {circumflex over (υ)}<sub>1 </sub>is taken in the same direction as H<sub>1</sub>, and the rest are determined, for example, by iterative subtraction process, so that {circumflex over (υ)}<sub>j </sub>retain basic characteristics of the corresponding H<sub>j </sub>as much as possible:
<maths id="MATH-US-00144" num="00144"><math overflow="scroll"><mtable><mtr><mtd><mrow><msub><mover><mi>v</mi><mo>^</mo></mover><mn>1</mn></msub><mo>=</mo><mrow><mfrac><msub><mi>H</mi><mn>1</mn></msub><mrow><mo></mo><msub><mi>H</mi><mn>1</mn></msub><mo></mo></mrow></mfrac><mo>=</mo><mrow><mrow><mfrac><msub><mi>H</mi><mn>1</mn></msub><msqrt><mrow><mi>𝒦</mi><mo></mo><mrow><mo>(</mo><mrow><msub><mi>G</mi><mn>1</mn></msub><mo>,</mo><msub><mi>G</mi><mn>1</mn></msub></mrow><mo>)</mo></mrow></mrow></msqrt></mfrac><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>or</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><msub><mi>H</mi><mn>1</mn></msub></mrow><mo>=</mo><mrow><mrow><mo>(</mo><mrow><msub><mi>H</mi><mn>1</mn></msub><mo>·</mo><msub><mover><mi>v</mi><mo>^</mo></mover><mn>1</mn></msub></mrow><mo>)</mo></mrow><mo></mo><msub><mover><mi>v</mi><mo>^</mo></mover><mn>1</mn></msub></mrow></mrow></mrow></mrow></mtd><mtd><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mtd></mtr><mtr><mtd><mrow><mrow><msub><mover><mi>v</mi><mo>^</mo></mover><mn>2</mn></msub><mo>=</mo><mfrac><msub><mi>V</mi><mn>2</mn></msub><mrow><mo></mo><msub><mi>V</mi><mn>2</mn></msub><mo></mo></mrow></mfrac></mrow><mo>,</mo><mrow><mrow><mi>where</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><msub><mi>V</mi><mn>2</mn></msub></mrow><mo>=</mo><mrow><msub><mi>H</mi><mn>2</mn></msub><mo>-</mo><mrow><mrow><mo>(</mo><mrow><msub><mi>H</mi><mn>2</mn></msub><mo>·</mo><msub><mover><mi>v</mi><mo>^</mo></mover><mn>1</mn></msub></mrow><mo>)</mo></mrow><mo></mo><msub><mover><mi>v</mi><mo>^</mo></mover><mn>1</mn></msub></mrow></mrow></mrow></mrow></mtd><mtd><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mtd></mtr><mtr><mtd><mrow><mrow><msub><mover><mi>v</mi><mo>^</mo></mover><mn>3</mn></msub><mo>=</mo><mfrac><msub><mi>V</mi><mn>3</mn></msub><mrow><mo></mo><msub><mi>V</mi><mn>3</mn></msub><mo></mo></mrow></mfrac></mrow><mo>,</mo><mrow><mrow><mi>where</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><msub><mi>V</mi><mn>3</mn></msub></mrow><mo>=</mo><mrow><msub><mi>H</mi><mn>3</mn></msub><mo>-</mo><mrow><mrow><mo>(</mo><mrow><msub><mi>H</mi><mn>3</mn></msub><mo>·</mo><msub><mover><mi>v</mi><mo>^</mo></mover><mn>2</mn></msub></mrow><mo>)</mo></mrow><mo></mo><msub><mover><mi>v</mi><mo>^</mo></mover><mn>2</mn></msub></mrow><mo>-</mo><mrow><mrow><mo>(</mo><mrow><msub><mi>H</mi><mn>3</mn></msub><mo>·</mo><msub><mover><mi>v</mi><mo>^</mo></mover><mn>1</mn></msub></mrow><mo>)</mo></mrow><mo></mo><msub><mover><mi>v</mi><mo>^</mo></mover><mn>1</mn></msub></mrow></mrow></mrow></mrow></mtd><mtd><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mtd></mtr><mtr><mtd><mrow><mrow><mo>.</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo>.</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo>.</mo></mrow><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mrow></mtd><mtd><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mtd></mtr><mtr><mtd><mrow><mrow><msub><mover><mi>v</mi><mo>^</mo></mover><mi>j</mi></msub><mo>=</mo><mfrac><msub><mi>V</mi><mi>j</mi></msub><mrow><mo></mo><msub><mi>V</mi><mi>j</mi></msub><mo></mo></mrow></mfrac></mrow><mo>,</mo><mrow><mrow><mi>where</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><msub><mi>V</mi><mi>j</mi></msub></mrow><mo>=</mo><mrow><msub><mi>H</mi><mi>j</mi></msub><mo>-</mo><mrow><munderover><mo>∑</mo><mrow><msup><mi>j</mi><mi>′</mi></msup><mo>=</mo><mn>1</mn></mrow><mrow><mi>j</mi><mo>-</mo><mn>1</mn></mrow></munderover><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><mrow><mo>(</mo><mrow><msub><mi>H</mi><mi>j</mi></msub><mo>·</mo><msub><mover><mi>v</mi><mo>^</mo></mover><msup><mi>j</mi><mi>′</mi></msup></msub></mrow><mo>)</mo></mrow><mo></mo><msub><mover><mi>v</mi><mo>^</mo></mover><msup><mi>j</mi><mi>′</mi></msup></msub></mrow></mrow></mrow></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mn>58</mn><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2022121884A1_D26678.tif" /><img file="US2022121884A1_D26679.tif" /><img file="US2022121884A1_D26680.tif" /><img file="US2022121884A1_D26681.tif" /><img file="US2022121884A1_D26682.tif" /><img file="US2022121884A1_D26683.tif" /><img file="US2022121884A1_D26684.tif" /><img file="US2022121884A1_D26685.tif" /><img file="US2022121884A1_D26686.tif" /><img file="US2022121884A1_D26687.tif" /><img file="US2022121884A1_D26688.tif" /><img file="US2022121884A1_D26689.tif" /><img file="US2022121884A1_D26690.tif" /><img file="US2022121884A1_D26691.tif" /><img file="US2022121884A1_D26692.tif" /><img file="US2022121884A1_D26693.tif" /><img file="US2022121884A1_D26694.tif" /><img file="US2022121884A1_D26695.tif" /><img file="US2022121884A1_D26696.tif" /><img file="US2022121884A1_D26697.tif" /><img file="US2022121884A1_D26698.tif" /><img file="US2022121884A1_D26699.tif" /><img file="US2022121884A1_D26700.tif" /><img file="US2022121884A1_D26701.tif" /><img file="US2022121884A1_D26702.tif" /><img file="US2022121884A1_D26703.tif" /><img file="US2022121884A1_D26704.tif" /><img file="US2022121884A1_D26705.tif" /><img file="US2022121884A1_D26706.tif" /><img file="US2022121884A1_D26707.tif" /><img file="US2022121884A1_D26708.tif" /><img file="US2022121884A1_D26709.tif" /><img file="US2022121884A1_D26710.tif" /><img file="US2022121884A1_D26711.tif" /><img file="US2022121884A1_D26712.tif" /><img file="US2022121884A1_D26713.tif" /><img file="US2022121884A1_D26714.tif" /><img file="US2022121884A1_D26715.tif" /><img file="US2022121884A1_D26716.tif" /><img file="US2022121884A1_D26717.tif" /><img file="US2022121884A1_D26718.tif" /><img file="US2022121884A1_D26719.tif" /><img file="US2022121884A1_D26720.tif" /><img file="US2022121884A1_D26721.tif" /><img file="US2022121884A1_D26722.tif" /><img file="US2022121884A1_D26723.tif" /><img file="US2022121884A1_D26724.tif" /><img file="US2022121884A1_D26725.tif" /><img file="US2022121884A1_D26726.tif" /><img file="US2022121884A1_D26727.tif" /><img file="US2022121884A1_D26728.tif" /><img file="US2022121884A1_D26729.tif" /><img file="US2022121884A1_D26730.tif" /><img file="US2022121884A1_D26731.tif" /><img file="US2022121884A1_D26732.tif" /><img file="US2022121884A1_D26733.tif" /><img file="US2022121884A1_D26734.tif" /><img file="US2022121884A1_D26735.tif" /><img file="US2022121884A1_D26736.tif" /><img file="US2022121884A1_D26737.tif" /><img file="US2022121884A1_D26738.tif" /><img file="US2022121884A1_D26739.tif" /><img file="US2022121884A1_D26740.tif" /><img file="US2022121884A1_D26741.tif" /><img file="US2022121884A1_D26742.tif" /><img file="US2022121884A1_D26743.tif" /><img file="US2022121884A1_D26744.tif" /><img file="US2022121884A1_D26745.tif" /><img file="US2022121884A1_D26746.tif" /><img file="US2022121884A1_D26747.tif" /><img file="US2022121884A1_D26748.tif" /><img file="US2022121884A1_D26749.tif" /><img file="US2022121884A1_D26750.tif" /><img file="US2022121884A1_D26751.tif" /><img file="US2022121884A1_D26752.tif" /><img file="US2022121884A1_D26753.tif" /><img file="US2022121884A1_D26754.tif" /><img file="US2022121884A1_D26755.tif" /><img file="US2022121884A1_D26756.tif" /><img file="US2022121884A1_D26757.tif" /><img file="US2022121884A1_D26758.tif" /><img file="US2022121884A1_D26759.tif" /><img file="US2022121884A1_D26760.tif" /><img file="US2022121884A1_D26761.tif" /><img file="US2022121884A1_D26762.tif" /><img file="US2022121884A1_D26763.tif" /><img file="US2022121884A1_D26764.tif" /><img file="US2022121884A1_D26765.tif" /><img file="US2022121884A1_D26766.tif" /><img file="US2022121884A1_D26767.tif" /><img file="US2022121884A1_D26768.tif" /><img file="US2022121884A1_D26769.tif" /><img file="US2022121884A1_D26770.tif" /><img file="US2022121884A1_D26771.tif" /><img file="US2022121884A1_D26772.tif" /><img file="US2022121884A1_D26773.tif" /><img file="US2022121884A1_D26774.tif" /><img file="US2022121884A1_D26775.tif" /><img file="US2022121884A1_D26776.tif" /><img file="US2022121884A1_D26777.tif" /><img file="US2022121884A1_D26778.tif" /><img file="US2022121884A1_D26779.tif" /><img file="US2022121884A1_D26780.tif" /><img file="US2022121884A1_D26781.tif" /><img file="US2022121884A1_D26782.tif" /><img file="US2022121884A1_D26783.tif" /><img file="US2022121884A1_D26784.tif" /><img file="US2022121884A1_D26785.tif" /><img file="US2022121884A1_D26786.tif" /><img file="US2022121884A1_D26787.tif" /><img file="US2022121884A1_D26788.tif" /><img file="US2022121884A1_D26789.tif" />
Note that as ∥V<sub>j</sub>∥ as √{square root over (V<sub>j</sub>·V<sub>j</sub>)} may be expressed via dot products of H<sub>1 </sub>through H<sub>j</sub>, and therefore, accessible in terms of cross kernels of G<sub>j</sub>'s: <img file="US2022121884A1_D26790.tif" />(G<sub>j1</sub>, G<sub>j1</sub>,).
All transformed data points z<sub>i</sub>'s (including H<sub>j</sub>'s) as well as hyperplane related vectors (e.g., ŵ<sub>∥</sub> and ŵ<sub>⊥,k</sub>) may be expressed based on the orthonormal set of {circumflex over (υ)}<sub>j</sub>'s. For example:
<maths id="MATH-US-00145" num="00145"><math overflow="scroll"><mtable><mtr><mtd><mrow><mstyle><mspace width="4.4em" height="4.4ex" /></mstyle><mo></mo><mrow><msub><mi>H</mi><mn>1</mn></msub><mo>=</mo><mrow><msqrt><mrow><mi>𝒦</mi><mo></mo><mrow><mo>(</mo><mrow><msub><mi>G</mi><mn>1</mn></msub><mo>,</mo><msub><mi>G</mi><mn>1</mn></msub></mrow><mo>)</mo></mrow></mrow></msqrt><mo></mo><msub><mover><mi>v</mi><mo>^</mo></mover><mn>1</mn></msub></mrow></mrow></mrow></mtd><mtd><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mtd></mtr><mtr><mtd><mrow><mstyle><mspace width="4.4em" height="4.4ex" /></mstyle><mo></mo><mrow><msub><mi>H</mi><mn>2</mn></msub><mo>=</mo><mrow><mrow><mrow><mo></mo><msub><mi>V</mi><mn>2</mn></msub><mo></mo></mrow><mo></mo><msub><mover><mi>v</mi><mo>^</mo></mover><mn>2</mn></msub></mrow><mo>+</mo><mrow><mrow><mo>(</mo><mrow><msub><mi>H</mi><mn>2</mn></msub><mo>·</mo><msub><mover><mi>v</mi><mo>^</mo></mover><mn>1</mn></msub></mrow><mo>)</mo></mrow><mo></mo><msub><mover><mi>v</mi><mo>^</mo></mover><mn>1</mn></msub></mrow></mrow></mrow></mrow></mtd><mtd><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mtd></mtr><mtr><mtd><mrow><mstyle><mspace width="4.4em" height="4.4ex" /></mstyle><mo></mo><mrow><msub><mi>H</mi><mn>3</mn></msub><mo>=</mo><mrow><mrow><mrow><mo></mo><msub><mi>V</mi><mn>3</mn></msub><mo></mo></mrow><mo></mo><msub><mover><mi>v</mi><mo>^</mo></mover><mn>3</mn></msub></mrow><mo>+</mo><mrow><mrow><mo>(</mo><mrow><msub><mi>H</mi><mn>3</mn></msub><mo>·</mo><msub><mover><mi>v</mi><mo>^</mo></mover><mn>2</mn></msub></mrow><mo>)</mo></mrow><mo></mo><msub><mover><mi>v</mi><mo>^</mo></mover><mn>2</mn></msub></mrow><mo>+</mo><mrow><mrow><mo>(</mo><mrow><msub><mi>H</mi><mn>3</mn></msub><mo>·</mo><msub><mover><mi>v</mi><mo>^</mo></mover><mn>1</mn></msub></mrow><mo>)</mo></mrow><mo></mo><msub><mover><mi>v</mi><mo>^</mo></mover><mn>1</mn></msub></mrow></mrow></mrow></mrow></mtd><mtd><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mtd></mtr><mtr><mtd><mrow><mstyle><mspace width="4.4em" height="4.4ex" /></mstyle><mo></mo><mrow><mo>.</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo>.</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo>.</mo></mrow><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mrow></mtd><mtd><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mtd></mtr><mtr><mtd><mrow><mrow><msub><mi>H</mi><mi>j</mi></msub><mo>=</mo><mrow><mrow><mrow><mrow><mo></mo><msub><mi>V</mi><mi>j</mi></msub><mo></mo></mrow><mo></mo><msub><mover><mi>v</mi><mo>^</mo></mover><mi>j</mi></msub></mrow><mo>+</mo><mrow><munderover><mo>∑</mo><mrow><msup><mi>j</mi><mi>′</mi></msup><mo>=</mo><mn>1</mn></mrow><mrow><mi>j</mi><mo>-</mo><mn>1</mn></mrow></munderover><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><mrow><mo>(</mo><mrow><msub><mi>H</mi><mi>j</mi></msub><mo>·</mo><msub><mover><mi>v</mi><mo>^</mo></mover><msup><mi>j</mi><mi>′</mi></msup></msub></mrow><mo>)</mo></mrow><mo></mo><msub><mover><mi>v</mi><mo>^</mo></mover><msup><mi>j</mi><mi>′</mi></msup></msub></mrow></mrow></mrow><mo>=</mo><mrow><munderover><mo>∑</mo><mrow><msup><mi>j</mi><mi>′</mi></msup><mo>=</mo><mn>1</mn></mrow><mi>j</mi></munderover><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><msub><mi>h</mi><mrow><mi>j</mi><mo>,</mo><msup><mi>j</mi><mi>′</mi></msup></mrow></msub><mo></mo><msub><mover><mi>v</mi><mo>^</mo></mover><msup><mi>j</mi><mi>′</mi></msup></msub></mrow></mrow></mrow></mrow><mo>,</mo><mrow><mrow><mi>where</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><msub><mi>h</mi><mrow><mi>j</mi><mo>,</mo><msup><mi>j</mi><mi>′</mi></msup></mrow></msub></mrow><mo>=</mo><mrow><mrow><mn>0</mn><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><mi>for</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><msup><mi>j</mi><mi>′</mi></msup></mrow><mo>></mo><mi>j</mi></mrow></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mn>59</mn><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2022121884A1_D26791.tif" /><img file="US2022121884A1_D26792.tif" /><img file="US2022121884A1_D26793.tif" /><img file="US2022121884A1_D26794.tif" /><img file="US2022121884A1_D26795.tif" /><img file="US2022121884A1_D26796.tif" /><img file="US2022121884A1_D26797.tif" /><img file="US2022121884A1_D26798.tif" /><img file="US2022121884A1_D26799.tif" /><img file="US2022121884A1_D26800.tif" /><img file="US2022121884A1_D26801.tif" /><img file="US2022121884A1_D26802.tif" /><img file="US2022121884A1_D26803.tif" /><img file="US2022121884A1_D26804.tif" /><img file="US2022121884A1_D26805.tif" /><img file="US2022121884A1_D26806.tif" /><img file="US2022121884A1_D26807.tif" /><img file="US2022121884A1_D26808.tif" /><img file="US2022121884A1_D26809.tif" /><img file="US2022121884A1_D26810.tif" /><img file="US2022121884A1_D26811.tif" /><img file="US2022121884A1_D26812.tif" /><img file="US2022121884A1_D26813.tif" /><img file="US2022121884A1_D26814.tif" /><img file="US2022121884A1_D26815.tif" /><img file="US2022121884A1_D26816.tif" /><img file="US2022121884A1_D26817.tif" /><img file="US2022121884A1_D26818.tif" /><img file="US2022121884A1_D26819.tif" /><img file="US2022121884A1_D26820.tif" /><img file="US2022121884A1_D26821.tif" /><img file="US2022121884A1_D26822.tif" /><img file="US2022121884A1_D26823.tif" /><img file="US2022121884A1_D26824.tif" /><img file="US2022121884A1_D26825.tif" /><img file="US2022121884A1_D26826.tif" /><img file="US2022121884A1_D26827.tif" /><img file="US2022121884A1_D26828.tif" /><img file="US2022121884A1_D26829.tif" /><img file="US2022121884A1_D26830.tif" /><img file="US2022121884A1_D26831.tif" /><img file="US2022121884A1_D26832.tif" /><img file="US2022121884A1_D26833.tif" /><img file="US2022121884A1_D26834.tif" /><img file="US2022121884A1_D26835.tif" /><img file="US2022121884A1_D26836.tif" /><img file="US2022121884A1_D26837.tif" /><img file="US2022121884A1_D26838.tif" /><img file="US2022121884A1_D26839.tif" /><img file="US2022121884A1_D26840.tif" /><img file="US2022121884A1_D26841.tif" /><img file="US2022121884A1_D26842.tif" /><img file="US2022121884A1_D26843.tif" /><img file="US2022121884A1_D26844.tif" /><img file="US2022121884A1_D26845.tif" /><img file="US2022121884A1_D26846.tif" /><img file="US2022121884A1_D26847.tif" /><img file="US2022121884A1_D26848.tif" /><img file="US2022121884A1_D26849.tif" /><img file="US2022121884A1_D26850.tif" /><img file="US2022121884A1_D26851.tif" /><img file="US2022121884A1_D26852.tif" /><img file="US2022121884A1_D26853.tif" /><img file="US2022121884A1_D26854.tif" /><img file="US2022121884A1_D26855.tif" /><img file="US2022121884A1_D26856.tif" /><img file="US2022121884A1_D26857.tif" /><img file="US2022121884A1_D26858.tif" /><img file="US2022121884A1_D26859.tif" /><img file="US2022121884A1_D26860.tif" /><img file="US2022121884A1_D26861.tif" /><img file="US2022121884A1_D26862.tif" /><img file="US2022121884A1_D26863.tif" /><img file="US2022121884A1_D26864.tif" /><img file="US2022121884A1_D26865.tif" /><img file="US2022121884A1_D26866.tif" /><img file="US2022121884A1_D26867.tif" /><img file="US2022121884A1_D26868.tif" /><img file="US2022121884A1_D26869.tif" /><img file="US2022121884A1_D26870.tif" /><img file="US2022121884A1_D26871.tif" /><img file="US2022121884A1_D26872.tif" /><img file="US2022121884A1_D26873.tif" /><img file="US2022121884A1_D26874.tif" /><img file="US2022121884A1_D26875.tif" /><img file="US2022121884A1_D26876.tif" /><img file="US2022121884A1_D26877.tif" /><img file="US2022121884A1_D26878.tif" /><img file="US2022121884A1_D26879.tif" /><img file="US2022121884A1_D26880.tif" /><img file="US2022121884A1_D26881.tif" /><img file="US2022121884A1_D26882.tif" /><img file="US2022121884A1_D26883.tif" /><img file="US2022121884A1_D26884.tif" /><img file="US2022121884A1_D26885.tif" /><img file="US2022121884A1_D26886.tif" /><img file="US2022121884A1_D26887.tif" /><img file="US2022121884A1_D26888.tif" /><img file="US2022121884A1_D26889.tif" /><img file="US2022121884A1_D26890.tif" /><img file="US2022121884A1_D26891.tif" /><img file="US2022121884A1_D26892.tif" /><img file="US2022121884A1_D26893.tif" /><img file="US2022121884A1_D26894.tif" /><img file="US2022121884A1_D26895.tif" /><img file="US2022121884A1_D26896.tif" /><img file="US2022121884A1_D26897.tif" /><img file="US2022121884A1_D26898.tif" /><img file="US2022121884A1_D26899.tif" /><img file="US2022121884A1_D26900.tif" /><img file="US2022121884A1_D26901.tif" /><img file="US2022121884A1_D26902.tif" />
where h<sub>j,j</sub>,'s are expressed via cross kernel of G<sub>j</sub>'s. Similarly, for a z<sub>i</sub>:
<maths id="MATH-US-00146" num="00146"><math overflow="scroll"><mtable><mtr><mtd><mrow><msub><mi>z</mi><mi>i</mi></msub><mo>=</mo><mrow><munderover><mo>∑</mo><mrow><mi>j</mi><mo>=</mo><mn>1</mn></mrow><mi>l</mi></munderover><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo></mo><mrow><msub><mi>z</mi><mrow><mi>i</mi><mo>,</mo><mi>j</mi></mrow></msub><mo></mo><msub><mover><mi>v</mi><mo>^</mo></mover><mi>j</mi></msub></mrow></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mn>60</mn><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2022121884A1_D26903.tif" /><img file="US2022121884A1_D26904.tif" /><img file="US2022121884A1_D26905.tif" /><img file="US2022121884A1_D26906.tif" /><img file="US2022121884A1_D26907.tif" /><img file="US2022121884A1_D26908.tif" /><img file="US2022121884A1_D26909.tif" /><img file="US2022121884A1_D26910.tif" /><img file="US2022121884A1_D26911.tif" /><img file="US2022121884A1_D26912.tif" /><img file="US2022121884A1_D26913.tif" /><img file="US2022121884A1_D26914.tif" /><img file="US2022121884A1_D26915.tif" /><img file="US2022121884A1_D26916.tif" /><img file="US2022121884A1_D26917.tif" /><img file="US2022121884A1_D26918.tif" /><img file="US2022121884A1_D26919.tif" /><img file="US2022121884A1_D26920.tif" /><img file="US2022121884A1_D26921.tif" /><img file="US2022121884A1_D26922.tif" /><img file="US2022121884A1_D26923.tif" /><img file="US2022121884A1_D26924.tif" /><img file="US2022121884A1_D26925.tif" /><img file="US2022121884A1_D26926.tif" /><img file="US2022121884A1_D26927.tif" /><img file="US2022121884A1_D26928.tif" /><img file="US2022121884A1_D26929.tif" /><img file="US2022121884A1_D26930.tif" /><img file="US2022121884A1_D26931.tif" /><img file="US2022121884A1_D26932.tif" /><img file="US2022121884A1_D26933.tif" /><img file="US2022121884A1_D26934.tif" /><img file="US2022121884A1_D26935.tif" /><img file="US2022121884A1_D26936.tif" /><img file="US2022121884A1_D26937.tif" /><img file="US2022121884A1_D26938.tif" /><img file="US2022121884A1_D26939.tif" /><img file="US2022121884A1_D26940.tif" /><img file="US2022121884A1_D26941.tif" /><img file="US2022121884A1_D26942.tif" /><img file="US2022121884A1_D26943.tif" /><img file="US2022121884A1_D26944.tif" /><img file="US2022121884A1_D26945.tif" /><img file="US2022121884A1_D26946.tif" /><img file="US2022121884A1_D26947.tif" /><img file="US2022121884A1_D26948.tif" /><img file="US2022121884A1_D26949.tif" /><img file="US2022121884A1_D26950.tif" /><img file="US2022121884A1_D26951.tif" /><img file="US2022121884A1_D26952.tif" /><img file="US2022121884A1_D26953.tif" /><img file="US2022121884A1_D26954.tif" /><img file="US2022121884A1_D26955.tif" /><img file="US2022121884A1_D26956.tif" /><img file="US2022121884A1_D26957.tif" /><img file="US2022121884A1_D26958.tif" /><img file="US2022121884A1_D26959.tif" /><img file="US2022121884A1_D26960.tif" /><img file="US2022121884A1_D26961.tif" /><img file="US2022121884A1_D26962.tif" /><img file="US2022121884A1_D26963.tif" /><img file="US2022121884A1_D26964.tif" /><img file="US2022121884A1_D26965.tif" /><img file="US2022121884A1_D26966.tif" /><img file="US2022121884A1_D26967.tif" /><img file="US2022121884A1_D26968.tif" /><img file="US2022121884A1_D26969.tif" /><img file="US2022121884A1_D26970.tif" /><img file="US2022121884A1_D26971.tif" /><img file="US2022121884A1_D26972.tif" /><img file="US2022121884A1_D26973.tif" /><img file="US2022121884A1_D26974.tif" /><img file="US2022121884A1_D26975.tif" /><img file="US2022121884A1_D26976.tif" /><img file="US2022121884A1_D26977.tif" /><img file="US2022121884A1_D26978.tif" /><img file="US2022121884A1_D26979.tif" /><img file="US2022121884A1_D26980.tif" /><img file="US2022121884A1_D26981.tif" /><img file="US2022121884A1_D26982.tif" /><img file="US2022121884A1_D26983.tif" /><img file="US2022121884A1_D26984.tif" /><img file="US2022121884A1_D26985.tif" /><img file="US2022121884A1_D26986.tif" /><img file="US2022121884A1_D26987.tif" /><img file="US2022121884A1_D26988.tif" /><img file="US2022121884A1_D26989.tif" /><img file="US2022121884A1_D26990.tif" /><img file="US2022121884A1_D26991.tif" /><img file="US2022121884A1_D26992.tif" /><img file="US2022121884A1_D26993.tif" /><img file="US2022121884A1_D26994.tif" /><img file="US2022121884A1_D26995.tif" /><img file="US2022121884A1_D26996.tif" /><img file="US2022121884A1_D26997.tif" /><img file="US2022121884A1_D26998.tif" /><img file="US2022121884A1_D26999.tif" /><img file="US2022121884A1_D27000.tif" /><img file="US2022121884A1_D27001.tif" /><img file="US2022121884A1_D27002.tif" /><img file="US2022121884A1_D27003.tif" /><img file="US2022121884A1_D27004.tif" /><img file="US2022121884A1_D27005.tif" /><img file="US2022121884A1_D27006.tif" /><img file="US2022121884A1_D27007.tif" /><img file="US2022121884A1_D27008.tif" /><img file="US2022121884A1_D27009.tif" /><img file="US2022121884A1_D27010.tif" /><img file="US2022121884A1_D27011.tif" /><img file="US2022121884A1_D27012.tif" /><img file="US2022121884A1_D27013.tif" /><img file="US2022121884A1_D27014.tif" />
On the basis of orthonormal set of {circumflex over (υ)}<sub>j</sub>'s, a lower triangular matrix H is constructed by transposing H<sub>j</sub>'s as rows of <img file="US2022121884A1_D27015.tif" />:
<maths id="MATH-US-00147" num="00147"><math overflow="scroll"><mtable><mtr><mtd><mrow><mi>ℋ</mi><mo>=</mo><mrow><mrow><mo>[</mo><mtable><mtr><mtd><mrow><mrow><mo>.</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo>.</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo>.</mo></mrow><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mrow></mtd></mtr><mtr><mtd><msup><msub><mi>H</mi><mi>j</mi></msub><mi>T</mi></msup></mtd></mtr><mtr><mtd><mrow><mrow><mo>.</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo>.</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo>.</mo></mrow><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mrow></mtd></mtr></mtable><mo>]</mo></mrow><mo>=</mo><msub><mrow><mo>[</mo><msub><mi>h</mi><mrow><mi>j</mi><mo>,</mo><msup><mi>j</mi><mi>′</mi></msup></mrow></msub><mo>]</mo></mrow><mrow><mi>l</mi><mo>×</mo><mi>l</mi></mrow></msub></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mn>61</mn><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2022121884A1_D27016.tif" /><img file="US2022121884A1_D27017.tif" /><img file="US2022121884A1_D27018.tif" /><img file="US2022121884A1_D27019.tif" /><img file="US2022121884A1_D27020.tif" /><img file="US2022121884A1_D27021.tif" /><img file="US2022121884A1_D27022.tif" /><img file="US2022121884A1_D27023.tif" /><img file="US2022121884A1_D27024.tif" /><img file="US2022121884A1_D27025.tif" /><img file="US2022121884A1_D27026.tif" /><img file="US2022121884A1_D27027.tif" /><img file="US2022121884A1_D27028.tif" /><img file="US2022121884A1_D27029.tif" /><img file="US2022121884A1_D27030.tif" /><img file="US2022121884A1_D27031.tif" /><img file="US2022121884A1_D27032.tif" /><img file="US2022121884A1_D27033.tif" /><img file="US2022121884A1_D27034.tif" /><img file="US2022121884A1_D27035.tif" /><img file="US2022121884A1_D27036.tif" /><img file="US2022121884A1_D27037.tif" /><img file="US2022121884A1_D27038.tif" /><img file="US2022121884A1_D27039.tif" /><img file="US2022121884A1_D27040.tif" /><img file="US2022121884A1_D27041.tif" /><img file="US2022121884A1_D27042.tif" /><img file="US2022121884A1_D27043.tif" /><img file="US2022121884A1_D27044.tif" /><img file="US2022121884A1_D27045.tif" /><img file="US2022121884A1_D27046.tif" /><img file="US2022121884A1_D27047.tif" /><img file="US2022121884A1_D27048.tif" /><img file="US2022121884A1_D27049.tif" /><img file="US2022121884A1_D27050.tif" /><img file="US2022121884A1_D27051.tif" /><img file="US2022121884A1_D27052.tif" /><img file="US2022121884A1_D27053.tif" /><img file="US2022121884A1_D27054.tif" /><img file="US2022121884A1_D27055.tif" /><img file="US2022121884A1_D27056.tif" /><img file="US2022121884A1_D27057.tif" /><img file="US2022121884A1_D27058.tif" /><img file="US2022121884A1_D27059.tif" /><img file="US2022121884A1_D27060.tif" /><img file="US2022121884A1_D27061.tif" /><img file="US2022121884A1_D27062.tif" /><img file="US2022121884A1_D27063.tif" /><img file="US2022121884A1_D27064.tif" /><img file="US2022121884A1_D27065.tif" /><img file="US2022121884A1_D27066.tif" /><img file="US2022121884A1_D27067.tif" /><img file="US2022121884A1_D27068.tif" /><img file="US2022121884A1_D27069.tif" /><img file="US2022121884A1_D27070.tif" /><img file="US2022121884A1_D27071.tif" /><img file="US2022121884A1_D27072.tif" /><img file="US2022121884A1_D27073.tif" /><img file="US2022121884A1_D27074.tif" /><img file="US2022121884A1_D27075.tif" /><img file="US2022121884A1_D27076.tif" /><img file="US2022121884A1_D27077.tif" /><img file="US2022121884A1_D27078.tif" /><img file="US2022121884A1_D27079.tif" /><img file="US2022121884A1_D27080.tif" /><img file="US2022121884A1_D27081.tif" /><img file="US2022121884A1_D27082.tif" /><img file="US2022121884A1_D27083.tif" /><img file="US2022121884A1_D27084.tif" /><img file="US2022121884A1_D27085.tif" /><img file="US2022121884A1_D27086.tif" /><img file="US2022121884A1_D27087.tif" /><img file="US2022121884A1_D27088.tif" /><img file="US2022121884A1_D27089.tif" /><img file="US2022121884A1_D27090.tif" /><img file="US2022121884A1_D27091.tif" /><img file="US2022121884A1_D27092.tif" /><img file="US2022121884A1_D27093.tif" /><img file="US2022121884A1_D27094.tif" /><img file="US2022121884A1_D27095.tif" /><img file="US2022121884A1_D27096.tif" /><img file="US2022121884A1_D27097.tif" /><img file="US2022121884A1_D27098.tif" /><img file="US2022121884A1_D27099.tif" /><img file="US2022121884A1_D27100.tif" /><img file="US2022121884A1_D27101.tif" /><img file="US2022121884A1_D27102.tif" /><img file="US2022121884A1_D27103.tif" /><img file="US2022121884A1_D27104.tif" /><img file="US2022121884A1_D27105.tif" /><img file="US2022121884A1_D27106.tif" /><img file="US2022121884A1_D27107.tif" /><img file="US2022121884A1_D27108.tif" /><img file="US2022121884A1_D27109.tif" /><img file="US2022121884A1_D27110.tif" /><img file="US2022121884A1_D27111.tif" /><img file="US2022121884A1_D27112.tif" /><img file="US2022121884A1_D27113.tif" /><img file="US2022121884A1_D27114.tif" /><img file="US2022121884A1_D27115.tif" /><img file="US2022121884A1_D27116.tif" /><img file="US2022121884A1_D27117.tif" /><img file="US2022121884A1_D27118.tif" /><img file="US2022121884A1_D27119.tif" /><img file="US2022121884A1_D27120.tif" /><img file="US2022121884A1_D27121.tif" /><img file="US2022121884A1_D27122.tif" /><img file="US2022121884A1_D27123.tif" /><img file="US2022121884A1_D27124.tif" /><img file="US2022121884A1_D27125.tif" /><img file="US2022121884A1_D27126.tif" /><img file="US2022121884A1_D27127.tif" />
The components of z<sub>i</sub>, i.e., z<sub>i,j</sub>'s, are determined by inverting H as follows:
<maths id="MATH-US-00148" num="00148"><math overflow="scroll"><mtable><mtr><mtd><mrow><mrow><mi>ℋ</mi><mo></mo><mstyle><mspace width="0.8em" height="0.8ex" /></mstyle><mo></mo><msub><mi>z</mi><mi>i</mi></msub></mrow><mo>=</mo><mrow><mrow><mrow><mo>[</mo><mtable><mtr><mtd><mrow><mrow><mo>.</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo>.</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo>.</mo></mrow><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mrow></mtd></mtr><mtr><mtd><msup><msub><mi>H</mi><mi>j</mi></msub><mi>T</mi></msup></mtd></mtr><mtr><mtd><mrow><mrow><mo>.</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo>.</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo>.</mo></mrow><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mrow></mtd></mtr></mtable><mo>]</mo></mrow><mo></mo><msub><mi>z</mi><mi>i</mi></msub></mrow><mo>=</mo><mrow><msub><mrow><mo>[</mo><mtable><mtr><mtd><mrow><mrow><mo>.</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo>.</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo>.</mo></mrow><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mrow></mtd></mtr><mtr><mtd><mrow><msub><mi>H</mi><mi>j</mi></msub><mo>·</mo><msub><mi>z</mi><mi>i</mi></msub></mrow></mtd></mtr><mtr><mtd><mrow><mrow><mo>.</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo>.</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo>.</mo></mrow><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mrow></mtd></mtr></mtable><mo>]</mo></mrow><mrow><mi>l</mi><mo>×</mo><mn>1</mn></mrow></msub><mo>=</mo><msub><mrow><mo>[</mo><mtable><mtr><mtd><mrow><mrow><mo>.</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo>.</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo>.</mo></mrow><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mrow></mtd></mtr><mtr><mtd><mrow><mi>𝒦</mi><mo></mo><mrow><mo>(</mo><mrow><msub><mi>G</mi><mi>j</mi></msub><mo>,</mo><msub><mi>x</mi><mi>i</mi></msub></mrow><mo>)</mo></mrow></mrow></mtd></mtr><mtr><mtd><mrow><mrow><mo>.</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo>.</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo>.</mo></mrow><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mrow></mtd></mtr></mtable><mo>]</mo></mrow><mrow><mi>l</mi><mo>×</mo><mn>1</mn></mrow></msub></mrow></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mn>62</mn><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2022121884A1_D27128.tif" /><img file="US2022121884A1_D27129.tif" /><img file="US2022121884A1_D27130.tif" /><img file="US2022121884A1_D27131.tif" /><img file="US2022121884A1_D27132.tif" /><img file="US2022121884A1_D27133.tif" /><img file="US2022121884A1_D27134.tif" /><img file="US2022121884A1_D27135.tif" /><img file="US2022121884A1_D27136.tif" /><img file="US2022121884A1_D27137.tif" /><img file="US2022121884A1_D27138.tif" /><img file="US2022121884A1_D27139.tif" /><img file="US2022121884A1_D27140.tif" /><img file="US2022121884A1_D27141.tif" /><img file="US2022121884A1_D27142.tif" /><img file="US2022121884A1_D27143.tif" /><img file="US2022121884A1_D27144.tif" /><img file="US2022121884A1_D27145.tif" /><img file="US2022121884A1_D27146.tif" /><img file="US2022121884A1_D27147.tif" /><img file="US2022121884A1_D27148.tif" /><img file="US2022121884A1_D27149.tif" /><img file="US2022121884A1_D27150.tif" /><img file="US2022121884A1_D27151.tif" /><img file="US2022121884A1_D27152.tif" /><img file="US2022121884A1_D27153.tif" /><img file="US2022121884A1_D27154.tif" /><img file="US2022121884A1_D27155.tif" /><img file="US2022121884A1_D27156.tif" /><img file="US2022121884A1_D27157.tif" /><img file="US2022121884A1_D27158.tif" /><img file="US2022121884A1_D27159.tif" /><img file="US2022121884A1_D27160.tif" /><img file="US2022121884A1_D27161.tif" /><img file="US2022121884A1_D27162.tif" /><img file="US2022121884A1_D27163.tif" /><img file="US2022121884A1_D27164.tif" /><img file="US2022121884A1_D27165.tif" /><img file="US2022121884A1_D27166.tif" /><img file="US2022121884A1_D27167.tif" /><img file="US2022121884A1_D27168.tif" /><img file="US2022121884A1_D27169.tif" /><img file="US2022121884A1_D27170.tif" /><img file="US2022121884A1_D27171.tif" /><img file="US2022121884A1_D27172.tif" /><img file="US2022121884A1_D27173.tif" /><img file="US2022121884A1_D27174.tif" /><img file="US2022121884A1_D27175.tif" /><img file="US2022121884A1_D27176.tif" /><img file="US2022121884A1_D27177.tif" /><img file="US2022121884A1_D27178.tif" /><img file="US2022121884A1_D27179.tif" /><img file="US2022121884A1_D27180.tif" /><img file="US2022121884A1_D27181.tif" /><img file="US2022121884A1_D27182.tif" /><img file="US2022121884A1_D27183.tif" /><img file="US2022121884A1_D27184.tif" /><img file="US2022121884A1_D27185.tif" /><img file="US2022121884A1_D27186.tif" /><img file="US2022121884A1_D27187.tif" /><img file="US2022121884A1_D27188.tif" /><img file="US2022121884A1_D27189.tif" /><img file="US2022121884A1_D27190.tif" /><img file="US2022121884A1_D27191.tif" /><img file="US2022121884A1_D27192.tif" /><img file="US2022121884A1_D27193.tif" /><img file="US2022121884A1_D27194.tif" /><img file="US2022121884A1_D27195.tif" /><img file="US2022121884A1_D27196.tif" /><img file="US2022121884A1_D27197.tif" /><img file="US2022121884A1_D27198.tif" /><img file="US2022121884A1_D27199.tif" /><img file="US2022121884A1_D27200.tif" /><img file="US2022121884A1_D27201.tif" /><img file="US2022121884A1_D27202.tif" /><img file="US2022121884A1_D27203.tif" /><img file="US2022121884A1_D27204.tif" /><img file="US2022121884A1_D27205.tif" /><img file="US2022121884A1_D27206.tif" /><img file="US2022121884A1_D27207.tif" /><img file="US2022121884A1_D27208.tif" /><img file="US2022121884A1_D27209.tif" /><img file="US2022121884A1_D27210.tif" /><img file="US2022121884A1_D27211.tif" /><img file="US2022121884A1_D27212.tif" /><img file="US2022121884A1_D27213.tif" /><img file="US2022121884A1_D27214.tif" /><img file="US2022121884A1_D27215.tif" /><img file="US2022121884A1_D27216.tif" /><img file="US2022121884A1_D27217.tif" /><img file="US2022121884A1_D27218.tif" /><img file="US2022121884A1_D27219.tif" /><img file="US2022121884A1_D27220.tif" /><img file="US2022121884A1_D27221.tif" /><img file="US2022121884A1_D27222.tif" /><img file="US2022121884A1_D27223.tif" /><img file="US2022121884A1_D27224.tif" /><img file="US2022121884A1_D27225.tif" /><img file="US2022121884A1_D27226.tif" /><img file="US2022121884A1_D27227.tif" /><img file="US2022121884A1_D27228.tif" /><img file="US2022121884A1_D27229.tif" /><img file="US2022121884A1_D27230.tif" /><img file="US2022121884A1_D27231.tif" /><img file="US2022121884A1_D27232.tif" /><img file="US2022121884A1_D27233.tif" /><img file="US2022121884A1_D27234.tif" /><img file="US2022121884A1_D27235.tif" /><img file="US2022121884A1_D27236.tif" /><img file="US2022121884A1_D27237.tif" /><img file="US2022121884A1_D27238.tif" /><img file="US2022121884A1_D27239.tif" />
Therefore:
<maths id="MATH-US-00149" num="00149"><math overflow="scroll"><mtable><mtr><mtd><mrow><msub><mi>z</mi><mi>i</mi></msub><mo>=</mo><mrow><mrow><mo>[</mo><mtable><mtr><mtd><mrow><mrow><mo>.</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo>.</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo>.</mo></mrow><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mrow></mtd></mtr><mtr><mtd><msub><mi>z</mi><mrow><mi>i</mi><mo>,</mo><mi>j</mi></mrow></msub></mtd></mtr><mtr><mtd><mrow><mrow><mo>.</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo>.</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo>.</mo></mrow><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mrow></mtd></mtr></mtable><mo>]</mo></mrow><mo>=</mo><msub><mrow><msup><mi>ℋ</mi><mrow><mo>-</mo><mn>1</mn></mrow></msup><mo></mo><mrow><mo>[</mo><mtable><mtr><mtd><mrow><mrow><mo>.</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo>.</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo>.</mo></mrow><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mrow></mtd></mtr><mtr><mtd><mrow><mi>𝒦</mi><mo></mo><mrow><mo>(</mo><mrow><msub><mi>G</mi><mi>j</mi></msub><mo>,</mo><msub><mi>x</mi><mi>i</mi></msub></mrow><mo>)</mo></mrow></mrow></mtd></mtr><mtr><mtd><mrow><mrow><mo>.</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo>.</mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle><mo>.</mo></mrow><mo></mo><mstyle><mspace width="0.3em" height="0.3ex" /></mstyle></mrow></mtd></mtr></mtable><mo>]</mo></mrow></mrow><mrow><mi>l</mi><mo>×</mo><mn>1</mn></mrow></msub></mrow></mrow></mtd><mtd><mrow><mo>(</mo><mn>63</mn><mo>)</mo></mrow></mtd></mtr></mtable></math></maths><img file="US2022121884A1_D27240.tif" /><img file="US2022121884A1_D27241.tif" /><img file="US2022121884A1_D27242.tif" /><img file="US2022121884A1_D27243.tif" /><img file="US2022121884A1_D27244.tif" /><img file="US2022121884A1_D27245.tif" /><img file="US2022121884A1_D27246.tif" /><img file="US2022121884A1_D27247.tif" /><img file="US2022121884A1_D27248.tif" /><img file="US2022121884A1_D27249.tif" /><img file="US2022121884A1_D27250.tif" /><img file="US2022121884A1_D27251.tif" /><img file="US2022121884A1_D27252.tif" /><img file="US2022121884A1_D27253.tif" /><img file="US2022121884A1_D27254.tif" /><img file="US2022121884A1_D27255.tif" /><img file="US2022121884A1_D27256.tif" /><img file="US2022121884A1_D27257.tif" /><img file="US2022121884A1_D27258.tif" /><img file="US2022121884A1_D27259.tif" /><img file="US2022121884A1_D27260.tif" /><img file="US2022121884A1_D27261.tif" /><img file="US2022121884A1_D27262.tif" /><img file="US2022121884A1_D27263.tif" /><img file="US2022121884A1_D27264.tif" /><img file="US2022121884A1_D27265.tif" /><img file="US2022121884A1_D27266.tif" /><img file="US2022121884A1_D27267.tif" /><img file="US2022121884A1_D27268.tif" /><img file="US2022121884A1_D27269.tif" /><img file="US2022121884A1_D27270.tif" /><img file="US2022121884A1_D27271.tif" /><img file="US2022121884A1_D27272.tif" /><img file="US2022121884A1_D27273.tif" /><img file="US2022121884A1_D27274.tif" /><img file="US2022121884A1_D27275.tif" /><img file="US2022121884A1_D27276.tif" /><img file="US2022121884A1_D27277.tif" /><img file="US2022121884A1_D27278.tif" /><img file="US2022121884A1_D27279.tif" /><img file="US2022121884A1_D27280.tif" /><img file="US2022121884A1_D27281.tif" /><img file="US2022121884A1_D27282.tif" /><img file="US2022121884A1_D27283.tif" /><img file="US2022121884A1_D27284.tif" /><img file="US2022121884A1_D27285.tif" /><img file="US2022121884A1_D27286.tif" /><img file="US2022121884A1_D27287.tif" /><img file="US2022121884A1_D27288.tif" /><img file="US2022121884A1_D27289.tif" /><img file="US2022121884A1_D27290.tif" /><img file="US2022121884A1_D27291.tif" /><img file="US2022121884A1_D27292.tif" /><img file="US2022121884A1_D27293.tif" /><img file="US2022121884A1_D27294.tif" /><img file="US2022121884A1_D27295.tif" /><img file="US2022121884A1_D27296.tif" /><img file="US2022121884A1_D27297.tif" /><img file="US2022121884A1_D27298.tif" /><img file="US2022121884A1_D27299.tif" /><img file="US2022121884A1_D27300.tif" /><img file="US2022121884A1_D27301.tif" /><img file="US2022121884A1_D27302.tif" /><img file="US2022121884A1_D27303.tif" /><img file="US2022121884A1_D27304.tif" /><img file="US2022121884A1_D27305.tif" /><img file="US2022121884A1_D27306.tif" /><img file="US2022121884A1_D27307.tif" /><img file="US2022121884A1_D27308.tif" /><img file="US2022121884A1_D27309.tif" /><img file="US2022121884A1_D27310.tif" /><img file="US2022121884A1_D27311.tif" /><img file="US2022121884A1_D27312.tif" /><img file="US2022121884A1_D27313.tif" /><img file="US2022121884A1_D27314.tif" /><img file="US2022121884A1_D27315.tif" /><img file="US2022121884A1_D27316.tif" /><img file="US2022121884A1_D27317.tif" /><img file="US2022121884A1_D27318.tif" /><img file="US2022121884A1_D27319.tif" /><img file="US2022121884A1_D27320.tif" /><img file="US2022121884A1_D27321.tif" /><img file="US2022121884A1_D27322.tif" /><img file="US2022121884A1_D27323.tif" /><img file="US2022121884A1_D27324.tif" /><img file="US2022121884A1_D27325.tif" /><img file="US2022121884A1_D27326.tif" /><img file="US2022121884A1_D27327.tif" /><img file="US2022121884A1_D27328.tif" /><img file="US2022121884A1_D27329.tif" /><img file="US2022121884A1_D27330.tif" /><img file="US2022121884A1_D27331.tif" /><img file="US2022121884A1_D27332.tif" /><img file="US2022121884A1_D27333.tif" /><img file="US2022121884A1_D27334.tif" /><img file="US2022121884A1_D27335.tif" /><img file="US2022121884A1_D27336.tif" /><img file="US2022121884A1_D27337.tif" /><img file="US2022121884A1_D27338.tif" /><img file="US2022121884A1_D27339.tif" /><img file="US2022121884A1_D27340.tif" /><img file="US2022121884A1_D27341.tif" /><img file="US2022121884A1_D27342.tif" /><img file="US2022121884A1_D27343.tif" /><img file="US2022121884A1_D27344.tif" /><img file="US2022121884A1_D27345.tif" /><img file="US2022121884A1_D27346.tif" /><img file="US2022121884A1_D27347.tif" /><img file="US2022121884A1_D27348.tif" /><img file="US2022121884A1_D27349.tif" /><img file="US2022121884A1_D27350.tif" /><img file="US2022121884A1_D27351.tif" />
The above shows that a slice of original kernel matrix in (55) is used to deal with the data in feature space. The coverage and triangulation in input space implies redundancy in the kernel matrix. In other words, if two input points x<sub>1</sub>and x<sub>2 </sub>may be located in <img file="US2022121884A1_D27352.tif" /><sup>d </sup>based on their kernels (or distances) to G<sub>j</sub>'s, then per (63), <img file="US2022121884A1_D27353.tif" />(x<sub>1</sub>, x<sub>2</sub>) (which is (z<sub>1</sub>·z<sub>2</sub>)) may be expressed in terms of <img file="US2022121884A1_D27354.tif" />(G<sub>j</sub>, x<sub>1</sub>)'s, <img file="US2022121884A1_D27355.tif" />(G<sub>j</sub>, x<sub>2</sub>)'s, and <img file="US2022121884A1_D27356.tif" />(G<sub>j</sub>, G<sub>j1</sub>)'s. The accuracy in which this is possible can be used as a validation of coverage and triangulation to ensure the dimensionality of the feature space can support decomposition in (60) and (63).
The machinery of previous sections can thus be brought to bear in the feature space, as all expressions are convertible to dot products (such as projections of the data points on certain directions).
EXAMPLES & APPLICATIONS
Example 1
A method for recognition of faces from a still image or video frame, said method comprising:
receiving a still image or video frame through an input interface;
preprocessing said still image or video frame;
recognizing a first class of image for said still image or video frame;
if said first class of image for said still image or video frame comprises face or human, then sending said still image or video frame to a face recognizer module;
said face recognizer module accessing a first basis function from a first library of basis functions, stored in a first basis function storage, corresponding to a first component of face;
said face recognizer module accessing a second basis function from a second library of basis functions, stored in a second basis function storage, corresponding to a second component of face;
a computing processor applying said first basis function across said still image or video frame to detect said first component of face;
said computing processor applying said second basis function across said still image or video frame to detect said second component of face;
said computing processor accessing a relationship between said first component of face and said second component of face;
assigning a first node and a second node on a relational web to represent said first component of face and said second component of face, respectively;
assigning a first branch connecting said first node and said second node on said relational web to represent said relationship between said first component of face and said second component of face;
assigning a first Z-factor, a second Z-factor, and a third Z-factor to said first node, said second node, and said first branch, respectively;
wherein Z-factor is a mathematical set of factors comprising one or more of reliability factor, confidence factor, truth factor, expertise factor, bias factor, knowledge factor, usefulness factor, and relevance factor;
said computing processor analyzing said first Z-factor, said second Z-factor, and said third Z-factor for said first node, said second node, and said first branch;
said computing processor detecting one or more faces in said still image or video frame, with a fourth Z-factor, based on said analysis step;
said computing processor comparing said detected one or more faces with said fourth Z-factor against a library of faces, each with its own said Z-factor, stored in a first face storage;
if said detected one or more faces match or correspond to a first face in said library of faces, then outputting identity or identification number of said first face, as identification for said detected one or more faces from said still image or video frame, along with a fifth Z-factor corresponding to said matching or correspondence to said first face.
Example 2
A method for determining a Z-valuation, said method comprising:
inputting one or more rules into a rules engine, wherein said rules engine is run by a processor device;
receiving one or more fact information by said rules engine;
setting up one or more protoforms in a first memory location or unit;
establishing one or more relationships related to said one or more protoforms;
extracting a first attribute from said one or more relationships;
filtering possible reciprocal relationships from a first database, wherein said possible reciprocal relationships are selected based on said first attribute;
determining a first reciprocal relationship based on said filtering step;
determining a first consequential attribute based on said first attribute;
determining one or more synonym attributes based on said first attribute, wherein said one or more synonym attributes reside on a second memory location or unit;
instantiating a first supplemental relationship based on said one or more synonym attributes, said first reciprocal relationship, or said first consequential attribute;
expanding one or more additional relationships by matching a first set of attributes to a first set of general rules from a knowledge base, stored on a second database;
determining a first Z-valuation based on said first supplemental relationship.
Example 3
A method for fuzzy logic control, said method comprising:
an input module receiving a precisiated proposition associated with a protoform;
a fuzzy logic inference engine evaluating a first fuzzy logic rule from a fuzzy logic rule repository;
wherein said fuzzy logic inference engine is in or loaded on or executed on or implemented in a computing device;
wherein said computing device comprises one or more of following: computer, processor device, integrated circuit, microprocessor, or server;
wherein said fuzzy logic rule repository comprises one or more fuzzy logic rules;
wherein said first fuzzy logic rule comprises an antecedent part and a consequent part;
wherein said precisiated proposition comprises a Z-valuation;
wherein said Z-valuation is in a form of ordered triple (X, A, B), representing a statement assignment of X to a pair (A, B);
wherein X represents a variable, A is a fuzzy logic set in domain of X, and B is a fuzzy logic set representing a certainty indicator of X being possiblistically restricted by said fuzzy logic set A; and
said evaluating step comprises:
a test score evaluation module assigning a first test score to a candidate probability distribution for X based on said Z-valuation;
wherein said candidate probability distribution belongs to a set of candidate probability distributions;
said test score evaluation module assigning a second test score to said antecedent part based on said antecedent part, said set of candidate probability distributions, and said first test score; and
said fuzzy logic inference engine determining whether said antecedent part is satisfied beyond a threshold, based on said second test score.
Example 4
A method of search for an item, said method comprising:
a first input module receiving a first item;
wherein said first item is associated with a first Z-number;
a second input module receiving a second item;
wherein said second item is associated with a second Z-number;
a relevance analysis module generating one or more first relevant items from said first item, using a relevance storage database;
said relevance analysis module generating one or more second relevant items from said one or more first relevant items;
said relevance analysis module generating one or more third relevant items from said second item;
a correlation degree module receiving said one or more second relevant items and said one or more third relevant items;
wherein said one or more second relevant items are associated with a third Z-number;
wherein said one or more third relevant items are associated with a fourth Z-number;
wherein said third Z-number is dependent on said first Z-number;
wherein said fourth Z-number is dependent on said second Z-number;
said correlation degree module analyzing a correlation between said one or more second relevant items and said one or more third relevant items, using one or more correlation rules, from a correlation rule storage, based on said third Z-number and said fourth Z-number;
based on said correlation analysis, a computing device deciding whether to connect said one or more second relevant items with said one or more third relevant items;
if said one or more second relevant items is connected with said one or more third relevant items, then associating said second item with said first item.
Example 5
A method of storage for data in a computer media, said method comprising:
an input module receiving a first data;
a computing processor module fuzzifying said first data, to produce a second data;
said computing processor module fuzzifying said second data, to produce a third data;
a storage management module storing said first data in a first memory unit;
said storage management module storing said second data in a second memory unit;
said storage management module storing said third data in a third memory unit;
wherein said first memory unit is for short term storage;
wherein said second memory unit is for medium term storage;
wherein said third memory unit is for long term storage;
accessing said first data, said second data, or said third data, through an interface;
after a first expiration date, said storage management module deleting said first data from said first memory unit;
after a second expiration date, said storage management module deleting said second data. from said second memory unit;
wherein said second expiration date is after said first expiration date.
Example 6
A method of searching for an item in an image or video, said method comprising:
an input module receiving an image or video frame;
an object recognizer recognizing an object in said image or video frame;
a computing processor unit accessing a database for list of one or more items related to said object,
said computing processor unit receiving information about statistics of position of said one or more items with respect to position of said object;
wherein said object corresponds to a first node on a Z-web;
wherein said one or more items correspond to a second node on said Z-web;
wherein a first Z-factor relates said first node to said second node on said Z-web;
said computing processor unit defining a radius or region of search on said image or video frame, based on said position of said one or more items with respect to position of said object, and based on said first Z-factor;
an item recognizer searching for said one or more items within said radius or region of search on said image or video frame.
Example 7
A method for supervised descriptive training of a recognition system, said method comprising:
rendering an image based on a model driven by invariant or semi-invariant parameters, variant parameters, and pose parameters;
wherein said pose parameters comprise one or more of orientation, position, and scaling type parameters;
wherein said invariant or semi-invariant parameters are invariant or semi-invariant with respect to different poses and expression of same person or object rendered by said model;
wherein value of said variant parameters are in common for various people or objects with same or similar expressions rendered by said model;
detecting or classifying a feature set from said image;
taking an optimization step in training a correlation layer using said feature set and one or more of said invariant or semi-invariant parameters, said variant parameters, and said pose parameters, as input to said correlation layer; and
wherein said correlation layer comprises stochastic sigmoid units and unidirectional weighted links.
Example 8
A method for feature space translator, said method comprising:
selecting or generating training data or image from a model renderer or a database;
detecting or classifying a first feature set from said training data or image by a first feature detector;
detecting or classifying a second feature set from said training data or image by a second feature detector;
taking an optimization step in training a correlation layer using said first feature set and said second feature set as input to said correlation layer;
wherein said correlation layer comprises stochastic sigmoid units and unidirectional weighted links; and
wherein said correlation layer, upon training, outputs a translated feature set, given a third feature set as input to said correlation layer.
Example 9
A method for geometrical abstraction for a recognition system, said method comprising:
an input module receiving an image or video frame;
an object recognizer unit recognizing an object in said image or video frame;
a computing processor applying a skeleton operator or thinning filter to said object in said image or video frame, to produce a basic shape;
a matching module comparing said basic shape with members of symbols library, geometrical objects library, and alphabets library;
describing said basic shape with said members of said symbols library, said geometrical objects library, and said alphabets library;
said matching module comparing said basic shape with combinations of said members of said symbols library, said geometrical objects library, and said alphabets library;
encoding said basic shape with combinations of said members of said symbols library, said geometrical objects library, and said alphabets library;
associating a Z-factor to said described basic shape and said encoded basic shape;
storing said described basic shape and said encoded basic shape in a geometrical descriptor database;
receiving another item in an image or video;
based on said geometrical descriptor database for said object and said another item, comparing said object to said another item.
Example 10
A system for feature detection with reliability, said system comprising:
one or more layers of stochastic units;
one or more weighted links associating a first stochastic unit of said one or more layers of stochastic units with one or more linked units;
a layer of input units;
wherein a set of data is input to one or more of clamped input units in said layer of input units;
a set of detected features;
wherein said set of detected features are associated with a top layer of said one or more layers of stochastic units;
wherein an energy measure corresponding to said set of data is determined based on factors comparing said one or more of clamped input units, said one or more weighted links, and said one or more layers of stochastic units;
wherein a reliability or conformity measure corresponding to said set of detected features is determined based on said energy measure and a baseline.
Appendices (Descriptions):
Besides Packages 1-33, we also have Appendices 1-10 (for details of teachings and clarifications, incorporated by reference from the parents and prior applications, as well as with the current application):
Please note that Appendices 1-5 (of Zadeh-101-CIP (i.e., Ser. No. 14/218,923)) are identified as: <ul id="ul0109" list-style="none"><li id="ul0109-0001" num="0000"><ul id="ul0110" list-style="none"><li id="ul0110-0001" num="3190">Appendix 1: article about “Approximate Z-Number Evaluation based on Categorical Sets of Probability Distributions” (11 pages)</li><li id="ul0110-0002" num="3191">Appendix 2: hand-written technical notes, formulations, algorithms, and derivations (5 pages)</li><li id="ul0110-0003" num="3192">Appendix 3: presentation about “Approximate Z-Number Evaluation Based on Categorical Sets of Probability Distributions” (30 pages)</li><li id="ul0110-0004" num="3193">Appendix 4: presentation with. FIGS. from B<b>1</b> to B<b>19</b> (19 pages)</li><li id="ul0110-0005" num="3194">Appendix 5: presentation about “SVM Classifier” (22 pages)</li></ul></li></ul>
Please note that Appendices 6-10 (of Zadeh-101-CIP-CIP) are identified as: <ul id="ul0111" list-style="none"><li id="ul0111-0001" num="0000"><ul id="ul0112" list-style="none"><li id="ul0112-0001" num="3196">Appendix 6: article/journal/technical/research/paper about “The Information Principle”, by Prof. Lotfi Zadeh, Information Sciences, submitted 16-May-2014, published 2015 (10 pages)</li><li id="ul0112-0002" num="3197">Appendix 7: presentation/conference/talk/invited/keynote speaker/lecture about “Stratification, target set reachability, and incremental enlargement principle”, by Prof. Lotfi Zadeh, UC Berkeley, World Conference on Soft Computing, May 22, 2016 (14 pages, each page including 9 slides, for a total of 126 slides) (first version prepared on Feb. 8, 2016)</li><li id="ul0112-0003" num="3198">Appendix 8: article about “Stratification, quantization, target set reachability, and incremental enlargement principle”, by Prof. Lotfi Zadeh, for Information Sciences, received 4-July-2016 (17 pages) (first version prepared on Feb. 5, 2016)</li><li id="ul0112-0004" num="3199">Appendix 9: This shows the usage of visual search terms for our image search engine (1 page), which is the first in the industry. It shows an example for shoes (component or parts matching, from various shoes), using ZAC/our technology and platform. For example, it shows the search for: “side look like shoe number 1, heel look like shoe number 2, and toe look like shoe number 3”, based on what the user is looking/searching for. In general, we can have a combination of conditions, e.g. : (R<sub>1 </sub>AND R<sub>2 </sub>AND . . . AND R<sub>n</sub>), or any logical search terms or combinations or operators, e.g., [R<sub>1 </sub>OR (R<sub>2 </sub>AND R<sub>3</sub>)], which is very helpful for e-commerce or websites/e-stores.</li><li id="ul0112-0005" num="3200">Appendix 10: “Brief Introduction to AI and Machine Learning”, for conventional tools and methods, sometimes used or referred to in this invention, for completeness and as support of the main invention, or just for the purpose of comparison with the conventional tools and methods.</li></ul></li></ul>
For the current inventions, we can combine any and a 11 the systems and methods and embodiments and steps and components and examples of our own prior applications, including all appendices and all those incorporated by reference, e.g., Packages 1-33 and Appendices 1-10, which we have priority claim for, to provide very efficient and fast algorithms for image processing, learning machines, General-AI, NLP, pattern recognition, classification, SVM, deep learning, and the like, for all the applications and usages mentioned here in this disclosure, with all tools, systems, and methods provided here.
The Information Principle:
The conventional wisdom is that the concept of information is closely related to the concept of probability, ,In Shannon's information theory, information is equated to a reduction in entropy, a probabilistic concept. Here, a different/new view of information is put on the table. Information is equated to restriction. More concretely, a restriction is a limitation on the values which a variable can take. The concept of a restriction is more general than the concept of a constraint and the concept of a probability distribution. There are three principal kinds of restrictions: possibilistic, probabilistic, and bimodal. A bimodal restriction is a combination of possibilistic and probabilistic restrictions.
Underlying the restriction-centered approach to information is what may be called the Information Principle. Briefly stated, the Information Principle has three parts: (a) Information=restriction. (b) There are three principal types of information: possibilistic information, probabilistic information, and bimodal information. Bimodal information is a combination of possibilistic information and probabilistic information. (c) Possibilistic information and probabilistic information are underivable (orthogonal), with respect to each other, in the sense that neither is derivable from the other.
Information is all around us, and yet, there is widespread unawareness of the existence of the Information Principle. In particular, what is not recognized is that possibilistic information and probabilistic information are underivable (orthogonal). An important empirical observation is that propositions in a natural language are carriers of predominantly fuzzy possibilistic information (FPI) and fuzzy bimodal information (FBI). Existing systems of reasoning and computation, other than fuzzy logic, do not have the capability to reason and compute with fuzzy bimodal information. (See Appendix 6 for more details/examples.)
That is a very important principle, which guides us to solve very complex problems, such as NLP, which cannot be solved completely/correctly/efficiently using conventional AI/machine learning, available in the industry today. We also show the applications of this method/principle in other parts of this disclosure.
Stratification, Quantization, Target Set Reachability, and Incremental Enlargement Principle:
(See Appendices 7 and 8 for more details/examples.)
Abstract:
This section/embodiment presents a new approach for the concept of stratification, call it CST for short. In our approach to stratification, CST is a computational system in which the objects of computation are strata of data. Usually, the strata are nested or stacked with nested strata centering on a target set, T. CST has significant applications in planning, robotics, optimal control, pursuit, multiobjective optimization, exploration, search, and other fields. Very simple, familiar examples of stratification are dictionaries, directories, and catalogues. A multi-layer perceptron may be viewed as a system with a stratified structure. In spirit, CST has similarity to dynamic programing (DP), but it is much easier to understand and much easier to implement. An interesting question which relates to neuroscience is: Does the human brain employ stratification to store information? It would be natural to represent a concept such as chair, as a collection of strata with one or more strata representing a type of chair.
Underlining our approach is a model, call it FSM. FSM is a discrete-time, discrete-state dynamical system which has a finite number of states. The importance of FSM as a model derives from the fact that through the use of granulation and/or quantization, almost any kind of system can be approximated to by a finite state system. A concept which plays an important role in our approach is that of target set reachability. Reachability involves moving (transitioning) FSM from a state w to a state in target state, T, in a minimum number of steps. To this end, the state space, W, is stratified through the use of what is refer as the incremental enlargement principle. It should also be noted that the concept reachability is related to the concept of accessibility in modal logic.
Introduction:
Our version, CST, is systems-oriented, rather than logic-oriented. In spirit, CST has similarity to dynamic programming, DP, but it is much easier to understand and easier to implement. Basically, CST is a system of competition in which the objects of competition are strata of data.
Usually, the strata are nested or stacked with the nested strata centered on a target set, T.
Stratified count: Consider the question: What is the population of Washington D.C.? Using Google the answer is 658,000. What is more informative is what may be called stratified count. Concretely, assume that the area around Washington is partitioned into nested strata (belts) S1, S2, . . . , Sn, centering on downtown Washington. Assume that the population of Si is pi. Stratified count is the collection (S1, p1), . . . , (Sn, pn). Stratification need not be geographical, it may involve on population, P, which may be stratified based on age, occupation, religion, ethnicity, etc, Stratified polls would be a significant value to politicians running for office.
Underlying CST is a model, call it FSM. FSM is a discrete-time, discrete-state dynamical system with a finite number of states. In general, stratification can be precomputed. Precomputation serves an important purpose. It enhances the ability of FSM to deal with disturbances. Concretely, assume that ESM is taken by disturbances to a state w′ which is not on its trajectory to T, Since every state w is annotated through stratification, so is w′. Annotation of w′ is an input sequence, u, which takes w′ to T. In this way, disturbances do not prevent FSM from reaching T.
It should be noted that, fundamentally, most methods of efficient storage of information involve a mapping from similarity to spatial proximity. Stratification and clustering are instances of this mapping. it should also be noted that strata may contain clusters and clusters may be stratified. Strata can be combined. The resulting granules may be represented as states.
Bask Concepts, Definitions, and Notations:
In the following, some basic concept which relate to stratification are briefly defined.
System: A system, A, is a collection of objects, drawn together to serve a particular purpose. A is associated with a collection of state variables, X, which serve to describe A and its behavior.
State: A state, w, is a set of instantiated state variables. The choice of state variables is a province of system designer. Example: Assume that FSM is a patient in a hospital, assume that instantiated state variables are results of various tests: temperature=99.3, and blood pressure=145/74. States are time-dependent. States have a basic property, termed separation property. A state separates the future from the past. More concretely, the behavior oft/SM for t≥t<b>0</b> depends only on the state at time t<b>0</b> and inputs for t≥t<b>0</b>, and not on prior values of st and ut.
In the context of stratification, the principal concepts related to FSM are the following:
State-space: W=(w1, . . . , wn), where W is 2-dimensional. FSM has a finite number of states. Note that finiteness the state-space necessitates that state variables take values in finite sets.
Body: The body of FSM, B, defines FSM. B consists of a collection of all input/output pairs, (u, v) in which u is a sequence of inputs (actions) when u is applied to FSM in state w, and v is the output sequence which is observed. (Note: The idea of defining a system as a collection of input/output pairs was introduced before.)
Bundle: The input and output pairs (u, v) may be bundled. The tag on a bundle identifies the state of FSM when input sequence u is applied. u and v have the same length.
State-transition function, f, is defined by the equation:
<br /><i>s</i>(<i>t</i>+1)=<i>f</i>(<i>st,ut</i>) ,
meaning that if input ut is applied when FSM is in state st, then FSM transitions (moves) to state s(t+1). The behavior of FSM is governed by the equations:
<br /><i>s</i>(<i>t</i>+1)=<i>f</i>(<i>st,ut</i>) ,
<br /><i>vt=g</i>(<i>st,ut</i>) ,
where vt is the output at e t. Note that the state transition function may be derived from the bundled body.
The behavior of FSM may be represented in tabular form, and in graphical form.
Link: The concept of a link and related concept are defined in Appendices 7 and 8.
Trajectory (path): the chain of pointing in the same direction.
Predecessor/successor is described in Appendices 7 and 8.
Note that ω is a single state, and T is a set of states. Pred (T) is the union of predecessors in states of T.
A link may be one-way (unidirectional) or two-way (bidirectional). If the link between wi and wk is bidirectional, then wk is both a successor and a predecessor of wi. If there are no arrows, the link is a two-way link, A link may be considered to be a one-step transition from wi to wk.
A path (trajectory) from w<sub>i </sub>to wk is a succession (chain) of links from wi to wk, A path is terminal, if wk is a target state. The length of the path is the number of steps. The distance d(wi, wk) is the minimum number of steps needed to reach wk from wi.
Target state: A state, w, is a target state if reaching ω is an objective of FSM. Example: Assume that FSM is a patient in a hospital, and state space consists of results of various tests. Assume that p patient is cured. In this case, a target state is a state in which proposition p is true.
Target set: A target set, T, is the set of all target states. In the above example, the target set is the set of all states in which the patient is considered to be cured.
Truth function: The truth function, tp, defines the truth value tp(w) of proposition, p, in state w. The value oft is one or true, if w is a target state. Thus, p is a proposition which defines the target set, T. Consequently, p is referred to as the target set defining proposition.
Reachability: wk is reachable from w<sub>i </sub>if there is input sequence which takes w<sub>i </sub>to wk.
Reachability relation: The reachability relation, R, is defined on W×W. R consists of all pairs (wi, wk) such that wk is reachable from wi. it should be noted that reachability relation is closely related to accessibility relation in modal logic. Following are special case of R which are of relevance to target set reachability. Rr=set of all pairs (wi, wk) such that wk is reachable from wi in r steps.
R may be represented as its incidence matrix, A, in which aij=1, if wk is reachable from wi and aij=0. if wk is not reachable from wi. R1 is the set of all pairs (wi, wk) such that wk is reachable from wi in one step. In terms of R1, R1<sup>n</sup>, is the set of all pairs (wi, wk) such that wk is reachable from wi in n steps. R(≤r) consists of all pairs (wi, wk) such that wk is reachable from wi in r or fewer steps.
More concretely,
<br /><i>R</i>(≤<i>r</i>)=<i>R</i>1<i>+R</i>1<sup>2</sup><i>+. . . +R</i>1<sup>r </sup>
Correspondingly,
<br /><i>R=R</i>1<sup>1</sup><i>+R</i>1<sup>2</sup>+. . .
The right-hand side of this equation is the transitive closure of R. The transitive closure may be computed through the use of Warshall's algorithm.
Reachable set, R(wi) is the set of all states which are reachable from wi. The target set T is reachable from wi if the intersection of R(wi) and T is nonempty. Equivalently, T is reachable from wi if there is a target state in T which is reachable from wi.
Reachability of target set: T is reachable from w if there is a state in T which is reachable from w.
Fuzzy target set: A target set, T, may be a fuzzy set., in which case membership in T is a matter of degree. When T is a fuzzy set, its membership function may be equated to the truth function, t=tp(w), or, equivalently, to the objective function g(w). g(w) is the degree to which FSM achieves its objective, when FSM is in state w.
Non-uniqueness of target sets: Note: Non-uniqueness of target set is closely related to multiobjective optimization. So far, it was assumed that there is just one target set. In many realistic settings, there is more than one target set.
With reference to Appendices 7-8, the objective is: w is in T. Assume that we have two target sets, T1 and T2. The intersection of T1 and T2 may be viewed as a combined target set with combined objective function being the conjunction of g1(w) and g2(w):
<br /><i>g</i>(<i>w</i>)=<i>g</i>1(<i>w</i>) Λ <i>g</i>2 (<i>w</i>)
More generally, if the target sets are T1, T2, . . . , Tk, then the combined target set, T, may be expressed as the intersection:
<br />T=T1 ∩ T2 ∩. . . ∩Tk
Assume we have k target sets T1, . . . , tk, and correspondingly k objective G1, . . . , Gk. An objective Gi is defined by a normalized objective function gi(w) which represents the degree to which Gi is achieved, when the system under consideration is in state w. gi(w) may be equated to the membership function of Ti. Objective functions may be combined through conjunction, resulting in a combined objective functions:
<br />g=g1Λ. . . ΛA gk
Correspondingly, the Gi may be combined through intersection:
<br />G=G1∩. . . ∩Gk
In terms of target sets, the combined target set may be expressed as the intersection:
<br />T=T1∩. . . ∩Tk,
implying that optimal w is in T. In this way, the case where there is more than one target set may be reduced to the case where there is just one combined target set, T. This is the basis for an approach to multiobjective optimization which is described before. This approach has a shortcoming: it does not address situations in which the objective functions have unequal importance. This shortcoming is a reflection of the fact that in the literature there is no working definition of conjunction with weights of importance.
Stratum (Stratum in w): is the set of those states and only those states from which target set can be reached in N or fewer steps. For a stratum, SN, what should be stressed is that stratification is application-depended. An immediate consequence of the definition of stratum is:
<br />SN ∈ S(N+1)
Stratum may be disjoint, except for shared boundaries, or cumulative, in which case SN contains all lower number strata.
Stratification criterion: As was stressed already stratification is application-depended. Stratification criterion is a condition for a membership in SN. To stratify a body of data what needed is criterion. For example, in the case of FSM the stratification criterion is that for a state w to be in SN it is necessary that the distance from w to T is N or less.
Vertical, horizontal, and angular stratifications: Definitions of vertical, horizontal and angular stratifications are given in Appendices 7-8.
Example of stratification is: horizontal, vertical, and angular. Vertical and horizontal stratifications are particularly useful, in competition with fuzzy numbers and Z-numbers.
Annotation: Annotation associates with each states w an input sequence which takes w into target set, T. Note that annotation of states in S(N+1) is very simply derivable from annotation of steps in SN.
Incremental Enlargement Principle:
At this point, the stage is set for introducing a key idea which underlies our approach to stratification. A description of this principle is presented in the following:
With reference to Appendices 7-8, a basic problem which arises in many applications is: Given a state ω in SN finite input sequence u will transition w into a state w′ in T. To this end, let S0=T0=T.
With reference to Appendices 7-8, assume that our objective is downgraded by allowing w′ to be in T or near T, with the understanding that near should be interpreted as one-step away from T. This is equivalent to adding to T states which are one-step away from T. Such states are the predecessors and successors of T, Pred(T) and Succ(T). Consequently, the states near T(T0) are:
<br />Pred(T0)+Succ(T0)
with + interpreted as disjunction (union). Let T1 be the enlarged target set, then:
<br /><i>T</i>1<i>=T</i>0+Pred(<i>T</i>0),
since Succ(T0) is a subset of Pred(T0),
With reference to Appendices 7-8, assume that T=T0=3, then Pred(T0)=6+2 and hence:
<br /><i>T</i>1=6+2,
Correspondingly,
<br /><i>S</i><i>=S</i>0+Pred(<i>S</i>0)=3+6+2,
Upon iteration, we arrive at the equation:
<br /><i>T</i>(<i>N</i>+1)=<i>TN</i>+Pred(<i>TN</i>)
Correspondingly,
<br /><i>S</i>(<i>N</i>+1)=<i>SN</i>+Pred(<i>SN</i>)
These equations will be referred to as incremental enlargement equations. Note that S(N+1) is defined recursively.
A consequence of these equations uses annotation of states in S(N+1). This completes stratification of W. The idea may be described as “incremental enlargement target set”.
It will be helpful to briefly restate the procedure which stratifies W. With reference to Appendices 7-8, assume that the target set is in a corner of the state space W. Set S<b>0</b>=T0 with S0 being a stratum of W. Assume that we downgrade our objective by adding to T states which are near T (one-step away), but not necessarily in T. Such states are predecessors and successors of states in T0. Call the enlarged target set T1, then:
<br /><i>T</i>1<i>=T</i>0+Pred(<i>T</i>0),
since Succ(T0) is a subset of Pred(T0).
What this relation means is that we have incrementally enlarged T0 to T1. Iterating the process, we arrive at the basic equation:
<br /><i>T</i>(<i>N</i>+1)=<i>TN</i>+Pred(<i>TN</i>)
This equation is the basis for stratification of W. Every state in W in SN is annotated with an input sequence which leads from ω to w′. In this stratification, every state in W is assigned to a stratum and is annotated with an input sequence which transitions it to a state in S0+Pred(S0) in N or fewer steps.
A key application of stratification relates to reachability of the target set. It is easy to show that from any state in S(N+1), T is reachable in N+1 or fewer steps. Let w be a state in S(N+1), then w is a state in SN or in Pred(SN). If w is in SN, then T is reachable in N or fewer steps, if T can be reached in(N+1) or fewer steps. The incremental enlargement equations show that if w is an annotated state in SN, then it is trivially easy to find annotation, if w is in S(N+1), What this implies is the annotation of states in SN induces annotation of states in S(N+1). The strata in W maybe interpreted in terms of enlarged target sets.
It should be noted that stratification may be interpreted as a progressive incremental enlargement of the target state. Concretely, let TN=SN, and SN may be viewed as result of progressive incremental enlargement of S0. This completes stratification of W. it is of interest to observe that in the limit, as discreet-time equations become differential equations, the back-propagation of the target set through the state space becomes analogous to a flow of fluid through the state space with S(N+1) representing the wave front.
In summary, our approach to stratification (CST) is a promising direction in the analysis and design of complex large-scale systems in which the objects of computation are, or can be organized as, nested or stacked strata. The theory outline here can be extended in many directions. In one such direction, FSM is assumed to be a stochastic (probabilistic) system, in which case the reachability relation becomes a probability distribution. An important direction is one in which we have an array of FSMs which in combination perform deep computations and have a capability to do deep learning. An example is using stratification to construct a program to automate parking of a car. Another example relates to application of stratification to computation with the extension principle,
Please note that the following are some of the references useful/cited for the stratification section, above: (Please also see Appendices 7-8.)
1. “Nonlinear Multiobjective Optimization” by Kaisa Miettinen.
2. “Richard Bellman on the birth of dynamic programming” by Richard Bellman.
3. “Stratified logic programs” by Marek Sergot.
4. “Stratified Programming Integrated development environment (SPIDER)” by Sergiu Dascalu, Adrian Pasculescu, Josh Woolever, Eric Fritzinger, Vivek Sharan.
5. “Linear System Theory: The State Space Approach” by L. A. Ladeh and C. A. Desoer.
6. “A New Introduction to Modal Logic” by M. J. Cresswell, G. E. Hughes, Routledge.
7. “Introduction to AIgorithms” (1st ed.) by Cormen, Thomas, H. Leiserson, Charles E., Rivest, Ronald L. (1990). See in particular Section 26.2, “The FloydWarshall algorithm”, pp. 558-565 and Section 26.4, “A general framework for solving path problems in directed graphs”, pp. 570-576.
8. “Decision-making in a fuzzy environment” by E. Belk a and L. A. Zadeh.
9. “A note on Z-numbers” by Lotfi A. Zadeh.
10, “Optimal pursuit strategies in discrete-state probabilistic systems”, by L. A. Zadeh and I. H. Eaton.
11. “Fuzzy sets. Information and Control” by L. A. Zadeh.
12. “The concept of linguistic variable and its application to approximate reasoning-I” by L. A. Zadeh.
13. “Axiomatic Fuzzy Set Theory and Its Applications” by Xiaodong Liu and Witold Pedrycz.
Other embodiments & applications:
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 260</figref>, the extent of the connectivity between the visible units and higher units are limited (local extent). This helps reduce the number of parameters for better regularization. In one embodiment, the local extent may be uniform across the image or vary in size or shape. In one embodiment, the higher level cells may connect to the visible units via overlapping and/or non-overlapping local extent (fan-out). Similar limitation of local extent may be imposed between higher layers, as well.
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 261</figref>, the local extent is defined by a patch of visible units, for example in a rectangular, circular, or polygonal (e.g., hexagonal) form. In one embodiment, some patches may overlap and some patches may not overlap each other. In one embodiment, the pattern of the patch arrangements may be a regular of non-uniform across the image.
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 262</figref>, a portion or all of the visible layer/cells are divided to (overlapping and/or non-overlapping) patches, and a feature set {k<sub>1</sub>, . . . , k<sub>n</sub>} is used to drive the features from the cells/visible units from patches (e.g., patch i and j in <figref idref="DRAWINGS">FIG. 262</figref>). Such feature sets may include various functionalities, such as convolution, averaging, contrast, edge detection, color representation (e.g., based on DCT or other transformations). Each k in feature set may be multidimensional depending on the corresponding feature. In one embodiment, feature k may be a linear combination of the underlying cell attributes (e.g., color, or value) with a non-linear function (e.g., tanh or sigmoid) applied to the result. In one embodiment, some features may be deterministic and some features may be probabilistic (e.g., the resulting function determines the probability of the feature value (e.g., to be on/off)). In one embodiment, the weights and offsets (e.g., w<sub>i,k1</sub>, b<sub>i,k1</sub>) related to patch i and the feature set are represented by vectors, arrays, and/or tensors.
In one embodiment, the same feature sets having the same weights/biases are used for multiple patches (overlapping or non-overlapping). In such an embodiment, the total number of parameters (degrees of freedom) relating the visible units to the feature sets are reduced drastically which helps the regularization (i.e., avoids overfitting during the training) and provides translational invariance, i.e., learning a line piece in one patch implies learning it in other patches. In such an embodiment, a collection of such reusable features are treated as standard feature sets that may be applied to all sorts of input images, as they contain the basic image processing common to many types of images. In one embodiment, only a subset of features are evaluated at a given time for a given patch to conserve computational resources (e.g., CPU cycles and memory), based on other information or triggers. In one embodiment, upon automatic inference, more features are activated to get evaluated for a patch, e.g., where the inference module-'engine indicates that a feature is expected in or about the patch's location (e.g., with a probability above a threshold) or randomly selected based on an exploration mode.
In one embodiment, the features are further combined at higher layers for more complex (abstract) features. With increasing layers, the locality may be reduced due to fan-out. In one embodiment, at a level where the features are potentially linked to any/every visible unit, the subsequent levels are more fully connected (in contrast to sparse connections from the visible layer).
The localization of the concepts (e.g., circle, ellipse, line, or other free form geometries) from upper layers is achieved by driving down at each layer based on fan-out extent. For example, to determine potential intercept points of the circle and a line recognized at upper layers, a reconstruction along the fan-out cells are used to determine cells in common to both fan-outs. In driving down the layers, the concept would change from high level (e.g., circle) to arc/pieces to pixels in the visible layer.
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 263</figref>, the feature set may detect geometric features such as lines, arcs, segments, dash lines. In one embodiment, such a feature set may be used at various layers, where the lower layers have more limited coverage extend of the visible layer due to fan-out limitation. In one embodiment, feature sets (e.g., averaging) may be used in subsequent layers to effectively form a thumbnail at a higher layer. The similar feature sets (e.g., detecting geometrical shapes) would be used regardless of the scale reduction toward higher layers, to detect, for example, a small circle in a lower layer, and a larger circle at a higher layer. In one embodiment, use of various pre-learned or pre-defined feature sets helps with the regularization and reduces duplicity in learning features.
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 264</figref>, the feature detection occurs based on other features, e.g., via inference or pattern. For example, when a stroke or line is detected in one block or patch, the detection attributes would indicate a pattern or direction which is used, for example with other information, to infer which other patch(es) might contain this or other features. In one embodiment, features are sub-detected sequentially. In one embodiment, sub-features are detected in parallel from various existing sub-features. In one embodiment, the inference as to which portion/location/area of the image may have features is learned via known training samples, by learning the relationships (e.g., arrangements) between features.
In one embodiment, the range of weights, biases, and/or input values are granularized (e.g., using fuzzy sets) and the dot product is made based on fuzzy sets.
In one embodiment, an image patch is normalized, e.g., by getting average intensity/color and contrast/direction/DCT features of the patch.
In one embodiment, a kernel is used in feature detection/classification, with discrete values. In one embodiment, input values of the training samples (and/or weights/biases) use discrete values. In one embodiment, discrete values are in {−1, 0, +1}. In one embodiment, a (proximity) kernel is defined as ⊕(x<sub>i </sub>⊗y<sub>i</sub>), where (x<sub>i </sub>⊗y<sub>i</sub>) is defined as +1 when x<sub>i</sub>=y<sub>i</sub>; −1 when x<sub>i</sub>=y<sub>i </sub>and x<sub>i</sub>≠0;and 0 otherwise; and where ⊕( . . . ) is defined as in various forms, such as +1 when none of the constituents is −1 and majority of constituents are +1 (or their summation is above a threshold value); 0 when none of the constituents is −1 and majority of constituents are 0;and −1 otherwise.
In one embodiment, the learning process of the learning machine uses a statistical approach to hypothesis parameters by keeping track of those values over time during fitting the data fitting, with more weight given to those parameters occurring more often.
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 265</figref>, the patches and/or unit coverage with a patch are arranged in a radial fashion. In one embodiment, the feature detectors for connected to the patches or the units are restricted to have their weights follow the symmetry (e.g., either be the same or correlated at different angles), so that once the detector learns a feature in an image, it would be able to detect same feature rotated at a somewhat different angle.
In one embodiment, the dot products and non-linear functions used for neural cells are implemented via electronics, e.g., using a circuit depicted in <figref idref="DRAWINGS">FIG. 266</figref>. Other variations of the circuit or its equivalents may be used. Weights (including the bias) are input to gates of the transistors to modulate the current. At low voltage (on x<sub>i </sub>side), the current is approximately linear with x<sub>i </sub>and dependent of the transconductance (which depends on the gate voltage). The current in the transistor can be made proportional to both x<sub>i </sub>and w<sub>i </sub>(or inverse thereof). The operational amplifier in negative feedback creates a virtual ground that forces the sum of the currents of the input transistors to pass through one of the clamping diodes (depending on the direction) by adjusting the output of the operational amplifier. The output voltage follows back-to-back inverted turn-on diode characteristics that resemble sigmoid or step functions. In one embodiment, the weights are provided to the circuit using a programmable device (e.g., FPGA), memory device (with connected paths to transistors), ASIC, buffers, and/or serial input.
In one embodiment, an ad network uses image recognition platform to match on-line images (e.g., on a publisher's webpage, posting, message, email, or a Tweet) to one or more visual items (or attributes derived from visual items) such as merchants/advertisers' catalog items. In one embodiment, (a) publisher and/or merchant/advertiser aggregators are used to scale the system to reach more merchants and publishers, (b) the system uses consistent and fewer interfaces, (c) the system reuses the image-based ads for webpages/images that are shared, pinned (e.g., in content aggregators such as Pinterest), or tagged/liked (e.g., in social networks, such as Facebook), or contain identical images (e.g., based on hash/block signature assigned to crawled images), in order to create a multiplier effect on the ad reach and revenue generation, and/or (d) relevant image-based ads (e.g., on social network applications such as Facebook wall/timeline next to a friend's liked image, pinned/tagged images, e.g., as in Pinterest, or shared images or webpages) are significantly more rewarding and much less annoying alternative to irrelevant native ads, on a desktop or mobile settings.
One embodiment uses a deep/detailed level cognitive approach for recognition, in contrast to traditional approaches that (a) have many training samples only to learn what to ignore (e.g., a flower decoration on vamp of the shoe) (b) provide results in generic classification and identification of objects, and (c) treat the whole image as only one object with many parts/attributes. In one embodiment, a deep cognitive approach uses a learnable recursive inference approach to treat objects as flexible collection of features (components) and the learning encompasses the components relationships in a model layer. In one embodiment, the learning continues when unexpected or one-off components are encountered. In one embodiment, far less number of training samples is required to recognize complex objects (where in some instances, there may not even be enough training samples for conventional methods when object's loose component variation increases). In one embodiment, the untying of the learning of loose components and their arrangements, require less number of training samples, and it provides flexibility in learning/recognizing the integration arrangements of various components and features for making inference about where/what features may be found in the input data (e.g., image).
In one embodiment, as for example depicted in <figref idref="DRAWINGS">FIG. 267</figref>, a recursive approach is used to build knowledge from data (e.g., image, voice, video, text). In one embodiment, the data (e.g., image) is further explored based on the prior knowledge (e.g., is that a glove or a hand? Does the color match the face?). In one embodiment, expected features are confirmed and more refined features are extracted. In one embodiment, unexpected features are learned, and may be later used as particular search term (e.g., a narrow red band on the heel cap). In one embodiment, recurring features are re-prioritized in the recursive recognition. In one embodiment, the system learns to infer or learns to search for features, e.g., based on detection of known features (e.g., in training samples or previously detected features), learn effective discovery process/rules (e.g., as in learning the rules of a game by simulating the games) and optimizing based on cost of success (finding feature) and failure (not finding feature) (e.g., based on CPU usage or memory requirement). The learning will capture the patterns of the relationships between the components of the objects and the inference follows the spatial relationships of the components (e.g., probabilistically or by generation or reconstruction of the phantom samples, for example, by clamping the visual and/or hidden layer(s) to the found feature; or e.g., by executing captured rules). For example, a person's head or a hand in an image leads to body and infers orientation of the body (parts). In one embodiment, the search for features uses stochastic approach, so that the search has a chance to stumble upon unexpected features and/or have a coverage of the data (e.g., image).
In one embodiment, functional attributes/features can be targeted and learned. For example, consider a shoe object. Different shoe styles have various (common/uncommon) attributes or components (e.g., sole, platform, vamp). What makes a shoe “a shoe” is various (flexible) combinations of such components & attributes in particular or fuzzy arrangements. Designer shoes have their own attributes, e.g.: red band at the sole, flower decoration on toe box, fluffy decoration on the counter, logo on the outer side. In one embodiment, such combinations, arrangements, and relationships are learned, and the learned relationships are used as predictor of features and their locations/arrangements in presence or absence of other features, e.g., shape/geometry, relative position, hidden surfaces/coverage. Functional abstraction is an attribute at the high level, e.g., vamp extends platform to cover front of foot.
One embodiment uses predictive feature detection. In one embodiment, the inference module predicts where the features might be based on the initial recognition. This approach provides feature discovery in exploratory/recursive/iterative manner. In one embodiment, the approach takes a coarse to fine window/field of focus (including finer effective pixel size) to get (or confirm) additional fine features, e.g., based on initial confirmation. In one embodiment, detecting one feature leads to other features via inference module. In one embodiment, when detection fails to confirm the presence of the expected or inferred feature, a detection module captures the new or one-off feature(s) for later classification, or the inference module adjusts initial recognition assumptions. (Note that the one-off features are those that happen rarely or not-often on the object, e.g., a special shape ribbon on a shoe, for decoration, which happens very rarely, and thus, it is hard or impossible to get trained for that, with the other methods of AI, available today in the industry.)
One embodiment uses soft classification for training, based on soft similarities and soft dissimilarities, e.g., by using soft class boundaries. In one embodiment, interest points/locations are used in training to learn spatial features/relations and to provide anchors for further exploration of features. In one embodiment, such interest points are used to learn 3D model of the object from multiple image of the same or similar object from various perspective. In one embodiment, hidden features/points/surfaces are learned in the model layer.
One embodiment uses progressive feature selection and prioritization. In one embodiment, the feature selection and prioritization are used for efficiency, e.g., the detection looks for hands first or faces first, or run parallel, and then it looks for other body parts. In one embodiment, the priority and selection of features are learned or determined, e.g., based on strong correlations and frequency of features, e.g., in training samples and/or later detected input data. In one embodiment, some of one-off features are gradually categorized as common features, e.g., based on occurrences and/or cost functions, e.g., in one embodiment, it is less costly to look for common features before others (as strong predictors of other features).
In one embodiment, a fuzzy match between features is used during search. For example, consider features indicating narrow red band on high heel. “Red” may be matched with reddish, and fuzzy attributes such as “Narrow”, “wide”, “high”. “short” would be relative to other features and to the same feature present in other images.
Recursive Inference:
In one embodiment, a recursive inference module uses patterns of the features detected to predict the potential location/existence (and their likelihood) of other features. One embodiment uses a recursive inference to feed the model layer with data from the same data/image (or sequence of images as in a video) to look for other expected features to confirm and fine tune the model or discover new and/or unexpected features (e.g., a decorative flower on the vamp of the shoe). One embodiment uses component level approach to determine the similarity measure of data/images for search at the image level, at the component level, or both. Such component level approach enables fast search at the component level. One embodiment uses simultaneously search for a mix of features derived from multiple datasets (e.g., images). For example, the user can search for a shoe having a high heel similar to the shoe in one image, toe cap similar to a shoe in another image, and a flower decoration similar to a shoe in yet another image. In one embodiment, by untying the learning of loose components and their arrangements, the training requires less number of training samples, and it provides flexibility in learning/recognizing the integration arrangements of various components and features for making inference. One embodiment uses component masking between recursive feature detections which makes the later fine feature detection more efficient and accurate both in terms of learning and recognition. In one embodiment, a new object representation may be conceived and searched by new combinations of features the user may specify via a user interface, e.g., a shoe with a red band on its sole (like shoe # 1) and decorative flower on its vamp (like shoe # 2)
Highly Integrated Components:
Some object categories have “highly integrated components” (e.g., in face recognition for frontal (naked) face). In such an example, visual attributes (nose, eyes, lips, chin, etc.) are always present and tightly integrated together. Such categories of objects may be learned and recognized in one-go (i.e., by capturing the highly integrated pattern of arrangement along with the components in one-go). However, in the other extreme, for example, a scene from a street (with people and objects loosely integrated with respect to each other) would be difficult to learn or be recognized using such one-go approach, because it would require an very large number of training samples and very deep (many layered) neural network, based on traditional methods, which would also be hard to converge (i.e., impossible or hard to learn in one shot due to loose patterns, sparsity, and one-off situations). In practice, various complex objects (e.g., shoe, or faces with hats/beards/glasses) fall somewhere in between in the spectrum of Integration Flexibility. In one embodiment, the recursive inference approach takes advantage of the integration flexibility and provides more efficient and accurate recognition and search. Please see the next section below/Table for more details.
Please note that in our approach here, for this embodiment/context, the “Deep Level” or “Deep Learning” refers to the “detailed” discovery/recognition/learning for an object or image.
Comparison with Traditional/Current/Conventional/Current State-of-the-Art Approaches/Methods/Systems/Algorithms:
As discussed/shown in the other parts of this disclosure, our ZAC General-AI Platform is superior to other methods/the current state-of-the-art approaches, for many reasons, as shown and discussed in details in Table 1, below.
This can be for any kind of data, not just image. The ZAC AI platform is horizontal, feeding the vertical applications, e.g., for image recognition, e.g., for clothing, shoe, bag, face, biometrics, satellite, aerial, building, structures, landmarks (artificial or natural), or medical, for end-users for, e.g., image referral network, image ad network, searchable images and videos, mobile and wearable devices, smart cameras and phones, social network, tracking and monitoring, analytics, security and intelligence, dating sites, location services, maps, tourism, real estate, electronic medical records, diagnostic tools, fraud detection, e.g., for blockchain and banking, or the like.
ZAC method is superior in any situation, however, it is especially more useful for situations with loose integration or high Features Integration Flexibility Value, e.g., street scene, with many actors and various objects, always changing, thus, impossible to learn with the current/conventional methods (versus, e.g., human face, frontal view, no cover, which always has 2 eyes, one nose, and one mouth, at almost/roughly the same places for all humans, which is a more tightly/fixed/constant integrated object/system, with respect to and for its components).
Note that we coined and introduced the parameter/concept/metrics for “Features Integration Flexibility (value)” or “Component Integration Flexibility Scale/Axis/Metrics/Value” or “Integration Flexibility” a few years ago, in our parent cases, to quantify/described/tackle/distinguish such a situation/condition. It can be expressed as a percentage, membership value between 0 to 1, fuzzy parameter, such as High and Low, scaled/normalized number between 0 to 100, or in any other scale. It also indicates the degree of freedom or randomness/choices/options available for the objects and their components, or locations, in absolute/relative terms/coordinates, or with respect to each other.
<figref idref="DRAWINGS">FIG. 269</figref> shows an example of state-of-the-art learning system by others, in industry or academia, to show their limitations, e.g., for frozen/fixed weights and biases, after the training phase. <figref idref="DRAWINGS">FIG. 270</figref> shows an example of state-of-the-art learning system by others, in industry or academia, to show their limitations, e.g., for frozen/fixed weights and biases, after the training phase.
<figref idref="DRAWINGS">FIG. 271</figref> shows an embodiment for ZAC Learning and Recognition Platform, using Inference Layer, Reasoning Layer, and Cognition Layer, recursively, for our General-AI method, with dynamic and changing parameters in the learning machine (in contrast to the machines by others), which enables the Simultaneous/Continuous Learning and Recognition Process (as we call it “SCLRP”), similar to humans. This is a major shift in learning technology/science/process, with a quantum leap improvement, which means that there is no need to re-train from scratch, or erase the whole learning machine weights and biases to re-train the system with the new objects/classes (in contrast to the machines by others), similar to humans. (The details of components are shown and. described elsewhere in this disclosure.)
<figref idref="DRAWINGS">FIG. 272</figref> shows an embodiment for ZAC Learning and Recognition Platform, using Inference Layer, Reasoning Layer, and Cognition Layer, for our General-AI method, with knowledge base and cumulative learning, for new classes of objects, with interaction with multiple (G) modules (e.g., 3), which is scalable, with detailed learning, with each module learning a feature specific to/specialized for that module.
There are multiple methods to set the parameter(s) used in the module from outside: One is using a feedback method, such as the conventional back propagation method used in the conventional neural networks, or using derivatives for contribution of changes from each node to the next layer. The other method is to change the portion corresponding to that parameter in the module, by replacing it with that set value(s). This can be done permanently in one embodiment. Or, it can be done temporarily, in another embodiment. That is, in the last case, it can be changed again in the next round of correction or learning batch or samples. Another method is to isolate that portion of the module and bypass that portion for any future training or cycle, and just put that set value(s) as a placeholder there, in that position. In case the parameter is an input to the module, the modification is much easier, i.e., just change the input value(s) for those involved for that module.
In the case of neural networks, one can also use another method: One can change the layers horizontally, by setting the weights and biases, for a layer or part of a layer of that neural network, to result in that set parameter locally, using feedback or back propagation or using derivatives for contribution of changes from each node to the next layer.
<figref idref="DRAWINGS">FIG. 273</figref> shows an embodiment for ZAC Learning and Recognition Platform, using Inference Layer, Reasoning Layer, and Cognition Layer, for our General-AI method, with the details, including inference engine, Reasoning engine, and Cognition engine, and their corresponding databases for storage/updates. <figref idref="DRAWINGS">FIG. 274</figref> shows an embodiment for ZAC Learning and Recognition Platform, using Inference engine, with an example of how it works, for our General-AI method.
<figref idref="DRAWINGS">FIG. 275</figref> shows an embodiment for ZAC Learning and Recognition Platform, using Reasoning engine and Cognition engine, with an example of how it works, for our General-AI method. <figref idref="DRAWINGS">FIG. 276</figref> shows an embodiment for ZAC Learning and Recognition Platform, using expressions used for modules, e.g., based on logical expressions, e.g., for Inference engine, Reasoning engine, and Cognition engine, for our General-AI method.
<figref idref="DRAWINGS">FIG. 277</figref> shows an embodiment for ZAC Learning and Recognition Platform, using Inference engine, Reasoning engine, and Cognition engine, with a controller and a central processor, for our General-AI method. <figref idref="DRAWINGS">FIG. 278</figref> shows an embodiment for ZAC Learning and Recognition Platform, for our General-AI method, working with the stratification module and Z-Web, e.g., for image recognition, e.g., of 3-D objects, from any direction, in 3-D, e.g., shoes.
<figref idref="DRAWINGS">FIG. 279</figref> shows an embodiment for ZAC Learning and Recognition Platform, for our General-AI method, working with the Information Principle module and Z-Web, e.g., for image recognition. <figref idref="DRAWINGS">FIG. 280</figref> shows an embodiment for ZAC Learning and Recognition Platform, for our General-AI method, working with the Information module and Z-Web, e.g., for image recognition.
<figref idref="DRAWINGS">FIG. 281</figref> shows an embodiment/example for Restriction, used for Information Principle module. <figref idref="DRAWINGS">FIG. 282</figref> shows an embodiment for ZAC Learning and Recognition Platform, for our General-AI method, working with the Information module and Z-Web, e.g., for image recognition.
<figref idref="DRAWINGS">FIG. 284</figref> shows an embodiment for various applications and vertical usages for our/ZAC General-AI platform. <figref idref="DRAWINGS">FIG. 285</figref> shows an embodiment for cognition layer for complex combined data for our/ZAC General-AI platform. <figref idref="DRAWINGS">FIG. 286</figref> shows an embodiment for cognition layer for complex combined data for our/ZAC General-AI platform. <figref idref="DRAWINGS">FIG. 287</figref> shows an embodiment for cognition layer for complex combined data for our/ZAC General-AI platform.
<figref idref="DRAWINGS">FIG. 288</figref> shows an embodiment for cognition layer for complex combined data for our/ZAC Explainable-AI system and its components/modules/devices, as one type or example for such a system. <figref idref="DRAWINGS">FIG. 289</figref> shows an embodiment for our/ZAC AI Platform/system and its components/modules/de vices, as one type or example. <figref idref="DRAWINGS">FIG. 290</figref> shows an embodiment for our/ZAC cross-domain system and its components/modules/devices, as one type or example.
<figref idref="DRAWINGS">FIG. 291</figref> shows an embodiment for our/ZAC generalization system and its components/modules/devices, as one type or example. <figref idref="DRAWINGS">FIG. 292</figref> shows an embodiment for our/ZAC generalization/abstraction system and its components/modules/devices, as one type or example. <figref idref="DRAWINGS">FIG. 293</figref> shows an embodiment for our/ZAC intelligent tracking system and its components/modules/devices, as one type or example. <figref idref="DRAWINGS">FIG. 294</figref> shows an embodiment for cognition layer for complex combined data for our/ZAC Explainable-AI system and its components/modules/devices, as one type or example for such a system.
<figref idref="DRAWINGS">FIG. 295</figref> shows an embodiment for cognition layer for complex combined data for our/ZAC Explainable-AI system and its components/modules/devices, as one type or example for such a system. <figref idref="DRAWINGS">FIG. 296</figref> shows an embodiment for cognition layer for complex combined data for our/ZAC Explainable-AI system and its components/modules/devices, as one type or example for such a system. <figref idref="DRAWINGS">FIG. 297</figref> shows an embodiment for cognition layer for complex hybrid data for our/ZAC Explainable-AI (or XAI or X-AI) system and its components/modules/devices, as one type or example for such a system, which is a component of ZAC General-AI (or GAI) Platform.
Please note that we need much fewer number of training samples, e.g., 100 samples or less, instead of 100,000 or 1,000,000 samples, i.e., a few orders of magnitude less training samples, which is the Holy-Grail of the ML, AI, and image recognition. In addition, it can learn complex environments with high dimensionality, and can go to small features/details and one-offs or unexpected situations or patterns, which has not even seen before, in training samples, using cognition layer, as explained here in this disclosure. ZAC is much superior to Deep CNN or ResNet or Transfer-Learning (which is a “band-aid”, but cannot solve the problem of ML/AI, and cannot generalize or understand concepts or do cross-domain learning/training) or the like/their variations, used by all universities and companies/industry, right now (their current state-of-the-art).
We also need much less battery, CPU/GPU, footprint/weight/size, and computation/training time, which is a side benefit, but extremely important and practical for various applications, e.g., for mobile or for battery usage.
Please note that recently some companies/people still use NN and CNN and incorrectly call it “Explainable-AI”. However, NN is purely statistical, and they, e.g., try to filter or clean or modify the training samples for that purpose, which may bias the training, which is not a good practice, anyway. So, their “Explainable-AI” is not the same as ours, because theirs do not really explain the recognition process (internally), as to, e.g., why a car is a “car”, or a shoe is a “shoe”, or an open toe shoe is an “open toe shoe”, for various objects and concepts. So, theirs is not really an Explainable-AI.
We are the first group/researcher in the world that applied/devised General-AI and Explainable-AI algorithms/working software to ML (machine learning), as was also shown in our prior applications/patents and our prior software/demos, which is superior to NN and its variations. (Generally, everybody else is still using NN, CNN, or a variation of that.)
Please also see Appendices 1-5, 6-10, 11-13, and 14, for more details and descriptions, as well as demo/softwares results (and advantages over CNN or ResNet), for General-AI and Explainable-AI.
An example of Explainable-AI method/system is given here:
A method for image recognition in an image or video recognition platform, with explainability, said method comprising: an interface receiving an image; said interface sending said image to a first analyzer and a second analyzer; said first analyzer obtaining a first data from said image; said second analyzer obtaining a second data from said image; wherein said first data is a complex hybrid data; wherein said first data is different type of data than said second data.
A first processor combining said first data from said first analyzer and said second data from said second analyzer; a second processor receiving said combined said first data and said second data from said first processor; said second processor analyzing contradiction and uncertainty in said combined said first data and said second data; said second processor sending said contradiction and uncertainty analysis to a cognition layer device; said cognition layer device communicating with a search engine for images; said search engine for images communicating with a first database for images; said search engine for images communicating with a second database for non-images; said search engine for images receiving said contradiction and uncertainty analysis from said cognition layer device.
The search engine for images receiving said first data and said second data; said search engine for images searching within said first database for images; said search engine for images searching within said second database for non-images; said search engine for images combining said search within said first database for images with said search within said second database for non-images; based on said contradiction and uncertainty analysis and said first data and said second data, said search engine for images Obtaining a match for said image; said search engine for images outputting said match for said image.
Other options and variations and usages are: <ul id="ul0113" list-style="none"><li id="ul0113-0001" num="0000"><ul id="ul0114" list-style="none"><li id="ul0114-0001" num="3341">said image is a still image.</li><li id="ul0114-0002" num="3342">said image is a frame of a video.</li><li id="ul0114-0003" num="3343">said image is a portion of a frame of a video.</li><li id="ul0114-0004" num="3344">said image or video recognition platform is for intelligent tracking of objects.</li><li id="ul0114-0005" num="3345">said image or video recognition platform is for intelligent tracking of humans.</li><li id="ul0114-0006" num="3346">said image or video recognition platform is on a video camera.</li><li id="ul0114-0007" num="3347">said image or video recognition platform is on an autonomous vehicle.</li><li id="ul0114-0008" num="3348">said image or video recognition platform is on a drone, airplane, or satellite.</li><li id="ul0114-0009" num="3349">said image or video recognition platform is on a boat or submarine vehicle.</li><li id="ul0114-0010" num="3350">said image or video recognition platform is at the airport.</li><li id="ul0114-0011" num="3351">said image is related to face.</li><li id="ul0114-0012" num="3352">said image is related to biometrics.</li><li id="ul0114-0013" num="3353">said image or video recognition platform is a part of a navigation system of a vehicle or drone.</li><li id="ul0114-0014" num="3354">said image or video recognition platform is connected to a UPS or coordinate analysis system.</li><li id="ul0114-0015" num="3355">said image or video recognition platform is a part of a multi-camera system.</li><li id="ul0114-0016" num="3356">communicating with an inference engine.</li><li id="ul0114-0017" num="3357">communicating with a logic engine.</li><li id="ul0114-0018" num="3358">communicating with an outside knowledge base.</li></ul></li></ul>
combining image, video, voice, sound, numeral, and text data.
Table 1. Comparison of an embodiment of our invention (ZAC General-All Platform) (our technologies/methods/systems, taught in this disclosure) (e.g., for image search/recognition) with other/current state-of-the-art methods/approaches:
<tables id="TABLE-US-00006" num="00006"><table frame="none" colsep="0" rowsep="0" pgwide="1"><tgroup align="left" colsep="0" rowsep="0" cols="3"><colspec colname="1" colwidth="70pt" align="left" /><colspec colname="2" colwidth="84pt" align="left" /><colspec colname="3" colwidth="105pt" align="left" /><thead><row><entry namest="1" nameend="3" align="center" rowsep="1" /></row><row><entry /><entry>Recursive Inference</entry><entry /></row><row><entry>Characteristic/</entry><entry>Deep/Detailed Level</entry><entry /></row><row><entry>parameter(s)/</entry><entry>Approach (ours) (ZAC)</entry><entry>Other Learning</entry></row><row><entry>issue(s)/goal(s)</entry><entry>(RIDL method)</entry><entry>Approaches (by others)</entry></row><row><entry namest="1" nameend="3" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry>Image/data size</entry><entry>Can be large</entry><entry>Limited to small size due to</entry></row><row><entry /><entry /><entry>limited 1<sup>st </sup>layer visible units </entry></row><row><entry /><entry /><entry>set prior to learning</entry></row><row><entry>Image/data </entry><entry>Can learn to find features</entry><entry>The features in the images are</entry></row><row><entry>isolation</entry><entry /><entry>required to be isolated to begin</entry></row><row><entry /><entry /><entry>with, e.g., with features </entry></row><row><entry /><entry /><entry>restricted to occupy good fraction </entry></row><row><entry /><entry /><entry>of the image (e.g., at least 1/3)</entry></row><row><entry>Fine features</entry><entry>Can be detected during </entry><entry>Ignored completely, as not being</entry></row><row><entry /><entry>recursion</entry><entry>a principal feature. (This is the</entry></row><row><entry /><entry /><entry>theoretical limitation of this</entry></row><row><entry /><entry /><entry>approach.)</entry></row><row><entry>Detection Level</entry><entry>Fine & detailed down to</entry><entry>Generic categorization, at the </entry></row><row><entry /><entry>components</entry><entry>best (if possible, in the first place)</entry></row><row><entry /><entry /><entry>(This is the theoretical limitation</entry></row><row><entry /><entry /><entry>of this approach.)</entry></row><row><entry>Component</entry><entry>Scalable and flexible</entry><entry>Not scalable or flexible. (This is</entry></row><row><entry>integration </entry><entry /><entry>the theoretical limitation of this</entry></row><row><entry>flexibility</entry><entry /><entry>approach.)</entry></row><row><entry>Training </entry><entry>Mix of training of </entry><entry>Training in one-go requires far</entry></row><row><entry>approach</entry><entry>components for feature </entry><entry>more training samples (even if</entry></row><row><entry /><entry>detectors and training of </entry><entry>possible at all, to learn more</entry></row><row><entry /><entry>the integration arrangement </entry><entry>loosely arranged components)</entry></row><row><entry /><entry>for inference</entry><entry>(This is the theoretical limitation</entry></row><row><entry /><entry /><entry>of this approach.)</entry></row><row><entry>Learning </entry><entry>Guided by inference & </entry><entry>Impossible. Requires full</entry></row><row><entry>additional/</entry><entry>reasoning & cognition </entry><entry>retraining of everything (i.e., old</entry></row><row><entry>unexpected/new </entry><entry>layers/engines</entry><entry>and new features), as the weights</entry></row><row><entry>features/one-offs</entry><entry /><entry>and parameters all have to be</entry></row><row><entry /><entry /><entry>changed/re-done again from</entry></row><row><entry /><entry /><entry>scratch. (This is the theoretical</entry></row><row><entry /><entry /><entry>limitation of this approach.)</entry></row><row><entry>Size/number of</entry><entry>Limited number of samples </entry><entry>Much larger training samples</entry></row><row><entry>training samples</entry><entry>would be enough to deal </entry><entry>needed, to deal with more loosely</entry></row><row><entry /><entry>with components and their</entry><entry>integrated or flexible components</entry></row><row><entry /><entry>arrangements.</entry><entry>(usually impossible or</entry></row><row><entry /><entry /><entry>impractical) (with no guarantee</entry></row><row><entry /><entry /><entry>that training may even be</entry></row><row><entry /><entry /><entry>successful) (for most cases, the</entry></row><row><entry /><entry /><entry>training does not converge at all,</entry></row><row><entry /><entry /><entry>e.g., in 3D image/object</entry></row><row><entry /><entry /><entry>recognition from any direction,</entry></row><row><entry /><entry /><entry>due to large number of parameters</entry></row><row><entry /><entry /><entry>and degrees of freedom, or due to</entry></row><row><entry /><entry /><entry>large value of dimensionality of</entry></row><row><entry /><entry /><entry>feature space) (This is the</entry></row><row><entry /><entry /><entry>theoretical limitation of this</entry></row><row><entry /><entry /><entry>approach.)</entry></row><row><entry>Training/recognition </entry><entry>Less expensive, with less </entry><entry>More expensive, with more</entry></row><row><entry>cost for complex</entry><entry>number of calculations. </entry><entry>calculations required, for more</entry></row><row><entry>objects</entry><entry>Learning of flexible or </entry><entry>layers of hardwire/hardware, or</entry></row><row><entry /><entry>loosely-integrated </entry><entry>for Neural Nets, with more</entry></row><row><entry /><entry>components or concepts </entry><entry>training samples.</entry></row><row><entry /><entry>may also be separately</entry><entry>It is even more likely to oveifit</entry></row><row><entry /><entry>done/optimized.</entry><entry>the data with excessive number of</entry></row><row><entry /><entry /><entry>parameters (i.e., not learning the</entry></row><row><entry /><entry /><entry>patterns, but memorizing the</entry></row><row><entry /><entry /><entry>training samples).</entry></row><row><entry>Accuracy</entry><entry>Very high</entry><entry>Low (or no recognition at all for</entry></row><row><entry /><entry /><entry>most cases) or recognition at</entry></row><row><entry /><entry /><entry>generic level, only, with no</entry></row><row><entry /><entry /><entry>details)</entry></row><row><entry>A1 method</entry><entry>Based on General-AI, with</entry><entry>Based on Specific-AI (This is the</entry></row><row><entry /><entry>reasoning and cognition </entry><entry>theoretical limitation of this</entry></row><row><entry /><entry>layers added to the learning </entry><entry>approach, as discussed elsewhere</entry></row><row><entry /><entry>layer/engine (the same way </entry><entry>in this disclosure.)</entry></row><row><entry /><entry>humans learn/recognize the</entry><entry /></row><row><entry /><entry>patterns/objects)</entry><entry /></row><row><entry>Efficiency</entry><entry>Very high</entry><entry>Low (or no recognition at all for</entry></row><row><entry /><entry /><entry>most cases)</entry></row><row><entry>CPU/GPU</entry><entry>Low</entry><entry>Very high</entry></row><row><entry>requirements</entry><entry /><entry /></row><row><entry>Maintenance </entry><entry>Low</entry><entry>Very high</entry></row><row><entry>cost for hardware</entry><entry /><entry /></row><row><entry>Battery/energy</entry><entry>Low</entry><entry>Very high</entry></row><row><entry>requirements/</entry><entry /><entry /></row><row><entry>usage/cost</entry><entry /><entry /></row><row><entry>Miniaturization </entry><entry>Possible</entry><entry>Very hard or impossible or not</entry></row><row><entry>for mobile </entry><entry /><entry>practical</entry></row><row><entry>devices or IoTs </entry><entry /><entry /></row><row><entry>or telephones or </entry><entry /><entry /></row><row><entry>others</entry><entry /><entry /></row><row><entry>Training time, to</entry><entry>Low</entry><entry>Very high</entry></row><row><entry>learn</entry><entry /><entry /></row><row><entry>Time to gather</entry><entry>Low</entry><entry>Very high</entry></row><row><entry>training samples</entry><entry /><entry /></row><row><entry>Flexibility for</entry><entry>Very flexible, based on </entry><entry>Not flexible at all (This is the</entry></row><row><entry>learning/</entry><entry>General-AI</entry><entry>theoretical limitation of this</entry></row><row><entry>recognition</entry><entry /><entry>approach.)</entry></row><row><entry>Re-use knowledge </entry><entry>Yes, based on General-AI</entry><entry>None (This is the theoretical</entry></row><row><entry>or experience or </entry><entry /><entry>limitation of this approach.)</entry></row><row><entry>objects or concepts </entry><entry /><entry /></row><row><entry>or relationships or </entry><entry /><entry /></row><row><entry>logic</entry><entry /><entry /></row><row><entry>Modularity for </entry><entry>Yes, based on General-AI</entry><entry>None (This is the theoretical</entry></row><row><entry>both learning and</entry><entry /><entry>limitation of this approach.)</entry></row><row><entry>recognition</entry><entry /><entry /></row><row><entry>Scalability for </entry><entry>Yes, based on General-AI</entry><entry>None (This is the theoretical</entry></row><row><entry>both learning and</entry><entry /><entry>limitation of this approach.)</entry></row><row><entry>recognition</entry><entry /><entry /></row><row><entry>Reasoning &</entry><entry>Yes, based on General-AI</entry><entry>None (This is the theoretical</entry></row><row><entry>cognition &</entry><entry /><entry>limitation of this approach.)</entry></row><row><entry>inference</entry><entry /><entry /></row><row><entry>Handling/</entry><entry>Yes, based on General-AI</entry><entry>None (This is the theoretical</entry></row><row><entry>recognizing new </entry><entry /><entry>limitation of this approach.)</entry></row><row><entry>classes or objects </entry><entry /><entry /></row><row><entry>or species or</entry><entry /><entry /></row><row><entry>concepts</entry><entry /><entry /></row><row><entry>Self-taught </entry><entry>Yes, based on General-AI</entry><entry>None (This is the theoretical</entry></row><row><entry>capability for new </entry><entry /><entry>limitation of this approach.)</entry></row><row><entry>concepts</entry><entry /><entry /></row><row><entry>Discover new</entry><entry>Yes, based on General-AI</entry><entry>None (This is the theoretical</entry></row><row><entry>concepts on its </entry><entry /><entry>limitation of this approach.)</entry></row><row><entry>own, without </entry><entry /><entry /></row><row><entry>training beforehand</entry><entry /><entry /></row><row><entry>Self-diagnosis &</entry><entry>Yes, based on General-AI</entry><entry>None (This is the theoretical</entry></row><row><entry>self-repair </entry><entry /><entry>limitation of this approach.)</entry></row><row><entry>capability, for </entry><entry /><entry /></row><row><entry>robots or software</entry><entry /><entry /></row><row><entry>Continuous </entry><entry>Yes, based on General-AI</entry><entry>None (This is the theoretical</entry></row><row><entry>learning</entry><entry /><entry>limitation of this approach.)</entry></row><row><entry>Simultaneous</entry><entry>Yes, based on General-AI</entry><entry>None (This is the theoretical</entry></row><row><entry>learning &</entry><entry /><entry>limitation of this approach.)</entry></row><row><entry>recognition, at the</entry><entry /><entry /></row><row><entry>same time</entry><entry /><entry /></row><row><entry>Cumulative </entry><entry>Yes, based on General-AI</entry><entry>None (This is the theoretical</entry></row><row><entry>learning</entry><entry /><entry>limitation of this approach.)</entry></row><row><entry namest="1" nameend="3" align="center" rowsep="1" /></row></tbody></tgroup></table></tables>
Verification for Ad Networks:
For one embodiment, for verification of Ad Networks, e.g., company A has an image ad network, where company A wants to deter the cheaters (who do not want to pay the percentages and fees, based on prior agreement), and company A tells them in advance that: we can put some dummy unknown websites (i.e., unknown to public or merchants), that company A owns, so that if a merchant, in violation of their agreement, tries to reuse company A's data, without paying company A, then company A can detect the cheatings, from those dummy unknown websites that company A owns, which can be proven using the hits they have got on the dummy websites. This is an important feature for verification and authentication process, to discourage the would-be cheaters, for better management of the Ad networks, for fair distribution of the revenue, based on agreed contracts and agreements/rates/percentages.
Fast Signature Recognition/Match (but NOT an Image/Object Recognition):
For one embodiment, e.g., we divide the image in (m X n) blocks, e.g., 10 by 8 blocks, and get the signature(s) of each block, such as color histogram or distribution or intensity or range or max or min, or density of lines detected, or frequency analysis (such as Fourier domain or DCT (discrete cosine transform)), to get one or more values, parameters, sets of numbers, or patterns, to compare or match or classify or cluster different images, based on the signature(s), for each block or totality of all blocks or average of blocks or weighted average of blocks or random or semi-random average of blocks or set of blocks or majority of the blocks or the best blocks or closest blocks (in terms of similarity measure and/or location), or top nearest blocks or summation of all blocks or total of all blocks or all blocks minus outliers (in terms of similarity measure, being off-the-wall or very different), or probability distribution of signatures or middle of distribution selection (as we call this “block signature comparison” or “BSC” technique).
This is a fast/efficient signature recognition/match (but NOT an image/object recognition). However, it can be used in conjunction with our much more powerful ZAC Platform for image/pattern recognition, to supplement that, for the 1<sup>st </sup>line of defense or filtering, e.g., to remove a lot of garbage data, without employing a much more powerful ZAC Platform, which can be used for more detailed analysis and actual image/pattern recognition, instead.
This can be based on metrics for various definitions of distances and differences, such as exponential or exp(x1-x2) type kernels, or Euclidean distances or √Sum(x1-x2)<sup>2 </sup>or Sum(x1-x2)<sup>2 </sup>or Absolute(x1-x2) type kernels. We may have different thresholds for comparisons for matching purposes, for differences between the parameters, values, or pixels. This can be based on hash functions or value(s), as very fast comparison, as the 1st step, and then, continue with more depth and details, if matched at the 1st phase, for more accurate signatures and detailed comparisons, in multiple tiers and hierarchical.
For one embodiment, the kernel sensitivity and type are based on user's input, or user's input parameter(s), e.g., fuzzy input parameter.
Cognition Layer & Inference Engine:
For one embodiment, es., we use a cognitive layer which controls the rules, to help train the multiple learning machines (as we call this “cognitive layer based rules for learning machines” or “CLR-LM” system), with much less number of training samples (reducing the need on training samples, but substituting it with rules to govern the systematic training). For one embodiment, e.g., we use a modularized set of learning machines, both for training and recognition. For one embodiment, e.g., we use a “self-learning learning machine” (as we call this “SLM” system), which can dynamically adjust itself, learn new rules from scratch, make new rules, find exceptions, do the discovery, find one-offs, find anomalies, find main features on an object, find patterns or semi-patterns, or discover new patterns or semi-patterns. For one embodiment, e.g., we use a “self-repairing learning machine” (as we call this “SIR-LM” system), which can interact with a sister-machine to adjust and repair each other, or on itself, according to a predetermined rules engine or accumulated experience or AI rules or Fuzzy rules or iterative rules or cognition rules or cognition layer or inference layer. In addition, they (original machine with one or more sister-machines) can learn from each other, exchange or change weights and biases for learning machines, copy layers for learning machines, replace layers for learning machines, edit layers for learning machines, copy or replace all or partial structures for learning machines, mask or enable or disable all or partial structures for learning machines, or set or enable or disable or increase or decrease or set to zero or reset for learning rates or learning steps or rate of learning rates (2nd derivatives) or time variation (or rate) (or per iteration or per time).
This means that we do not need a lot of training samples to do the training, compared to the training done by others, e.g., in other companies or universities, using, e.g., deep convolutional neural networks, with many layers and nodes, which requires astronomically large training samples or images, which in most cases, we would not have enough training samples any way, and/or it would become too expensive to train the system. This problem becomes more evident for any universe of objects with many classes of objects within that universe. So, for most practical applications, one cannot use their methods for training. Instead, the only viable method is our method taught here.
Z Advanced Computing, Inc. (ZAC), our company, has developed a General-AI platform for object recognition using a new AI machine/algorithm/paradigm/theorem, e.g., for shoes, as described elsewhere in this disclosure. The breakthroughs and unique features for ZAC platform are listed in Table 1 (superior and different from the other technologies by others in industry and universities).
Abstraction & Summarization:
For one embodiment, e.g., we have a long text, which gets into memory on concept level, as abstract, as fuzzified, without any details and exact language/words used, as min information needed for complete or almost complete recall or bulk of the message for storage or transmission. For example, the sentence “I have tried very hard to get to the airport as soon as possible.” becomes as “[I+try+go+airport+soon]”, which is much smaller in size. Multiple sentences may map to the same abstract result. So, for the recall, the sentence may get reconstructed as different from exact wordings of the original, which is OK/tolerable for this purpose.
For one embodiment, e.g., we have a long poem memorized in memory with exact wording, as it is enveloped by rhythm or beats of sound or music, to be able to store that efficiently, for exact or similar wording recall, on top of the abstract storage mentioned above. For example, for a nursery rhyme “Jump in a car, with a chocolate bar, . . . ”, the second phrase or sentence can be enveloped by the first one, as it sounds that way, or similar, with a rhyme. So, for memorization or recall/storage, it is much easier or efficient to recall a piece of music or poem, in comparison to the pure text, using rhyme envelope plus/with components of text, that can be abstracted or fuzzified for storage, as summary or basic meaning of the original (as we call it as Enveloped Fuzzified Recall, or “EFR” method, for storage or summarization or transmission of information, such as text, with efficiency and more accuracy, plus less cost). So, the data is modulated on top of the envelope or carder. This way, we use templates/dictionaries/tables, and reduce redundancies, and increase efficiencies, and reduce cost and storage size and transmission time.
Other Applications & Examples:
In one embodiment, human subjects are used to learn the inference, by automatically monitoring the movement of eye's focus and/or field of view on displayed images/objects to determine which features are visited/located/revisited and in which order and/or frequency. This data is used as part of the training set for the inference module/engine to learn how to locate other features when it locates a feature in an image/data.
In one embodiment, the model layer is fed with detected features of the same object, for example from a video or multiple images, to improve the features or confirm. In one embodiment, the images are simulated or prepared manually by changing the view perspective and/or illumination) of an object. Such learning may be used, in one embodiment, to learn the structural and overall shape of the object and its orientation, for fast recognition and masking, e.g., prior to make fine recognition of features of the object. The outline/mask of the object is also learned during the training, in one embodiment. In one embodiment, the mask is applied to visible units (e.g., during recognition) by, for example, ignoring units outside the masked portion, or forcing a highly contrastive unit value for outside units neighboring the mask periphery, based on the inside units at the periphery. In one embodiment, when learning a training object, a mask is used to limit the training image to the inside mask portion of the visible units. One embodiment, during training, either unclamps the other visible units (outside of mask) or set them to highly contrastive values, based on the visible units inside the mask.
One embodiment uses a cognitive layer in addition to the deep neural network. In one embodiment, the relationships of object components (e.g., hand and face) are learned and used to infer expected position and state of other features (e.g., the hand with respect to the position of the face).
In one embodiment, ι coverage G<sub>j </sub>points/centers are used in <img file="US2022121884A1_D27357.tif" /><sup>d</sup>, covering the input dataset for training an SVM. In one embodiment, clustering is used to determine candidate center points. In one embodiment, G<sub>j </sub>is initially randomly chosen and the choice is validated against decomposition in transformed space. For each scanned input data point, x<sub>i</sub>, the decomposition of <img file="US2022121884A1_D27358.tif" />(x<sub>i</sub>, x<sub>i</sub>) or <img file="US2022121884A1_D27359.tif" />(G<sub>j</sub>, x<sub>i</sub>) is evaluated, and if it the validation fails beyond a threshold, then x<sub>i </sub>is assigned to be the next center, G<sub>j+1</sub>. If all ι coverage G<sub>j </sub>points/centers are assigned in this manner, the remaining data points are validated similarly. If there is a failure, then either the number of centers are increased, or a previously assigned center is given up in favor of the new one, e.g., based on closeness of previously selected centers based on <img file="US2022121884A1_D27360.tif" />(G<sub>j</sub>, G<sub>j1</sub>).
In one embodiment, an image ad network detects efforts to bypass the ad network by putting dummy unknown web sites, so that if a publisher attempts to bypass the network and reuse ad landing page link, the attempt can be detected, logged, and notified.
In one embodiment, a layer of cognitive processing with rules engine is used with a deep learning machine, e.g., using Z number for rules (e.g., having a rule that in summer, people usually wear short sleeve shirts, or people usually wear short sleeve shirts with cargo pants) to match, infer, recognize, or correlate objects in images.
In one embodiment, a 3D model is learned by using a rotating/pivoting controllable pedestal as a platform to support an object and/or camera and take pictures/videos for training, e.g., a shoe out of a class as a representative, to teach the learning machine recognize the orientation attributes.
In one embodiment, the ads displaying the items of the competitor merchants are not displayed on the merchant's webpage, by filtering the matching sources or limiting the source to the particular merchant. In one embodiment, the visual ads are based on the image, text, and history/behavior of user.
In one embodiment, the consensus voting is used with for crowd tagging, so that bad actors or mistakes are detected, and a person making repeated mistake (e.g., beyond threshold) is identified and notified, or dropped.
In one embodiment, when a feature selection occurs often enough (e.g., with CPU cost lowered), the feature selector is moved up in a priority to an earlier pass at the data/image.
In one embodiment, the fine level detection of a component is done as a later task, e.g., asynchronously or as needed, for example, a deep recognition for detecting the seams on the shoe may be done at a later time or based on triggers (demand, number of inquiries).
In one embodiment, a learning machines discovers new patterns in a class, such as a new shoe, by for example detecting unelected features. In an embodiment, such features are stored for later correlation and pattern recognition, as the instances increase.
In one embodiment, a face recognition engine recognizes/detects micro expressions (e.g., happy, angry, sad, contempt, etc.) for behavior analysis (e.g., for humans) by frame by frame analysis, e.g., for automation for psychological analysis.
In one embodiment, the tone of skin, hair color, and/or eye color is detected and matched with clothing and shoes and/or lip stick and other accessories, automatically, based on fashion rules and color rules.
In one embodiment, the SVM use (proximity) kernels based on similarity measures assigned, e.g., by crowd tagging, as the input to kernel matrix, e.g. indicating the similarities between objects and/or object components, e.g., shoes, shoe laces and other features of the shoe. One embodiment, uses similarity measures on the component/feature level. One embodiment isolates the feature, e.g., via correlation. One embodiment determines several labels (for components) and assess similarities on the components via their labels, tag components (e.g., red band on the heel).
One embodiment uses a cognition module to capture abstract rules e.g., what a shoe is), e.g., by using subject matter expert and also crowd sourcing.
In one embodiment, the input impression is summarized and fuzzified, e.g., 30-35 C temperature outside with probability of about 25 percent becomes low 30s with low probability.
In one embodiment, geometric features are detected separate form functional features (e.g., hat or shoe). In one embodiment, functional features (e.g., shoe vamp) are correlated.
In one embodiment, additional training samples are creates by offsetting, rotating, re-coloring, adding noise, adding contrast to the original image.
In one embodiment, the delta between the expected feature and unexpected feature is learned, e.g., a red spot on a shoe which expected based on the model layer. If encountered many times, then this is taken as a feature to detect earlier in the recursive process. So, the model gets richer, and the system learns and grows the model.
In one embodiment, the training commences with simple (e.g., computer generated simple images), with no exceptional features, gradually expands to richer feature, and finds patterns with these exceptions, as correlation, and append to model for next rounds of recognition.
In one embodiment, the priority of processing of information (e.g., parallel and sequential, or mix) is optimized.
In one embodiment, one or more object components are detected first (e.g., head, face, hand, shoe), and then, the inference module uses the model layer or learned patterns (e.g., via a neural network) infers the rest of body (e.g., shirt and elbow). The feature detectors then zoom/locate the interest areas sequentially or in parallel, for confirmation or fine detection. For example, a component that looks like zipper on shirt, based on structure, shape or position, may further be fine detected to conclude that it is a zipper. In one embodiment, the detection tasks are prioritized (e.g., scheduled for execution asynchronously).
In one embodiment, model can anticipate by recognizing component (or a label), e.g., an object is recognized to be a cat, even from its paws or part of body.
In one embodiment, the training samples includes cartoonish, simple silhouette, shadow shape images.
In one embodiment, a GPU hardware is used for image processing and calculations, e.g., related to the neural networks.
In one embodiment, multiple specialized recognizers are used for recognition of shoe, head, hand, in parallel, each doing its own focus and duty, with its own neural net, which is very small compared to general purpose neural net.
One embodiment uses multiple basis functions for various objects such as face locating and shoe locating simultaneously in parallel.
Note that complex hybrid data comprises multiple image and non-image features, in one example, e.g., shapes or components or shapes of components of the object (specifically tagged and trained for, e.g., for a car or a banana or a concept), and other properties from the image or data, e.g., color or hue, or size of the object in pixel or inch or meter, or how many tires a car have, or textual tags, or other properties/parameters. ZAC can handle data that are different in nature, e.g., text and image and voice, combined, which NN cannot handle. Also, ZAC can handle image and non-image data, combined, simultaneously, which NN (neural net) cannot do/process (e.g., for Explainable-AI figures/examples in this disclosure), as also detailed elsewhere in this disclosure.
In one embodiment, the training via back propagation uses one or more of softmax, cross entropy (e.g., sigmoid cross entropy), contrastive, Eucledean distance (sum of squares of difference), multinomial logistic, infogain (a generalization of multinomial logistic), hinge/unit/margin (e.g., one versus all hinge (L1) or squared hinge (L2)) loss layer/unit/comparison. These tools are well known in the art, e.g., in various websites and papers, e.g., in Caffe, maintained by UC Berkeley, at: http://caffe.berkeleyvision.org/tutorial/layers.html. (So, for the definitions, one is referred to any of those references.)
One embodiment uses different weights for features/components for recognition/search, as some are more important than the others or more relevant in the context, e.g., in recognizing an individual in a specific race faster, based on, e.g., more primary features for that subset.
The teachings above are all various embodiments or components or parts or variations of the inventions, which can be combined in various orders in various contexts and environments for various vertical or specific applications. The examples are just for teaching the concepts and inventions, and are not limiting at all.
The hardware and circuitry taught in any section meant to be used for any other section, including CPU, GPU, processor, microprocessor, memory, storage, hard drive, disk, RAM, ROM, temporary storage, display, interface, keyboard, stylus, or the like, for modules, systems, sub-systems, devices, apparatuses, and platforms (or the like), taught here.
Contents9
27,711 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11 Sheet 12 Sheet 13 Sheet 14 Sheet 15 Sheet 16 Sheet 17 Sheet 18 Sheet 19 Sheet 20 Sheet 21 Sheet 22 Sheet 23 Sheet 24 Sheet 25 Sheet 26 Sheet 27 Sheet 28 Sheet 29 Sheet 30 Sheet 31 Sheet 32 Sheet 33 Sheet 34 Sheet 35 Sheet 36 Sheet 37 Sheet 38 Sheet 39 Sheet 40 Sheet 41 Sheet 42 Sheet 43 Sheet 44 Sheet 45 Sheet 46 Sheet 47 Sheet 48 Sheet 49 Sheet 50 Sheet 51 Sheet 52 Sheet 53 Sheet 54 Sheet 55 Sheet 56 Sheet 57 Sheet 58 Sheet 59 Sheet 60 Sheet 61 Sheet 62 Sheet 63 Sheet 64 Sheet 65 Sheet 66 Sheet 67 Sheet 68 Sheet 69 Sheet 70 Sheet 71 Sheet 72 Sheet 73 Sheet 74 Sheet 75 Sheet 76 Sheet 77 Sheet 78 Sheet 79 Sheet 80 Sheet 81 Sheet 82 Sheet 83 Sheet 84 Sheet 85 Sheet 86 Sheet 87 Sheet 88 Sheet 89 Sheet 90 Sheet 91 Sheet 92 Sheet 93 Sheet 94 Sheet 95 Sheet 96 Sheet 97 Sheet 98 Sheet 99 Sheet 100 Sheet 101 Sheet 102 Sheet 103 Sheet 104 Sheet 105 Sheet 106 Sheet 107 Sheet 108 Sheet 109 Sheet 110 Sheet 111 Sheet 112 Sheet 113 Sheet 114 Sheet 115 Sheet 116 Sheet 117 Sheet 118 Sheet 119 Sheet 120 Sheet 121 Sheet 122 Sheet 123 Sheet 124 Sheet 125 Sheet 126 Sheet 127 Sheet 128 Sheet 129 Sheet 130 Sheet 131 Sheet 132 Sheet 133 Sheet 134 Sheet 135 Sheet 136 Sheet 137 Sheet 138 Sheet 139 Sheet 140 Sheet 141 Sheet 142 Sheet 143 Sheet 144 Sheet 145 Sheet 146 Sheet 147 Sheet 148 Sheet 149 Sheet 150 Sheet 151 Sheet 152 Sheet 153 Sheet 154 Sheet 155 Sheet 156 Sheet 157 Sheet 158 Sheet 159 Sheet 160 Sheet 161 Sheet 162 Sheet 163 Sheet 164 Sheet 165 Sheet 166 Sheet 167 Sheet 168 Sheet 169 Sheet 170 Sheet 171 Sheet 172 Sheet 173 Sheet 174 Sheet 175 Sheet 176 Sheet 177 Sheet 178 Sheet 179 Sheet 180 Sheet 181 Sheet 182 Sheet 183 Sheet 184 Sheet 185 Sheet 186 Sheet 187 Sheet 188 Sheet 189 Sheet 190 Sheet 191 Sheet 192 Sheet 193 Sheet 194 Sheet 195 Sheet 196 Sheet 197 Sheet 198 Sheet 199 Sheet 200 Sheet 201 Sheet 202 Sheet 203 Sheet 204 Sheet 205 Sheet 206 Sheet 207 Sheet 208 Sheet 209 Sheet 210 Sheet 211 Sheet 212 Sheet 213 Sheet 214 Sheet 215 Sheet 216 Sheet 217 Sheet 218 Sheet 219 Sheet 220 Sheet 221 Sheet 222 Sheet 223 Sheet 224 Sheet 225 Sheet 226 Sheet 227 Sheet 228 Sheet 229 Sheet 230 Sheet 231 Sheet 232 Sheet 233 Sheet 234 Sheet 235 Sheet 236 Sheet 237 Sheet 238 Sheet 239 Sheet 240 Sheet 241 Sheet 242 Sheet 243 Sheet 244 Sheet 245 Sheet 246 Sheet 247 Sheet 248 Sheet 249 Sheet 250 Sheet 251 Sheet 252 Sheet 253 Sheet 254 Sheet 255 Sheet 256 Sheet 257 Sheet 258 Sheet 259 Sheet 260 Sheet 261 Sheet 262 Sheet 263 Sheet 264 Sheet 265 Sheet 266 Sheet 267 Sheet 268 Sheet 269 Sheet 270 Sheet 271 Sheet 272 Sheet 273 Sheet 274 Sheet 275 Sheet 276 Sheet 277 Sheet 278 Sheet 279 Sheet 280 Sheet 281 Sheet 282 Sheet 283 Sheet 284 Sheet 285 Sheet 286 Sheet 287 Sheet 288 Sheet 289 Sheet 290 Sheet 291 Sheet 292 Sheet 293 Sheet 294 Sheet 295 Sheet 296 Sheet 297 Sheet 298 Sheet 299 Sheet 300 Sheet 301 Sheet 302 Sheet 303 Sheet 304 Sheet 305 Sheet 306 Sheet 307 Sheet 308 Sheet 309 Sheet 310 Sheet 311 Sheet 312 Sheet 313 Sheet 314 Sheet 315 Sheet 316 Sheet 317 Sheet 318 Sheet 319 Sheet 320 Sheet 321 Sheet 322 Sheet 323 Sheet 324 Sheet 325 Sheet 326 Sheet 327 Sheet 328 Sheet 329 Sheet 330 Sheet 331 Sheet 332 Sheet 333 Sheet 334 Sheet 335 Sheet 336 Sheet 337 Sheet 338 Sheet 339 Sheet 340 Sheet 341 Sheet 342 Sheet 343 Sheet 344 Sheet 345 Sheet 346 Sheet 347 Sheet 348 Sheet 349 Sheet 350 Sheet 351 Sheet 352 Sheet 353 Sheet 354 Sheet 355 Sheet 356 Sheet 357 Sheet 358 Sheet 359 Sheet 360 Sheet 361 Sheet 362 Sheet 363 Sheet 364 Sheet 365 Sheet 366 Sheet 367 Sheet 368 Sheet 369 Sheet 370 Sheet 371 Sheet 372 Sheet 373 Sheet 374 Sheet 375 Sheet 376 Sheet 377 Sheet 378 Sheet 379 Sheet 380 Sheet 381 Sheet 382 Sheet 383 Sheet 384 Sheet 385 Sheet 386 Sheet 387 Sheet 388 Sheet 389 Sheet 390 Sheet 391 Sheet 392 Sheet 393 Sheet 394 Sheet 395 Sheet 396 Sheet 397 Sheet 398 Sheet 399 Sheet 400 Sheet 401 Sheet 402 Sheet 403 Sheet 404 Sheet 405 Sheet 406 Sheet 407 Sheet 408 Sheet 409 Sheet 410 Sheet 411 Sheet 412 Sheet 413 Sheet 414 Sheet 415 Sheet 416 Sheet 417 Sheet 418 Sheet 419 Sheet 420 Sheet 421 Sheet 422 Sheet 423 Sheet 424 Sheet 425 Sheet 426 Sheet 427 Sheet 428 Sheet 429 Sheet 430 Sheet 431 Sheet 432 Sheet 433 Sheet 434 Sheet 435 Sheet 436 Sheet 437 Sheet 438 Sheet 439 Sheet 440 Sheet 441 Sheet 442 Sheet 443 Sheet 444 Sheet 445 Sheet 446 Sheet 447 Sheet 448 Sheet 449 Sheet 450 Sheet 451 Sheet 452 Sheet 453 Sheet 454 Sheet 455 Sheet 456 Sheet 457 Sheet 458 Sheet 459 Sheet 460 Sheet 461 Sheet 462 Sheet 463 Sheet 464 Sheet 465 Sheet 466 Sheet 467 Sheet 468 Sheet 469 Sheet 470 Sheet 471 Sheet 472 Sheet 473 Sheet 474 Sheet 475 Sheet 476 Sheet 477 Sheet 478 Sheet 479 Sheet 480 Sheet 481 Sheet 482 Sheet 483 Sheet 484 Sheet 485 Sheet 486 Sheet 487 Sheet 488 Sheet 489 Sheet 490 Sheet 491 Sheet 492 Sheet 493 Sheet 494 Sheet 495 Sheet 496 Sheet 497 Sheet 498 Sheet 499 Sheet 500 Sheet 501 Sheet 502 Sheet 503 Sheet 504 Sheet 505 Sheet 506 Sheet 507 Sheet 508 Sheet 509 Sheet 510 Sheet 511 Sheet 512 Sheet 513 Sheet 514 Sheet 515 Sheet 516 Sheet 517 Sheet 518 Sheet 519 Sheet 520 Sheet 521 Sheet 522 Sheet 523 Sheet 524 Sheet 525 Sheet 526 Sheet 527 Sheet 528 Sheet 529 Sheet 530 Sheet 531 Sheet 532 Sheet 533 Sheet 534 Sheet 535 Sheet 536 Sheet 537 Sheet 538 Sheet 539 Sheet 540 Sheet 541 Sheet 542 Sheet 543 Sheet 544 Sheet 545 Sheet 546 Sheet 547 Sheet 548 Sheet 549 Sheet 550 Sheet 551 Sheet 552 Sheet 553 Sheet 554 Sheet 555 Sheet 556 Sheet 557 Sheet 558 Sheet 559 Sheet 560 Sheet 561 Sheet 562 Sheet 563 Sheet 564 Sheet 565 Sheet 566 Sheet 567 Sheet 568 Sheet 569 Sheet 570 Sheet 571 Sheet 572 Sheet 573 Sheet 574 Sheet 575 Sheet 576 Sheet 577 Sheet 578 Sheet 579 Sheet 580 Sheet 581 Sheet 582 Sheet 583 Sheet 584 Sheet 585 Sheet 586 Sheet 587 Sheet 588 Sheet 589 Sheet 590 Sheet 591 Sheet 592 Sheet 593 Sheet 594 Sheet 595 Sheet 596 Sheet 597 Sheet 598 Sheet 599 Sheet 600 Sheet 601 Sheet 602 Sheet 603 Sheet 604 Sheet 605 Sheet 606 Sheet 607 Sheet 608 Sheet 609 Sheet 610 Sheet 611 Sheet 612 Sheet 613 Sheet 614 Sheet 615 Sheet 616 Sheet 617 Sheet 618 Sheet 619 Sheet 620 Sheet 621 Sheet 622 Sheet 623 Sheet 624 Sheet 625 Sheet 626 Sheet 627 Sheet 628 Sheet 629 Sheet 630 Sheet 631 Sheet 632 Sheet 633 Sheet 634 Sheet 635 Sheet 636 Sheet 637 Sheet 638 Sheet 639 Sheet 640 Sheet 641 Sheet 642 Sheet 643 Sheet 644 Sheet 645 Sheet 646 Sheet 647 Sheet 648 Sheet 649 Sheet 650 Sheet 651 Sheet 652 Sheet 653 Sheet 654 Sheet 655 Sheet 656 Sheet 657 Sheet 658 Sheet 659 Sheet 660 Sheet 661 Sheet 662 Sheet 663 Sheet 664 Sheet 665 Sheet 666 Sheet 667 Sheet 668 Sheet 669 Sheet 670 Sheet 671 Sheet 672 Sheet 673 Sheet 674 Sheet 675 Sheet 676 Sheet 677 Sheet 678 Sheet 679 Sheet 680 Sheet 681 Sheet 682 Sheet 683 Sheet 684 Sheet 685 Sheet 686 Sheet 687 Sheet 688 Sheet 689 Sheet 690 Sheet 691 Sheet 692 Sheet 693 Sheet 694 Sheet 695 Sheet 696 Sheet 697 Sheet 698 Sheet 699 Sheet 700 Sheet 701 Sheet 702 Sheet 703 Sheet 704 Sheet 705 Sheet 706 Sheet 707 Sheet 708 Sheet 709 Sheet 710 Sheet 711 Sheet 712 Sheet 713 Sheet 714 Sheet 715 Sheet 716 Sheet 717 Sheet 718 Sheet 719 Sheet 720 Sheet 721 Sheet 722 Sheet 723 Sheet 724 Sheet 725 Sheet 726 Sheet 727 Sheet 728 Sheet 729 Sheet 730 Sheet 731 Sheet 732 Sheet 733 Sheet 734 Sheet 735 Sheet 736 Sheet 737 Sheet 738 Sheet 739 Sheet 740 Sheet 741 Sheet 742 Sheet 743 Sheet 744 Sheet 745 Sheet 746 Sheet 747 Sheet 748 Sheet 749 Sheet 750 Sheet 751 Sheet 752 Sheet 753 Sheet 754 Sheet 755 Sheet 756 Sheet 757 Sheet 758 Sheet 759 Sheet 760 Sheet 761 Sheet 762 Sheet 763 Sheet 764 Sheet 765 Sheet 766 Sheet 767 Sheet 768 Sheet 769 Sheet 770 Sheet 771 Sheet 772 Sheet 773 Sheet 774 Sheet 775 Sheet 776 Sheet 777 Sheet 778 Sheet 779 Sheet 780 Sheet 781 Sheet 782 Sheet 783 Sheet 784 Sheet 785 Sheet 786 Sheet 787 Sheet 788 Sheet 789 Sheet 790 Sheet 791 Sheet 792 Sheet 793 Sheet 794 Sheet 795 Sheet 796 Sheet 797 Sheet 798 Sheet 799 Sheet 800 Sheet 801 Sheet 802 Sheet 803 Sheet 804 Sheet 805 Sheet 806 Sheet 807 Sheet 808 Sheet 809 Sheet 810 Sheet 811 Sheet 812 Sheet 813 Sheet 814 Sheet 815 Sheet 816 Sheet 817 Sheet 818 Sheet 819 Sheet 820 Sheet 821 Sheet 822 Sheet 823 Sheet 824 Sheet 825 Sheet 826 Sheet 827 Sheet 828 Sheet 829 Sheet 830 Sheet 831 Sheet 832 Sheet 833 Sheet 834 Sheet 835 Sheet 836 Sheet 837 Sheet 838 Sheet 839 Sheet 840 Sheet 841 Sheet 842 Sheet 843 Sheet 844 Sheet 845 Sheet 846 Sheet 847 Sheet 848 Sheet 849 Sheet 850 Sheet 851 Sheet 852 Sheet 853 Sheet 854 Sheet 855 Sheet 856 Sheet 857 Sheet 858 Sheet 859 Sheet 860 Sheet 861 Sheet 862 Sheet 863 Sheet 864 Sheet 865 Sheet 866 Sheet 867 Sheet 868 Sheet 869 Sheet 870 Sheet 871 Sheet 872 Sheet 873 Sheet 874 Sheet 875 Sheet 876 Sheet 877 Sheet 878 Sheet 879 Sheet 880 Sheet 881 Sheet 882 Sheet 883 Sheet 884 Sheet 885 Sheet 886 Sheet 887 Sheet 888 Sheet 889 Sheet 890 Sheet 891 Sheet 892 Sheet 893 Sheet 894 Sheet 895 Sheet 896 Sheet 897 Sheet 898 Sheet 899 Sheet 900 Sheet 901 Sheet 902 Sheet 903 Sheet 904 Sheet 905 Sheet 906 Sheet 907 Sheet 908 Sheet 909 Sheet 910 Sheet 911 Sheet 912 Sheet 913 Sheet 914 Sheet 915 Sheet 916 Sheet 917 Sheet 918 Sheet 919 Sheet 920 Sheet 921 Sheet 922 Sheet 923 Sheet 924 Sheet 925 Sheet 926 Sheet 927 Sheet 928 Sheet 929 Sheet 930 Sheet 931 Sheet 932 Sheet 933 Sheet 934 Sheet 935 Sheet 936 Sheet 937 Sheet 938 Sheet 939 Sheet 940 Sheet 941 Sheet 942 Sheet 943 Sheet 944 Sheet 945 Sheet 946 Sheet 947 Sheet 948 Sheet 949 Sheet 950 Sheet 951 Sheet 952 Sheet 953 Sheet 954 Sheet 955 Sheet 956 Sheet 957 Sheet 958 Sheet 959 Sheet 960 Sheet 961 Sheet 962 Sheet 963 Sheet 964 Sheet 965 Sheet 966 Sheet 967 Sheet 968 Sheet 969 Sheet 970 Sheet 971 Sheet 972 Sheet 973 Sheet 974 Sheet 975 Sheet 976 Sheet 977 Sheet 978 Sheet 979 Sheet 980 Sheet 981 Sheet 982 Sheet 983 Sheet 984 Sheet 985 Sheet 986 Sheet 987 Sheet 988 Sheet 989 Sheet 990 Sheet 991 Sheet 992 Sheet 993 Sheet 994 Sheet 995 Sheet 996 Sheet 997 Sheet 998 Sheet 999 Sheet 1000 Sheet 1001 Sheet 1002 Sheet 1003 Sheet 1004 Sheet 1005 Sheet 1006 Sheet 1007 Sheet 1008 Sheet 1009 Sheet 1010 Sheet 1011 Sheet 1012 Sheet 1013 Sheet 1014 Sheet 1015 Sheet 1016 Sheet 1017 Sheet 1018 Sheet 1019 Sheet 1020 Sheet 1021 Sheet 1022 Sheet 1023 Sheet 1024 Sheet 1025 Sheet 1026 Sheet 1027 Sheet 1028 Sheet 1029 Sheet 1030 Sheet 1031 Sheet 1032 Sheet 1033 Sheet 1034 Sheet 1035 Sheet 1036 Sheet 1037 Sheet 1038 Sheet 1039 Sheet 1040 Sheet 1041 Sheet 1042 Sheet 1043 Sheet 1044 Sheet 1045 Sheet 1046 Sheet 1047 Sheet 1048 Sheet 1049 Sheet 1050 Sheet 1051 Sheet 1052 Sheet 1053 Sheet 1054 Sheet 1055 Sheet 1056 Sheet 1057 Sheet 1058 Sheet 1059 Sheet 1060 Sheet 1061 Sheet 1062 Sheet 1063 Sheet 1064 Sheet 1065 Sheet 1066 Sheet 1067 Sheet 1068 Sheet 1069 Sheet 1070 Sheet 1071 Sheet 1072 Sheet 1073 Sheet 1074 Sheet 1075 Sheet 1076 Sheet 1077 Sheet 1078 Sheet 1079 Sheet 1080 Sheet 1081 Sheet 1082 Sheet 1083 Sheet 1084 Sheet 1085 Sheet 1086 Sheet 1087 Sheet 1088 Sheet 1089 Sheet 1090 Sheet 1091 Sheet 1092 Sheet 1093 Sheet 1094 Sheet 1095 Sheet 1096 Sheet 1097 Sheet 1098 Sheet 1099 Sheet 1100 Sheet 1101 Sheet 1102 Sheet 1103 Sheet 1104 Sheet 1105 Sheet 1106 Sheet 1107 Sheet 1108 Sheet 1109 Sheet 1110 Sheet 1111 Sheet 1112 Sheet 1113 Sheet 1114 Sheet 1115 Sheet 1116 Sheet 1117 Sheet 1118 Sheet 1119 Sheet 1120 Sheet 1121 Sheet 1122 Sheet 1123 Sheet 1124 Sheet 1125 Sheet 1126 Sheet 1127 Sheet 1128 Sheet 1129 Sheet 1130 Sheet 1131 Sheet 1132 Sheet 1133 Sheet 1134 Sheet 1135 Sheet 1136 Sheet 1137 Sheet 1138 Sheet 1139 Sheet 1140 Sheet 1141 Sheet 1142 Sheet 1143 Sheet 1144 Sheet 1145 Sheet 1146 Sheet 1147 Sheet 1148 Sheet 1149 Sheet 1150 Sheet 1151 Sheet 1152 Sheet 1153 Sheet 1154 Sheet 1155 Sheet 1156 Sheet 1157 Sheet 1158 Sheet 1159 Sheet 1160 Sheet 1161 Sheet 1162 Sheet 1163 Sheet 1164 Sheet 1165 Sheet 1166 Sheet 1167 Sheet 1168 Sheet 1169 Sheet 1170 Sheet 1171 Sheet 1172 Sheet 1173 Sheet 1174 Sheet 1175 Sheet 1176 Sheet 1177 Sheet 1178 Sheet 1179 Sheet 1180 Sheet 1181 Sheet 1182 Sheet 1183 Sheet 1184 Sheet 1185 Sheet 1186 Sheet 1187 Sheet 1188 Sheet 1189 Sheet 1190 Sheet 1191 Sheet 1192 Sheet 1193 Sheet 1194 Sheet 1195 Sheet 1196 Sheet 1197 Sheet 1198 Sheet 1199 Sheet 1200 Sheet 1201 Sheet 1202 Sheet 1203 Sheet 1204 Sheet 1205 Sheet 1206 Sheet 1207 Sheet 1208 Sheet 1209 Sheet 1210 Sheet 1211 Sheet 1212 Sheet 1213 Sheet 1214 Sheet 1215 Sheet 1216 Sheet 1217 Sheet 1218 Sheet 1219 Sheet 1220 Sheet 1221 Sheet 1222 Sheet 1223 Sheet 1224 Sheet 1225 Sheet 1226 Sheet 1227 Sheet 1228 Sheet 1229 Sheet 1230 Sheet 1231 Sheet 1232 Sheet 1233 Sheet 1234 Sheet 1235 Sheet 1236 Sheet 1237 Sheet 1238 Sheet 1239 Sheet 1240 Sheet 1241 Sheet 1242 Sheet 1243 Sheet 1244 Sheet 1245 Sheet 1246 Sheet 1247 Sheet 1248 Sheet 1249 Sheet 1250 Sheet 1251 Sheet 1252 Sheet 1253 Sheet 1254 Sheet 1255 Sheet 1256 Sheet 1257 Sheet 1258 Sheet 1259 Sheet 1260 Sheet 1261 Sheet 1262 Sheet 1263 Sheet 1264 Sheet 1265 Sheet 1266 Sheet 1267 Sheet 1268 Sheet 1269 Sheet 1270 Sheet 1271 Sheet 1272 Sheet 1273 Sheet 1274 Sheet 1275 Sheet 1276 Sheet 1277 Sheet 1278 Sheet 1279 Sheet 1280 Sheet 1281 Sheet 1282 Sheet 1283 Sheet 1284 Sheet 1285 Sheet 1286 Sheet 1287 Sheet 1288 Sheet 1289 Sheet 1290 Sheet 1291 Sheet 1292 Sheet 1293 Sheet 1294 Sheet 1295 Sheet 1296 Sheet 1297 Sheet 1298 Sheet 1299 Sheet 1300 Sheet 1301 Sheet 1302 Sheet 1303 Sheet 1304 Sheet 1305 Sheet 1306 Sheet 1307 Sheet 1308 Sheet 1309 Sheet 1310 Sheet 1311 Sheet 1312 Sheet 1313 Sheet 1314 Sheet 1315 Sheet 1316 Sheet 1317 Sheet 1318 Sheet 1319 Sheet 1320 Sheet 1321 Sheet 1322 Sheet 1323 Sheet 1324 Sheet 1325 Sheet 1326 Sheet 1327 Sheet 1328 Sheet 1329 Sheet 1330 Sheet 1331 Sheet 1332 Sheet 1333 Sheet 1334 Sheet 1335 Sheet 1336 Sheet 1337 Sheet 1338 Sheet 1339 Sheet 1340 Sheet 1341 Sheet 1342 Sheet 1343 Sheet 1344 Sheet 1345 Sheet 1346 Sheet 1347 Sheet 1348 Sheet 1349 Sheet 1350 Sheet 1351 Sheet 1352 Sheet 1353 Sheet 1354 Sheet 1355 Sheet 1356 Sheet 1357 Sheet 1358 Sheet 1359 Sheet 1360 Sheet 1361 Sheet 1362 Sheet 1363 Sheet 1364 Sheet 1365 Sheet 1366 Sheet 1367 Sheet 1368 Sheet 1369 Sheet 1370 Sheet 1371 Sheet 1372 Sheet 1373 Sheet 1374 Sheet 1375 Sheet 1376 Sheet 1377 Sheet 1378 Sheet 1379 Sheet 1380 Sheet 1381 Sheet 1382 Sheet 1383 Sheet 1384 Sheet 1385 Sheet 1386 Sheet 1387 Sheet 1388 Sheet 1389 Sheet 1390 Sheet 1391 Sheet 1392 Sheet 1393 Sheet 1394 Sheet 1395 Sheet 1396 Sheet 1397 Sheet 1398 Sheet 1399 Sheet 1400 Sheet 1401 Sheet 1402 Sheet 1403 Sheet 1404 Sheet 1405 Sheet 1406 Sheet 1407 Sheet 1408 Sheet 1409 Sheet 1410 Sheet 1411 Sheet 1412 Sheet 1413 Sheet 1414 Sheet 1415 Sheet 1416 Sheet 1417 Sheet 1418 Sheet 1419 Sheet 1420 Sheet 1421 Sheet 1422 Sheet 1423 Sheet 1424 Sheet 1425 Sheet 1426 Sheet 1427 Sheet 1428 Sheet 1429 Sheet 1430 Sheet 1431 Sheet 1432 Sheet 1433 Sheet 1434 Sheet 1435 Sheet 1436 Sheet 1437 Sheet 1438 Sheet 1439 Sheet 1440 Sheet 1441 Sheet 1442 Sheet 1443 Sheet 1444 Sheet 1445 Sheet 1446 Sheet 1447 Sheet 1448 Sheet 1449 Sheet 1450 Sheet 1451 Sheet 1452 Sheet 1453 Sheet 1454 Sheet 1455 Sheet 1456 Sheet 1457 Sheet 1458 Sheet 1459 Sheet 1460 Sheet 1461 Sheet 1462 Sheet 1463 Sheet 1464 Sheet 1465 Sheet 1466 Sheet 1467 Sheet 1468 Sheet 1469 Sheet 1470 Sheet 1471 Sheet 1472 Sheet 1473 Sheet 1474 Sheet 1475 Sheet 1476 Sheet 1477 Sheet 1478 Sheet 1479 Sheet 1480 Sheet 1481 Sheet 1482 Sheet 1483 Sheet 1484 Sheet 1485 Sheet 1486 Sheet 1487 Sheet 1488 Sheet 1489 Sheet 1490 Sheet 1491 Sheet 1492 Sheet 1493 Sheet 1494 Sheet 1495 Sheet 1496 Sheet 1497 Sheet 1498 Sheet 1499 Sheet 1500 Sheet 1501 Sheet 1502 Sheet 1503 Sheet 1504 Sheet 1505 Sheet 1506 Sheet 1507 Sheet 1508 Sheet 1509 Sheet 1510 Sheet 1511 Sheet 1512 Sheet 1513 Sheet 1514 Sheet 1515 Sheet 1516 Sheet 1517 Sheet 1518 Sheet 1519 Sheet 1520 Sheet 1521 Sheet 1522 Sheet 1523 Sheet 1524 Sheet 1525 Sheet 1526 Sheet 1527 Sheet 1528 Sheet 1529 Sheet 1530 Sheet 1531 Sheet 1532 Sheet 1533 Sheet 1534 Sheet 1535 Sheet 1536 Sheet 1537 Sheet 1538 Sheet 1539 Sheet 1540 Sheet 1541 Sheet 1542 Sheet 1543 Sheet 1544 Sheet 1545 Sheet 1546 Sheet 1547 Sheet 1548 Sheet 1549 Sheet 1550 Sheet 1551 Sheet 1552 Sheet 1553 Sheet 1554 Sheet 1555 Sheet 1556 Sheet 1557 Sheet 1558 Sheet 1559 Sheet 1560 Sheet 1561 Sheet 1562 Sheet 1563 Sheet 1564 Sheet 1565 Sheet 1566 Sheet 1567 Sheet 1568 Sheet 1569 Sheet 1570 Sheet 1571 Sheet 1572 Sheet 1573 Sheet 1574 Sheet 1575 Sheet 1576 Sheet 1577 Sheet 1578 Sheet 1579 Sheet 1580 Sheet 1581 Sheet 1582 Sheet 1583 Sheet 1584 Sheet 1585 Sheet 1586 Sheet 1587 Sheet 1588 Sheet 1589 Sheet 1590 Sheet 1591 Sheet 1592 Sheet 1593 Sheet 1594 Sheet 1595 Sheet 1596 Sheet 1597 Sheet 1598 Sheet 1599 Sheet 1600 Sheet 1601 Sheet 1602 Sheet 1603 Sheet 1604 Sheet 1605 Sheet 1606 Sheet 1607 Sheet 1608 Sheet 1609 Sheet 1610 Sheet 1611 Sheet 1612 Sheet 1613 Sheet 1614 Sheet 1615 Sheet 1616 Sheet 1617 Sheet 1618 Sheet 1619 Sheet 1620 Sheet 1621 Sheet 1622 Sheet 1623 Sheet 1624 Sheet 1625 Sheet 1626 Sheet 1627 Sheet 1628 Sheet 1629 Sheet 1630 Sheet 1631 Sheet 1632 Sheet 1633 Sheet 1634 Sheet 1635 Sheet 1636 Sheet 1637 Sheet 1638 Sheet 1639 Sheet 1640 Sheet 1641 Sheet 1642 Sheet 1643 Sheet 1644 Sheet 1645 Sheet 1646 Sheet 1647 Sheet 1648 Sheet 1649 Sheet 1650 Sheet 1651 Sheet 1652 Sheet 1653 Sheet 1654 Sheet 1655 Sheet 1656 Sheet 1657 Sheet 1658 Sheet 1659 Sheet 1660 Sheet 1661 Sheet 1662 Sheet 1663 Sheet 1664 Sheet 1665 Sheet 1666 Sheet 1667 Sheet 1668 Sheet 1669 Sheet 1670 Sheet 1671 Sheet 1672 Sheet 1673 Sheet 1674 Sheet 1675 Sheet 1676 Sheet 1677 Sheet 1678 Sheet 1679 Sheet 1680 Sheet 1681 Sheet 1682 Sheet 1683 Sheet 1684 Sheet 1685 Sheet 1686 Sheet 1687 Sheet 1688 Sheet 1689 Sheet 1690 Sheet 1691 Sheet 1692 Sheet 1693 Sheet 1694 Sheet 1695 Sheet 1696 Sheet 1697 Sheet 1698 Sheet 1699 Sheet 1700 Sheet 1701 Sheet 1702 Sheet 1703 Sheet 1704 Sheet 1705 Sheet 1706 Sheet 1707 Sheet 1708 Sheet 1709 Sheet 1710 Sheet 1711 Sheet 1712 Sheet 1713 Sheet 1714 Sheet 1715 Sheet 1716 Sheet 1717 Sheet 1718 Sheet 1719 Sheet 1720 Sheet 1721 Sheet 1722 Sheet 1723 Sheet 1724 Sheet 1725 Sheet 1726 Sheet 1727 Sheet 1728 Sheet 1729 Sheet 1730 Sheet 1731 Sheet 1732 Sheet 1733 Sheet 1734 Sheet 1735 Sheet 1736 Sheet 1737 Sheet 1738 Sheet 1739 Sheet 1740 Sheet 1741 Sheet 1742 Sheet 1743 Sheet 1744 Sheet 1745 Sheet 1746 Sheet 1747 Sheet 1748 Sheet 1749 Sheet 1750 Sheet 1751 Sheet 1752 Sheet 1753 Sheet 1754 Sheet 1755 Sheet 1756 Sheet 1757 Sheet 1758 Sheet 1759 Sheet 1760 Sheet 1761 Sheet 1762 Sheet 1763 Sheet 1764 Sheet 1765 Sheet 1766 Sheet 1767 Sheet 1768 Sheet 1769 Sheet 1770 Sheet 1771 Sheet 1772 Sheet 1773 Sheet 1774 Sheet 1775 Sheet 1776 Sheet 1777 Sheet 1778 Sheet 1779 Sheet 1780 Sheet 1781 Sheet 1782 Sheet 1783 Sheet 1784 Sheet 1785 Sheet 1786 Sheet 1787 Sheet 1788 Sheet 1789 Sheet 1790 Sheet 1791 Sheet 1792 Sheet 1793 Sheet 1794 Sheet 1795 Sheet 1796 Sheet 1797 Sheet 1798 Sheet 1799 Sheet 1800 Sheet 1801 Sheet 1802 Sheet 1803 Sheet 1804 Sheet 1805 Sheet 1806 Sheet 1807 Sheet 1808 Sheet 1809 Sheet 1810 Sheet 1811 Sheet 1812 Sheet 1813 Sheet 1814 Sheet 1815 Sheet 1816 Sheet 1817 Sheet 1818 Sheet 1819 Sheet 1820 Sheet 1821 Sheet 1822 Sheet 1823 Sheet 1824 Sheet 1825 Sheet 1826 Sheet 1827 Sheet 1828 Sheet 1829 Sheet 1830 Sheet 1831 Sheet 1832 Sheet 1833 Sheet 1834 Sheet 1835 Sheet 1836 Sheet 1837 Sheet 1838 Sheet 1839 Sheet 1840 Sheet 1841 Sheet 1842 Sheet 1843 Sheet 1844 Sheet 1845 Sheet 1846 Sheet 1847 Sheet 1848 Sheet 1849 Sheet 1850 Sheet 1851 Sheet 1852 Sheet 1853 Sheet 1854 Sheet 1855 Sheet 1856 Sheet 1857 Sheet 1858 Sheet 1859 Sheet 1860 Sheet 1861 Sheet 1862 Sheet 1863 Sheet 1864 Sheet 1865 Sheet 1866 Sheet 1867 Sheet 1868 Sheet 1869 Sheet 1870 Sheet 1871 Sheet 1872 Sheet 1873 Sheet 1874 Sheet 1875 Sheet 1876 Sheet 1877 Sheet 1878 Sheet 1879 Sheet 1880 Sheet 1881 Sheet 1882 Sheet 1883 Sheet 1884 Sheet 1885 Sheet 1886 Sheet 1887 Sheet 1888 Sheet 1889 Sheet 1890 Sheet 1891 Sheet 1892 Sheet 1893 Sheet 1894 Sheet 1895 Sheet 1896 Sheet 1897 Sheet 1898 Sheet 1899 Sheet 1900 Sheet 1901 Sheet 1902 Sheet 1903 Sheet 1904 Sheet 1905 Sheet 1906 Sheet 1907 Sheet 1908 Sheet 1909 Sheet 1910 Sheet 1911 Sheet 1912 Sheet 1913 Sheet 1914 Sheet 1915 Sheet 1916 Sheet 1917 Sheet 1918 Sheet 1919 Sheet 1920 Sheet 1921 Sheet 1922 Sheet 1923 Sheet 1924 Sheet 1925 Sheet 1926 Sheet 1927 Sheet 1928 Sheet 1929 Sheet 1930 Sheet 1931 Sheet 1932 Sheet 1933 Sheet 1934 Sheet 1935 Sheet 1936 Sheet 1937 Sheet 1938 Sheet 1939 Sheet 1940 Sheet 1941 Sheet 1942 Sheet 1943 Sheet 1944 Sheet 1945 Sheet 1946 Sheet 1947 Sheet 1948 Sheet 1949 Sheet 1950 Sheet 1951 Sheet 1952 Sheet 1953 Sheet 1954 Sheet 1955 Sheet 1956 Sheet 1957 Sheet 1958 Sheet 1959 Sheet 1960 Sheet 1961 Sheet 1962 Sheet 1963 Sheet 1964 Sheet 1965 Sheet 1966 Sheet 1967 Sheet 1968 Sheet 1969 Sheet 1970 Sheet 1971 Sheet 1972 Sheet 1973 Sheet 1974 Sheet 1975 Sheet 1976 Sheet 1977 Sheet 1978 Sheet 1979 Sheet 1980 Sheet 1981 Sheet 1982 Sheet 1983 Sheet 1984 Sheet 1985 Sheet 1986 Sheet 1987 Sheet 1988 Sheet 1989 Sheet 1990 Sheet 1991 Sheet 1992 Sheet 1993 Sheet 1994 Sheet 1995 Sheet 1996 Sheet 1997 Sheet 1998 Sheet 1999 Sheet 2000 Sheet 2001 Sheet 2002 Sheet 2003 Sheet 2004 Sheet 2005 Sheet 2006 Sheet 2007 Sheet 2008 Sheet 2009 Sheet 2010 Sheet 2011 Sheet 2012 Sheet 2013 Sheet 2014 Sheet 2015 Sheet 2016 Sheet 2017 Sheet 2018 Sheet 2019 Sheet 2020 Sheet 2021 Sheet 2022 Sheet 2023 Sheet 2024 Sheet 2025 Sheet 2026 Sheet 2027 Sheet 2028 Sheet 2029 Sheet 2030 Sheet 2031 Sheet 2032 Sheet 2033 Sheet 2034 Sheet 2035 Sheet 2036 Sheet 2037 Sheet 2038 Sheet 2039 Sheet 2040 Sheet 2041 Sheet 2042 Sheet 2043 Sheet 2044 Sheet 2045 Sheet 2046 Sheet 2047 Sheet 2048 Sheet 2049 Sheet 2050 Sheet 2051 Sheet 2052 Sheet 2053 Sheet 2054 Sheet 2055 Sheet 2056 Sheet 2057 Sheet 2058 Sheet 2059 Sheet 2060 Sheet 2061 Sheet 2062 Sheet 2063 Sheet 2064 Sheet 2065 Sheet 2066 Sheet 2067 Sheet 2068 Sheet 2069 Sheet 2070 Sheet 2071 Sheet 2072 Sheet 2073 Sheet 2074 Sheet 2075 Sheet 2076 Sheet 2077 Sheet 2078 Sheet 2079 Sheet 2080 Sheet 2081 Sheet 2082 Sheet 2083 Sheet 2084 Sheet 2085 Sheet 2086 Sheet 2087 Sheet 2088 Sheet 2089 Sheet 2090 Sheet 2091 Sheet 2092 Sheet 2093 Sheet 2094 Sheet 2095 Sheet 2096 Sheet 2097 Sheet 2098 Sheet 2099 Sheet 2100 Sheet 2101 Sheet 2102 Sheet 2103 Sheet 2104 Sheet 2105 Sheet 2106 Sheet 2107 Sheet 2108 Sheet 2109 Sheet 2110 Sheet 2111 Sheet 2112 Sheet 2113 Sheet 2114 Sheet 2115 Sheet 2116 Sheet 2117 Sheet 2118 Sheet 2119 Sheet 2120 Sheet 2121 Sheet 2122 Sheet 2123 Sheet 2124 Sheet 2125 Sheet 2126 Sheet 2127 Sheet 2128 Sheet 2129 Sheet 2130 Sheet 2131 Sheet 2132 Sheet 2133 Sheet 2134 Sheet 2135 Sheet 2136 Sheet 2137 Sheet 2138 Sheet 2139 Sheet 2140 Sheet 2141 Sheet 2142 Sheet 2143 Sheet 2144 Sheet 2145 Sheet 2146 Sheet 2147 Sheet 2148 Sheet 2149 Sheet 2150 Sheet 2151 Sheet 2152 Sheet 2153 Sheet 2154 Sheet 2155 Sheet 2156 Sheet 2157 Sheet 2158 Sheet 2159 Sheet 2160 Sheet 2161 Sheet 2162 Sheet 2163 Sheet 2164 Sheet 2165 Sheet 2166 Sheet 2167 Sheet 2168 Sheet 2169 Sheet 2170 Sheet 2171 Sheet 2172 Sheet 2173 Sheet 2174 Sheet 2175 Sheet 2176 Sheet 2177 Sheet 2178 Sheet 2179 Sheet 2180 Sheet 2181 Sheet 2182 Sheet 2183 Sheet 2184 Sheet 2185 Sheet 2186 Sheet 2187 Sheet 2188 Sheet 2189 Sheet 2190 Sheet 2191 Sheet 2192 Sheet 2193 Sheet 2194 Sheet 2195 Sheet 2196 Sheet 2197 Sheet 2198 Sheet 2199 Sheet 2200 Sheet 2201 Sheet 2202 Sheet 2203 Sheet 2204 Sheet 2205 Sheet 2206 Sheet 2207 Sheet 2208 Sheet 2209 Sheet 2210 Sheet 2211 Sheet 2212 Sheet 2213 Sheet 2214 Sheet 2215 Sheet 2216 Sheet 2217 Sheet 2218 Sheet 2219 Sheet 2220 Sheet 2221 Sheet 2222 Sheet 2223 Sheet 2224 Sheet 2225 Sheet 2226 Sheet 2227 Sheet 2228 Sheet 2229 Sheet 2230 Sheet 2231 Sheet 2232 Sheet 2233 Sheet 2234 Sheet 2235 Sheet 2236 Sheet 2237 Sheet 2238 Sheet 2239 Sheet 2240 Sheet 2241 Sheet 2242 Sheet 2243 Sheet 2244 Sheet 2245 Sheet 2246 Sheet 2247 Sheet 2248 Sheet 2249 Sheet 2250 Sheet 2251 Sheet 2252 Sheet 2253 Sheet 2254 Sheet 2255 Sheet 2256 Sheet 2257 Sheet 2258 Sheet 2259 Sheet 2260 Sheet 2261 Sheet 2262 Sheet 2263 Sheet 2264 Sheet 2265 Sheet 2266 Sheet 2267 Sheet 2268 Sheet 2269 Sheet 2270 Sheet 2271 Sheet 2272 Sheet 2273 Sheet 2274 Sheet 2275 Sheet 2276 Sheet 2277 Sheet 2278 Sheet 2279 Sheet 2280 Sheet 2281 Sheet 2282 Sheet 2283 Sheet 2284 Sheet 2285 Sheet 2286 Sheet 2287 Sheet 2288 Sheet 2289 Sheet 2290 Sheet 2291 Sheet 2292 Sheet 2293 Sheet 2294 Sheet 2295 Sheet 2296 Sheet 2297 Sheet 2298 Sheet 2299 Sheet 2300 Sheet 2301 Sheet 2302 Sheet 2303 Sheet 2304 Sheet 2305 Sheet 2306 Sheet 2307 Sheet 2308 Sheet 2309 Sheet 2310 Sheet 2311 Sheet 2312 Sheet 2313 Sheet 2314 Sheet 2315 Sheet 2316 Sheet 2317 Sheet 2318 Sheet 2319 Sheet 2320 Sheet 2321 Sheet 2322 Sheet 2323 Sheet 2324 Sheet 2325 Sheet 2326 Sheet 2327 Sheet 2328 Sheet 2329 Sheet 2330 Sheet 2331 Sheet 2332 Sheet 2333 Sheet 2334 Sheet 2335 Sheet 2336 Sheet 2337 Sheet 2338 Sheet 2339 Sheet 2340 Sheet 2341 Sheet 2342 Sheet 2343 Sheet 2344 Sheet 2345 Sheet 2346 Sheet 2347 Sheet 2348 Sheet 2349 Sheet 2350 Sheet 2351 Sheet 2352 Sheet 2353 Sheet 2354 Sheet 2355 Sheet 2356 Sheet 2357 Sheet 2358 Sheet 2359 Sheet 2360 Sheet 2361 Sheet 2362 Sheet 2363 Sheet 2364 Sheet 2365 Sheet 2366 Sheet 2367 Sheet 2368 Sheet 2369 Sheet 2370 Sheet 2371 Sheet 2372 Sheet 2373 Sheet 2374 Sheet 2375 Sheet 2376 Sheet 2377 Sheet 2378 Sheet 2379 Sheet 2380 Sheet 2381 Sheet 2382 Sheet 2383 Sheet 2384 Sheet 2385 Sheet 2386 Sheet 2387 Sheet 2388 Sheet 2389 Sheet 2390 Sheet 2391 Sheet 2392 Sheet 2393 Sheet 2394 Sheet 2395 Sheet 2396 Sheet 2397 Sheet 2398 Sheet 2399 Sheet 2400 Sheet 2401 Sheet 2402 Sheet 2403 Sheet 2404 Sheet 2405 Sheet 2406 Sheet 2407 Sheet 2408 Sheet 2409 Sheet 2410 Sheet 2411 Sheet 2412 Sheet 2413 Sheet 2414 Sheet 2415 Sheet 2416 Sheet 2417 Sheet 2418 Sheet 2419 Sheet 2420 Sheet 2421 Sheet 2422 Sheet 2423 Sheet 2424 Sheet 2425 Sheet 2426 Sheet 2427 Sheet 2428 Sheet 2429 Sheet 2430 Sheet 2431 Sheet 2432 Sheet 2433 Sheet 2434 Sheet 2435 Sheet 2436 Sheet 2437 Sheet 2438 Sheet 2439 Sheet 2440 Sheet 2441 Sheet 2442 Sheet 2443 Sheet 2444 Sheet 2445 Sheet 2446 Sheet 2447 Sheet 2448 Sheet 2449 Sheet 2450 Sheet 2451 Sheet 2452 Sheet 2453 Sheet 2454 Sheet 2455 Sheet 2456 Sheet 2457 Sheet 2458 Sheet 2459 Sheet 2460 Sheet 2461 Sheet 2462 Sheet 2463 Sheet 2464 Sheet 2465 Sheet 2466 Sheet 2467 Sheet 2468 Sheet 2469 Sheet 2470 Sheet 2471 Sheet 2472 Sheet 2473 Sheet 2474 Sheet 2475 Sheet 2476 Sheet 2477 Sheet 2478 Sheet 2479 Sheet 2480 Sheet 2481 Sheet 2482 Sheet 2483 Sheet 2484 Sheet 2485 Sheet 2486 Sheet 2487 Sheet 2488 Sheet 2489 Sheet 2490 Sheet 2491 Sheet 2492 Sheet 2493 Sheet 2494 Sheet 2495 Sheet 2496 Sheet 2497 Sheet 2498 Sheet 2499 Sheet 2500 Sheet 2501 Sheet 2502 Sheet 2503 Sheet 2504 Sheet 2505 Sheet 2506 Sheet 2507 Sheet 2508 Sheet 2509 Sheet 2510 Sheet 2511 Sheet 2512 Sheet 2513 Sheet 2514 Sheet 2515 Sheet 2516 Sheet 2517 Sheet 2518 Sheet 2519 Sheet 2520 Sheet 2521 Sheet 2522 Sheet 2523 Sheet 2524 Sheet 2525 Sheet 2526 Sheet 2527 Sheet 2528 Sheet 2529 Sheet 2530 Sheet 2531 Sheet 2532 Sheet 2533 Sheet 2534 Sheet 2535 Sheet 2536 Sheet 2537 Sheet 2538 Sheet 2539 Sheet 2540 Sheet 2541 Sheet 2542 Sheet 2543 Sheet 2544 Sheet 2545 Sheet 2546 Sheet 2547 Sheet 2548 Sheet 2549 Sheet 2550 Sheet 2551 Sheet 2552 Sheet 2553 Sheet 2554 Sheet 2555 Sheet 2556 Sheet 2557 Sheet 2558 Sheet 2559 Sheet 2560 Sheet 2561 Sheet 2562 Sheet 2563 Sheet 2564 Sheet 2565 Sheet 2566 Sheet 2567 Sheet 2568 Sheet 2569 Sheet 2570 Sheet 2571 Sheet 2572 Sheet 2573 Sheet 2574 Sheet 2575 Sheet 2576 Sheet 2577 Sheet 2578 Sheet 2579 Sheet 2580 Sheet 2581 Sheet 2582 Sheet 2583 Sheet 2584 Sheet 2585 Sheet 2586 Sheet 2587 Sheet 2588 Sheet 2589 Sheet 2590 Sheet 2591 Sheet 2592 Sheet 2593 Sheet 2594 Sheet 2595 Sheet 2596 Sheet 2597 Sheet 2598 Sheet 2599 Sheet 2600 Sheet 2601 Sheet 2602 Sheet 2603 Sheet 2604 Sheet 2605 Sheet 2606 Sheet 2607 Sheet 2608 Sheet 2609 Sheet 2610 Sheet 2611 Sheet 2612 Sheet 2613 Sheet 2614 Sheet 2615 Sheet 2616 Sheet 2617 Sheet 2618 Sheet 2619 Sheet 2620 Sheet 2621 Sheet 2622 Sheet 2623 Sheet 2624 Sheet 2625 Sheet 2626 Sheet 2627 Sheet 2628 Sheet 2629 Sheet 2630 Sheet 2631 Sheet 2632 Sheet 2633 Sheet 2634 Sheet 2635 Sheet 2636 Sheet 2637 Sheet 2638 Sheet 2639 Sheet 2640 Sheet 2641 Sheet 2642 Sheet 2643 Sheet 2644 Sheet 2645 Sheet 2646 Sheet 2647 Sheet 2648 Sheet 2649 Sheet 2650 Sheet 2651 Sheet 2652 Sheet 2653 Sheet 2654 Sheet 2655 Sheet 2656 Sheet 2657 Sheet 2658 Sheet 2659 Sheet 2660 Sheet 2661 Sheet 2662 Sheet 2663 Sheet 2664 Sheet 2665 Sheet 2666 Sheet 2667 Sheet 2668 Sheet 2669 Sheet 2670 Sheet 2671 Sheet 2672 Sheet 2673 Sheet 2674 Sheet 2675 Sheet 2676 Sheet 2677 Sheet 2678 Sheet 2679 Sheet 2680 Sheet 2681 Sheet 2682 Sheet 2683 Sheet 2684 Sheet 2685 Sheet 2686 Sheet 2687 Sheet 2688 Sheet 2689 Sheet 2690 Sheet 2691 Sheet 2692 Sheet 2693 Sheet 2694 Sheet 2695 Sheet 2696 Sheet 2697 Sheet 2698 Sheet 2699 Sheet 2700 Sheet 2701 Sheet 2702 Sheet 2703 Sheet 2704 Sheet 2705 Sheet 2706 Sheet 2707 Sheet 2708 Sheet 2709 Sheet 2710 Sheet 2711 Sheet 2712 Sheet 2713 Sheet 2714 Sheet 2715 Sheet 2716 Sheet 2717 Sheet 2718 Sheet 2719 Sheet 2720 Sheet 2721 Sheet 2722 Sheet 2723 Sheet 2724 Sheet 2725 Sheet 2726 Sheet 2727 Sheet 2728 Sheet 2729 Sheet 2730 Sheet 2731 Sheet 2732 Sheet 2733 Sheet 2734 Sheet 2735 Sheet 2736 Sheet 2737 Sheet 2738 Sheet 2739 Sheet 2740 Sheet 2741 Sheet 2742 Sheet 2743 Sheet 2744 Sheet 2745 Sheet 2746 Sheet 2747 Sheet 2748 Sheet 2749 Sheet 2750 Sheet 2751 Sheet 2752 Sheet 2753 Sheet 2754 Sheet 2755 Sheet 2756 Sheet 2757 Sheet 2758 Sheet 2759 Sheet 2760 Sheet 2761 Sheet 2762 Sheet 2763 Sheet 2764 Sheet 2765 Sheet 2766 Sheet 2767 Sheet 2768 Sheet 2769 Sheet 2770 Sheet 2771 Sheet 2772 Sheet 2773 Sheet 2774 Sheet 2775 Sheet 2776 Sheet 2777 Sheet 2778 Sheet 2779 Sheet 2780 Sheet 2781 Sheet 2782 Sheet 2783 Sheet 2784 Sheet 2785 Sheet 2786 Sheet 2787 Sheet 2788 Sheet 2789 Sheet 2790 Sheet 2791 Sheet 2792 Sheet 2793 Sheet 2794 Sheet 2795 Sheet 2796 Sheet 2797 Sheet 2798 Sheet 2799 Sheet 2800 Sheet 2801 Sheet 2802 Sheet 2803 Sheet 2804 Sheet 2805 Sheet 2806 Sheet 2807 Sheet 2808 Sheet 2809 Sheet 2810 Sheet 2811 Sheet 2812 Sheet 2813 Sheet 2814 Sheet 2815 Sheet 2816 Sheet 2817 Sheet 2818 Sheet 2819 Sheet 2820 Sheet 2821 Sheet 2822 Sheet 2823 Sheet 2824 Sheet 2825 Sheet 2826 Sheet 2827 Sheet 2828 Sheet 2829 Sheet 2830 Sheet 2831 Sheet 2832 Sheet 2833 Sheet 2834 Sheet 2835 Sheet 2836 Sheet 2837 Sheet 2838 Sheet 2839 Sheet 2840 Sheet 2841 Sheet 2842 Sheet 2843 Sheet 2844 Sheet 2845 Sheet 2846 Sheet 2847 Sheet 2848 Sheet 2849 Sheet 2850 Sheet 2851 Sheet 2852 Sheet 2853 Sheet 2854 Sheet 2855 Sheet 2856 Sheet 2857 Sheet 2858 Sheet 2859 Sheet 2860 Sheet 2861 Sheet 2862 Sheet 2863 Sheet 2864 Sheet 2865 Sheet 2866 Sheet 2867 Sheet 2868 Sheet 2869 Sheet 2870 Sheet 2871 Sheet 2872 Sheet 2873 Sheet 2874 Sheet 2875 Sheet 2876 Sheet 2877 Sheet 2878 Sheet 2879 Sheet 2880 Sheet 2881 Sheet 2882 Sheet 2883 Sheet 2884 Sheet 2885 Sheet 2886 Sheet 2887 Sheet 2888 Sheet 2889 Sheet 2890 Sheet 2891 Sheet 2892 Sheet 2893 Sheet 2894 Sheet 2895 Sheet 2896 Sheet 2897 Sheet 2898 Sheet 2899 Sheet 2900 Sheet 2901 Sheet 2902 Sheet 2903 Sheet 2904 Sheet 2905 Sheet 2906 Sheet 2907 Sheet 2908 Sheet 2909 Sheet 2910 Sheet 2911 Sheet 2912 Sheet 2913 Sheet 2914 Sheet 2915 Sheet 2916 Sheet 2917 Sheet 2918 Sheet 2919 Sheet 2920 Sheet 2921 Sheet 2922 Sheet 2923 Sheet 2924 Sheet 2925 Sheet 2926 Sheet 2927 Sheet 2928 Sheet 2929 Sheet 2930 Sheet 2931 Sheet 2932 Sheet 2933 Sheet 2934 Sheet 2935 Sheet 2936 Sheet 2937 Sheet 2938 Sheet 2939 Sheet 2940 Sheet 2941 Sheet 2942 Sheet 2943 Sheet 2944 Sheet 2945 Sheet 2946 Sheet 2947 Sheet 2948 Sheet 2949 Sheet 2950 Sheet 2951 Sheet 2952 Sheet 2953 Sheet 2954 Sheet 2955 Sheet 2956 Sheet 2957 Sheet 2958 Sheet 2959 Sheet 2960 Sheet 2961 Sheet 2962 Sheet 2963 Sheet 2964 Sheet 2965 Sheet 2966 Sheet 2967 Sheet 2968 Sheet 2969 Sheet 2970 Sheet 2971 Sheet 2972 Sheet 2973 Sheet 2974 Sheet 2975 Sheet 2976 Sheet 2977 Sheet 2978 Sheet 2979 Sheet 2980 Sheet 2981 Sheet 2982 Sheet 2983 Sheet 2984 Sheet 2985 Sheet 2986 Sheet 2987 Sheet 2988 Sheet 2989 Sheet 2990 Sheet 2991 Sheet 2992 Sheet 2993 Sheet 2994 Sheet 2995 Sheet 2996 Sheet 2997 Sheet 2998 Sheet 2999 Sheet 3000 Sheet 3001 Sheet 3002 Sheet 3003 Sheet 3004 Sheet 3005 Sheet 3006 Sheet 3007 Sheet 3008 Sheet 3009 Sheet 3010 Sheet 3011 Sheet 3012 Sheet 3013 Sheet 3014 Sheet 3015 Sheet 3016 Sheet 3017 Sheet 3018 Sheet 3019 Sheet 3020 Sheet 3021 Sheet 3022 Sheet 3023 Sheet 3024 Sheet 3025 Sheet 3026 Sheet 3027 Sheet 3028 Sheet 3029 Sheet 3030 Sheet 3031 Sheet 3032 Sheet 3033 Sheet 3034 Sheet 3035 Sheet 3036 Sheet 3037 Sheet 3038 Sheet 3039 Sheet 3040 Sheet 3041 Sheet 3042 Sheet 3043 Sheet 3044 Sheet 3045 Sheet 3046 Sheet 3047 Sheet 3048 Sheet 3049 Sheet 3050 Sheet 3051 Sheet 3052 Sheet 3053 Sheet 3054 Sheet 3055 Sheet 3056 Sheet 3057 Sheet 3058 Sheet 3059 Sheet 3060 Sheet 3061 Sheet 3062 Sheet 3063 Sheet 3064 Sheet 3065 Sheet 3066 Sheet 3067 Sheet 3068 Sheet 3069 Sheet 3070 Sheet 3071 Sheet 3072 Sheet 3073 Sheet 3074 Sheet 3075 Sheet 3076 Sheet 3077 Sheet 3078 Sheet 3079 Sheet 3080 Sheet 3081 Sheet 3082 Sheet 3083 Sheet 3084 Sheet 3085 Sheet 3086 Sheet 3087 Sheet 3088 Sheet 3089 Sheet 3090 Sheet 3091 Sheet 3092 Sheet 3093 Sheet 3094 Sheet 3095 Sheet 3096 Sheet 3097 Sheet 3098 Sheet 3099 Sheet 3100 Sheet 3101 Sheet 3102 Sheet 3103 Sheet 3104 Sheet 3105 Sheet 3106 Sheet 3107 Sheet 3108 Sheet 3109 Sheet 3110 Sheet 3111 Sheet 3112 Sheet 3113 Sheet 3114 Sheet 3115 Sheet 3116 Sheet 3117 Sheet 3118 Sheet 3119 Sheet 3120 Sheet 3121 Sheet 3122 Sheet 3123 Sheet 3124 Sheet 3125 Sheet 3126 Sheet 3127 Sheet 3128 Sheet 3129 Sheet 3130 Sheet 3131 Sheet 3132 Sheet 3133 Sheet 3134 Sheet 3135 Sheet 3136 Sheet 3137 Sheet 3138 Sheet 3139 Sheet 3140 Sheet 3141 Sheet 3142 Sheet 3143 Sheet 3144 Sheet 3145 Sheet 3146 Sheet 3147 Sheet 3148 Sheet 3149 Sheet 3150 Sheet 3151 Sheet 3152 Sheet 3153 Sheet 3154 Sheet 3155 Sheet 3156 Sheet 3157 Sheet 3158 Sheet 3159 Sheet 3160 Sheet 3161 Sheet 3162 Sheet 3163 Sheet 3164 Sheet 3165 Sheet 3166 Sheet 3167 Sheet 3168 Sheet 3169 Sheet 3170 Sheet 3171 Sheet 3172 Sheet 3173 Sheet 3174 Sheet 3175 Sheet 3176 Sheet 3177 Sheet 3178 Sheet 3179 Sheet 3180 Sheet 3181 Sheet 3182 Sheet 3183 Sheet 3184 Sheet 3185 Sheet 3186 Sheet 3187 Sheet 3188 Sheet 3189 Sheet 3190 Sheet 3191 Sheet 3192 Sheet 3193 Sheet 3194 Sheet 3195 Sheet 3196 Sheet 3197 Sheet 3198 Sheet 3199 Sheet 3200 Sheet 3201 Sheet 3202 Sheet 3203 Sheet 3204 Sheet 3205 Sheet 3206 Sheet 3207 Sheet 3208 Sheet 3209 Sheet 3210 Sheet 3211 Sheet 3212 Sheet 3213 Sheet 3214 Sheet 3215 Sheet 3216 Sheet 3217 Sheet 3218 Sheet 3219 Sheet 3220 Sheet 3221 Sheet 3222 Sheet 3223 Sheet 3224 Sheet 3225 Sheet 3226 Sheet 3227 Sheet 3228 Sheet 3229 Sheet 3230 Sheet 3231 Sheet 3232 Sheet 3233 Sheet 3234 Sheet 3235 Sheet 3236 Sheet 3237 Sheet 3238 Sheet 3239 Sheet 3240 Sheet 3241 Sheet 3242 Sheet 3243 Sheet 3244 Sheet 3245 Sheet 3246 Sheet 3247 Sheet 3248 Sheet 3249 Sheet 3250 Sheet 3251 Sheet 3252 Sheet 3253 Sheet 3254 Sheet 3255 Sheet 3256 Sheet 3257 Sheet 3258 Sheet 3259 Sheet 3260 Sheet 3261 Sheet 3262 Sheet 3263 Sheet 3264 Sheet 3265 Sheet 3266 Sheet 3267 Sheet 3268 Sheet 3269 Sheet 3270 Sheet 3271 Sheet 3272 Sheet 3273 Sheet 3274 Sheet 3275 Sheet 3276 Sheet 3277 Sheet 3278 Sheet 3279 Sheet 3280 Sheet 3281 Sheet 3282 Sheet 3283 Sheet 3284 Sheet 3285 Sheet 3286 Sheet 3287 Sheet 3288 Sheet 3289 Sheet 3290 Sheet 3291 Sheet 3292 Sheet 3293 Sheet 3294 Sheet 3295 Sheet 3296 Sheet 3297 Sheet 3298 Sheet 3299 Sheet 3300 Sheet 3301 Sheet 3302 Sheet 3303 Sheet 3304 Sheet 3305 Sheet 3306 Sheet 3307 Sheet 3308 Sheet 3309 Sheet 3310 Sheet 3311 Sheet 3312 Sheet 3313 Sheet 3314 Sheet 3315 Sheet 3316 Sheet 3317 Sheet 3318 Sheet 3319 Sheet 3320 Sheet 3321 Sheet 3322 Sheet 3323 Sheet 3324 Sheet 3325 Sheet 3326 Sheet 3327 Sheet 3328 Sheet 3329 Sheet 3330 Sheet 3331 Sheet 3332 Sheet 3333 Sheet 3334 Sheet 3335 Sheet 3336 Sheet 3337 Sheet 3338 Sheet 3339 Sheet 3340 Sheet 3341 Sheet 3342 Sheet 3343 Sheet 3344 Sheet 3345 Sheet 3346 Sheet 3347 Sheet 3348 Sheet 3349 Sheet 3350 Sheet 3351 Sheet 3352 Sheet 3353 Sheet 3354 Sheet 3355 Sheet 3356 Sheet 3357 Sheet 3358 Sheet 3359 Sheet 3360 Sheet 3361 Sheet 3362 Sheet 3363 Sheet 3364 Sheet 3365 Sheet 3366 Sheet 3367 Sheet 3368 Sheet 3369 Sheet 3370 Sheet 3371 Sheet 3372 Sheet 3373 Sheet 3374 Sheet 3375 Sheet 3376 Sheet 3377 Sheet 3378 Sheet 3379 Sheet 3380 Sheet 3381 Sheet 3382 Sheet 3383 Sheet 3384 Sheet 3385 Sheet 3386 Sheet 3387 Sheet 3388 Sheet 3389 Sheet 3390 Sheet 3391 Sheet 3392 Sheet 3393 Sheet 3394 Sheet 3395 Sheet 3396 Sheet 3397 Sheet 3398 Sheet 3399 Sheet 3400 Sheet 3401 Sheet 3402 Sheet 3403 Sheet 3404 Sheet 3405 Sheet 3406 Sheet 3407 Sheet 3408 Sheet 3409 Sheet 3410 Sheet 3411 Sheet 3412 Sheet 3413 Sheet 3414 Sheet 3415 Sheet 3416 Sheet 3417 Sheet 3418 Sheet 3419 Sheet 3420 Sheet 3421 Sheet 3422 Sheet 3423 Sheet 3424 Sheet 3425 Sheet 3426 Sheet 3427 Sheet 3428 Sheet 3429 Sheet 3430 Sheet 3431 Sheet 3432 Sheet 3433 Sheet 3434 Sheet 3435 Sheet 3436 Sheet 3437 Sheet 3438 Sheet 3439 Sheet 3440 Sheet 3441 Sheet 3442 Sheet 3443 Sheet 3444 Sheet 3445 Sheet 3446 Sheet 3447 Sheet 3448 Sheet 3449 Sheet 3450 Sheet 3451 Sheet 3452 Sheet 3453 Sheet 3454 Sheet 3455 Sheet 3456 Sheet 3457 Sheet 3458 Sheet 3459 Sheet 3460 Sheet 3461 Sheet 3462 Sheet 3463 Sheet 3464 Sheet 3465 Sheet 3466 Sheet 3467 Sheet 3468 Sheet 3469 Sheet 3470 Sheet 3471 Sheet 3472 Sheet 3473 Sheet 3474 Sheet 3475 Sheet 3476 Sheet 3477 Sheet 3478 Sheet 3479 Sheet 3480 Sheet 3481 Sheet 3482 Sheet 3483 Sheet 3484 Sheet 3485 Sheet 3486 Sheet 3487 Sheet 3488 Sheet 3489 Sheet 3490 Sheet 3491 Sheet 3492 Sheet 3493 Sheet 3494 Sheet 3495 Sheet 3496 Sheet 3497 Sheet 3498 Sheet 3499 Sheet 3500 Sheet 3501 Sheet 3502 Sheet 3503 Sheet 3504 Sheet 3505 Sheet 3506 Sheet 3507 Sheet 3508 Sheet 3509 Sheet 3510 Sheet 3511 Sheet 3512 Sheet 3513 Sheet 3514 Sheet 3515 Sheet 3516 Sheet 3517 Sheet 3518 Sheet 3519 Sheet 3520 Sheet 3521 Sheet 3522 Sheet 3523 Sheet 3524 Sheet 3525 Sheet 3526 Sheet 3527 Sheet 3528 Sheet 3529 Sheet 3530 Sheet 3531 Sheet 3532 Sheet 3533 Sheet 3534 Sheet 3535 Sheet 3536 Sheet 3537 Sheet 3538 Sheet 3539 Sheet 3540 Sheet 3541 Sheet 3542 Sheet 3543 Sheet 3544 Sheet 3545 Sheet 3546 Sheet 3547 Sheet 3548 Sheet 3549 Sheet 3550 Sheet 3551 Sheet 3552 Sheet 3553 Sheet 3554 Sheet 3555 Sheet 3556 Sheet 3557 Sheet 3558 Sheet 3559 Sheet 3560 Sheet 3561 Sheet 3562 Sheet 3563 Sheet 3564 Sheet 3565 Sheet 3566 Sheet 3567 Sheet 3568 Sheet 3569 Sheet 3570 Sheet 3571 Sheet 3572 Sheet 3573 Sheet 3574 Sheet 3575 Sheet 3576 Sheet 3577 Sheet 3578 Sheet 3579 Sheet 3580 Sheet 3581 Sheet 3582 Sheet 3583 Sheet 3584 Sheet 3585 Sheet 3586 Sheet 3587 Sheet 3588 Sheet 3589 Sheet 3590 Sheet 3591 Sheet 3592 Sheet 3593 Sheet 3594 Sheet 3595 Sheet 3596 Sheet 3597 Sheet 3598 Sheet 3599 Sheet 3600 Sheet 3601 Sheet 3602 Sheet 3603 Sheet 3604 Sheet 3605 Sheet 3606 Sheet 3607 Sheet 3608 Sheet 3609 Sheet 3610 Sheet 3611 Sheet 3612 Sheet 3613 Sheet 3614 Sheet 3615 Sheet 3616 Sheet 3617 Sheet 3618 Sheet 3619 Sheet 3620 Sheet 3621 Sheet 3622 Sheet 3623 Sheet 3624 Sheet 3625 Sheet 3626 Sheet 3627 Sheet 3628 Sheet 3629 Sheet 3630 Sheet 3631 Sheet 3632 Sheet 3633 Sheet 3634 Sheet 3635 Sheet 3636 Sheet 3637 Sheet 3638 Sheet 3639 Sheet 3640 Sheet 3641 Sheet 3642 Sheet 3643 Sheet 3644 Sheet 3645 Sheet 3646 Sheet 3647 Sheet 3648 Sheet 3649 Sheet 3650 Sheet 3651 Sheet 3652 Sheet 3653 Sheet 3654 Sheet 3655 Sheet 3656 Sheet 3657 Sheet 3658 Sheet 3659 Sheet 3660 Sheet 3661 Sheet 3662 Sheet 3663 Sheet 3664 Sheet 3665 Sheet 3666 Sheet 3667 Sheet 3668 Sheet 3669 Sheet 3670 Sheet 3671 Sheet 3672 Sheet 3673 Sheet 3674 Sheet 3675 Sheet 3676 Sheet 3677 Sheet 3678 Sheet 3679 Sheet 3680 Sheet 3681 Sheet 3682 Sheet 3683 Sheet 3684 Sheet 3685 Sheet 3686 Sheet 3687 Sheet 3688 Sheet 3689 Sheet 3690 Sheet 3691 Sheet 3692 Sheet 3693 Sheet 3694 Sheet 3695 Sheet 3696 Sheet 3697 Sheet 3698 Sheet 3699 Sheet 3700 Sheet 3701 Sheet 3702 Sheet 3703 Sheet 3704 Sheet 3705 Sheet 3706 Sheet 3707 Sheet 3708 Sheet 3709 Sheet 3710 Sheet 3711 Sheet 3712 Sheet 3713 Sheet 3714 Sheet 3715 Sheet 3716 Sheet 3717 Sheet 3718 Sheet 3719 Sheet 3720 Sheet 3721 Sheet 3722 Sheet 3723 Sheet 3724 Sheet 3725 Sheet 3726 Sheet 3727 Sheet 3728 Sheet 3729 Sheet 3730 Sheet 3731 Sheet 3732 Sheet 3733 Sheet 3734 Sheet 3735 Sheet 3736 Sheet 3737 Sheet 3738 Sheet 3739 Sheet 3740 Sheet 3741 Sheet 3742 Sheet 3743 Sheet 3744 Sheet 3745 Sheet 3746 Sheet 3747 Sheet 3748 Sheet 3749 Sheet 3750 Sheet 3751 Sheet 3752 Sheet 3753 Sheet 3754 Sheet 3755 Sheet 3756 Sheet 3757 Sheet 3758 Sheet 3759 Sheet 3760 Sheet 3761 Sheet 3762 Sheet 3763 Sheet 3764 Sheet 3765 Sheet 3766 Sheet 3767 Sheet 3768 Sheet 3769 Sheet 3770 Sheet 3771 Sheet 3772 Sheet 3773 Sheet 3774 Sheet 3775 Sheet 3776 Sheet 3777 Sheet 3778 Sheet 3779 Sheet 3780 Sheet 3781 Sheet 3782 Sheet 3783 Sheet 3784 Sheet 3785 Sheet 3786 Sheet 3787 Sheet 3788 Sheet 3789 Sheet 3790 Sheet 3791 Sheet 3792 Sheet 3793 Sheet 3794 Sheet 3795 Sheet 3796 Sheet 3797 Sheet 3798 Sheet 3799 Sheet 3800 Sheet 3801 Sheet 3802 Sheet 3803 Sheet 3804 Sheet 3805 Sheet 3806 Sheet 3807 Sheet 3808 Sheet 3809 Sheet 3810 Sheet 3811 Sheet 3812 Sheet 3813 Sheet 3814 Sheet 3815 Sheet 3816 Sheet 3817 Sheet 3818 Sheet 3819 Sheet 3820 Sheet 3821 Sheet 3822 Sheet 3823 Sheet 3824 Sheet 3825 Sheet 3826 Sheet 3827 Sheet 3828 Sheet 3829 Sheet 3830 Sheet 3831 Sheet 3832 Sheet 3833 Sheet 3834 Sheet 3835 Sheet 3836 Sheet 3837 Sheet 3838 Sheet 3839 Sheet 3840 Sheet 3841 Sheet 3842 Sheet 3843 Sheet 3844 Sheet 3845 Sheet 3846 Sheet 3847 Sheet 3848 Sheet 3849 Sheet 3850 Sheet 3851 Sheet 3852 Sheet 3853 Sheet 3854 Sheet 3855 Sheet 3856 Sheet 3857 Sheet 3858 Sheet 3859 Sheet 3860 Sheet 3861 Sheet 3862 Sheet 3863 Sheet 3864 Sheet 3865 Sheet 3866 Sheet 3867 Sheet 3868 Sheet 3869 Sheet 3870 Sheet 3871 Sheet 3872 Sheet 3873 Sheet 3874 Sheet 3875 Sheet 3876 Sheet 3877 Sheet 3878 Sheet 3879 Sheet 3880 Sheet 3881 Sheet 3882 Sheet 3883 Sheet 3884 Sheet 3885 Sheet 3886 Sheet 3887 Sheet 3888 Sheet 3889 Sheet 3890 Sheet 3891 Sheet 3892 Sheet 3893 Sheet 3894 Sheet 3895 Sheet 3896 Sheet 3897 Sheet 3898 Sheet 3899 Sheet 3900 Sheet 3901 Sheet 3902 Sheet 3903 Sheet 3904 Sheet 3905 Sheet 3906 Sheet 3907 Sheet 3908 Sheet 3909 Sheet 3910 Sheet 3911 Sheet 3912 Sheet 3913 Sheet 3914 Sheet 3915 Sheet 3916 Sheet 3917 Sheet 3918 Sheet 3919 Sheet 3920 Sheet 3921 Sheet 3922 Sheet 3923 Sheet 3924 Sheet 3925 Sheet 3926 Sheet 3927 Sheet 3928 Sheet 3929 Sheet 3930 Sheet 3931 Sheet 3932 Sheet 3933 Sheet 3934 Sheet 3935 Sheet 3936 Sheet 3937 Sheet 3938 Sheet 3939 Sheet 3940 Sheet 3941 Sheet 3942 Sheet 3943 Sheet 3944 Sheet 3945 Sheet 3946 Sheet 3947 Sheet 3948 Sheet 3949 Sheet 3950 Sheet 3951 Sheet 3952 Sheet 3953 Sheet 3954 Sheet 3955 Sheet 3956 Sheet 3957 Sheet 3958 Sheet 3959 Sheet 3960 Sheet 3961 Sheet 3962 Sheet 3963 Sheet 3964 Sheet 3965 Sheet 3966 Sheet 3967 Sheet 3968 Sheet 3969 Sheet 3970 Sheet 3971 Sheet 3972 Sheet 3973 Sheet 3974 Sheet 3975 Sheet 3976 Sheet 3977 Sheet 3978 Sheet 3979 Sheet 3980 Sheet 3981 Sheet 3982 Sheet 3983 Sheet 3984 Sheet 3985 Sheet 3986 Sheet 3987 Sheet 3988 Sheet 3989 Sheet 3990 Sheet 3991 Sheet 3992 Sheet 3993 Sheet 3994 Sheet 3995 Sheet 3996 Sheet 3997 Sheet 3998 Sheet 3999 Sheet 4000 Sheet 4001 Sheet 4002 Sheet 4003 Sheet 4004 Sheet 4005 Sheet 4006 Sheet 4007 Sheet 4008 Sheet 4009 Sheet 4010 Sheet 4011 Sheet 4012 Sheet 4013 Sheet 4014 Sheet 4015 Sheet 4016 Sheet 4017 Sheet 4018 Sheet 4019 Sheet 4020 Sheet 4021 Sheet 4022 Sheet 4023 Sheet 4024 Sheet 4025 Sheet 4026 Sheet 4027 Sheet 4028 Sheet 4029 Sheet 4030 Sheet 4031 Sheet 4032 Sheet 4033 Sheet 4034 Sheet 4035 Sheet 4036 Sheet 4037 Sheet 4038 Sheet 4039 Sheet 4040 Sheet 4041 Sheet 4042 Sheet 4043 Sheet 4044 Sheet 4045 Sheet 4046 Sheet 4047 Sheet 4048 Sheet 4049 Sheet 4050 Sheet 4051 Sheet 4052 Sheet 4053 Sheet 4054 Sheet 4055 Sheet 4056 Sheet 4057 Sheet 4058 Sheet 4059 Sheet 4060 Sheet 4061 Sheet 4062 Sheet 4063 Sheet 4064 Sheet 4065 Sheet 4066 Sheet 4067 Sheet 4068 Sheet 4069 Sheet 4070 Sheet 4071 Sheet 4072 Sheet 4073 Sheet 4074 Sheet 4075 Sheet 4076 Sheet 4077 Sheet 4078 Sheet 4079 Sheet 4080 Sheet 4081 Sheet 4082 Sheet 4083 Sheet 4084 Sheet 4085 Sheet 4086 Sheet 4087 Sheet 4088 Sheet 4089 Sheet 4090 Sheet 4091 Sheet 4092 Sheet 4093 Sheet 4094 Sheet 4095 Sheet 4096 Sheet 4097 Sheet 4098 Sheet 4099 Sheet 4100 Sheet 4101 Sheet 4102 Sheet 4103 Sheet 4104 Sheet 4105 Sheet 4106 Sheet 4107 Sheet 4108 Sheet 4109 Sheet 4110 Sheet 4111 Sheet 4112 Sheet 4113 Sheet 4114 Sheet 4115 Sheet 4116 Sheet 4117 Sheet 4118 Sheet 4119 Sheet 4120 Sheet 4121 Sheet 4122 Sheet 4123 Sheet 4124 Sheet 4125 Sheet 4126 Sheet 4127 Sheet 4128 Sheet 4129 Sheet 4130 Sheet 4131 Sheet 4132 Sheet 4133 Sheet 4134 Sheet 4135 Sheet 4136 Sheet 4137 Sheet 4138 Sheet 4139 Sheet 4140 Sheet 4141 Sheet 4142 Sheet 4143 Sheet 4144 Sheet 4145 Sheet 4146 Sheet 4147 Sheet 4148 Sheet 4149 Sheet 4150 Sheet 4151 Sheet 4152 Sheet 4153 Sheet 4154 Sheet 4155 Sheet 4156 Sheet 4157 Sheet 4158 Sheet 4159 Sheet 4160 Sheet 4161 Sheet 4162 Sheet 4163 Sheet 4164 Sheet 4165 Sheet 4166 Sheet 4167 Sheet 4168 Sheet 4169 Sheet 4170 Sheet 4171 Sheet 4172 Sheet 4173 Sheet 4174 Sheet 4175 Sheet 4176 Sheet 4177 Sheet 4178 Sheet 4179 Sheet 4180 Sheet 4181 Sheet 4182 Sheet 4183 Sheet 4184 Sheet 4185 Sheet 4186 Sheet 4187 Sheet 4188 Sheet 4189 Sheet 4190 Sheet 4191 Sheet 4192 Sheet 4193 Sheet 4194 Sheet 4195 Sheet 4196 Sheet 4197 Sheet 4198 Sheet 4199 Sheet 4200 Sheet 4201 Sheet 4202 Sheet 4203 Sheet 4204 Sheet 4205 Sheet 4206 Sheet 4207 Sheet 4208 Sheet 4209 Sheet 4210 Sheet 4211 Sheet 4212 Sheet 4213 Sheet 4214 Sheet 4215 Sheet 4216 Sheet 4217 Sheet 4218 Sheet 4219 Sheet 4220 Sheet 4221 Sheet 4222 Sheet 4223 Sheet 4224 Sheet 4225 Sheet 4226 Sheet 4227 Sheet 4228 Sheet 4229 Sheet 4230 Sheet 4231 Sheet 4232 Sheet 4233 Sheet 4234 Sheet 4235 Sheet 4236 Sheet 4237 Sheet 4238 Sheet 4239 Sheet 4240 Sheet 4241 Sheet 4242 Sheet 4243 Sheet 4244 Sheet 4245 Sheet 4246 Sheet 4247 Sheet 4248 Sheet 4249 Sheet 4250 Sheet 4251 Sheet 4252 Sheet 4253 Sheet 4254 Sheet 4255 Sheet 4256 Sheet 4257 Sheet 4258 Sheet 4259 Sheet 4260 Sheet 4261 Sheet 4262 Sheet 4263 Sheet 4264 Sheet 4265 Sheet 4266 Sheet 4267 Sheet 4268 Sheet 4269 Sheet 4270 Sheet 4271 Sheet 4272 Sheet 4273 Sheet 4274 Sheet 4275 Sheet 4276 Sheet 4277 Sheet 4278 Sheet 4279 Sheet 4280 Sheet 4281 Sheet 4282 Sheet 4283 Sheet 4284 Sheet 4285 Sheet 4286 Sheet 4287 Sheet 4288 Sheet 4289 Sheet 4290 Sheet 4291 Sheet 4292 Sheet 4293 Sheet 4294 Sheet 4295 Sheet 4296 Sheet 4297 Sheet 4298 Sheet 4299 Sheet 4300 Sheet 4301 Sheet 4302 Sheet 4303 Sheet 4304 Sheet 4305 Sheet 4306 Sheet 4307 Sheet 4308 Sheet 4309 Sheet 4310 Sheet 4311 Sheet 4312 Sheet 4313 Sheet 4314 Sheet 4315 Sheet 4316 Sheet 4317 Sheet 4318 Sheet 4319 Sheet 4320 Sheet 4321 Sheet 4322 Sheet 4323 Sheet 4324 Sheet 4325 Sheet 4326 Sheet 4327 Sheet 4328 Sheet 4329 Sheet 4330 Sheet 4331 Sheet 4332 Sheet 4333 Sheet 4334 Sheet 4335 Sheet 4336 Sheet 4337 Sheet 4338 Sheet 4339 Sheet 4340 Sheet 4341 Sheet 4342 Sheet 4343 Sheet 4344 Sheet 4345 Sheet 4346 Sheet 4347 Sheet 4348 Sheet 4349 Sheet 4350 Sheet 4351 Sheet 4352 Sheet 4353 Sheet 4354 Sheet 4355 Sheet 4356 Sheet 4357 Sheet 4358 Sheet 4359 Sheet 4360 Sheet 4361 Sheet 4362 Sheet 4363 Sheet 4364 Sheet 4365 Sheet 4366 Sheet 4367 Sheet 4368 Sheet 4369 Sheet 4370 Sheet 4371 Sheet 4372 Sheet 4373 Sheet 4374 Sheet 4375 Sheet 4376 Sheet 4377 Sheet 4378 Sheet 4379 Sheet 4380 Sheet 4381 Sheet 4382 Sheet 4383 Sheet 4384 Sheet 4385 Sheet 4386 Sheet 4387 Sheet 4388 Sheet 4389 Sheet 4390 Sheet 4391 Sheet 4392 Sheet 4393 Sheet 4394 Sheet 4395 Sheet 4396 Sheet 4397 Sheet 4398 Sheet 4399 Sheet 4400 Sheet 4401 Sheet 4402 Sheet 4403 Sheet 4404 Sheet 4405 Sheet 4406 Sheet 4407 Sheet 4408 Sheet 4409 Sheet 4410 Sheet 4411 Sheet 4412 Sheet 4413 Sheet 4414 Sheet 4415 Sheet 4416 Sheet 4417 Sheet 4418 Sheet 4419 Sheet 4420 Sheet 4421 Sheet 4422 Sheet 4423 Sheet 4424 Sheet 4425 Sheet 4426 Sheet 4427 Sheet 4428 Sheet 4429 Sheet 4430 Sheet 4431 Sheet 4432 Sheet 4433 Sheet 4434 Sheet 4435 Sheet 4436 Sheet 4437 Sheet 4438 Sheet 4439 Sheet 4440 Sheet 4441 Sheet 4442 Sheet 4443 Sheet 4444 Sheet 4445 Sheet 4446 Sheet 4447 Sheet 4448 Sheet 4449 Sheet 4450 Sheet 4451 Sheet 4452 Sheet 4453 Sheet 4454 Sheet 4455 Sheet 4456 Sheet 4457 Sheet 4458 Sheet 4459 Sheet 4460 Sheet 4461 Sheet 4462 Sheet 4463 Sheet 4464 Sheet 4465 Sheet 4466 Sheet 4467 Sheet 4468 Sheet 4469 Sheet 4470 Sheet 4471 Sheet 4472 Sheet 4473 Sheet 4474 Sheet 4475 Sheet 4476 Sheet 4477 Sheet 4478 Sheet 4479 Sheet 4480 Sheet 4481 Sheet 4482 Sheet 4483 Sheet 4484 Sheet 4485 Sheet 4486 Sheet 4487 Sheet 4488 Sheet 4489 Sheet 4490 Sheet 4491 Sheet 4492 Sheet 4493 Sheet 4494 Sheet 4495 Sheet 4496 Sheet 4497 Sheet 4498 Sheet 4499 Sheet 4500 Sheet 4501 Sheet 4502 Sheet 4503 Sheet 4504 Sheet 4505 Sheet 4506 Sheet 4507 Sheet 4508 Sheet 4509 Sheet 4510 Sheet 4511 Sheet 4512 Sheet 4513 Sheet 4514 Sheet 4515 Sheet 4516 Sheet 4517 Sheet 4518 Sheet 4519 Sheet 4520 Sheet 4521 Sheet 4522 Sheet 4523 Sheet 4524 Sheet 4525 Sheet 4526 Sheet 4527 Sheet 4528 Sheet 4529 Sheet 4530 Sheet 4531 Sheet 4532 Sheet 4533 Sheet 4534 Sheet 4535 Sheet 4536 Sheet 4537 Sheet 4538 Sheet 4539 Sheet 4540 Sheet 4541 Sheet 4542 Sheet 4543 Sheet 4544 Sheet 4545 Sheet 4546 Sheet 4547 Sheet 4548 Sheet 4549 Sheet 4550 Sheet 4551 Sheet 4552 Sheet 4553 Sheet 4554 Sheet 4555 Sheet 4556 Sheet 4557 Sheet 4558 Sheet 4559 Sheet 4560 Sheet 4561 Sheet 4562 Sheet 4563 Sheet 4564 Sheet 4565 Sheet 4566 Sheet 4567 Sheet 4568 Sheet 4569 Sheet 4570 Sheet 4571 Sheet 4572 Sheet 4573 Sheet 4574 Sheet 4575 Sheet 4576 Sheet 4577 Sheet 4578 Sheet 4579 Sheet 4580 Sheet 4581 Sheet 4582 Sheet 4583 Sheet 4584 Sheet 4585 Sheet 4586 Sheet 4587 Sheet 4588 Sheet 4589 Sheet 4590 Sheet 4591 Sheet 4592 Sheet 4593 Sheet 4594 Sheet 4595 Sheet 4596 Sheet 4597 Sheet 4598 Sheet 4599 Sheet 4600 Sheet 4601 Sheet 4602 Sheet 4603 Sheet 4604 Sheet 4605 Sheet 4606 Sheet 4607 Sheet 4608 Sheet 4609 Sheet 4610 Sheet 4611 Sheet 4612 Sheet 4613 Sheet 4614 Sheet 4615 Sheet 4616 Sheet 4617 Sheet 4618 Sheet 4619 Sheet 4620 Sheet 4621 Sheet 4622 Sheet 4623 Sheet 4624 Sheet 4625 Sheet 4626 Sheet 4627 Sheet 4628 Sheet 4629 Sheet 4630 Sheet 4631 Sheet 4632 Sheet 4633 Sheet 4634 Sheet 4635 Sheet 4636 Sheet 4637 Sheet 4638 Sheet 4639 Sheet 4640 Sheet 4641 Sheet 4642 Sheet 4643 Sheet 4644 Sheet 4645 Sheet 4646 Sheet 4647 Sheet 4648 Sheet 4649 Sheet 4650 Sheet 4651 Sheet 4652 Sheet 4653 Sheet 4654 Sheet 4655 Sheet 4656 Sheet 4657 Sheet 4658 Sheet 4659 Sheet 4660 Sheet 4661 Sheet 4662 Sheet 4663 Sheet 4664 Sheet 4665 Sheet 4666 Sheet 4667 Sheet 4668 Sheet 4669 Sheet 4670 Sheet 4671 Sheet 4672 Sheet 4673 Sheet 4674 Sheet 4675 Sheet 4676 Sheet 4677 Sheet 4678 Sheet 4679 Sheet 4680 Sheet 4681 Sheet 4682 Sheet 4683 Sheet 4684 Sheet 4685 Sheet 4686 Sheet 4687 Sheet 4688 Sheet 4689 Sheet 4690 Sheet 4691 Sheet 4692 Sheet 4693 Sheet 4694 Sheet 4695 Sheet 4696 Sheet 4697 Sheet 4698 Sheet 4699 Sheet 4700 Sheet 4701 Sheet 4702 Sheet 4703 Sheet 4704 Sheet 4705 Sheet 4706 Sheet 4707 Sheet 4708 Sheet 4709 Sheet 4710 Sheet 4711 Sheet 4712 Sheet 4713 Sheet 4714 Sheet 4715 Sheet 4716 Sheet 4717 Sheet 4718 Sheet 4719 Sheet 4720 Sheet 4721 Sheet 4722 Sheet 4723 Sheet 4724 Sheet 4725 Sheet 4726 Sheet 4727 Sheet 4728 Sheet 4729 Sheet 4730 Sheet 4731 Sheet 4732 Sheet 4733 Sheet 4734 Sheet 4735 Sheet 4736 Sheet 4737 Sheet 4738 Sheet 4739 Sheet 4740 Sheet 4741 Sheet 4742 Sheet 4743 Sheet 4744 Sheet 4745 Sheet 4746 Sheet 4747 Sheet 4748 Sheet 4749 Sheet 4750 Sheet 4751 Sheet 4752 Sheet 4753 Sheet 4754 Sheet 4755 Sheet 4756 Sheet 4757 Sheet 4758 Sheet 4759 Sheet 4760 Sheet 4761 Sheet 4762 Sheet 4763 Sheet 4764 Sheet 4765 Sheet 4766 Sheet 4767 Sheet 4768 Sheet 4769 Sheet 4770 Sheet 4771 Sheet 4772 Sheet 4773 Sheet 4774 Sheet 4775 Sheet 4776 Sheet 4777 Sheet 4778 Sheet 4779 Sheet 4780 Sheet 4781 Sheet 4782 Sheet 4783 Sheet 4784 Sheet 4785 Sheet 4786 Sheet 4787 Sheet 4788 Sheet 4789 Sheet 4790 Sheet 4791 Sheet 4792 Sheet 4793 Sheet 4794 Sheet 4795 Sheet 4796 Sheet 4797 Sheet 4798 Sheet 4799 Sheet 4800 Sheet 4801 Sheet 4802 Sheet 4803 Sheet 4804 Sheet 4805 Sheet 4806 Sheet 4807 Sheet 4808 Sheet 4809 Sheet 4810 Sheet 4811 Sheet 4812 Sheet 4813 Sheet 4814 Sheet 4815 Sheet 4816 Sheet 4817 Sheet 4818 Sheet 4819 Sheet 4820 Sheet 4821 Sheet 4822 Sheet 4823 Sheet 4824 Sheet 4825 Sheet 4826 Sheet 4827 Sheet 4828 Sheet 4829 Sheet 4830 Sheet 4831 Sheet 4832 Sheet 4833 Sheet 4834 Sheet 4835 Sheet 4836 Sheet 4837 Sheet 4838 Sheet 4839 Sheet 4840 Sheet 4841 Sheet 4842 Sheet 4843 Sheet 4844 Sheet 4845 Sheet 4846 Sheet 4847 Sheet 4848 Sheet 4849 Sheet 4850 Sheet 4851 Sheet 4852 Sheet 4853 Sheet 4854 Sheet 4855 Sheet 4856 Sheet 4857 Sheet 4858 Sheet 4859 Sheet 4860 Sheet 4861 Sheet 4862 Sheet 4863 Sheet 4864 Sheet 4865 Sheet 4866 Sheet 4867 Sheet 4868 Sheet 4869 Sheet 4870 Sheet 4871 Sheet 4872 Sheet 4873 Sheet 4874 Sheet 4875 Sheet 4876 Sheet 4877 Sheet 4878 Sheet 4879 Sheet 4880 Sheet 4881 Sheet 4882 Sheet 4883 Sheet 4884 Sheet 4885 Sheet 4886 Sheet 4887 Sheet 4888 Sheet 4889 Sheet 4890 Sheet 4891 Sheet 4892 Sheet 4893 Sheet 4894 Sheet 4895 Sheet 4896 Sheet 4897 Sheet 4898 Sheet 4899 Sheet 4900 Sheet 4901 Sheet 4902 Sheet 4903 Sheet 4904 Sheet 4905 Sheet 4906 Sheet 4907 Sheet 4908 Sheet 4909 Sheet 4910 Sheet 4911 Sheet 4912 Sheet 4913 Sheet 4914 Sheet 4915 Sheet 4916 Sheet 4917 Sheet 4918 Sheet 4919 Sheet 4920 Sheet 4921 Sheet 4922 Sheet 4923 Sheet 4924 Sheet 4925 Sheet 4926 Sheet 4927 Sheet 4928 Sheet 4929 Sheet 4930 Sheet 4931 Sheet 4932 Sheet 4933 Sheet 4934 Sheet 4935 Sheet 4936 Sheet 4937 Sheet 4938 Sheet 4939 Sheet 4940 Sheet 4941 Sheet 4942 Sheet 4943 Sheet 4944 Sheet 4945 Sheet 4946 Sheet 4947 Sheet 4948 Sheet 4949 Sheet 4950 Sheet 4951 Sheet 4952 Sheet 4953 Sheet 4954 Sheet 4955 Sheet 4956 Sheet 4957 Sheet 4958 Sheet 4959 Sheet 4960 Sheet 4961 Sheet 4962 Sheet 4963 Sheet 4964 Sheet 4965 Sheet 4966 Sheet 4967 Sheet 4968 Sheet 4969 Sheet 4970 Sheet 4971 Sheet 4972 Sheet 4973 Sheet 4974 Sheet 4975 Sheet 4976 Sheet 4977 Sheet 4978 Sheet 4979 Sheet 4980 Sheet 4981 Sheet 4982 Sheet 4983 Sheet 4984 Sheet 4985 Sheet 4986 Sheet 4987 Sheet 4988 Sheet 4989 Sheet 4990 Sheet 4991 Sheet 4992 Sheet 4993 Sheet 4994 Sheet 4995 Sheet 4996 Sheet 4997 Sheet 4998 Sheet 4999 Sheet 5000 Sheet 5001 Sheet 5002 Sheet 5003 Sheet 5004 Sheet 5005 Sheet 5006 Sheet 5007 Sheet 5008 Sheet 5009 Sheet 5010 Sheet 5011 Sheet 5012 Sheet 5013 Sheet 5014 Sheet 5015 Sheet 5016 Sheet 5017 Sheet 5018 Sheet 5019 Sheet 5020 Sheet 5021 Sheet 5022 Sheet 5023 Sheet 5024 Sheet 5025 Sheet 5026 Sheet 5027 Sheet 5028 Sheet 5029 Sheet 5030 Sheet 5031 Sheet 5032 Sheet 5033 Sheet 5034 Sheet 5035 Sheet 5036 Sheet 5037 Sheet 5038 Sheet 5039 Sheet 5040 Sheet 5041 Sheet 5042 Sheet 5043 Sheet 5044 Sheet 5045 Sheet 5046 Sheet 5047 Sheet 5048 Sheet 5049 Sheet 5050 Sheet 5051 Sheet 5052 Sheet 5053 Sheet 5054 Sheet 5055 Sheet 5056 Sheet 5057 Sheet 5058 Sheet 5059 Sheet 5060 Sheet 5061 Sheet 5062 Sheet 5063 Sheet 5064 Sheet 5065 Sheet 5066 Sheet 5067 Sheet 5068 Sheet 5069 Sheet 5070 Sheet 5071 Sheet 5072 Sheet 5073 Sheet 5074 Sheet 5075 Sheet 5076 Sheet 5077 Sheet 5078 Sheet 5079 Sheet 5080 Sheet 5081 Sheet 5082 Sheet 5083 Sheet 5084 Sheet 5085 Sheet 5086 Sheet 5087 Sheet 5088 Sheet 5089 Sheet 5090 Sheet 5091 Sheet 5092 Sheet 5093 Sheet 5094 Sheet 5095 Sheet 5096 Sheet 5097 Sheet 5098 Sheet 5099 Sheet 5100 Sheet 5101 Sheet 5102 Sheet 5103 Sheet 5104 Sheet 5105 Sheet 5106 Sheet 5107 Sheet 5108 Sheet 5109 Sheet 5110 Sheet 5111 Sheet 5112 Sheet 5113 Sheet 5114 Sheet 5115 Sheet 5116 Sheet 5117 Sheet 5118 Sheet 5119 Sheet 5120 Sheet 5121 Sheet 5122 Sheet 5123 Sheet 5124 Sheet 5125 Sheet 5126 Sheet 5127 Sheet 5128 Sheet 5129 Sheet 5130 Sheet 5131 Sheet 5132 Sheet 5133 Sheet 5134 Sheet 5135 Sheet 5136 Sheet 5137 Sheet 5138 Sheet 5139 Sheet 5140 Sheet 5141 Sheet 5142 Sheet 5143 Sheet 5144 Sheet 5145 Sheet 5146 Sheet 5147 Sheet 5148 Sheet 5149 Sheet 5150 Sheet 5151 Sheet 5152 Sheet 5153 Sheet 5154 Sheet 5155 Sheet 5156 Sheet 5157 Sheet 5158 Sheet 5159 Sheet 5160 Sheet 5161 Sheet 5162 Sheet 5163 Sheet 5164 Sheet 5165 Sheet 5166 Sheet 5167 Sheet 5168 Sheet 5169 Sheet 5170 Sheet 5171 Sheet 5172 Sheet 5173 Sheet 5174 Sheet 5175 Sheet 5176 Sheet 5177 Sheet 5178 Sheet 5179 Sheet 5180 Sheet 5181 Sheet 5182 Sheet 5183 Sheet 5184 Sheet 5185 Sheet 5186 Sheet 5187 Sheet 5188 Sheet 5189 Sheet 5190 Sheet 5191 Sheet 5192 Sheet 5193 Sheet 5194 Sheet 5195 Sheet 5196 Sheet 5197 Sheet 5198 Sheet 5199 Sheet 5200 Sheet 5201 Sheet 5202 Sheet 5203 Sheet 5204 Sheet 5205 Sheet 5206 Sheet 5207 Sheet 5208 Sheet 5209 Sheet 5210 Sheet 5211 Sheet 5212 Sheet 5213 Sheet 5214 Sheet 5215 Sheet 5216 Sheet 5217 Sheet 5218 Sheet 5219 Sheet 5220 Sheet 5221 Sheet 5222 Sheet 5223 Sheet 5224 Sheet 5225 Sheet 5226 Sheet 5227 Sheet 5228 Sheet 5229 Sheet 5230 Sheet 5231 Sheet 5232 Sheet 5233 Sheet 5234 Sheet 5235 Sheet 5236 Sheet 5237 Sheet 5238 Sheet 5239 Sheet 5240 Sheet 5241 Sheet 5242 Sheet 5243 Sheet 5244 Sheet 5245 Sheet 5246 Sheet 5247 Sheet 5248 Sheet 5249 Sheet 5250 Sheet 5251 Sheet 5252 Sheet 5253 Sheet 5254 Sheet 5255 Sheet 5256 Sheet 5257 Sheet 5258 Sheet 5259 Sheet 5260 Sheet 5261 Sheet 5262 Sheet 5263 Sheet 5264 Sheet 5265 Sheet 5266 Sheet 5267 Sheet 5268 Sheet 5269 Sheet 5270 Sheet 5271 Sheet 5272 Sheet 5273 Sheet 5274 Sheet 5275 Sheet 5276 Sheet 5277 Sheet 5278 Sheet 5279 Sheet 5280 Sheet 5281 Sheet 5282 Sheet 5283 Sheet 5284 Sheet 5285 Sheet 5286 Sheet 5287 Sheet 5288 Sheet 5289 Sheet 5290 Sheet 5291 Sheet 5292 Sheet 5293 Sheet 5294 Sheet 5295 Sheet 5296 Sheet 5297 Sheet 5298 Sheet 5299 Sheet 5300 Sheet 5301 Sheet 5302 Sheet 5303 Sheet 5304 Sheet 5305 Sheet 5306 Sheet 5307 Sheet 5308 Sheet 5309 Sheet 5310 Sheet 5311 Sheet 5312 Sheet 5313 Sheet 5314 Sheet 5315 Sheet 5316 Sheet 5317 Sheet 5318 Sheet 5319 Sheet 5320 Sheet 5321 Sheet 5322 Sheet 5323 Sheet 5324 Sheet 5325 Sheet 5326 Sheet 5327 Sheet 5328 Sheet 5329 Sheet 5330 Sheet 5331 Sheet 5332 Sheet 5333 Sheet 5334 Sheet 5335 Sheet 5336 Sheet 5337 Sheet 5338 Sheet 5339 Sheet 5340 Sheet 5341 Sheet 5342 Sheet 5343 Sheet 5344 Sheet 5345 Sheet 5346 Sheet 5347 Sheet 5348 Sheet 5349 Sheet 5350 Sheet 5351 Sheet 5352 Sheet 5353 Sheet 5354 Sheet 5355 Sheet 5356 Sheet 5357 Sheet 5358 Sheet 5359 Sheet 5360 Sheet 5361 Sheet 5362 Sheet 5363 Sheet 5364 Sheet 5365 Sheet 5366 Sheet 5367 Sheet 5368 Sheet 5369 Sheet 5370 Sheet 5371 Sheet 5372 Sheet 5373 Sheet 5374 Sheet 5375 Sheet 5376 Sheet 5377 Sheet 5378 Sheet 5379 Sheet 5380 Sheet 5381 Sheet 5382 Sheet 5383 Sheet 5384 Sheet 5385 Sheet 5386 Sheet 5387 Sheet 5388 Sheet 5389 Sheet 5390 Sheet 5391 Sheet 5392 Sheet 5393 Sheet 5394 Sheet 5395 Sheet 5396 Sheet 5397 Sheet 5398 Sheet 5399 Sheet 5400 Sheet 5401 Sheet 5402 Sheet 5403 Sheet 5404 Sheet 5405 Sheet 5406 Sheet 5407 Sheet 5408 Sheet 5409 Sheet 5410 Sheet 5411 Sheet 5412 Sheet 5413 Sheet 5414 Sheet 5415 Sheet 5416 Sheet 5417 Sheet 5418 Sheet 5419 Sheet 5420 Sheet 5421 Sheet 5422 Sheet 5423 Sheet 5424 Sheet 5425 Sheet 5426 Sheet 5427 Sheet 5428 Sheet 5429 Sheet 5430 Sheet 5431 Sheet 5432 Sheet 5433 Sheet 5434 Sheet 5435 Sheet 5436 Sheet 5437 Sheet 5438 Sheet 5439 Sheet 5440 Sheet 5441 Sheet 5442 Sheet 5443 Sheet 5444 Sheet 5445 Sheet 5446 Sheet 5447 Sheet 5448 Sheet 5449 Sheet 5450 Sheet 5451 Sheet 5452 Sheet 5453 Sheet 5454 Sheet 5455 Sheet 5456 Sheet 5457 Sheet 5458 Sheet 5459 Sheet 5460 Sheet 5461 Sheet 5462 Sheet 5463 Sheet 5464 Sheet 5465 Sheet 5466 Sheet 5467 Sheet 5468 Sheet 5469 Sheet 5470 Sheet 5471 Sheet 5472 Sheet 5473 Sheet 5474 Sheet 5475 Sheet 5476 Sheet 5477 Sheet 5478 Sheet 5479 Sheet 5480 Sheet 5481 Sheet 5482 Sheet 5483 Sheet 5484 Sheet 5485 Sheet 5486 Sheet 5487 Sheet 5488 Sheet 5489 Sheet 5490 Sheet 5491 Sheet 5492 Sheet 5493 Sheet 5494 Sheet 5495 Sheet 5496 Sheet 5497 Sheet 5498 Sheet 5499 Sheet 5500 Sheet 5501 Sheet 5502 Sheet 5503 Sheet 5504 Sheet 5505 Sheet 5506 Sheet 5507 Sheet 5508 Sheet 5509 Sheet 5510 Sheet 5511 Sheet 5512 Sheet 5513 Sheet 5514 Sheet 5515 Sheet 5516 Sheet 5517 Sheet 5518 Sheet 5519 Sheet 5520 Sheet 5521 Sheet 5522 Sheet 5523 Sheet 5524 Sheet 5525 Sheet 5526 Sheet 5527 Sheet 5528 Sheet 5529 Sheet 5530 Sheet 5531 Sheet 5532 Sheet 5533 Sheet 5534 Sheet 5535 Sheet 5536 Sheet 5537 Sheet 5538 Sheet 5539 Sheet 5540 Sheet 5541 Sheet 5542 Sheet 5543 Sheet 5544 Sheet 5545 Sheet 5546 Sheet 5547 Sheet 5548 Sheet 5549 Sheet 5550 Sheet 5551 Sheet 5552 Sheet 5553 Sheet 5554 Sheet 5555 Sheet 5556 Sheet 5557 Sheet 5558 Sheet 5559 Sheet 5560 Sheet 5561 Sheet 5562 Sheet 5563 Sheet 5564 Sheet 5565 Sheet 5566 Sheet 5567 Sheet 5568 Sheet 5569 Sheet 5570 Sheet 5571 Sheet 5572 Sheet 5573 Sheet 5574 Sheet 5575 Sheet 5576 Sheet 5577 Sheet 5578 Sheet 5579 Sheet 5580 Sheet 5581 Sheet 5582 Sheet 5583 Sheet 5584 Sheet 5585 Sheet 5586 Sheet 5587 Sheet 5588 Sheet 5589 Sheet 5590 Sheet 5591 Sheet 5592 Sheet 5593 Sheet 5594 Sheet 5595 Sheet 5596 Sheet 5597 Sheet 5598 Sheet 5599 Sheet 5600 Sheet 5601 Sheet 5602 Sheet 5603 Sheet 5604 Sheet 5605 Sheet 5606 Sheet 5607 Sheet 5608 Sheet 5609 Sheet 5610 Sheet 5611 Sheet 5612 Sheet 5613 Sheet 5614 Sheet 5615 Sheet 5616 Sheet 5617 Sheet 5618 Sheet 5619 Sheet 5620 Sheet 5621 Sheet 5622 Sheet 5623 Sheet 5624 Sheet 5625 Sheet 5626 Sheet 5627 Sheet 5628 Sheet 5629 Sheet 5630 Sheet 5631 Sheet 5632 Sheet 5633 Sheet 5634 Sheet 5635 Sheet 5636 Sheet 5637 Sheet 5638 Sheet 5639 Sheet 5640 Sheet 5641 Sheet 5642 Sheet 5643 Sheet 5644 Sheet 5645 Sheet 5646 Sheet 5647 Sheet 5648 Sheet 5649 Sheet 5650 Sheet 5651 Sheet 5652 Sheet 5653 Sheet 5654 Sheet 5655 Sheet 5656 Sheet 5657 Sheet 5658 Sheet 5659 Sheet 5660 Sheet 5661 Sheet 5662 Sheet 5663 Sheet 5664 Sheet 5665 Sheet 5666 Sheet 5667 Sheet 5668 Sheet 5669 Sheet 5670 Sheet 5671 Sheet 5672 Sheet 5673 Sheet 5674 Sheet 5675 Sheet 5676 Sheet 5677 Sheet 5678 Sheet 5679 Sheet 5680 Sheet 5681 Sheet 5682 Sheet 5683 Sheet 5684 Sheet 5685 Sheet 5686 Sheet 5687 Sheet 5688 Sheet 5689 Sheet 5690 Sheet 5691 Sheet 5692 Sheet 5693 Sheet 5694 Sheet 5695 Sheet 5696 Sheet 5697 Sheet 5698 Sheet 5699 Sheet 5700 Sheet 5701 Sheet 5702 Sheet 5703 Sheet 5704 Sheet 5705 Sheet 5706 Sheet 5707 Sheet 5708 Sheet 5709 Sheet 5710 Sheet 5711 Sheet 5712 Sheet 5713 Sheet 5714 Sheet 5715 Sheet 5716 Sheet 5717 Sheet 5718 Sheet 5719 Sheet 5720 Sheet 5721 Sheet 5722 Sheet 5723 Sheet 5724 Sheet 5725 Sheet 5726 Sheet 5727 Sheet 5728 Sheet 5729 Sheet 5730 Sheet 5731 Sheet 5732 Sheet 5733 Sheet 5734 Sheet 5735 Sheet 5736 Sheet 5737 Sheet 5738 Sheet 5739 Sheet 5740 Sheet 5741 Sheet 5742 Sheet 5743 Sheet 5744 Sheet 5745 Sheet 5746 Sheet 5747 Sheet 5748 Sheet 5749 Sheet 5750 Sheet 5751 Sheet 5752 Sheet 5753 Sheet 5754 Sheet 5755 Sheet 5756 Sheet 5757 Sheet 5758 Sheet 5759 Sheet 5760 Sheet 5761 Sheet 5762 Sheet 5763 Sheet 5764 Sheet 5765 Sheet 5766 Sheet 5767 Sheet 5768 Sheet 5769 Sheet 5770 Sheet 5771 Sheet 5772 Sheet 5773 Sheet 5774 Sheet 5775 Sheet 5776 Sheet 5777 Sheet 5778 Sheet 5779 Sheet 5780 Sheet 5781 Sheet 5782 Sheet 5783 Sheet 5784 Sheet 5785 Sheet 5786 Sheet 5787 Sheet 5788 Sheet 5789 Sheet 5790 Sheet 5791 Sheet 5792 Sheet 5793 Sheet 5794 Sheet 5795 Sheet 5796 Sheet 5797 Sheet 5798 Sheet 5799 Sheet 5800 Sheet 5801 Sheet 5802 Sheet 5803 Sheet 5804 Sheet 5805 Sheet 5806 Sheet 5807 Sheet 5808 Sheet 5809 Sheet 5810 Sheet 5811 Sheet 5812 Sheet 5813 Sheet 5814 Sheet 5815 Sheet 5816 Sheet 5817 Sheet 5818 Sheet 5819 Sheet 5820 Sheet 5821 Sheet 5822 Sheet 5823 Sheet 5824 Sheet 5825 Sheet 5826 Sheet 5827 Sheet 5828 Sheet 5829 Sheet 5830 Sheet 5831 Sheet 5832 Sheet 5833 Sheet 5834 Sheet 5835 Sheet 5836 Sheet 5837 Sheet 5838 Sheet 5839 Sheet 5840 Sheet 5841 Sheet 5842 Sheet 5843 Sheet 5844 Sheet 5845 Sheet 5846 Sheet 5847 Sheet 5848 Sheet 5849 Sheet 5850 Sheet 5851 Sheet 5852 Sheet 5853 Sheet 5854 Sheet 5855 Sheet 5856 Sheet 5857 Sheet 5858 Sheet 5859 Sheet 5860 Sheet 5861 Sheet 5862 Sheet 5863 Sheet 5864 Sheet 5865 Sheet 5866 Sheet 5867 Sheet 5868 Sheet 5869 Sheet 5870 Sheet 5871 Sheet 5872 Sheet 5873 Sheet 5874 Sheet 5875 Sheet 5876 Sheet 5877 Sheet 5878 Sheet 5879 Sheet 5880 Sheet 5881 Sheet 5882 Sheet 5883 Sheet 5884 Sheet 5885 Sheet 5886 Sheet 5887 Sheet 5888 Sheet 5889 Sheet 5890 Sheet 5891 Sheet 5892 Sheet 5893 Sheet 5894 Sheet 5895 Sheet 5896 Sheet 5897 Sheet 5898 Sheet 5899 Sheet 5900 Sheet 5901 Sheet 5902 Sheet 5903 Sheet 5904 Sheet 5905 Sheet 5906 Sheet 5907 Sheet 5908 Sheet 5909 Sheet 5910 Sheet 5911 Sheet 5912 Sheet 5913 Sheet 5914 Sheet 5915 Sheet 5916 Sheet 5917 Sheet 5918 Sheet 5919 Sheet 5920 Sheet 5921 Sheet 5922 Sheet 5923 Sheet 5924 Sheet 5925 Sheet 5926 Sheet 5927 Sheet 5928 Sheet 5929 Sheet 5930 Sheet 5931 Sheet 5932 Sheet 5933 Sheet 5934 Sheet 5935 Sheet 5936 Sheet 5937 Sheet 5938 Sheet 5939 Sheet 5940 Sheet 5941 Sheet 5942 Sheet 5943 Sheet 5944 Sheet 5945 Sheet 5946 Sheet 5947 Sheet 5948 Sheet 5949 Sheet 5950 Sheet 5951 Sheet 5952 Sheet 5953 Sheet 5954 Sheet 5955 Sheet 5956 Sheet 5957 Sheet 5958 Sheet 5959 Sheet 5960 Sheet 5961 Sheet 5962 Sheet 5963 Sheet 5964 Sheet 5965 Sheet 5966 Sheet 5967 Sheet 5968 Sheet 5969 Sheet 5970 Sheet 5971 Sheet 5972 Sheet 5973 Sheet 5974 Sheet 5975 Sheet 5976 Sheet 5977 Sheet 5978 Sheet 5979 Sheet 5980 Sheet 5981 Sheet 5982 Sheet 5983 Sheet 5984 Sheet 5985 Sheet 5986 Sheet 5987 Sheet 5988 Sheet 5989 Sheet 5990 Sheet 5991 Sheet 5992 Sheet 5993 Sheet 5994 Sheet 5995 Sheet 5996 Sheet 5997 Sheet 5998 Sheet 5999 Sheet 6000 Sheet 6001 Sheet 6002 Sheet 6003 Sheet 6004 Sheet 6005 Sheet 6006 Sheet 6007 Sheet 6008 Sheet 6009 Sheet 6010 Sheet 6011 Sheet 6012 Sheet 6013 Sheet 6014 Sheet 6015 Sheet 6016 Sheet 6017 Sheet 6018 Sheet 6019 Sheet 6020 Sheet 6021 Sheet 6022 Sheet 6023 Sheet 6024 Sheet 6025 Sheet 6026 Sheet 6027 Sheet 6028 Sheet 6029 Sheet 6030 Sheet 6031 Sheet 6032 Sheet 6033 Sheet 6034 Sheet 6035 Sheet 6036 Sheet 6037 Sheet 6038 Sheet 6039 Sheet 6040 Sheet 6041 Sheet 6042 Sheet 6043 Sheet 6044 Sheet 6045 Sheet 6046 Sheet 6047 Sheet 6048 Sheet 6049 Sheet 6050 Sheet 6051 Sheet 6052 Sheet 6053 Sheet 6054 Sheet 6055 Sheet 6056 Sheet 6057 Sheet 6058 Sheet 6059 Sheet 6060 Sheet 6061 Sheet 6062 Sheet 6063 Sheet 6064 Sheet 6065 Sheet 6066 Sheet 6067 Sheet 6068 Sheet 6069 Sheet 6070 Sheet 6071 Sheet 6072 Sheet 6073 Sheet 6074 Sheet 6075 Sheet 6076 Sheet 6077 Sheet 6078 Sheet 6079 Sheet 6080 Sheet 6081 Sheet 6082 Sheet 6083 Sheet 6084 Sheet 6085 Sheet 6086 Sheet 6087 Sheet 6088 Sheet 6089 Sheet 6090 Sheet 6091 Sheet 6092 Sheet 6093 Sheet 6094 Sheet 6095 Sheet 6096 Sheet 6097 Sheet 6098 Sheet 6099 Sheet 6100 Sheet 6101 Sheet 6102 Sheet 6103 Sheet 6104 Sheet 6105 Sheet 6106 Sheet 6107 Sheet 6108 Sheet 6109 Sheet 6110 Sheet 6111 Sheet 6112 Sheet 6113 Sheet 6114 Sheet 6115 Sheet 6116 Sheet 6117 Sheet 6118 Sheet 6119 Sheet 6120 Sheet 6121 Sheet 6122 Sheet 6123 Sheet 6124 Sheet 6125 Sheet 6126 Sheet 6127 Sheet 6128 Sheet 6129 Sheet 6130 Sheet 6131 Sheet 6132 Sheet 6133 Sheet 6134 Sheet 6135 Sheet 6136 Sheet 6137 Sheet 6138 Sheet 6139 Sheet 6140 Sheet 6141 Sheet 6142 Sheet 6143 Sheet 6144 Sheet 6145 Sheet 6146 Sheet 6147 Sheet 6148 Sheet 6149 Sheet 6150 Sheet 6151 Sheet 6152 Sheet 6153 Sheet 6154 Sheet 6155 Sheet 6156 Sheet 6157 Sheet 6158 Sheet 6159 Sheet 6160 Sheet 6161 Sheet 6162 Sheet 6163 Sheet 6164 Sheet 6165 Sheet 6166 Sheet 6167 Sheet 6168 Sheet 6169 Sheet 6170 Sheet 6171 Sheet 6172 Sheet 6173 Sheet 6174 Sheet 6175 Sheet 6176 Sheet 6177 Sheet 6178 Sheet 6179 Sheet 6180 Sheet 6181 Sheet 6182 Sheet 6183 Sheet 6184 Sheet 6185 Sheet 6186 Sheet 6187 Sheet 6188 Sheet 6189 Sheet 6190 Sheet 6191 Sheet 6192 Sheet 6193 Sheet 6194 Sheet 6195 Sheet 6196 Sheet 6197 Sheet 6198 Sheet 6199 Sheet 6200 Sheet 6201 Sheet 6202 Sheet 6203 Sheet 6204 Sheet 6205 Sheet 6206 Sheet 6207 Sheet 6208 Sheet 6209 Sheet 6210 Sheet 6211 Sheet 6212 Sheet 6213 Sheet 6214 Sheet 6215 Sheet 6216 Sheet 6217 Sheet 6218 Sheet 6219 Sheet 6220 Sheet 6221 Sheet 6222 Sheet 6223 Sheet 6224 Sheet 6225 Sheet 6226 Sheet 6227 Sheet 6228 Sheet 6229 Sheet 6230 Sheet 6231 Sheet 6232 Sheet 6233 Sheet 6234 Sheet 6235 Sheet 6236 Sheet 6237 Sheet 6238 Sheet 6239 Sheet 6240 Sheet 6241 Sheet 6242 Sheet 6243 Sheet 6244 Sheet 6245 Sheet 6246 Sheet 6247 Sheet 6248 Sheet 6249 Sheet 6250 Sheet 6251 Sheet 6252 Sheet 6253 Sheet 6254 Sheet 6255 Sheet 6256 Sheet 6257 Sheet 6258 Sheet 6259 Sheet 6260 Sheet 6261 Sheet 6262 Sheet 6263 Sheet 6264 Sheet 6265 Sheet 6266 Sheet 6267 Sheet 6268 Sheet 6269 Sheet 6270 Sheet 6271 Sheet 6272 Sheet 6273 Sheet 6274 Sheet 6275 Sheet 6276 Sheet 6277 Sheet 6278 Sheet 6279 Sheet 6280 Sheet 6281 Sheet 6282 Sheet 6283 Sheet 6284 Sheet 6285 Sheet 6286 Sheet 6287 Sheet 6288 Sheet 6289 Sheet 6290 Sheet 6291 Sheet 6292 Sheet 6293 Sheet 6294 Sheet 6295 Sheet 6296 Sheet 6297 Sheet 6298 Sheet 6299 Sheet 6300 Sheet 6301 Sheet 6302 Sheet 6303 Sheet 6304 Sheet 6305 Sheet 6306 Sheet 6307 Sheet 6308 Sheet 6309 Sheet 6310 Sheet 6311 Sheet 6312 Sheet 6313 Sheet 6314 Sheet 6315 Sheet 6316 Sheet 6317 Sheet 6318 Sheet 6319 Sheet 6320 Sheet 6321 Sheet 6322 Sheet 6323 Sheet 6324 Sheet 6325 Sheet 6326 Sheet 6327 Sheet 6328 Sheet 6329 Sheet 6330 Sheet 6331 Sheet 6332 Sheet 6333 Sheet 6334 Sheet 6335 Sheet 6336 Sheet 6337 Sheet 6338 Sheet 6339 Sheet 6340 Sheet 6341 Sheet 6342 Sheet 6343 Sheet 6344 Sheet 6345 Sheet 6346 Sheet 6347 Sheet 6348 Sheet 6349 Sheet 6350 Sheet 6351 Sheet 6352 Sheet 6353 Sheet 6354 Sheet 6355 Sheet 6356 Sheet 6357 Sheet 6358 Sheet 6359 Sheet 6360 Sheet 6361 Sheet 6362 Sheet 6363 Sheet 6364 Sheet 6365 Sheet 6366 Sheet 6367 Sheet 6368 Sheet 6369 Sheet 6370 Sheet 6371 Sheet 6372 Sheet 6373 Sheet 6374 Sheet 6375 Sheet 6376 Sheet 6377 Sheet 6378 Sheet 6379 Sheet 6380 Sheet 6381 Sheet 6382 Sheet 6383 Sheet 6384 Sheet 6385 Sheet 6386 Sheet 6387 Sheet 6388 Sheet 6389 Sheet 6390 Sheet 6391 Sheet 6392 Sheet 6393 Sheet 6394 Sheet 6395 Sheet 6396 Sheet 6397 Sheet 6398 Sheet 6399 Sheet 6400 Sheet 6401 Sheet 6402 Sheet 6403 Sheet 6404 Sheet 6405 Sheet 6406 Sheet 6407 Sheet 6408 Sheet 6409 Sheet 6410 Sheet 6411 Sheet 6412 Sheet 6413 Sheet 6414 Sheet 6415 Sheet 6416 Sheet 6417 Sheet 6418 Sheet 6419 Sheet 6420 Sheet 6421 Sheet 6422 Sheet 6423 Sheet 6424 Sheet 6425 Sheet 6426 Sheet 6427 Sheet 6428 Sheet 6429 Sheet 6430 Sheet 6431 Sheet 6432 Sheet 6433 Sheet 6434 Sheet 6435 Sheet 6436 Sheet 6437 Sheet 6438 Sheet 6439 Sheet 6440 Sheet 6441 Sheet 6442 Sheet 6443 Sheet 6444 Sheet 6445 Sheet 6446 Sheet 6447 Sheet 6448 Sheet 6449 Sheet 6450 Sheet 6451 Sheet 6452 Sheet 6453 Sheet 6454 Sheet 6455 Sheet 6456 Sheet 6457 Sheet 6458 Sheet 6459 Sheet 6460 Sheet 6461 Sheet 6462 Sheet 6463 Sheet 6464 Sheet 6465 Sheet 6466 Sheet 6467 Sheet 6468 Sheet 6469 Sheet 6470 Sheet 6471 Sheet 6472 Sheet 6473 Sheet 6474 Sheet 6475 Sheet 6476 Sheet 6477 Sheet 6478 Sheet 6479 Sheet 6480 Sheet 6481 Sheet 6482 Sheet 6483 Sheet 6484 Sheet 6485 Sheet 6486 Sheet 6487 Sheet 6488 Sheet 6489 Sheet 6490 Sheet 6491 Sheet 6492 Sheet 6493 Sheet 6494 Sheet 6495 Sheet 6496 Sheet 6497 Sheet 6498 Sheet 6499 Sheet 6500 Sheet 6501 Sheet 6502 Sheet 6503 Sheet 6504 Sheet 6505 Sheet 6506 Sheet 6507 Sheet 6508 Sheet 6509 Sheet 6510 Sheet 6511 Sheet 6512 Sheet 6513 Sheet 6514 Sheet 6515 Sheet 6516 Sheet 6517 Sheet 6518 Sheet 6519 Sheet 6520 Sheet 6521 Sheet 6522 Sheet 6523 Sheet 6524 Sheet 6525 Sheet 6526 Sheet 6527 Sheet 6528 Sheet 6529 Sheet 6530 Sheet 6531 Sheet 6532 Sheet 6533 Sheet 6534 Sheet 6535 Sheet 6536 Sheet 6537 Sheet 6538 Sheet 6539 Sheet 6540 Sheet 6541 Sheet 6542 Sheet 6543 Sheet 6544 Sheet 6545 Sheet 6546 Sheet 6547 Sheet 6548 Sheet 6549 Sheet 6550 Sheet 6551 Sheet 6552 Sheet 6553 Sheet 6554 Sheet 6555 Sheet 6556 Sheet 6557 Sheet 6558 Sheet 6559 Sheet 6560 Sheet 6561 Sheet 6562 Sheet 6563 Sheet 6564 Sheet 6565 Sheet 6566 Sheet 6567 Sheet 6568 Sheet 6569 Sheet 6570 Sheet 6571 Sheet 6572 Sheet 6573 Sheet 6574 Sheet 6575 Sheet 6576 Sheet 6577 Sheet 6578 Sheet 6579 Sheet 6580 Sheet 6581 Sheet 6582 Sheet 6583 Sheet 6584 Sheet 6585 Sheet 6586 Sheet 6587 Sheet 6588 Sheet 6589 Sheet 6590 Sheet 6591 Sheet 6592 Sheet 6593 Sheet 6594 Sheet 6595 Sheet 6596 Sheet 6597 Sheet 6598 Sheet 6599 Sheet 6600 Sheet 6601 Sheet 6602 Sheet 6603 Sheet 6604 Sheet 6605 Sheet 6606 Sheet 6607 Sheet 6608 Sheet 6609 Sheet 6610 Sheet 6611 Sheet 6612 Sheet 6613 Sheet 6614 Sheet 6615 Sheet 6616 Sheet 6617 Sheet 6618 Sheet 6619 Sheet 6620 Sheet 6621 Sheet 6622 Sheet 6623 Sheet 6624 Sheet 6625 Sheet 6626 Sheet 6627 Sheet 6628 Sheet 6629 Sheet 6630 Sheet 6631 Sheet 6632 Sheet 6633 Sheet 6634 Sheet 6635 Sheet 6636 Sheet 6637 Sheet 6638 Sheet 6639 Sheet 6640 Sheet 6641 Sheet 6642 Sheet 6643 Sheet 6644 Sheet 6645 Sheet 6646 Sheet 6647 Sheet 6648 Sheet 6649 Sheet 6650 Sheet 6651 Sheet 6652 Sheet 6653 Sheet 6654 Sheet 6655 Sheet 6656 Sheet 6657 Sheet 6658 Sheet 6659 Sheet 6660 Sheet 6661 Sheet 6662 Sheet 6663 Sheet 6664 Sheet 6665 Sheet 6666 Sheet 6667 Sheet 6668 Sheet 6669 Sheet 6670 Sheet 6671 Sheet 6672 Sheet 6673 Sheet 6674 Sheet 6675 Sheet 6676 Sheet 6677 Sheet 6678 Sheet 6679 Sheet 6680 Sheet 6681 Sheet 6682 Sheet 6683 Sheet 6684 Sheet 6685 Sheet 6686 Sheet 6687 Sheet 6688 Sheet 6689 Sheet 6690 Sheet 6691 Sheet 6692 Sheet 6693 Sheet 6694 Sheet 6695 Sheet 6696 Sheet 6697 Sheet 6698 Sheet 6699 Sheet 6700 Sheet 6701 Sheet 6702 Sheet 6703 Sheet 6704 Sheet 6705 Sheet 6706 Sheet 6707 Sheet 6708 Sheet 6709 Sheet 6710 Sheet 6711 Sheet 6712 Sheet 6713 Sheet 6714 Sheet 6715 Sheet 6716 Sheet 6717 Sheet 6718 Sheet 6719 Sheet 6720 Sheet 6721 Sheet 6722 Sheet 6723 Sheet 6724 Sheet 6725 Sheet 6726 Sheet 6727 Sheet 6728 Sheet 6729 Sheet 6730 Sheet 6731 Sheet 6732 Sheet 6733 Sheet 6734 Sheet 6735 Sheet 6736 Sheet 6737 Sheet 6738 Sheet 6739 Sheet 6740 Sheet 6741 Sheet 6742 Sheet 6743 Sheet 6744 Sheet 6745 Sheet 6746 Sheet 6747 Sheet 6748 Sheet 6749 Sheet 6750 Sheet 6751 Sheet 6752 Sheet 6753 Sheet 6754 Sheet 6755 Sheet 6756 Sheet 6757 Sheet 6758 Sheet 6759 Sheet 6760 Sheet 6761 Sheet 6762 Sheet 6763 Sheet 6764 Sheet 6765 Sheet 6766 Sheet 6767 Sheet 6768 Sheet 6769 Sheet 6770 Sheet 6771 Sheet 6772 Sheet 6773 Sheet 6774 Sheet 6775 Sheet 6776 Sheet 6777 Sheet 6778 Sheet 6779 Sheet 6780 Sheet 6781 Sheet 6782 Sheet 6783 Sheet 6784 Sheet 6785 Sheet 6786 Sheet 6787 Sheet 6788 Sheet 6789 Sheet 6790 Sheet 6791 Sheet 6792 Sheet 6793 Sheet 6794 Sheet 6795 Sheet 6796 Sheet 6797 Sheet 6798 Sheet 6799 Sheet 6800 Sheet 6801 Sheet 6802 Sheet 6803 Sheet 6804 Sheet 6805 Sheet 6806 Sheet 6807 Sheet 6808 Sheet 6809 Sheet 6810 Sheet 6811 Sheet 6812 Sheet 6813 Sheet 6814 Sheet 6815 Sheet 6816 Sheet 6817 Sheet 6818 Sheet 6819 Sheet 6820 Sheet 6821 Sheet 6822 Sheet 6823 Sheet 6824 Sheet 6825 Sheet 6826 Sheet 6827 Sheet 6828 Sheet 6829 Sheet 6830 Sheet 6831 Sheet 6832 Sheet 6833 Sheet 6834 Sheet 6835 Sheet 6836 Sheet 6837 Sheet 6838 Sheet 6839 Sheet 6840 Sheet 6841 Sheet 6842 Sheet 6843 Sheet 6844 Sheet 6845 Sheet 6846 Sheet 6847 Sheet 6848 Sheet 6849 Sheet 6850 Sheet 6851 Sheet 6852 Sheet 6853 Sheet 6854 Sheet 6855 Sheet 6856 Sheet 6857 Sheet 6858 Sheet 6859 Sheet 6860 Sheet 6861 Sheet 6862 Sheet 6863 Sheet 6864 Sheet 6865 Sheet 6866 Sheet 6867 Sheet 6868 Sheet 6869 Sheet 6870 Sheet 6871 Sheet 6872 Sheet 6873 Sheet 6874 Sheet 6875 Sheet 6876 Sheet 6877 Sheet 6878 Sheet 6879 Sheet 6880 Sheet 6881 Sheet 6882 Sheet 6883 Sheet 6884 Sheet 6885 Sheet 6886 Sheet 6887 Sheet 6888 Sheet 6889 Sheet 6890 Sheet 6891 Sheet 6892 Sheet 6893 Sheet 6894 Sheet 6895 Sheet 6896 Sheet 6897 Sheet 6898 Sheet 6899 Sheet 6900 Sheet 6901 Sheet 6902 Sheet 6903 Sheet 6904 Sheet 6905 Sheet 6906 Sheet 6907 Sheet 6908 Sheet 6909 Sheet 6910 Sheet 6911 Sheet 6912 Sheet 6913 Sheet 6914 Sheet 6915 Sheet 6916 Sheet 6917 Sheet 6918 Sheet 6919 Sheet 6920 Sheet 6921 Sheet 6922 Sheet 6923 Sheet 6924 Sheet 6925 Sheet 6926 Sheet 6927 Sheet 6928 Sheet 6929 Sheet 6930 Sheet 6931 Sheet 6932 Sheet 6933 Sheet 6934 Sheet 6935 Sheet 6936 Sheet 6937 Sheet 6938 Sheet 6939 Sheet 6940 Sheet 6941 Sheet 6942 Sheet 6943 Sheet 6944 Sheet 6945 Sheet 6946 Sheet 6947 Sheet 6948 Sheet 6949 Sheet 6950 Sheet 6951 Sheet 6952 Sheet 6953 Sheet 6954 Sheet 6955 Sheet 6956 Sheet 6957 Sheet 6958 Sheet 6959 Sheet 6960 Sheet 6961 Sheet 6962 Sheet 6963 Sheet 6964 Sheet 6965 Sheet 6966 Sheet 6967 Sheet 6968 Sheet 6969 Sheet 6970 Sheet 6971 Sheet 6972 Sheet 6973 Sheet 6974 Sheet 6975 Sheet 6976 Sheet 6977 Sheet 6978 Sheet 6979 Sheet 6980 Sheet 6981 Sheet 6982 Sheet 6983 Sheet 6984 Sheet 6985 Sheet 6986 Sheet 6987 Sheet 6988 Sheet 6989 Sheet 6990 Sheet 6991 Sheet 6992 Sheet 6993 Sheet 6994 Sheet 6995 Sheet 6996 Sheet 6997 Sheet 6998 Sheet 6999 Sheet 7000 Sheet 7001 Sheet 7002 Sheet 7003 Sheet 7004 Sheet 7005 Sheet 7006 Sheet 7007 Sheet 7008 Sheet 7009 Sheet 7010 Sheet 7011 Sheet 7012 Sheet 7013 Sheet 7014 Sheet 7015 Sheet 7016 Sheet 7017 Sheet 7018 Sheet 7019 Sheet 7020 Sheet 7021 Sheet 7022 Sheet 7023 Sheet 7024 Sheet 7025 Sheet 7026 Sheet 7027 Sheet 7028 Sheet 7029 Sheet 7030 Sheet 7031 Sheet 7032 Sheet 7033 Sheet 7034 Sheet 7035 Sheet 7036 Sheet 7037 Sheet 7038 Sheet 7039 Sheet 7040 Sheet 7041 Sheet 7042 Sheet 7043 Sheet 7044 Sheet 7045 Sheet 7046 Sheet 7047 Sheet 7048 Sheet 7049 Sheet 7050 Sheet 7051 Sheet 7052 Sheet 7053 Sheet 7054 Sheet 7055 Sheet 7056 Sheet 7057 Sheet 7058 Sheet 7059 Sheet 7060 Sheet 7061 Sheet 7062 Sheet 7063 Sheet 7064 Sheet 7065 Sheet 7066 Sheet 7067 Sheet 7068 Sheet 7069 Sheet 7070 Sheet 7071 Sheet 7072 Sheet 7073 Sheet 7074 Sheet 7075 Sheet 7076 Sheet 7077 Sheet 7078 Sheet 7079 Sheet 7080 Sheet 7081 Sheet 7082 Sheet 7083 Sheet 7084 Sheet 7085 Sheet 7086 Sheet 7087 Sheet 7088 Sheet 7089 Sheet 7090 Sheet 7091 Sheet 7092 Sheet 7093 Sheet 7094 Sheet 7095 Sheet 7096 Sheet 7097 Sheet 7098 Sheet 7099 Sheet 7100 Sheet 7101 Sheet 7102 Sheet 7103 Sheet 7104 Sheet 7105 Sheet 7106 Sheet 7107 Sheet 7108 Sheet 7109 Sheet 7110 Sheet 7111 Sheet 7112 Sheet 7113 Sheet 7114 Sheet 7115 Sheet 7116 Sheet 7117 Sheet 7118 Sheet 7119 Sheet 7120 Sheet 7121 Sheet 7122 Sheet 7123 Sheet 7124 Sheet 7125 Sheet 7126 Sheet 7127 Sheet 7128 Sheet 7129 Sheet 7130 Sheet 7131 Sheet 7132 Sheet 7133 Sheet 7134 Sheet 7135 Sheet 7136 Sheet 7137 Sheet 7138 Sheet 7139 Sheet 7140 Sheet 7141 Sheet 7142 Sheet 7143 Sheet 7144 Sheet 7145 Sheet 7146 Sheet 7147 Sheet 7148 Sheet 7149 Sheet 7150 Sheet 7151 Sheet 7152 Sheet 7153 Sheet 7154 Sheet 7155 Sheet 7156 Sheet 7157 Sheet 7158 Sheet 7159 Sheet 7160 Sheet 7161 Sheet 7162 Sheet 7163 Sheet 7164 Sheet 7165 Sheet 7166 Sheet 7167 Sheet 7168 Sheet 7169 Sheet 7170 Sheet 7171 Sheet 7172 Sheet 7173 Sheet 7174 Sheet 7175 Sheet 7176 Sheet 7177 Sheet 7178 Sheet 7179 Sheet 7180 Sheet 7181 Sheet 7182 Sheet 7183 Sheet 7184 Sheet 7185 Sheet 7186 Sheet 7187 Sheet 7188 Sheet 7189 Sheet 7190 Sheet 7191 Sheet 7192 Sheet 7193 Sheet 7194 Sheet 7195 Sheet 7196 Sheet 7197 Sheet 7198 Sheet 7199 Sheet 7200 Sheet 7201 Sheet 7202 Sheet 7203 Sheet 7204 Sheet 7205 Sheet 7206 Sheet 7207 Sheet 7208 Sheet 7209 Sheet 7210 Sheet 7211 Sheet 7212 Sheet 7213 Sheet 7214 Sheet 7215 Sheet 7216 Sheet 7217 Sheet 7218 Sheet 7219 Sheet 7220 Sheet 7221 Sheet 7222 Sheet 7223 Sheet 7224 Sheet 7225 Sheet 7226 Sheet 7227 Sheet 7228 Sheet 7229 Sheet 7230 Sheet 7231 Sheet 7232 Sheet 7233 Sheet 7234 Sheet 7235 Sheet 7236 Sheet 7237 Sheet 7238 Sheet 7239 Sheet 7240 Sheet 7241 Sheet 7242 Sheet 7243 Sheet 7244 Sheet 7245 Sheet 7246 Sheet 7247 Sheet 7248 Sheet 7249 Sheet 7250 Sheet 7251 Sheet 7252 Sheet 7253 Sheet 7254 Sheet 7255 Sheet 7256 Sheet 7257 Sheet 7258 Sheet 7259 Sheet 7260 Sheet 7261 Sheet 7262 Sheet 7263 Sheet 7264 Sheet 7265 Sheet 7266 Sheet 7267 Sheet 7268 Sheet 7269 Sheet 7270 Sheet 7271 Sheet 7272 Sheet 7273 Sheet 7274 Sheet 7275 Sheet 7276 Sheet 7277 Sheet 7278 Sheet 7279 Sheet 7280 Sheet 7281 Sheet 7282 Sheet 7283 Sheet 7284 Sheet 7285 Sheet 7286 Sheet 7287 Sheet 7288 Sheet 7289 Sheet 7290 Sheet 7291 Sheet 7292 Sheet 7293 Sheet 7294 Sheet 7295 Sheet 7296 Sheet 7297 Sheet 7298 Sheet 7299 Sheet 7300 Sheet 7301 Sheet 7302 Sheet 7303 Sheet 7304 Sheet 7305 Sheet 7306 Sheet 7307 Sheet 7308 Sheet 7309 Sheet 7310 Sheet 7311 Sheet 7312 Sheet 7313 Sheet 7314 Sheet 7315 Sheet 7316 Sheet 7317 Sheet 7318 Sheet 7319 Sheet 7320 Sheet 7321 Sheet 7322 Sheet 7323 Sheet 7324 Sheet 7325 Sheet 7326 Sheet 7327 Sheet 7328 Sheet 7329 Sheet 7330 Sheet 7331 Sheet 7332 Sheet 7333 Sheet 7334 Sheet 7335 Sheet 7336 Sheet 7337 Sheet 7338 Sheet 7339 Sheet 7340 Sheet 7341 Sheet 7342 Sheet 7343 Sheet 7344 Sheet 7345 Sheet 7346 Sheet 7347 Sheet 7348 Sheet 7349 Sheet 7350 Sheet 7351 Sheet 7352 Sheet 7353 Sheet 7354 Sheet 7355 Sheet 7356 Sheet 7357 Sheet 7358 Sheet 7359 Sheet 7360 Sheet 7361 Sheet 7362 Sheet 7363 Sheet 7364 Sheet 7365 Sheet 7366 Sheet 7367 Sheet 7368 Sheet 7369 Sheet 7370 Sheet 7371 Sheet 7372 Sheet 7373 Sheet 7374 Sheet 7375 Sheet 7376 Sheet 7377 Sheet 7378 Sheet 7379 Sheet 7380 Sheet 7381 Sheet 7382 Sheet 7383 Sheet 7384 Sheet 7385 Sheet 7386 Sheet 7387 Sheet 7388 Sheet 7389 Sheet 7390 Sheet 7391 Sheet 7392 Sheet 7393 Sheet 7394 Sheet 7395 Sheet 7396 Sheet 7397 Sheet 7398 Sheet 7399 Sheet 7400 Sheet 7401 Sheet 7402 Sheet 7403 Sheet 7404 Sheet 7405 Sheet 7406 Sheet 7407 Sheet 7408 Sheet 7409 Sheet 7410 Sheet 7411 Sheet 7412 Sheet 7413 Sheet 7414 Sheet 7415 Sheet 7416 Sheet 7417 Sheet 7418 Sheet 7419 Sheet 7420 Sheet 7421 Sheet 7422 Sheet 7423 Sheet 7424 Sheet 7425 Sheet 7426 Sheet 7427 Sheet 7428 Sheet 7429 Sheet 7430 Sheet 7431 Sheet 7432 Sheet 7433 Sheet 7434 Sheet 7435 Sheet 7436 Sheet 7437 Sheet 7438 Sheet 7439 Sheet 7440 Sheet 7441 Sheet 7442 Sheet 7443 Sheet 7444 Sheet 7445 Sheet 7446 Sheet 7447 Sheet 7448 Sheet 7449 Sheet 7450 Sheet 7451 Sheet 7452 Sheet 7453 Sheet 7454 Sheet 7455 Sheet 7456 Sheet 7457 Sheet 7458 Sheet 7459 Sheet 7460 Sheet 7461 Sheet 7462 Sheet 7463 Sheet 7464 Sheet 7465 Sheet 7466 Sheet 7467 Sheet 7468 Sheet 7469 Sheet 7470 Sheet 7471 Sheet 7472 Sheet 7473 Sheet 7474 Sheet 7475 Sheet 7476 Sheet 7477 Sheet 7478 Sheet 7479 Sheet 7480 Sheet 7481 Sheet 7482 Sheet 7483 Sheet 7484 Sheet 7485 Sheet 7486 Sheet 7487 Sheet 7488 Sheet 7489 Sheet 7490 Sheet 7491 Sheet 7492 Sheet 7493 Sheet 7494 Sheet 7495 Sheet 7496 Sheet 7497 Sheet 7498 Sheet 7499 Sheet 7500 Sheet 7501 Sheet 7502 Sheet 7503 Sheet 7504 Sheet 7505 Sheet 7506 Sheet 7507 Sheet 7508 Sheet 7509 Sheet 7510 Sheet 7511 Sheet 7512 Sheet 7513 Sheet 7514 Sheet 7515 Sheet 7516 Sheet 7517 Sheet 7518 Sheet 7519 Sheet 7520 Sheet 7521 Sheet 7522 Sheet 7523 Sheet 7524 Sheet 7525 Sheet 7526 Sheet 7527 Sheet 7528 Sheet 7529 Sheet 7530 Sheet 7531 Sheet 7532 Sheet 7533 Sheet 7534 Sheet 7535 Sheet 7536 Sheet 7537 Sheet 7538 Sheet 7539 Sheet 7540 Sheet 7541 Sheet 7542 Sheet 7543 Sheet 7544 Sheet 7545 Sheet 7546 Sheet 7547 Sheet 7548 Sheet 7549 Sheet 7550 Sheet 7551 Sheet 7552 Sheet 7553 Sheet 7554 Sheet 7555 Sheet 7556 Sheet 7557 Sheet 7558 Sheet 7559 Sheet 7560 Sheet 7561 Sheet 7562 Sheet 7563 Sheet 7564 Sheet 7565 Sheet 7566 Sheet 7567 Sheet 7568 Sheet 7569 Sheet 7570 Sheet 7571 Sheet 7572 Sheet 7573 Sheet 7574 Sheet 7575 Sheet 7576 Sheet 7577 Sheet 7578 Sheet 7579 Sheet 7580 Sheet 7581 Sheet 7582 Sheet 7583 Sheet 7584 Sheet 7585 Sheet 7586 Sheet 7587 Sheet 7588 Sheet 7589 Sheet 7590 Sheet 7591 Sheet 7592 Sheet 7593 Sheet 7594 Sheet 7595 Sheet 7596 Sheet 7597 Sheet 7598 Sheet 7599 Sheet 7600 Sheet 7601 Sheet 7602 Sheet 7603 Sheet 7604 Sheet 7605 Sheet 7606 Sheet 7607 Sheet 7608 Sheet 7609 Sheet 7610 Sheet 7611 Sheet 7612 Sheet 7613 Sheet 7614 Sheet 7615 Sheet 7616 Sheet 7617 Sheet 7618 Sheet 7619 Sheet 7620 Sheet 7621 Sheet 7622 Sheet 7623 Sheet 7624 Sheet 7625 Sheet 7626 Sheet 7627 Sheet 7628 Sheet 7629 Sheet 7630 Sheet 7631 Sheet 7632 Sheet 7633 Sheet 7634 Sheet 7635 Sheet 7636 Sheet 7637 Sheet 7638 Sheet 7639 Sheet 7640 Sheet 7641 Sheet 7642 Sheet 7643 Sheet 7644 Sheet 7645 Sheet 7646 Sheet 7647 Sheet 7648 Sheet 7649 Sheet 7650 Sheet 7651 Sheet 7652 Sheet 7653 Sheet 7654 Sheet 7655 Sheet 7656 Sheet 7657 Sheet 7658 Sheet 7659 Sheet 7660 Sheet 7661 Sheet 7662 Sheet 7663 Sheet 7664 Sheet 7665 Sheet 7666 Sheet 7667 Sheet 7668 Sheet 7669 Sheet 7670 Sheet 7671 Sheet 7672 Sheet 7673 Sheet 7674 Sheet 7675 Sheet 7676 Sheet 7677 Sheet 7678 Sheet 7679 Sheet 7680 Sheet 7681 Sheet 7682 Sheet 7683 Sheet 7684 Sheet 7685 Sheet 7686 Sheet 7687 Sheet 7688 Sheet 7689 Sheet 7690 Sheet 7691 Sheet 7692 Sheet 7693 Sheet 7694 Sheet 7695 Sheet 7696 Sheet 7697 Sheet 7698 Sheet 7699 Sheet 7700 Sheet 7701 Sheet 7702 Sheet 7703 Sheet 7704 Sheet 7705 Sheet 7706 Sheet 7707 Sheet 7708 Sheet 7709 Sheet 7710 Sheet 7711 Sheet 7712 Sheet 7713 Sheet 7714 Sheet 7715 Sheet 7716 Sheet 7717 Sheet 7718 Sheet 7719 Sheet 7720 Sheet 7721 Sheet 7722 Sheet 7723 Sheet 7724 Sheet 7725 Sheet 7726 Sheet 7727 Sheet 7728 Sheet 7729 Sheet 7730 Sheet 7731 Sheet 7732 Sheet 7733 Sheet 7734 Sheet 7735 Sheet 7736 Sheet 7737 Sheet 7738 Sheet 7739 Sheet 7740 Sheet 7741 Sheet 7742 Sheet 7743 Sheet 7744 Sheet 7745 Sheet 7746 Sheet 7747 Sheet 7748 Sheet 7749 Sheet 7750 Sheet 7751 Sheet 7752 Sheet 7753 Sheet 7754 Sheet 7755 Sheet 7756 Sheet 7757 Sheet 7758 Sheet 7759 Sheet 7760 Sheet 7761 Sheet 7762 Sheet 7763 Sheet 7764 Sheet 7765 Sheet 7766 Sheet 7767 Sheet 7768 Sheet 7769 Sheet 7770 Sheet 7771 Sheet 7772 Sheet 7773 Sheet 7774 Sheet 7775 Sheet 7776 Sheet 7777 Sheet 7778 Sheet 7779 Sheet 7780 Sheet 7781 Sheet 7782 Sheet 7783 Sheet 7784 Sheet 7785 Sheet 7786 Sheet 7787 Sheet 7788 Sheet 7789 Sheet 7790 Sheet 7791 Sheet 7792 Sheet 7793 Sheet 7794 Sheet 7795 Sheet 7796 Sheet 7797 Sheet 7798 Sheet 7799 Sheet 7800 Sheet 7801 Sheet 7802 Sheet 7803 Sheet 7804 Sheet 7805 Sheet 7806 Sheet 7807 Sheet 7808 Sheet 7809 Sheet 7810 Sheet 7811 Sheet 7812 Sheet 7813 Sheet 7814 Sheet 7815 Sheet 7816 Sheet 7817 Sheet 7818 Sheet 7819 Sheet 7820 Sheet 7821 Sheet 7822 Sheet 7823 Sheet 7824 Sheet 7825 Sheet 7826 Sheet 7827 Sheet 7828 Sheet 7829 Sheet 7830 Sheet 7831 Sheet 7832 Sheet 7833 Sheet 7834 Sheet 7835 Sheet 7836 Sheet 7837 Sheet 7838 Sheet 7839 Sheet 7840 Sheet 7841 Sheet 7842 Sheet 7843 Sheet 7844 Sheet 7845 Sheet 7846 Sheet 7847 Sheet 7848 Sheet 7849 Sheet 7850 Sheet 7851 Sheet 7852 Sheet 7853 Sheet 7854 Sheet 7855 Sheet 7856 Sheet 7857 Sheet 7858 Sheet 7859 Sheet 7860 Sheet 7861 Sheet 7862 Sheet 7863 Sheet 7864 Sheet 7865 Sheet 7866 Sheet 7867 Sheet 7868 Sheet 7869 Sheet 7870 Sheet 7871 Sheet 7872 Sheet 7873 Sheet 7874 Sheet 7875 Sheet 7876 Sheet 7877 Sheet 7878 Sheet 7879 Sheet 7880 Sheet 7881 Sheet 7882 Sheet 7883 Sheet 7884 Sheet 7885 Sheet 7886 Sheet 7887 Sheet 7888 Sheet 7889 Sheet 7890 Sheet 7891 Sheet 7892 Sheet 7893 Sheet 7894 Sheet 7895 Sheet 7896 Sheet 7897 Sheet 7898 Sheet 7899 Sheet 7900 Sheet 7901 Sheet 7902 Sheet 7903 Sheet 7904 Sheet 7905 Sheet 7906 Sheet 7907 Sheet 7908 Sheet 7909 Sheet 7910 Sheet 7911 Sheet 7912 Sheet 7913 Sheet 7914 Sheet 7915 Sheet 7916 Sheet 7917 Sheet 7918 Sheet 7919 Sheet 7920 Sheet 7921 Sheet 7922 Sheet 7923 Sheet 7924 Sheet 7925 Sheet 7926 Sheet 7927 Sheet 7928 Sheet 7929 Sheet 7930 Sheet 7931 Sheet 7932 Sheet 7933 Sheet 7934 Sheet 7935 Sheet 7936 Sheet 7937 Sheet 7938 Sheet 7939 Sheet 7940 Sheet 7941 Sheet 7942 Sheet 7943 Sheet 7944 Sheet 7945 Sheet 7946 Sheet 7947 Sheet 7948 Sheet 7949 Sheet 7950 Sheet 7951 Sheet 7952 Sheet 7953 Sheet 7954 Sheet 7955 Sheet 7956 Sheet 7957 Sheet 7958 Sheet 7959 Sheet 7960 Sheet 7961 Sheet 7962 Sheet 7963 Sheet 7964 Sheet 7965 Sheet 7966 Sheet 7967 Sheet 7968 Sheet 7969 Sheet 7970 Sheet 7971 Sheet 7972 Sheet 7973 Sheet 7974 Sheet 7975 Sheet 7976 Sheet 7977 Sheet 7978 Sheet 7979 Sheet 7980 Sheet 7981 Sheet 7982 Sheet 7983 Sheet 7984 Sheet 7985 Sheet 7986 Sheet 7987 Sheet 7988 Sheet 7989 Sheet 7990 Sheet 7991 Sheet 7992 Sheet 7993 Sheet 7994 Sheet 7995 Sheet 7996 Sheet 7997 Sheet 7998 Sheet 7999 Sheet 8000 Sheet 8001 Sheet 8002 Sheet 8003 Sheet 8004 Sheet 8005 Sheet 8006 Sheet 8007 Sheet 8008 Sheet 8009 Sheet 8010 Sheet 8011 Sheet 8012 Sheet 8013 Sheet 8014 Sheet 8015 Sheet 8016 Sheet 8017 Sheet 8018 Sheet 8019 Sheet 8020 Sheet 8021 Sheet 8022 Sheet 8023 Sheet 8024 Sheet 8025 Sheet 8026 Sheet 8027 Sheet 8028 Sheet 8029 Sheet 8030 Sheet 8031 Sheet 8032 Sheet 8033 Sheet 8034 Sheet 8035 Sheet 8036 Sheet 8037 Sheet 8038 Sheet 8039 Sheet 8040 Sheet 8041 Sheet 8042 Sheet 8043 Sheet 8044 Sheet 8045 Sheet 8046 Sheet 8047 Sheet 8048 Sheet 8049 Sheet 8050 Sheet 8051 Sheet 8052 Sheet 8053 Sheet 8054 Sheet 8055 Sheet 8056 Sheet 8057 Sheet 8058 Sheet 8059 Sheet 8060 Sheet 8061 Sheet 8062 Sheet 8063 Sheet 8064 Sheet 8065 Sheet 8066 Sheet 8067 Sheet 8068 Sheet 8069 Sheet 8070 Sheet 8071 Sheet 8072 Sheet 8073 Sheet 8074 Sheet 8075 Sheet 8076 Sheet 8077 Sheet 8078 Sheet 8079 Sheet 8080 Sheet 8081 Sheet 8082 Sheet 8083 Sheet 8084 Sheet 8085 Sheet 8086 Sheet 8087 Sheet 8088 Sheet 8089 Sheet 8090 Sheet 8091 Sheet 8092 Sheet 8093 Sheet 8094 Sheet 8095 Sheet 8096 Sheet 8097 Sheet 8098 Sheet 8099 Sheet 8100 Sheet 8101 Sheet 8102 Sheet 8103 Sheet 8104 Sheet 8105 Sheet 8106 Sheet 8107 Sheet 8108 Sheet 8109 Sheet 8110 Sheet 8111 Sheet 8112 Sheet 8113 Sheet 8114 Sheet 8115 Sheet 8116 Sheet 8117 Sheet 8118 Sheet 8119 Sheet 8120 Sheet 8121 Sheet 8122 Sheet 8123 Sheet 8124 Sheet 8125 Sheet 8126 Sheet 8127 Sheet 8128 Sheet 8129 Sheet 8130 Sheet 8131 Sheet 8132 Sheet 8133 Sheet 8134 Sheet 8135 Sheet 8136 Sheet 8137 Sheet 8138 Sheet 8139 Sheet 8140 Sheet 8141 Sheet 8142 Sheet 8143 Sheet 8144 Sheet 8145 Sheet 8146 Sheet 8147 Sheet 8148 Sheet 8149 Sheet 8150 Sheet 8151 Sheet 8152 Sheet 8153 Sheet 8154 Sheet 8155 Sheet 8156 Sheet 8157 Sheet 8158 Sheet 8159 Sheet 8160 Sheet 8161 Sheet 8162 Sheet 8163 Sheet 8164 Sheet 8165 Sheet 8166 Sheet 8167 Sheet 8168 Sheet 8169 Sheet 8170 Sheet 8171 Sheet 8172 Sheet 8173 Sheet 8174 Sheet 8175 Sheet 8176 Sheet 8177 Sheet 8178 Sheet 8179 Sheet 8180 Sheet 8181 Sheet 8182 Sheet 8183 Sheet 8184 Sheet 8185 Sheet 8186 Sheet 8187 Sheet 8188 Sheet 8189 Sheet 8190 Sheet 8191 Sheet 8192 Sheet 8193 Sheet 8194 Sheet 8195 Sheet 8196 Sheet 8197 Sheet 8198 Sheet 8199 Sheet 8200 Sheet 8201 Sheet 8202 Sheet 8203 Sheet 8204 Sheet 8205 Sheet 8206 Sheet 8207 Sheet 8208 Sheet 8209 Sheet 8210 Sheet 8211 Sheet 8212 Sheet 8213 Sheet 8214 Sheet 8215 Sheet 8216 Sheet 8217 Sheet 8218 Sheet 8219 Sheet 8220 Sheet 8221 Sheet 8222 Sheet 8223 Sheet 8224 Sheet 8225 Sheet 8226 Sheet 8227 Sheet 8228 Sheet 8229 Sheet 8230 Sheet 8231 Sheet 8232 Sheet 8233 Sheet 8234 Sheet 8235 Sheet 8236 Sheet 8237 Sheet 8238 Sheet 8239 Sheet 8240 Sheet 8241 Sheet 8242 Sheet 8243 Sheet 8244 Sheet 8245 Sheet 8246 Sheet 8247 Sheet 8248 Sheet 8249 Sheet 8250 Sheet 8251 Sheet 8252 Sheet 8253 Sheet 8254 Sheet 8255 Sheet 8256 Sheet 8257 Sheet 8258 Sheet 8259 Sheet 8260 Sheet 8261 Sheet 8262 Sheet 8263 Sheet 8264 Sheet 8265 Sheet 8266 Sheet 8267 Sheet 8268 Sheet 8269 Sheet 8270 Sheet 8271 Sheet 8272 Sheet 8273 Sheet 8274 Sheet 8275 Sheet 8276 Sheet 8277 Sheet 8278 Sheet 8279 Sheet 8280 Sheet 8281 Sheet 8282 Sheet 8283 Sheet 8284 Sheet 8285 Sheet 8286 Sheet 8287 Sheet 8288 Sheet 8289 Sheet 8290 Sheet 8291 Sheet 8292 Sheet 8293 Sheet 8294 Sheet 8295 Sheet 8296 Sheet 8297 Sheet 8298 Sheet 8299 Sheet 8300 Sheet 8301 Sheet 8302 Sheet 8303 Sheet 8304 Sheet 8305 Sheet 8306 Sheet 8307 Sheet 8308 Sheet 8309 Sheet 8310 Sheet 8311 Sheet 8312 Sheet 8313 Sheet 8314 Sheet 8315 Sheet 8316 Sheet 8317 Sheet 8318 Sheet 8319 Sheet 8320 Sheet 8321 Sheet 8322 Sheet 8323 Sheet 8324 Sheet 8325 Sheet 8326 Sheet 8327 Sheet 8328 Sheet 8329 Sheet 8330 Sheet 8331 Sheet 8332 Sheet 8333 Sheet 8334 Sheet 8335 Sheet 8336 Sheet 8337 Sheet 8338 Sheet 8339 Sheet 8340 Sheet 8341 Sheet 8342 Sheet 8343 Sheet 8344 Sheet 8345 Sheet 8346 Sheet 8347 Sheet 8348 Sheet 8349 Sheet 8350 Sheet 8351 Sheet 8352 Sheet 8353 Sheet 8354 Sheet 8355 Sheet 8356 Sheet 8357 Sheet 8358 Sheet 8359 Sheet 8360 Sheet 8361 Sheet 8362 Sheet 8363 Sheet 8364 Sheet 8365 Sheet 8366 Sheet 8367 Sheet 8368 Sheet 8369 Sheet 8370 Sheet 8371 Sheet 8372 Sheet 8373 Sheet 8374 Sheet 8375 Sheet 8376 Sheet 8377 Sheet 8378 Sheet 8379 Sheet 8380 Sheet 8381 Sheet 8382 Sheet 8383 Sheet 8384 Sheet 8385 Sheet 8386 Sheet 8387 Sheet 8388 Sheet 8389 Sheet 8390 Sheet 8391 Sheet 8392 Sheet 8393 Sheet 8394 Sheet 8395 Sheet 8396 Sheet 8397 Sheet 8398 Sheet 8399 Sheet 8400 Sheet 8401 Sheet 8402 Sheet 8403 Sheet 8404 Sheet 8405 Sheet 8406 Sheet 8407 Sheet 8408 Sheet 8409 Sheet 8410 Sheet 8411 Sheet 8412 Sheet 8413 Sheet 8414 Sheet 8415 Sheet 8416 Sheet 8417 Sheet 8418 Sheet 8419 Sheet 8420 Sheet 8421 Sheet 8422 Sheet 8423 Sheet 8424 Sheet 8425 Sheet 8426 Sheet 8427 Sheet 8428 Sheet 8429 Sheet 8430 Sheet 8431 Sheet 8432 Sheet 8433 Sheet 8434 Sheet 8435 Sheet 8436 Sheet 8437 Sheet 8438 Sheet 8439 Sheet 8440 Sheet 8441 Sheet 8442 Sheet 8443 Sheet 8444 Sheet 8445 Sheet 8446 Sheet 8447 Sheet 8448 Sheet 8449 Sheet 8450 Sheet 8451 Sheet 8452 Sheet 8453 Sheet 8454 Sheet 8455 Sheet 8456 Sheet 8457 Sheet 8458 Sheet 8459 Sheet 8460 Sheet 8461 Sheet 8462 Sheet 8463 Sheet 8464 Sheet 8465 Sheet 8466 Sheet 8467 Sheet 8468 Sheet 8469 Sheet 8470 Sheet 8471 Sheet 8472 Sheet 8473 Sheet 8474 Sheet 8475 Sheet 8476 Sheet 8477 Sheet 8478 Sheet 8479 Sheet 8480 Sheet 8481 Sheet 8482 Sheet 8483 Sheet 8484 Sheet 8485 Sheet 8486 Sheet 8487 Sheet 8488 Sheet 8489 Sheet 8490 Sheet 8491 Sheet 8492 Sheet 8493 Sheet 8494 Sheet 8495 Sheet 8496 Sheet 8497 Sheet 8498 Sheet 8499 Sheet 8500 Sheet 8501 Sheet 8502 Sheet 8503 Sheet 8504 Sheet 8505 Sheet 8506 Sheet 8507 Sheet 8508 Sheet 8509 Sheet 8510 Sheet 8511 Sheet 8512 Sheet 8513 Sheet 8514 Sheet 8515 Sheet 8516 Sheet 8517 Sheet 8518 Sheet 8519 Sheet 8520 Sheet 8521 Sheet 8522 Sheet 8523 Sheet 8524 Sheet 8525 Sheet 8526 Sheet 8527 Sheet 8528 Sheet 8529 Sheet 8530 Sheet 8531 Sheet 8532 Sheet 8533 Sheet 8534 Sheet 8535 Sheet 8536 Sheet 8537 Sheet 8538 Sheet 8539 Sheet 8540 Sheet 8541 Sheet 8542 Sheet 8543 Sheet 8544 Sheet 8545 Sheet 8546 Sheet 8547 Sheet 8548 Sheet 8549 Sheet 8550 Sheet 8551 Sheet 8552 Sheet 8553 Sheet 8554 Sheet 8555 Sheet 8556 Sheet 8557 Sheet 8558 Sheet 8559 Sheet 8560 Sheet 8561 Sheet 8562 Sheet 8563 Sheet 8564 Sheet 8565 Sheet 8566 Sheet 8567 Sheet 8568 Sheet 8569 Sheet 8570 Sheet 8571 Sheet 8572 Sheet 8573 Sheet 8574 Sheet 8575 Sheet 8576 Sheet 8577 Sheet 8578 Sheet 8579 Sheet 8580 Sheet 8581 Sheet 8582 Sheet 8583 Sheet 8584 Sheet 8585 Sheet 8586 Sheet 8587 Sheet 8588 Sheet 8589 Sheet 8590 Sheet 8591 Sheet 8592 Sheet 8593 Sheet 8594 Sheet 8595 Sheet 8596 Sheet 8597 Sheet 8598 Sheet 8599 Sheet 8600 Sheet 8601 Sheet 8602 Sheet 8603 Sheet 8604 Sheet 8605 Sheet 8606 Sheet 8607 Sheet 8608 Sheet 8609 Sheet 8610 Sheet 8611 Sheet 8612 Sheet 8613 Sheet 8614 Sheet 8615 Sheet 8616 Sheet 8617 Sheet 8618 Sheet 8619 Sheet 8620 Sheet 8621 Sheet 8622 Sheet 8623 Sheet 8624 Sheet 8625 Sheet 8626 Sheet 8627 Sheet 8628 Sheet 8629 Sheet 8630 Sheet 8631 Sheet 8632 Sheet 8633 Sheet 8634 Sheet 8635 Sheet 8636 Sheet 8637 Sheet 8638 Sheet 8639 Sheet 8640 Sheet 8641 Sheet 8642 Sheet 8643 Sheet 8644 Sheet 8645 Sheet 8646 Sheet 8647 Sheet 8648 Sheet 8649 Sheet 8650 Sheet 8651 Sheet 8652 Sheet 8653 Sheet 8654 Sheet 8655 Sheet 8656 Sheet 8657 Sheet 8658 Sheet 8659 Sheet 8660 Sheet 8661 Sheet 8662 Sheet 8663 Sheet 8664 Sheet 8665 Sheet 8666 Sheet 8667 Sheet 8668 Sheet 8669 Sheet 8670 Sheet 8671 Sheet 8672 Sheet 8673 Sheet 8674 Sheet 8675 Sheet 8676 Sheet 8677 Sheet 8678 Sheet 8679 Sheet 8680 Sheet 8681 Sheet 8682 Sheet 8683 Sheet 8684 Sheet 8685 Sheet 8686 Sheet 8687 Sheet 8688 Sheet 8689 Sheet 8690 Sheet 8691 Sheet 8692 Sheet 8693 Sheet 8694 Sheet 8695 Sheet 8696 Sheet 8697 Sheet 8698 Sheet 8699 Sheet 8700 Sheet 8701 Sheet 8702 Sheet 8703 Sheet 8704 Sheet 8705 Sheet 8706 Sheet 8707 Sheet 8708 Sheet 8709 Sheet 8710 Sheet 8711 Sheet 8712 Sheet 8713 Sheet 8714 Sheet 8715 Sheet 8716 Sheet 8717 Sheet 8718 Sheet 8719 Sheet 8720 Sheet 8721 Sheet 8722 Sheet 8723 Sheet 8724 Sheet 8725 Sheet 8726 Sheet 8727 Sheet 8728 Sheet 8729 Sheet 8730 Sheet 8731 Sheet 8732 Sheet 8733 Sheet 8734 Sheet 8735 Sheet 8736 Sheet 8737 Sheet 8738 Sheet 8739 Sheet 8740 Sheet 8741 Sheet 8742 Sheet 8743 Sheet 8744 Sheet 8745 Sheet 8746 Sheet 8747 Sheet 8748 Sheet 8749 Sheet 8750 Sheet 8751 Sheet 8752 Sheet 8753 Sheet 8754 Sheet 8755 Sheet 8756 Sheet 8757 Sheet 8758 Sheet 8759 Sheet 8760 Sheet 8761 Sheet 8762 Sheet 8763 Sheet 8764 Sheet 8765 Sheet 8766 Sheet 8767 Sheet 8768 Sheet 8769 Sheet 8770 Sheet 8771 Sheet 8772 Sheet 8773 Sheet 8774 Sheet 8775 Sheet 8776 Sheet 8777 Sheet 8778 Sheet 8779 Sheet 8780 Sheet 8781 Sheet 8782 Sheet 8783 Sheet 8784 Sheet 8785 Sheet 8786 Sheet 8787 Sheet 8788 Sheet 8789 Sheet 8790 Sheet 8791 Sheet 8792 Sheet 8793 Sheet 8794 Sheet 8795 Sheet 8796 Sheet 8797 Sheet 8798 Sheet 8799 Sheet 8800 Sheet 8801 Sheet 8802 Sheet 8803 Sheet 8804 Sheet 8805 Sheet 8806 Sheet 8807 Sheet 8808 Sheet 8809 Sheet 8810 Sheet 8811 Sheet 8812 Sheet 8813 Sheet 8814 Sheet 8815 Sheet 8816 Sheet 8817 Sheet 8818 Sheet 8819 Sheet 8820 Sheet 8821 Sheet 8822 Sheet 8823 Sheet 8824 Sheet 8825 Sheet 8826 Sheet 8827 Sheet 8828 Sheet 8829 Sheet 8830 Sheet 8831 Sheet 8832 Sheet 8833 Sheet 8834 Sheet 8835 Sheet 8836 Sheet 8837 Sheet 8838 Sheet 8839 Sheet 8840 Sheet 8841 Sheet 8842 Sheet 8843 Sheet 8844 Sheet 8845 Sheet 8846 Sheet 8847 Sheet 8848 Sheet 8849 Sheet 8850 Sheet 8851 Sheet 8852 Sheet 8853 Sheet 8854 Sheet 8855 Sheet 8856 Sheet 8857 Sheet 8858 Sheet 8859 Sheet 8860 Sheet 8861 Sheet 8862 Sheet 8863 Sheet 8864 Sheet 8865 Sheet 8866 Sheet 8867 Sheet 8868 Sheet 8869 Sheet 8870 Sheet 8871 Sheet 8872 Sheet 8873 Sheet 8874 Sheet 8875 Sheet 8876 Sheet 8877 Sheet 8878 Sheet 8879 Sheet 8880 Sheet 8881 Sheet 8882 Sheet 8883 Sheet 8884 Sheet 8885 Sheet 8886 Sheet 8887 Sheet 8888 Sheet 8889 Sheet 8890 Sheet 8891 Sheet 8892 Sheet 8893 Sheet 8894 Sheet 8895 Sheet 8896 Sheet 8897 Sheet 8898 Sheet 8899 Sheet 8900 Sheet 8901 Sheet 8902 Sheet 8903 Sheet 8904 Sheet 8905 Sheet 8906 Sheet 8907 Sheet 8908 Sheet 8909 Sheet 8910 Sheet 8911 Sheet 8912 Sheet 8913 Sheet 8914 Sheet 8915 Sheet 8916 Sheet 8917 Sheet 8918 Sheet 8919 Sheet 8920 Sheet 8921 Sheet 8922 Sheet 8923 Sheet 8924 Sheet 8925 Sheet 8926 Sheet 8927 Sheet 8928 Sheet 8929 Sheet 8930 Sheet 8931 Sheet 8932 Sheet 8933 Sheet 8934 Sheet 8935 Sheet 8936 Sheet 8937 Sheet 8938 Sheet 8939 Sheet 8940 Sheet 8941 Sheet 8942 Sheet 8943 Sheet 8944 Sheet 8945 Sheet 8946 Sheet 8947 Sheet 8948 Sheet 8949 Sheet 8950 Sheet 8951 Sheet 8952 Sheet 8953 Sheet 8954 Sheet 8955 Sheet 8956 Sheet 8957 Sheet 8958 Sheet 8959 Sheet 8960 Sheet 8961 Sheet 8962 Sheet 8963 Sheet 8964 Sheet 8965 Sheet 8966 Sheet 8967 Sheet 8968 Sheet 8969 Sheet 8970 Sheet 8971 Sheet 8972 Sheet 8973 Sheet 8974 Sheet 8975 Sheet 8976 Sheet 8977 Sheet 8978 Sheet 8979 Sheet 8980 Sheet 8981 Sheet 8982 Sheet 8983 Sheet 8984 Sheet 8985 Sheet 8986 Sheet 8987 Sheet 8988 Sheet 8989 Sheet 8990 Sheet 8991 Sheet 8992 Sheet 8993 Sheet 8994 Sheet 8995 Sheet 8996 Sheet 8997 Sheet 8998 Sheet 8999 Sheet 9000 Sheet 9001 Sheet 9002 Sheet 9003 Sheet 9004 Sheet 9005 Sheet 9006 Sheet 9007 Sheet 9008 Sheet 9009 Sheet 9010 Sheet 9011 Sheet 9012 Sheet 9013 Sheet 9014 Sheet 9015 Sheet 9016 Sheet 9017 Sheet 9018 Sheet 9019 Sheet 9020 Sheet 9021 Sheet 9022 Sheet 9023 Sheet 9024 Sheet 9025 Sheet 9026 Sheet 9027 Sheet 9028 Sheet 9029 Sheet 9030 Sheet 9031 Sheet 9032 Sheet 9033 Sheet 9034 Sheet 9035 Sheet 9036 Sheet 9037 Sheet 9038 Sheet 9039 Sheet 9040 Sheet 9041 Sheet 9042 Sheet 9043 Sheet 9044 Sheet 9045 Sheet 9046 Sheet 9047 Sheet 9048 Sheet 9049 Sheet 9050 Sheet 9051 Sheet 9052 Sheet 9053 Sheet 9054 Sheet 9055 Sheet 9056 Sheet 9057 Sheet 9058 Sheet 9059 Sheet 9060 Sheet 9061 Sheet 9062 Sheet 9063 Sheet 9064 Sheet 9065 Sheet 9066 Sheet 9067 Sheet 9068 Sheet 9069 Sheet 9070 Sheet 9071 Sheet 9072 Sheet 9073 Sheet 9074 Sheet 9075 Sheet 9076 Sheet 9077 Sheet 9078 Sheet 9079 Sheet 9080 Sheet 9081 Sheet 9082 Sheet 9083 Sheet 9084 Sheet 9085 Sheet 9086 Sheet 9087 Sheet 9088 Sheet 9089 Sheet 9090 Sheet 9091 Sheet 9092 Sheet 9093 Sheet 9094 Sheet 9095 Sheet 9096 Sheet 9097 Sheet 9098 Sheet 9099 Sheet 9100 Sheet 9101 Sheet 9102 Sheet 9103 Sheet 9104 Sheet 9105 Sheet 9106 Sheet 9107 Sheet 9108 Sheet 9109 Sheet 9110 Sheet 9111 Sheet 9112 Sheet 9113 Sheet 9114 Sheet 9115 Sheet 9116 Sheet 9117 Sheet 9118 Sheet 9119 Sheet 9120 Sheet 9121 Sheet 9122 Sheet 9123 Sheet 9124 Sheet 9125 Sheet 9126 Sheet 9127 Sheet 9128 Sheet 9129 Sheet 9130 Sheet 9131 Sheet 9132 Sheet 9133 Sheet 9134 Sheet 9135 Sheet 9136 Sheet 9137 Sheet 9138 Sheet 9139 Sheet 9140 Sheet 9141 Sheet 9142 Sheet 9143 Sheet 9144 Sheet 9145 Sheet 9146 Sheet 9147 Sheet 9148 Sheet 9149 Sheet 9150 Sheet 9151 Sheet 9152 Sheet 9153 Sheet 9154 Sheet 9155 Sheet 9156 Sheet 9157 Sheet 9158 Sheet 9159 Sheet 9160 Sheet 9161 Sheet 9162 Sheet 9163 Sheet 9164 Sheet 9165 Sheet 9166 Sheet 9167 Sheet 9168 Sheet 9169 Sheet 9170 Sheet 9171 Sheet 9172 Sheet 9173 Sheet 9174 Sheet 9175 Sheet 9176 Sheet 9177 Sheet 9178 Sheet 9179 Sheet 9180 Sheet 9181 Sheet 9182 Sheet 9183 Sheet 9184 Sheet 9185 Sheet 9186 Sheet 9187 Sheet 9188 Sheet 9189 Sheet 9190 Sheet 9191 Sheet 9192 Sheet 9193 Sheet 9194 Sheet 9195 Sheet 9196 Sheet 9197 Sheet 9198 Sheet 9199 Sheet 9200 Sheet 9201 Sheet 9202 Sheet 9203 Sheet 9204 Sheet 9205 Sheet 9206 Sheet 9207 Sheet 9208 Sheet 9209 Sheet 9210 Sheet 9211 Sheet 9212 Sheet 9213 Sheet 9214 Sheet 9215 Sheet 9216 Sheet 9217 Sheet 9218 Sheet 9219 Sheet 9220 Sheet 9221 Sheet 9222 Sheet 9223 Sheet 9224 Sheet 9225 Sheet 9226 Sheet 9227 Sheet 9228 Sheet 9229 Sheet 9230 Sheet 9231 Sheet 9232 Sheet 9233 Sheet 9234 Sheet 9235 Sheet 9236 Sheet 9237 Sheet 9238 Sheet 9239 Sheet 9240 Sheet 9241 Sheet 9242 Sheet 9243 Sheet 9244 Sheet 9245 Sheet 9246 Sheet 9247 Sheet 9248 Sheet 9249 Sheet 9250 Sheet 9251 Sheet 9252 Sheet 9253 Sheet 9254 Sheet 9255 Sheet 9256 Sheet 9257 Sheet 9258 Sheet 9259 Sheet 9260 Sheet 9261 Sheet 9262 Sheet 9263 Sheet 9264 Sheet 9265 Sheet 9266 Sheet 9267 Sheet 9268 Sheet 9269 Sheet 9270 Sheet 9271 Sheet 9272 Sheet 9273 Sheet 9274 Sheet 9275 Sheet 9276 Sheet 9277 Sheet 9278 Sheet 9279 Sheet 9280 Sheet 9281 Sheet 9282 Sheet 9283 Sheet 9284 Sheet 9285 Sheet 9286 Sheet 9287 Sheet 9288 Sheet 9289 Sheet 9290 Sheet 9291 Sheet 9292 Sheet 9293 Sheet 9294 Sheet 9295 Sheet 9296 Sheet 9297 Sheet 9298 Sheet 9299 Sheet 9300 Sheet 9301 Sheet 9302 Sheet 9303 Sheet 9304 Sheet 9305 Sheet 9306 Sheet 9307 Sheet 9308 Sheet 9309 Sheet 9310 Sheet 9311 Sheet 9312 Sheet 9313 Sheet 9314 Sheet 9315 Sheet 9316 Sheet 9317 Sheet 9318 Sheet 9319 Sheet 9320 Sheet 9321 Sheet 9322 Sheet 9323 Sheet 9324 Sheet 9325 Sheet 9326 Sheet 9327 Sheet 9328 Sheet 9329 Sheet 9330 Sheet 9331 Sheet 9332 Sheet 9333 Sheet 9334 Sheet 9335 Sheet 9336 Sheet 9337 Sheet 9338 Sheet 9339 Sheet 9340 Sheet 9341 Sheet 9342 Sheet 9343 Sheet 9344 Sheet 9345 Sheet 9346 Sheet 9347 Sheet 9348 Sheet 9349 Sheet 9350 Sheet 9351 Sheet 9352 Sheet 9353 Sheet 9354 Sheet 9355 Sheet 9356 Sheet 9357 Sheet 9358 Sheet 9359 Sheet 9360 Sheet 9361 Sheet 9362 Sheet 9363 Sheet 9364 Sheet 9365 Sheet 9366 Sheet 9367 Sheet 9368 Sheet 9369 Sheet 9370 Sheet 9371 Sheet 9372 Sheet 9373 Sheet 9374 Sheet 9375 Sheet 9376 Sheet 9377 Sheet 9378 Sheet 9379 Sheet 9380 Sheet 9381 Sheet 9382 Sheet 9383 Sheet 9384 Sheet 9385 Sheet 9386 Sheet 9387 Sheet 9388 Sheet 9389 Sheet 9390 Sheet 9391 Sheet 9392 Sheet 9393 Sheet 9394 Sheet 9395 Sheet 9396 Sheet 9397 Sheet 9398 Sheet 9399 Sheet 9400 Sheet 9401 Sheet 9402 Sheet 9403 Sheet 9404 Sheet 9405 Sheet 9406 Sheet 9407 Sheet 9408 Sheet 9409 Sheet 9410 Sheet 9411 Sheet 9412 Sheet 9413 Sheet 9414 Sheet 9415 Sheet 9416 Sheet 9417 Sheet 9418 Sheet 9419 Sheet 9420 Sheet 9421 Sheet 9422 Sheet 9423 Sheet 9424 Sheet 9425 Sheet 9426 Sheet 9427 Sheet 9428 Sheet 9429 Sheet 9430 Sheet 9431 Sheet 9432 Sheet 9433 Sheet 9434 Sheet 9435 Sheet 9436 Sheet 9437 Sheet 9438 Sheet 9439 Sheet 9440 Sheet 9441 Sheet 9442 Sheet 9443 Sheet 9444 Sheet 9445 Sheet 9446 Sheet 9447 Sheet 9448 Sheet 9449 Sheet 9450 Sheet 9451 Sheet 9452 Sheet 9453 Sheet 9454 Sheet 9455 Sheet 9456 Sheet 9457 Sheet 9458 Sheet 9459 Sheet 9460 Sheet 9461 Sheet 9462 Sheet 9463 Sheet 9464 Sheet 9465 Sheet 9466 Sheet 9467 Sheet 9468 Sheet 9469 Sheet 9470 Sheet 9471 Sheet 9472 Sheet 9473 Sheet 9474 Sheet 9475 Sheet 9476 Sheet 9477 Sheet 9478 Sheet 9479 Sheet 9480 Sheet 9481 Sheet 9482 Sheet 9483 Sheet 9484 Sheet 9485 Sheet 9486 Sheet 9487 Sheet 9488 Sheet 9489 Sheet 9490 Sheet 9491 Sheet 9492 Sheet 9493 Sheet 9494 Sheet 9495 Sheet 9496 Sheet 9497 Sheet 9498 Sheet 9499 Sheet 9500 Sheet 9501 Sheet 9502 Sheet 9503 Sheet 9504 Sheet 9505 Sheet 9506 Sheet 9507 Sheet 9508 Sheet 9509 Sheet 9510 Sheet 9511 Sheet 9512 Sheet 9513 Sheet 9514 Sheet 9515 Sheet 9516 Sheet 9517 Sheet 9518 Sheet 9519 Sheet 9520 Sheet 9521 Sheet 9522 Sheet 9523 Sheet 9524 Sheet 9525 Sheet 9526 Sheet 9527 Sheet 9528 Sheet 9529 Sheet 9530 Sheet 9531 Sheet 9532 Sheet 9533 Sheet 9534 Sheet 9535 Sheet 9536 Sheet 9537 Sheet 9538 Sheet 9539 Sheet 9540 Sheet 9541 Sheet 9542 Sheet 9543 Sheet 9544 Sheet 9545 Sheet 9546 Sheet 9547 Sheet 9548 Sheet 9549 Sheet 9550 Sheet 9551 Sheet 9552 Sheet 9553 Sheet 9554 Sheet 9555 Sheet 9556 Sheet 9557 Sheet 9558 Sheet 9559 Sheet 9560 Sheet 9561 Sheet 9562 Sheet 9563 Sheet 9564 Sheet 9565 Sheet 9566 Sheet 9567 Sheet 9568 Sheet 9569 Sheet 9570 Sheet 9571 Sheet 9572 Sheet 9573 Sheet 9574 Sheet 9575 Sheet 9576 Sheet 9577 Sheet 9578 Sheet 9579 Sheet 9580 Sheet 9581 Sheet 9582 Sheet 9583 Sheet 9584 Sheet 9585 Sheet 9586 Sheet 9587 Sheet 9588 Sheet 9589 Sheet 9590 Sheet 9591 Sheet 9592 Sheet 9593 Sheet 9594 Sheet 9595 Sheet 9596 Sheet 9597 Sheet 9598 Sheet 9599 Sheet 9600 Sheet 9601 Sheet 9602 Sheet 9603 Sheet 9604 Sheet 9605 Sheet 9606 Sheet 9607 Sheet 9608 Sheet 9609 Sheet 9610 Sheet 9611 Sheet 9612 Sheet 9613 Sheet 9614 Sheet 9615 Sheet 9616 Sheet 9617 Sheet 9618 Sheet 9619 Sheet 9620 Sheet 9621 Sheet 9622 Sheet 9623 Sheet 9624 Sheet 9625 Sheet 9626 Sheet 9627 Sheet 9628 Sheet 9629 Sheet 9630 Sheet 9631 Sheet 9632 Sheet 9633 Sheet 9634 Sheet 9635 Sheet 9636 Sheet 9637 Sheet 9638 Sheet 9639 Sheet 9640 Sheet 9641 Sheet 9642 Sheet 9643 Sheet 9644 Sheet 9645 Sheet 9646 Sheet 9647 Sheet 9648 Sheet 9649 Sheet 9650 Sheet 9651 Sheet 9652 Sheet 9653 Sheet 9654 Sheet 9655 Sheet 9656 Sheet 9657 Sheet 9658 Sheet 9659 Sheet 9660 Sheet 9661 Sheet 9662 Sheet 9663 Sheet 9664 Sheet 9665 Sheet 9666 Sheet 9667 Sheet 9668 Sheet 9669 Sheet 9670 Sheet 9671 Sheet 9672 Sheet 9673 Sheet 9674 Sheet 9675 Sheet 9676 Sheet 9677 Sheet 9678 Sheet 9679 Sheet 9680 Sheet 9681 Sheet 9682 Sheet 9683 Sheet 9684 Sheet 9685 Sheet 9686 Sheet 9687 Sheet 9688 Sheet 9689 Sheet 9690 Sheet 9691 Sheet 9692 Sheet 9693 Sheet 9694 Sheet 9695 Sheet 9696 Sheet 9697 Sheet 9698 Sheet 9699 Sheet 9700 Sheet 9701 Sheet 9702 Sheet 9703 Sheet 9704 Sheet 9705 Sheet 9706 Sheet 9707 Sheet 9708 Sheet 9709 Sheet 9710 Sheet 9711 Sheet 9712 Sheet 9713 Sheet 9714 Sheet 9715 Sheet 9716 Sheet 9717 Sheet 9718 Sheet 9719 Sheet 9720 Sheet 9721 Sheet 9722 Sheet 9723 Sheet 9724 Sheet 9725 Sheet 9726 Sheet 9727 Sheet 9728 Sheet 9729 Sheet 9730 Sheet 9731 Sheet 9732 Sheet 9733 Sheet 9734 Sheet 9735 Sheet 9736 Sheet 9737 Sheet 9738 Sheet 9739 Sheet 9740 Sheet 9741 Sheet 9742 Sheet 9743 Sheet 9744 Sheet 9745 Sheet 9746 Sheet 9747 Sheet 9748 Sheet 9749 Sheet 9750 Sheet 9751 Sheet 9752 Sheet 9753 Sheet 9754 Sheet 9755 Sheet 9756 Sheet 9757 Sheet 9758 Sheet 9759 Sheet 9760 Sheet 9761 Sheet 9762 Sheet 9763 Sheet 9764 Sheet 9765 Sheet 9766 Sheet 9767 Sheet 9768 Sheet 9769 Sheet 9770 Sheet 9771 Sheet 9772 Sheet 9773 Sheet 9774 Sheet 9775 Sheet 9776 Sheet 9777 Sheet 9778 Sheet 9779 Sheet 9780 Sheet 9781 Sheet 9782 Sheet 9783 Sheet 9784 Sheet 9785 Sheet 9786 Sheet 9787 Sheet 9788 Sheet 9789 Sheet 9790 Sheet 9791 Sheet 9792 Sheet 9793 Sheet 9794 Sheet 9795 Sheet 9796 Sheet 9797 Sheet 9798 Sheet 9799 Sheet 9800 Sheet 9801 Sheet 9802 Sheet 9803 Sheet 9804 Sheet 9805 Sheet 9806 Sheet 9807 Sheet 9808 Sheet 9809 Sheet 9810 Sheet 9811 Sheet 9812 Sheet 9813 Sheet 9814 Sheet 9815 Sheet 9816 Sheet 9817 Sheet 9818 Sheet 9819 Sheet 9820 Sheet 9821 Sheet 9822 Sheet 9823 Sheet 9824 Sheet 9825 Sheet 9826 Sheet 9827 Sheet 9828 Sheet 9829 Sheet 9830 Sheet 9831 Sheet 9832 Sheet 9833 Sheet 9834 Sheet 9835 Sheet 9836 Sheet 9837 Sheet 9838 Sheet 9839 Sheet 9840 Sheet 9841 Sheet 9842 Sheet 9843 Sheet 9844 Sheet 9845 Sheet 9846 Sheet 9847 Sheet 9848 Sheet 9849 Sheet 9850 Sheet 9851 Sheet 9852 Sheet 9853 Sheet 9854 Sheet 9855 Sheet 9856 Sheet 9857 Sheet 9858 Sheet 9859 Sheet 9860 Sheet 9861 Sheet 9862 Sheet 9863 Sheet 9864 Sheet 9865 Sheet 9866 Sheet 9867 Sheet 9868 Sheet 9869 Sheet 9870 Sheet 9871 Sheet 9872 Sheet 9873 Sheet 9874 Sheet 9875 Sheet 9876 Sheet 9877 Sheet 9878 Sheet 9879 Sheet 9880 Sheet 9881 Sheet 9882 Sheet 9883 Sheet 9884 Sheet 9885 Sheet 9886 Sheet 9887 Sheet 9888 Sheet 9889 Sheet 9890 Sheet 9891 Sheet 9892 Sheet 9893 Sheet 9894 Sheet 9895 Sheet 9896 Sheet 9897 Sheet 9898 Sheet 9899 Sheet 9900 Sheet 9901 Sheet 9902 Sheet 9903 Sheet 9904 Sheet 9905 Sheet 9906 Sheet 9907 Sheet 9908 Sheet 9909 Sheet 9910 Sheet 9911 Sheet 9912 Sheet 9913 Sheet 9914 Sheet 9915 Sheet 9916 Sheet 9917 Sheet 9918 Sheet 9919 Sheet 9920 Sheet 9921 Sheet 9922 Sheet 9923 Sheet 9924 Sheet 9925 Sheet 9926 Sheet 9927 Sheet 9928 Sheet 9929 Sheet 9930 Sheet 9931 Sheet 9932 Sheet 9933 Sheet 9934 Sheet 9935 Sheet 9936 Sheet 9937 Sheet 9938 Sheet 9939 Sheet 9940 Sheet 9941 Sheet 9942 Sheet 9943 Sheet 9944 Sheet 9945 Sheet 9946 Sheet 9947 Sheet 9948 Sheet 9949 Sheet 9950 Sheet 9951 Sheet 9952 Sheet 9953 Sheet 9954 Sheet 9955 Sheet 9956 Sheet 9957 Sheet 9958 Sheet 9959 Sheet 9960 Sheet 9961 Sheet 9962 Sheet 9963 Sheet 9964 Sheet 9965 Sheet 9966 Sheet 9967 Sheet 9968 Sheet 9969 Sheet 9970 Sheet 9971 Sheet 9972 Sheet 9973 Sheet 9974 Sheet 9975 Sheet 9976 Sheet 9977 Sheet 9978 Sheet 9979 Sheet 9980 Sheet 9981 Sheet 9982 Sheet 9983 Sheet 9984 Sheet 9985 Sheet 9986 Sheet 9987 Sheet 9988 Sheet 9989 Sheet 9990 Sheet 9991 Sheet 9992 Sheet 9993 Sheet 9994 Sheet 9995 Sheet 9996 Sheet 9997 Sheet 9998 Sheet 9999 Sheet 10000 Sheet 10001 Sheet 10002 Sheet 10003 Sheet 10004 Sheet 10005 Sheet 10006 Sheet 10007 Sheet 10008 Sheet 10009 Sheet 10010 Sheet 10011 Sheet 10012 Sheet 10013 Sheet 10014 Sheet 10015 Sheet 10016 Sheet 10017 Sheet 10018 Sheet 10019 Sheet 10020 Sheet 10021 Sheet 10022 Sheet 10023 Sheet 10024 Sheet 10025 Sheet 10026 Sheet 10027 Sheet 10028 Sheet 10029 Sheet 10030 Sheet 10031 Sheet 10032 Sheet 10033 Sheet 10034 Sheet 10035 Sheet 10036 Sheet 10037 Sheet 10038 Sheet 10039 Sheet 10040 Sheet 10041 Sheet 10042 Sheet 10043 Sheet 10044 Sheet 10045 Sheet 10046 Sheet 10047 Sheet 10048 Sheet 10049 Sheet 10050 Sheet 10051 Sheet 10052 Sheet 10053 Sheet 10054 Sheet 10055 Sheet 10056 Sheet 10057 Sheet 10058 Sheet 10059 Sheet 10060 Sheet 10061 Sheet 10062 Sheet 10063 Sheet 10064 Sheet 10065 Sheet 10066 Sheet 10067 Sheet 10068 Sheet 10069 Sheet 10070 Sheet 10071 Sheet 10072 Sheet 10073 Sheet 10074 Sheet 10075 Sheet 10076 Sheet 10077 Sheet 10078 Sheet 10079 Sheet 10080 Sheet 10081 Sheet 10082 Sheet 10083 Sheet 10084 Sheet 10085 Sheet 10086 Sheet 10087 Sheet 10088 Sheet 10089 Sheet 10090 Sheet 10091 Sheet 10092 Sheet 10093 Sheet 10094 Sheet 10095 Sheet 10096 Sheet 10097 Sheet 10098 Sheet 10099 Sheet 10100 Sheet 10101 Sheet 10102 Sheet 10103 Sheet 10104 Sheet 10105 Sheet 10106 Sheet 10107 Sheet 10108 Sheet 10109 Sheet 10110 Sheet 10111 Sheet 10112 Sheet 10113 Sheet 10114 Sheet 10115 Sheet 10116 Sheet 10117 Sheet 10118 Sheet 10119 Sheet 10120 Sheet 10121 Sheet 10122 Sheet 10123 Sheet 10124 Sheet 10125 Sheet 10126 Sheet 10127 Sheet 10128 Sheet 10129 Sheet 10130 Sheet 10131 Sheet 10132 Sheet 10133 Sheet 10134 Sheet 10135 Sheet 10136 Sheet 10137 Sheet 10138 Sheet 10139 Sheet 10140 Sheet 10141 Sheet 10142 Sheet 10143 Sheet 10144 Sheet 10145 Sheet 10146 Sheet 10147 Sheet 10148 Sheet 10149 Sheet 10150 Sheet 10151 Sheet 10152 Sheet 10153 Sheet 10154 Sheet 10155 Sheet 10156 Sheet 10157 Sheet 10158 Sheet 10159 Sheet 10160 Sheet 10161 Sheet 10162 Sheet 10163 Sheet 10164 Sheet 10165 Sheet 10166 Sheet 10167 Sheet 10168 Sheet 10169 Sheet 10170 Sheet 10171 Sheet 10172 Sheet 10173 Sheet 10174 Sheet 10175 Sheet 10176 Sheet 10177 Sheet 10178 Sheet 10179 Sheet 10180 Sheet 10181 Sheet 10182 Sheet 10183 Sheet 10184 Sheet 10185 Sheet 10186 Sheet 10187 Sheet 10188 Sheet 10189 Sheet 10190 Sheet 10191 Sheet 10192 Sheet 10193 Sheet 10194 Sheet 10195 Sheet 10196 Sheet 10197 Sheet 10198 Sheet 10199 Sheet 10200 Sheet 10201 Sheet 10202 Sheet 10203 Sheet 10204 Sheet 10205 Sheet 10206 Sheet 10207 Sheet 10208 Sheet 10209 Sheet 10210 Sheet 10211 Sheet 10212 Sheet 10213 Sheet 10214 Sheet 10215 Sheet 10216 Sheet 10217 Sheet 10218 Sheet 10219 Sheet 10220 Sheet 10221 Sheet 10222 Sheet 10223 Sheet 10224 Sheet 10225 Sheet 10226 Sheet 10227 Sheet 10228 Sheet 10229 Sheet 10230 Sheet 10231 Sheet 10232 Sheet 10233 Sheet 10234 Sheet 10235 Sheet 10236 Sheet 10237 Sheet 10238 Sheet 10239 Sheet 10240 Sheet 10241 Sheet 10242 Sheet 10243 Sheet 10244 Sheet 10245 Sheet 10246 Sheet 10247 Sheet 10248 Sheet 10249 Sheet 10250 Sheet 10251 Sheet 10252 Sheet 10253 Sheet 10254 Sheet 10255 Sheet 10256 Sheet 10257 Sheet 10258 Sheet 10259 Sheet 10260 Sheet 10261 Sheet 10262 Sheet 10263 Sheet 10264 Sheet 10265 Sheet 10266 Sheet 10267 Sheet 10268 Sheet 10269 Sheet 10270 Sheet 10271 Sheet 10272 Sheet 10273 Sheet 10274 Sheet 10275 Sheet 10276 Sheet 10277 Sheet 10278 Sheet 10279 Sheet 10280 Sheet 10281 Sheet 10282 Sheet 10283 Sheet 10284 Sheet 10285 Sheet 10286 Sheet 10287 Sheet 10288 Sheet 10289 Sheet 10290 Sheet 10291 Sheet 10292 Sheet 10293 Sheet 10294 Sheet 10295 Sheet 10296 Sheet 10297 Sheet 10298 Sheet 10299 Sheet 10300 Sheet 10301 Sheet 10302 Sheet 10303 Sheet 10304 Sheet 10305 Sheet 10306 Sheet 10307 Sheet 10308 Sheet 10309 Sheet 10310 Sheet 10311 Sheet 10312 Sheet 10313 Sheet 10314 Sheet 10315 Sheet 10316 Sheet 10317 Sheet 10318 Sheet 10319 Sheet 10320 Sheet 10321 Sheet 10322 Sheet 10323 Sheet 10324 Sheet 10325 Sheet 10326 Sheet 10327 Sheet 10328 Sheet 10329 Sheet 10330 Sheet 10331 Sheet 10332 Sheet 10333 Sheet 10334 Sheet 10335 Sheet 10336 Sheet 10337 Sheet 10338 Sheet 10339 Sheet 10340 Sheet 10341 Sheet 10342 Sheet 10343 Sheet 10344 Sheet 10345 Sheet 10346 Sheet 10347 Sheet 10348 Sheet 10349 Sheet 10350 Sheet 10351 Sheet 10352 Sheet 10353 Sheet 10354 Sheet 10355 Sheet 10356 Sheet 10357 Sheet 10358 Sheet 10359 Sheet 10360 Sheet 10361 Sheet 10362 Sheet 10363 Sheet 10364 Sheet 10365 Sheet 10366 Sheet 10367 Sheet 10368 Sheet 10369 Sheet 10370 Sheet 10371 Sheet 10372 Sheet 10373 Sheet 10374 Sheet 10375 Sheet 10376 Sheet 10377 Sheet 10378 Sheet 10379 Sheet 10380 Sheet 10381 Sheet 10382 Sheet 10383 Sheet 10384 Sheet 10385 Sheet 10386 Sheet 10387 Sheet 10388 Sheet 10389 Sheet 10390 Sheet 10391 Sheet 10392 Sheet 10393 Sheet 10394 Sheet 10395 Sheet 10396 Sheet 10397 Sheet 10398 Sheet 10399 Sheet 10400 Sheet 10401 Sheet 10402 Sheet 10403 Sheet 10404 Sheet 10405 Sheet 10406 Sheet 10407 Sheet 10408 Sheet 10409 Sheet 10410 Sheet 10411 Sheet 10412 Sheet 10413 Sheet 10414 Sheet 10415 Sheet 10416 Sheet 10417 Sheet 10418 Sheet 10419 Sheet 10420 Sheet 10421 Sheet 10422 Sheet 10423 Sheet 10424 Sheet 10425 Sheet 10426 Sheet 10427 Sheet 10428 Sheet 10429 Sheet 10430 Sheet 10431 Sheet 10432 Sheet 10433 Sheet 10434 Sheet 10435 Sheet 10436 Sheet 10437 Sheet 10438 Sheet 10439 Sheet 10440 Sheet 10441 Sheet 10442 Sheet 10443 Sheet 10444 Sheet 10445 Sheet 10446 Sheet 10447 Sheet 10448 Sheet 10449 Sheet 10450 Sheet 10451 Sheet 10452 Sheet 10453 Sheet 10454 Sheet 10455 Sheet 10456 Sheet 10457 Sheet 10458 Sheet 10459 Sheet 10460 Sheet 10461 Sheet 10462 Sheet 10463 Sheet 10464 Sheet 10465 Sheet 10466 Sheet 10467 Sheet 10468 Sheet 10469 Sheet 10470 Sheet 10471 Sheet 10472 Sheet 10473 Sheet 10474 Sheet 10475 Sheet 10476 Sheet 10477 Sheet 10478 Sheet 10479 Sheet 10480 Sheet 10481 Sheet 10482 Sheet 10483 Sheet 10484 Sheet 10485 Sheet 10486 Sheet 10487 Sheet 10488 Sheet 10489 Sheet 10490 Sheet 10491 Sheet 10492 Sheet 10493 Sheet 10494 Sheet 10495 Sheet 10496 Sheet 10497 Sheet 10498 Sheet 10499 Sheet 10500 Sheet 10501 Sheet 10502 Sheet 10503 Sheet 10504 Sheet 10505 Sheet 10506 Sheet 10507 Sheet 10508 Sheet 10509 Sheet 10510 Sheet 10511 Sheet 10512 Sheet 10513 Sheet 10514 Sheet 10515 Sheet 10516 Sheet 10517 Sheet 10518 Sheet 10519 Sheet 10520 Sheet 10521 Sheet 10522 Sheet 10523 Sheet 10524 Sheet 10525 Sheet 10526 Sheet 10527 Sheet 10528 Sheet 10529 Sheet 10530 Sheet 10531 Sheet 10532 Sheet 10533 Sheet 10534 Sheet 10535 Sheet 10536 Sheet 10537 Sheet 10538 Sheet 10539 Sheet 10540 Sheet 10541 Sheet 10542 Sheet 10543 Sheet 10544 Sheet 10545 Sheet 10546 Sheet 10547 Sheet 10548 Sheet 10549 Sheet 10550 Sheet 10551 Sheet 10552 Sheet 10553 Sheet 10554 Sheet 10555 Sheet 10556 Sheet 10557 Sheet 10558 Sheet 10559 Sheet 10560 Sheet 10561 Sheet 10562 Sheet 10563 Sheet 10564 Sheet 10565 Sheet 10566 Sheet 10567 Sheet 10568 Sheet 10569 Sheet 10570 Sheet 10571 Sheet 10572 Sheet 10573 Sheet 10574 Sheet 10575 Sheet 10576 Sheet 10577 Sheet 10578 Sheet 10579 Sheet 10580 Sheet 10581 Sheet 10582 Sheet 10583 Sheet 10584 Sheet 10585 Sheet 10586 Sheet 10587 Sheet 10588 Sheet 10589 Sheet 10590 Sheet 10591 Sheet 10592 Sheet 10593 Sheet 10594 Sheet 10595 Sheet 10596 Sheet 10597 Sheet 10598 Sheet 10599 Sheet 10600 Sheet 10601 Sheet 10602 Sheet 10603 Sheet 10604 Sheet 10605 Sheet 10606 Sheet 10607 Sheet 10608 Sheet 10609 Sheet 10610 Sheet 10611 Sheet 10612 Sheet 10613 Sheet 10614 Sheet 10615 Sheet 10616 Sheet 10617 Sheet 10618 Sheet 10619 Sheet 10620 Sheet 10621 Sheet 10622 Sheet 10623 Sheet 10624 Sheet 10625 Sheet 10626 Sheet 10627 Sheet 10628 Sheet 10629 Sheet 10630 Sheet 10631 Sheet 10632 Sheet 10633 Sheet 10634 Sheet 10635 Sheet 10636 Sheet 10637 Sheet 10638 Sheet 10639 Sheet 10640 Sheet 10641 Sheet 10642 Sheet 10643 Sheet 10644 Sheet 10645 Sheet 10646 Sheet 10647 Sheet 10648 Sheet 10649 Sheet 10650 Sheet 10651 Sheet 10652 Sheet 10653 Sheet 10654 Sheet 10655 Sheet 10656 Sheet 10657 Sheet 10658 Sheet 10659 Sheet 10660 Sheet 10661 Sheet 10662 Sheet 10663 Sheet 10664 Sheet 10665 Sheet 10666 Sheet 10667 Sheet 10668 Sheet 10669 Sheet 10670 Sheet 10671 Sheet 10672 Sheet 10673 Sheet 10674 Sheet 10675 Sheet 10676 Sheet 10677 Sheet 10678 Sheet 10679 Sheet 10680 Sheet 10681 Sheet 10682 Sheet 10683 Sheet 10684 Sheet 10685 Sheet 10686 Sheet 10687 Sheet 10688 Sheet 10689 Sheet 10690 Sheet 10691 Sheet 10692 Sheet 10693 Sheet 10694 Sheet 10695 Sheet 10696 Sheet 10697 Sheet 10698 Sheet 10699 Sheet 10700 Sheet 10701 Sheet 10702 Sheet 10703 Sheet 10704 Sheet 10705 Sheet 10706 Sheet 10707 Sheet 10708 Sheet 10709 Sheet 10710 Sheet 10711 Sheet 10712 Sheet 10713 Sheet 10714 Sheet 10715 Sheet 10716 Sheet 10717 Sheet 10718 Sheet 10719 Sheet 10720 Sheet 10721 Sheet 10722 Sheet 10723 Sheet 10724 Sheet 10725 Sheet 10726 Sheet 10727 Sheet 10728 Sheet 10729 Sheet 10730 Sheet 10731 Sheet 10732 Sheet 10733 Sheet 10734 Sheet 10735 Sheet 10736 Sheet 10737 Sheet 10738 Sheet 10739 Sheet 10740 Sheet 10741 Sheet 10742 Sheet 10743 Sheet 10744 Sheet 10745 Sheet 10746 Sheet 10747 Sheet 10748 Sheet 10749 Sheet 10750 Sheet 10751 Sheet 10752 Sheet 10753 Sheet 10754 Sheet 10755 Sheet 10756 Sheet 10757 Sheet 10758 Sheet 10759 Sheet 10760 Sheet 10761 Sheet 10762 Sheet 10763 Sheet 10764 Sheet 10765 Sheet 10766 Sheet 10767 Sheet 10768 Sheet 10769 Sheet 10770 Sheet 10771 Sheet 10772 Sheet 10773 Sheet 10774 Sheet 10775 Sheet 10776 Sheet 10777 Sheet 10778 Sheet 10779 Sheet 10780 Sheet 10781 Sheet 10782 Sheet 10783 Sheet 10784 Sheet 10785 Sheet 10786 Sheet 10787 Sheet 10788 Sheet 10789 Sheet 10790 Sheet 10791 Sheet 10792 Sheet 10793 Sheet 10794 Sheet 10795 Sheet 10796 Sheet 10797 Sheet 10798 Sheet 10799 Sheet 10800 Sheet 10801 Sheet 10802 Sheet 10803 Sheet 10804 Sheet 10805 Sheet 10806 Sheet 10807 Sheet 10808 Sheet 10809 Sheet 10810 Sheet 10811 Sheet 10812 Sheet 10813 Sheet 10814 Sheet 10815 Sheet 10816 Sheet 10817 Sheet 10818 Sheet 10819 Sheet 10820 Sheet 10821 Sheet 10822 Sheet 10823 Sheet 10824 Sheet 10825 Sheet 10826 Sheet 10827 Sheet 10828 Sheet 10829 Sheet 10830 Sheet 10831 Sheet 10832 Sheet 10833 Sheet 10834 Sheet 10835 Sheet 10836 Sheet 10837 Sheet 10838 Sheet 10839 Sheet 10840 Sheet 10841 Sheet 10842 Sheet 10843 Sheet 10844 Sheet 10845 Sheet 10846 Sheet 10847 Sheet 10848 Sheet 10849 Sheet 10850 Sheet 10851 Sheet 10852 Sheet 10853 Sheet 10854 Sheet 10855 Sheet 10856 Sheet 10857 Sheet 10858 Sheet 10859 Sheet 10860 Sheet 10861 Sheet 10862 Sheet 10863 Sheet 10864 Sheet 10865 Sheet 10866 Sheet 10867 Sheet 10868 Sheet 10869 Sheet 10870 Sheet 10871 Sheet 10872 Sheet 10873 Sheet 10874 Sheet 10875 Sheet 10876 Sheet 10877 Sheet 10878 Sheet 10879 Sheet 10880 Sheet 10881 Sheet 10882 Sheet 10883 Sheet 10884 Sheet 10885 Sheet 10886 Sheet 10887 Sheet 10888 Sheet 10889 Sheet 10890 Sheet 10891 Sheet 10892 Sheet 10893 Sheet 10894 Sheet 10895 Sheet 10896 Sheet 10897 Sheet 10898 Sheet 10899 Sheet 10900 Sheet 10901 Sheet 10902 Sheet 10903 Sheet 10904 Sheet 10905 Sheet 10906 Sheet 10907 Sheet 10908 Sheet 10909 Sheet 10910 Sheet 10911 Sheet 10912 Sheet 10913 Sheet 10914 Sheet 10915 Sheet 10916 Sheet 10917 Sheet 10918 Sheet 10919 Sheet 10920 Sheet 10921 Sheet 10922 Sheet 10923 Sheet 10924 Sheet 10925 Sheet 10926 Sheet 10927 Sheet 10928 Sheet 10929 Sheet 10930 Sheet 10931 Sheet 10932 Sheet 10933 Sheet 10934 Sheet 10935 Sheet 10936 Sheet 10937 Sheet 10938 Sheet 10939 Sheet 10940 Sheet 10941 Sheet 10942 Sheet 10943 Sheet 10944 Sheet 10945 Sheet 10946 Sheet 10947 Sheet 10948 Sheet 10949 Sheet 10950 Sheet 10951 Sheet 10952 Sheet 10953 Sheet 10954 Sheet 10955 Sheet 10956 Sheet 10957 Sheet 10958 Sheet 10959 Sheet 10960 Sheet 10961 Sheet 10962 Sheet 10963 Sheet 10964 Sheet 10965 Sheet 10966 Sheet 10967 Sheet 10968 Sheet 10969 Sheet 10970 Sheet 10971 Sheet 10972 Sheet 10973 Sheet 10974 Sheet 10975 Sheet 10976 Sheet 10977 Sheet 10978 Sheet 10979 Sheet 10980 Sheet 10981 Sheet 10982 Sheet 10983 Sheet 10984 Sheet 10985 Sheet 10986 Sheet 10987 Sheet 10988 Sheet 10989 Sheet 10990 Sheet 10991 Sheet 10992 Sheet 10993 Sheet 10994 Sheet 10995 Sheet 10996 Sheet 10997 Sheet 10998 Sheet 10999 Sheet 11000 Sheet 11001 Sheet 11002 Sheet 11003 Sheet 11004 Sheet 11005 Sheet 11006 Sheet 11007 Sheet 11008 Sheet 11009 Sheet 11010 Sheet 11011 Sheet 11012 Sheet 11013 Sheet 11014 Sheet 11015 Sheet 11016 Sheet 11017 Sheet 11018 Sheet 11019 Sheet 11020 Sheet 11021 Sheet 11022 Sheet 11023 Sheet 11024 Sheet 11025 Sheet 11026 Sheet 11027 Sheet 11028 Sheet 11029 Sheet 11030 Sheet 11031 Sheet 11032 Sheet 11033 Sheet 11034 Sheet 11035 Sheet 11036 Sheet 11037 Sheet 11038 Sheet 11039 Sheet 11040 Sheet 11041 Sheet 11042 Sheet 11043 Sheet 11044 Sheet 11045 Sheet 11046 Sheet 11047 Sheet 11048 Sheet 11049 Sheet 11050 Sheet 11051 Sheet 11052 Sheet 11053 Sheet 11054 Sheet 11055 Sheet 11056 Sheet 11057 Sheet 11058 Sheet 11059 Sheet 11060 Sheet 11061 Sheet 11062 Sheet 11063 Sheet 11064 Sheet 11065 Sheet 11066 Sheet 11067 Sheet 11068 Sheet 11069 Sheet 11070 Sheet 11071 Sheet 11072 Sheet 11073 Sheet 11074 Sheet 11075 Sheet 11076 Sheet 11077 Sheet 11078 Sheet 11079 Sheet 11080 Sheet 11081 Sheet 11082 Sheet 11083 Sheet 11084 Sheet 11085 Sheet 11086 Sheet 11087 Sheet 11088 Sheet 11089 Sheet 11090 Sheet 11091 Sheet 11092 Sheet 11093 Sheet 11094 Sheet 11095 Sheet 11096 Sheet 11097 Sheet 11098 Sheet 11099 Sheet 11100 Sheet 11101 Sheet 11102 Sheet 11103 Sheet 11104 Sheet 11105 Sheet 11106 Sheet 11107 Sheet 11108 Sheet 11109 Sheet 11110 Sheet 11111 Sheet 11112 Sheet 11113 Sheet 11114 Sheet 11115 Sheet 11116 Sheet 11117 Sheet 11118 Sheet 11119 Sheet 11120 Sheet 11121 Sheet 11122 Sheet 11123 Sheet 11124 Sheet 11125 Sheet 11126 Sheet 11127 Sheet 11128 Sheet 11129 Sheet 11130 Sheet 11131 Sheet 11132 Sheet 11133 Sheet 11134 Sheet 11135 Sheet 11136 Sheet 11137 Sheet 11138 Sheet 11139 Sheet 11140 Sheet 11141 Sheet 11142 Sheet 11143 Sheet 11144 Sheet 11145 Sheet 11146 Sheet 11147 Sheet 11148 Sheet 11149 Sheet 11150 Sheet 11151 Sheet 11152 Sheet 11153 Sheet 11154 Sheet 11155 Sheet 11156 Sheet 11157 Sheet 11158 Sheet 11159 Sheet 11160 Sheet 11161 Sheet 11162 Sheet 11163 Sheet 11164 Sheet 11165 Sheet 11166 Sheet 11167 Sheet 11168 Sheet 11169 Sheet 11170 Sheet 11171 Sheet 11172 Sheet 11173 Sheet 11174 Sheet 11175 Sheet 11176 Sheet 11177 Sheet 11178 Sheet 11179 Sheet 11180 Sheet 11181 Sheet 11182 Sheet 11183 Sheet 11184 Sheet 11185 Sheet 11186 Sheet 11187 Sheet 11188 Sheet 11189 Sheet 11190 Sheet 11191 Sheet 11192 Sheet 11193 Sheet 11194 Sheet 11195 Sheet 11196 Sheet 11197 Sheet 11198 Sheet 11199 Sheet 11200 Sheet 11201 Sheet 11202 Sheet 11203 Sheet 11204 Sheet 11205 Sheet 11206 Sheet 11207 Sheet 11208 Sheet 11209 Sheet 11210 Sheet 11211 Sheet 11212 Sheet 11213 Sheet 11214 Sheet 11215 Sheet 11216 Sheet 11217 Sheet 11218 Sheet 11219 Sheet 11220 Sheet 11221 Sheet 11222 Sheet 11223 Sheet 11224 Sheet 11225 Sheet 11226 Sheet 11227 Sheet 11228 Sheet 11229 Sheet 11230 Sheet 11231 Sheet 11232 Sheet 11233 Sheet 11234 Sheet 11235 Sheet 11236 Sheet 11237 Sheet 11238 Sheet 11239 Sheet 11240 Sheet 11241 Sheet 11242 Sheet 11243 Sheet 11244 Sheet 11245 Sheet 11246 Sheet 11247 Sheet 11248 Sheet 11249 Sheet 11250 Sheet 11251 Sheet 11252 Sheet 11253 Sheet 11254 Sheet 11255 Sheet 11256 Sheet 11257 Sheet 11258 Sheet 11259 Sheet 11260 Sheet 11261 Sheet 11262 Sheet 11263 Sheet 11264 Sheet 11265 Sheet 11266 Sheet 11267 Sheet 11268 Sheet 11269 Sheet 11270 Sheet 11271 Sheet 11272 Sheet 11273 Sheet 11274 Sheet 11275 Sheet 11276 Sheet 11277 Sheet 11278 Sheet 11279 Sheet 11280 Sheet 11281 Sheet 11282 Sheet 11283 Sheet 11284 Sheet 11285 Sheet 11286 Sheet 11287 Sheet 11288 Sheet 11289 Sheet 11290 Sheet 11291 Sheet 11292 Sheet 11293 Sheet 11294 Sheet 11295 Sheet 11296 Sheet 11297 Sheet 11298 Sheet 11299 Sheet 11300 Sheet 11301 Sheet 11302 Sheet 11303 Sheet 11304 Sheet 11305 Sheet 11306 Sheet 11307 Sheet 11308 Sheet 11309 Sheet 11310 Sheet 11311 Sheet 11312 Sheet 11313 Sheet 11314 Sheet 11315 Sheet 11316 Sheet 11317 Sheet 11318 Sheet 11319 Sheet 11320 Sheet 11321 Sheet 11322 Sheet 11323 Sheet 11324 Sheet 11325 Sheet 11326 Sheet 11327 Sheet 11328 Sheet 11329 Sheet 11330 Sheet 11331 Sheet 11332 Sheet 11333 Sheet 11334 Sheet 11335 Sheet 11336 Sheet 11337 Sheet 11338 Sheet 11339 Sheet 11340 Sheet 11341 Sheet 11342 Sheet 11343 Sheet 11344 Sheet 11345 Sheet 11346 Sheet 11347 Sheet 11348 Sheet 11349 Sheet 11350 Sheet 11351 Sheet 11352 Sheet 11353 Sheet 11354 Sheet 11355 Sheet 11356 Sheet 11357 Sheet 11358 Sheet 11359 Sheet 11360 Sheet 11361 Sheet 11362 Sheet 11363 Sheet 11364 Sheet 11365 Sheet 11366 Sheet 11367 Sheet 11368 Sheet 11369 Sheet 11370 Sheet 11371 Sheet 11372 Sheet 11373 Sheet 11374 Sheet 11375 Sheet 11376 Sheet 11377 Sheet 11378 Sheet 11379 Sheet 11380 Sheet 11381 Sheet 11382 Sheet 11383 Sheet 11384 Sheet 11385 Sheet 11386 Sheet 11387 Sheet 11388 Sheet 11389 Sheet 11390 Sheet 11391 Sheet 11392 Sheet 11393 Sheet 11394 Sheet 11395 Sheet 11396 Sheet 11397 Sheet 11398 Sheet 11399 Sheet 11400 Sheet 11401 Sheet 11402 Sheet 11403 Sheet 11404 Sheet 11405 Sheet 11406 Sheet 11407 Sheet 11408 Sheet 11409 Sheet 11410 Sheet 11411 Sheet 11412 Sheet 11413 Sheet 11414 Sheet 11415 Sheet 11416 Sheet 11417 Sheet 11418 Sheet 11419 Sheet 11420 Sheet 11421 Sheet 11422 Sheet 11423 Sheet 11424 Sheet 11425 Sheet 11426 Sheet 11427 Sheet 11428 Sheet 11429 Sheet 11430 Sheet 11431 Sheet 11432 Sheet 11433 Sheet 11434 Sheet 11435 Sheet 11436 Sheet 11437 Sheet 11438 Sheet 11439 Sheet 11440 Sheet 11441 Sheet 11442 Sheet 11443 Sheet 11444 Sheet 11445 Sheet 11446 Sheet 11447 Sheet 11448 Sheet 11449 Sheet 11450 Sheet 11451 Sheet 11452 Sheet 11453 Sheet 11454 Sheet 11455 Sheet 11456 Sheet 11457 Sheet 11458 Sheet 11459 Sheet 11460 Sheet 11461 Sheet 11462 Sheet 11463 Sheet 11464 Sheet 11465 Sheet 11466 Sheet 11467 Sheet 11468 Sheet 11469 Sheet 11470 Sheet 11471 Sheet 11472 Sheet 11473 Sheet 11474 Sheet 11475 Sheet 11476 Sheet 11477 Sheet 11478 Sheet 11479 Sheet 11480 Sheet 11481 Sheet 11482 Sheet 11483 Sheet 11484 Sheet 11485 Sheet 11486 Sheet 11487 Sheet 11488 Sheet 11489 Sheet 11490 Sheet 11491 Sheet 11492 Sheet 11493 Sheet 11494 Sheet 11495 Sheet 11496 Sheet 11497 Sheet 11498 Sheet 11499 Sheet 11500 Sheet 11501 Sheet 11502 Sheet 11503 Sheet 11504 Sheet 11505 Sheet 11506 Sheet 11507 Sheet 11508 Sheet 11509 Sheet 11510 Sheet 11511 Sheet 11512 Sheet 11513 Sheet 11514 Sheet 11515 Sheet 11516 Sheet 11517 Sheet 11518 Sheet 11519 Sheet 11520 Sheet 11521 Sheet 11522 Sheet 11523 Sheet 11524 Sheet 11525 Sheet 11526 Sheet 11527 Sheet 11528 Sheet 11529 Sheet 11530 Sheet 11531 Sheet 11532 Sheet 11533 Sheet 11534 Sheet 11535 Sheet 11536 Sheet 11537 Sheet 11538 Sheet 11539 Sheet 11540 Sheet 11541 Sheet 11542 Sheet 11543 Sheet 11544 Sheet 11545 Sheet 11546 Sheet 11547 Sheet 11548 Sheet 11549 Sheet 11550 Sheet 11551 Sheet 11552 Sheet 11553 Sheet 11554 Sheet 11555 Sheet 11556 Sheet 11557 Sheet 11558 Sheet 11559 Sheet 11560 Sheet 11561 Sheet 11562 Sheet 11563 Sheet 11564 Sheet 11565 Sheet 11566 Sheet 11567 Sheet 11568 Sheet 11569 Sheet 11570 Sheet 11571 Sheet 11572 Sheet 11573 Sheet 11574 Sheet 11575 Sheet 11576 Sheet 11577 Sheet 11578 Sheet 11579 Sheet 11580 Sheet 11581 Sheet 11582 Sheet 11583 Sheet 11584 Sheet 11585 Sheet 11586 Sheet 11587 Sheet 11588 Sheet 11589 Sheet 11590 Sheet 11591 Sheet 11592 Sheet 11593 Sheet 11594 Sheet 11595 Sheet 11596 Sheet 11597 Sheet 11598 Sheet 11599 Sheet 11600 Sheet 11601 Sheet 11602 Sheet 11603 Sheet 11604 Sheet 11605 Sheet 11606 Sheet 11607 Sheet 11608 Sheet 11609 Sheet 11610 Sheet 11611 Sheet 11612 Sheet 11613 Sheet 11614 Sheet 11615 Sheet 11616 Sheet 11617 Sheet 11618 Sheet 11619 Sheet 11620 Sheet 11621 Sheet 11622 Sheet 11623 Sheet 11624 Sheet 11625 Sheet 11626 Sheet 11627 Sheet 11628 Sheet 11629 Sheet 11630 Sheet 11631 Sheet 11632 Sheet 11633 Sheet 11634 Sheet 11635 Sheet 11636 Sheet 11637 Sheet 11638 Sheet 11639 Sheet 11640 Sheet 11641 Sheet 11642 Sheet 11643 Sheet 11644 Sheet 11645 Sheet 11646 Sheet 11647 Sheet 11648 Sheet 11649 Sheet 11650 Sheet 11651 Sheet 11652 Sheet 11653 Sheet 11654 Sheet 11655 Sheet 11656 Sheet 11657 Sheet 11658 Sheet 11659 Sheet 11660 Sheet 11661 Sheet 11662 Sheet 11663 Sheet 11664 Sheet 11665 Sheet 11666 Sheet 11667 Sheet 11668 Sheet 11669 Sheet 11670 Sheet 11671 Sheet 11672 Sheet 11673 Sheet 11674 Sheet 11675 Sheet 11676 Sheet 11677 Sheet 11678 Sheet 11679 Sheet 11680 Sheet 11681 Sheet 11682 Sheet 11683 Sheet 11684 Sheet 11685 Sheet 11686 Sheet 11687 Sheet 11688 Sheet 11689 Sheet 11690 Sheet 11691 Sheet 11692 Sheet 11693 Sheet 11694 Sheet 11695 Sheet 11696 Sheet 11697 Sheet 11698 Sheet 11699 Sheet 11700 Sheet 11701 Sheet 11702 Sheet 11703 Sheet 11704 Sheet 11705 Sheet 11706 Sheet 11707 Sheet 11708 Sheet 11709 Sheet 11710 Sheet 11711 Sheet 11712 Sheet 11713 Sheet 11714 Sheet 11715 Sheet 11716 Sheet 11717 Sheet 11718 Sheet 11719 Sheet 11720 Sheet 11721 Sheet 11722 Sheet 11723 Sheet 11724 Sheet 11725 Sheet 11726 Sheet 11727 Sheet 11728 Sheet 11729 Sheet 11730 Sheet 11731 Sheet 11732 Sheet 11733 Sheet 11734 Sheet 11735 Sheet 11736 Sheet 11737 Sheet 11738 Sheet 11739 Sheet 11740 Sheet 11741 Sheet 11742 Sheet 11743 Sheet 11744 Sheet 11745 Sheet 11746 Sheet 11747 Sheet 11748 Sheet 11749 Sheet 11750 Sheet 11751 Sheet 11752 Sheet 11753 Sheet 11754 Sheet 11755 Sheet 11756 Sheet 11757 Sheet 11758 Sheet 11759 Sheet 11760 Sheet 11761 Sheet 11762 Sheet 11763 Sheet 11764 Sheet 11765 Sheet 11766 Sheet 11767 Sheet 11768 Sheet 11769 Sheet 11770 Sheet 11771 Sheet 11772 Sheet 11773 Sheet 11774 Sheet 11775 Sheet 11776 Sheet 11777 Sheet 11778 Sheet 11779 Sheet 11780 Sheet 11781 Sheet 11782 Sheet 11783 Sheet 11784 Sheet 11785 Sheet 11786 Sheet 11787 Sheet 11788 Sheet 11789 Sheet 11790 Sheet 11791 Sheet 11792 Sheet 11793 Sheet 11794 Sheet 11795 Sheet 11796 Sheet 11797 Sheet 11798 Sheet 11799 Sheet 11800 Sheet 11801 Sheet 11802 Sheet 11803 Sheet 11804 Sheet 11805 Sheet 11806 Sheet 11807 Sheet 11808 Sheet 11809 Sheet 11810 Sheet 11811 Sheet 11812 Sheet 11813 Sheet 11814 Sheet 11815 Sheet 11816 Sheet 11817 Sheet 11818 Sheet 11819 Sheet 11820 Sheet 11821 Sheet 11822 Sheet 11823 Sheet 11824 Sheet 11825 Sheet 11826 Sheet 11827 Sheet 11828 Sheet 11829 Sheet 11830 Sheet 11831 Sheet 11832 Sheet 11833 Sheet 11834 Sheet 11835 Sheet 11836 Sheet 11837 Sheet 11838 Sheet 11839 Sheet 11840 Sheet 11841 Sheet 11842 Sheet 11843 Sheet 11844 Sheet 11845 Sheet 11846 Sheet 11847 Sheet 11848 Sheet 11849 Sheet 11850 Sheet 11851 Sheet 11852 Sheet 11853 Sheet 11854 Sheet 11855 Sheet 11856 Sheet 11857 Sheet 11858 Sheet 11859 Sheet 11860 Sheet 11861 Sheet 11862 Sheet 11863 Sheet 11864 Sheet 11865 Sheet 11866 Sheet 11867 Sheet 11868 Sheet 11869 Sheet 11870 Sheet 11871 Sheet 11872 Sheet 11873 Sheet 11874 Sheet 11875 Sheet 11876 Sheet 11877 Sheet 11878 Sheet 11879 Sheet 11880 Sheet 11881 Sheet 11882 Sheet 11883 Sheet 11884 Sheet 11885 Sheet 11886 Sheet 11887 Sheet 11888 Sheet 11889 Sheet 11890 Sheet 11891 Sheet 11892 Sheet 11893 Sheet 11894 Sheet 11895 Sheet 11896 Sheet 11897 Sheet 11898 Sheet 11899 Sheet 11900 Sheet 11901 Sheet 11902 Sheet 11903 Sheet 11904 Sheet 11905 Sheet 11906 Sheet 11907 Sheet 11908 Sheet 11909 Sheet 11910 Sheet 11911 Sheet 11912 Sheet 11913 Sheet 11914 Sheet 11915 Sheet 11916 Sheet 11917 Sheet 11918 Sheet 11919 Sheet 11920 Sheet 11921 Sheet 11922 Sheet 11923 Sheet 11924 Sheet 11925 Sheet 11926 Sheet 11927 Sheet 11928 Sheet 11929 Sheet 11930 Sheet 11931 Sheet 11932 Sheet 11933 Sheet 11934 Sheet 11935 Sheet 11936 Sheet 11937 Sheet 11938 Sheet 11939 Sheet 11940 Sheet 11941 Sheet 11942 Sheet 11943 Sheet 11944 Sheet 11945 Sheet 11946 Sheet 11947 Sheet 11948 Sheet 11949 Sheet 11950 Sheet 11951 Sheet 11952 Sheet 11953 Sheet 11954 Sheet 11955 Sheet 11956 Sheet 11957 Sheet 11958 Sheet 11959 Sheet 11960 Sheet 11961 Sheet 11962 Sheet 11963 Sheet 11964 Sheet 11965 Sheet 11966 Sheet 11967 Sheet 11968 Sheet 11969 Sheet 11970 Sheet 11971 Sheet 11972 Sheet 11973 Sheet 11974 Sheet 11975 Sheet 11976 Sheet 11977 Sheet 11978 Sheet 11979 Sheet 11980 Sheet 11981 Sheet 11982 Sheet 11983 Sheet 11984 Sheet 11985 Sheet 11986 Sheet 11987 Sheet 11988 Sheet 11989 Sheet 11990 Sheet 11991 Sheet 11992 Sheet 11993 Sheet 11994 Sheet 11995 Sheet 11996 Sheet 11997 Sheet 11998 Sheet 11999 Sheet 12000 Sheet 12001 Sheet 12002 Sheet 12003 Sheet 12004 Sheet 12005 Sheet 12006 Sheet 12007 Sheet 12008 Sheet 12009 Sheet 12010 Sheet 12011 Sheet 12012 Sheet 12013 Sheet 12014 Sheet 12015 Sheet 12016 Sheet 12017 Sheet 12018 Sheet 12019 Sheet 12020 Sheet 12021 Sheet 12022 Sheet 12023 Sheet 12024 Sheet 12025 Sheet 12026 Sheet 12027 Sheet 12028 Sheet 12029 Sheet 12030 Sheet 12031 Sheet 12032 Sheet 12033 Sheet 12034 Sheet 12035 Sheet 12036 Sheet 12037 Sheet 12038 Sheet 12039 Sheet 12040 Sheet 12041 Sheet 12042 Sheet 12043 Sheet 12044 Sheet 12045 Sheet 12046 Sheet 12047 Sheet 12048 Sheet 12049 Sheet 12050 Sheet 12051 Sheet 12052 Sheet 12053 Sheet 12054 Sheet 12055 Sheet 12056 Sheet 12057 Sheet 12058 Sheet 12059 Sheet 12060 Sheet 12061 Sheet 12062 Sheet 12063 Sheet 12064 Sheet 12065 Sheet 12066 Sheet 12067 Sheet 12068 Sheet 12069 Sheet 12070 Sheet 12071 Sheet 12072 Sheet 12073 Sheet 12074 Sheet 12075 Sheet 12076 Sheet 12077 Sheet 12078 Sheet 12079 Sheet 12080 Sheet 12081 Sheet 12082 Sheet 12083 Sheet 12084 Sheet 12085 Sheet 12086 Sheet 12087 Sheet 12088 Sheet 12089 Sheet 12090 Sheet 12091 Sheet 12092 Sheet 12093 Sheet 12094 Sheet 12095 Sheet 12096 Sheet 12097 Sheet 12098 Sheet 12099 Sheet 12100 Sheet 12101 Sheet 12102 Sheet 12103 Sheet 12104 Sheet 12105 Sheet 12106 Sheet 12107 Sheet 12108 Sheet 12109 Sheet 12110 Sheet 12111 Sheet 12112 Sheet 12113 Sheet 12114 Sheet 12115 Sheet 12116 Sheet 12117 Sheet 12118 Sheet 12119 Sheet 12120 Sheet 12121 Sheet 12122 Sheet 12123 Sheet 12124 Sheet 12125 Sheet 12126 Sheet 12127 Sheet 12128 Sheet 12129 Sheet 12130 Sheet 12131 Sheet 12132 Sheet 12133 Sheet 12134 Sheet 12135 Sheet 12136 Sheet 12137 Sheet 12138 Sheet 12139 Sheet 12140 Sheet 12141 Sheet 12142 Sheet 12143 Sheet 12144 Sheet 12145 Sheet 12146 Sheet 12147 Sheet 12148 Sheet 12149 Sheet 12150 Sheet 12151 Sheet 12152 Sheet 12153 Sheet 12154 Sheet 12155 Sheet 12156 Sheet 12157 Sheet 12158 Sheet 12159 Sheet 12160 Sheet 12161 Sheet 12162 Sheet 12163 Sheet 12164 Sheet 12165 Sheet 12166 Sheet 12167 Sheet 12168 Sheet 12169 Sheet 12170 Sheet 12171 Sheet 12172 Sheet 12173 Sheet 12174 Sheet 12175 Sheet 12176 Sheet 12177 Sheet 12178 Sheet 12179 Sheet 12180 Sheet 12181 Sheet 12182 Sheet 12183 Sheet 12184 Sheet 12185 Sheet 12186 Sheet 12187 Sheet 12188 Sheet 12189 Sheet 12190 Sheet 12191 Sheet 12192 Sheet 12193 Sheet 12194 Sheet 12195 Sheet 12196 Sheet 12197 Sheet 12198 Sheet 12199 Sheet 12200 Sheet 12201 Sheet 12202 Sheet 12203 Sheet 12204 Sheet 12205 Sheet 12206 Sheet 12207 Sheet 12208 Sheet 12209 Sheet 12210 Sheet 12211 Sheet 12212 Sheet 12213 Sheet 12214 Sheet 12215 Sheet 12216 Sheet 12217 Sheet 12218 Sheet 12219 Sheet 12220 Sheet 12221 Sheet 12222 Sheet 12223 Sheet 12224 Sheet 12225 Sheet 12226 Sheet 12227 Sheet 12228 Sheet 12229 Sheet 12230 Sheet 12231 Sheet 12232 Sheet 12233 Sheet 12234 Sheet 12235 Sheet 12236 Sheet 12237 Sheet 12238 Sheet 12239 Sheet 12240 Sheet 12241 Sheet 12242 Sheet 12243 Sheet 12244 Sheet 12245 Sheet 12246 Sheet 12247 Sheet 12248 Sheet 12249 Sheet 12250 Sheet 12251 Sheet 12252 Sheet 12253 Sheet 12254 Sheet 12255 Sheet 12256 Sheet 12257 Sheet 12258 Sheet 12259 Sheet 12260 Sheet 12261 Sheet 12262 Sheet 12263 Sheet 12264 Sheet 12265 Sheet 12266 Sheet 12267 Sheet 12268 Sheet 12269 Sheet 12270 Sheet 12271 Sheet 12272 Sheet 12273 Sheet 12274 Sheet 12275 Sheet 12276 Sheet 12277 Sheet 12278 Sheet 12279 Sheet 12280 Sheet 12281 Sheet 12282 Sheet 12283 Sheet 12284 Sheet 12285 Sheet 12286 Sheet 12287 Sheet 12288 Sheet 12289 Sheet 12290 Sheet 12291 Sheet 12292 Sheet 12293 Sheet 12294 Sheet 12295 Sheet 12296 Sheet 12297 Sheet 12298 Sheet 12299 Sheet 12300 Sheet 12301 Sheet 12302 Sheet 12303 Sheet 12304 Sheet 12305 Sheet 12306 Sheet 12307 Sheet 12308 Sheet 12309 Sheet 12310 Sheet 12311 Sheet 12312 Sheet 12313 Sheet 12314 Sheet 12315 Sheet 12316 Sheet 12317 Sheet 12318 Sheet 12319 Sheet 12320 Sheet 12321 Sheet 12322 Sheet 12323 Sheet 12324 Sheet 12325 Sheet 12326 Sheet 12327 Sheet 12328 Sheet 12329 Sheet 12330 Sheet 12331 Sheet 12332 Sheet 12333 Sheet 12334 Sheet 12335 Sheet 12336 Sheet 12337 Sheet 12338 Sheet 12339 Sheet 12340 Sheet 12341 Sheet 12342 Sheet 12343 Sheet 12344 Sheet 12345 Sheet 12346 Sheet 12347 Sheet 12348 Sheet 12349 Sheet 12350 Sheet 12351 Sheet 12352 Sheet 12353 Sheet 12354 Sheet 12355 Sheet 12356 Sheet 12357 Sheet 12358 Sheet 12359 Sheet 12360 Sheet 12361 Sheet 12362 Sheet 12363 Sheet 12364 Sheet 12365 Sheet 12366 Sheet 12367 Sheet 12368 Sheet 12369 Sheet 12370 Sheet 12371 Sheet 12372 Sheet 12373 Sheet 12374 Sheet 12375 Sheet 12376 Sheet 12377 Sheet 12378 Sheet 12379 Sheet 12380 Sheet 12381 Sheet 12382 Sheet 12383 Sheet 12384 Sheet 12385 Sheet 12386 Sheet 12387 Sheet 12388 Sheet 12389 Sheet 12390 Sheet 12391 Sheet 12392 Sheet 12393 Sheet 12394 Sheet 12395 Sheet 12396 Sheet 12397 Sheet 12398 Sheet 12399 Sheet 12400 Sheet 12401 Sheet 12402 Sheet 12403 Sheet 12404 Sheet 12405 Sheet 12406 Sheet 12407 Sheet 12408 Sheet 12409 Sheet 12410 Sheet 12411 Sheet 12412 Sheet 12413 Sheet 12414 Sheet 12415 Sheet 12416 Sheet 12417 Sheet 12418 Sheet 12419 Sheet 12420 Sheet 12421 Sheet 12422 Sheet 12423 Sheet 12424 Sheet 12425 Sheet 12426 Sheet 12427 Sheet 12428 Sheet 12429 Sheet 12430 Sheet 12431 Sheet 12432 Sheet 12433 Sheet 12434 Sheet 12435 Sheet 12436 Sheet 12437 Sheet 12438 Sheet 12439 Sheet 12440 Sheet 12441 Sheet 12442 Sheet 12443 Sheet 12444 Sheet 12445 Sheet 12446 Sheet 12447 Sheet 12448 Sheet 12449 Sheet 12450 Sheet 12451 Sheet 12452 Sheet 12453 Sheet 12454 Sheet 12455 Sheet 12456 Sheet 12457 Sheet 12458 Sheet 12459 Sheet 12460 Sheet 12461 Sheet 12462 Sheet 12463 Sheet 12464 Sheet 12465 Sheet 12466 Sheet 12467 Sheet 12468 Sheet 12469 Sheet 12470 Sheet 12471 Sheet 12472 Sheet 12473 Sheet 12474 Sheet 12475 Sheet 12476 Sheet 12477 Sheet 12478 Sheet 12479 Sheet 12480 Sheet 12481 Sheet 12482 Sheet 12483 Sheet 12484 Sheet 12485 Sheet 12486 Sheet 12487 Sheet 12488 Sheet 12489 Sheet 12490 Sheet 12491 Sheet 12492 Sheet 12493 Sheet 12494 Sheet 12495 Sheet 12496 Sheet 12497 Sheet 12498 Sheet 12499 Sheet 12500 Sheet 12501 Sheet 12502 Sheet 12503 Sheet 12504 Sheet 12505 Sheet 12506 Sheet 12507 Sheet 12508 Sheet 12509 Sheet 12510 Sheet 12511 Sheet 12512 Sheet 12513 Sheet 12514 Sheet 12515 Sheet 12516 Sheet 12517 Sheet 12518 Sheet 12519 Sheet 12520 Sheet 12521 Sheet 12522 Sheet 12523 Sheet 12524 Sheet 12525 Sheet 12526 Sheet 12527 Sheet 12528 Sheet 12529 Sheet 12530 Sheet 12531 Sheet 12532 Sheet 12533 Sheet 12534 Sheet 12535 Sheet 12536 Sheet 12537 Sheet 12538 Sheet 12539 Sheet 12540 Sheet 12541 Sheet 12542 Sheet 12543 Sheet 12544 Sheet 12545 Sheet 12546 Sheet 12547 Sheet 12548 Sheet 12549 Sheet 12550 Sheet 12551 Sheet 12552 Sheet 12553 Sheet 12554 Sheet 12555 Sheet 12556 Sheet 12557 Sheet 12558 Sheet 12559 Sheet 12560 Sheet 12561 Sheet 12562 Sheet 12563 Sheet 12564 Sheet 12565 Sheet 12566 Sheet 12567 Sheet 12568 Sheet 12569 Sheet 12570 Sheet 12571 Sheet 12572 Sheet 12573 Sheet 12574 Sheet 12575 Sheet 12576 Sheet 12577 Sheet 12578 Sheet 12579 Sheet 12580 Sheet 12581 Sheet 12582 Sheet 12583 Sheet 12584 Sheet 12585 Sheet 12586 Sheet 12587 Sheet 12588 Sheet 12589 Sheet 12590 Sheet 12591 Sheet 12592 Sheet 12593 Sheet 12594 Sheet 12595 Sheet 12596 Sheet 12597 Sheet 12598 Sheet 12599 Sheet 12600 Sheet 12601 Sheet 12602 Sheet 12603 Sheet 12604 Sheet 12605 Sheet 12606 Sheet 12607 Sheet 12608 Sheet 12609 Sheet 12610 Sheet 12611 Sheet 12612 Sheet 12613 Sheet 12614 Sheet 12615 Sheet 12616 Sheet 12617 Sheet 12618 Sheet 12619 Sheet 12620 Sheet 12621 Sheet 12622 Sheet 12623 Sheet 12624 Sheet 12625 Sheet 12626 Sheet 12627 Sheet 12628 Sheet 12629 Sheet 12630 Sheet 12631 Sheet 12632 Sheet 12633 Sheet 12634 Sheet 12635 Sheet 12636 Sheet 12637 Sheet 12638 Sheet 12639 Sheet 12640 Sheet 12641 Sheet 12642 Sheet 12643 Sheet 12644 Sheet 12645 Sheet 12646 Sheet 12647 Sheet 12648 Sheet 12649 Sheet 12650 Sheet 12651 Sheet 12652 Sheet 12653 Sheet 12654 Sheet 12655 Sheet 12656 Sheet 12657 Sheet 12658 Sheet 12659 Sheet 12660 Sheet 12661 Sheet 12662 Sheet 12663 Sheet 12664 Sheet 12665 Sheet 12666 Sheet 12667 Sheet 12668 Sheet 12669 Sheet 12670 Sheet 12671 Sheet 12672 Sheet 12673 Sheet 12674 Sheet 12675 Sheet 12676 Sheet 12677 Sheet 12678 Sheet 12679 Sheet 12680 Sheet 12681 Sheet 12682 Sheet 12683 Sheet 12684 Sheet 12685 Sheet 12686 Sheet 12687 Sheet 12688 Sheet 12689 Sheet 12690 Sheet 12691 Sheet 12692 Sheet 12693 Sheet 12694 Sheet 12695 Sheet 12696 Sheet 12697 Sheet 12698 Sheet 12699 Sheet 12700 Sheet 12701 Sheet 12702 Sheet 12703 Sheet 12704 Sheet 12705 Sheet 12706 Sheet 12707 Sheet 12708 Sheet 12709 Sheet 12710 Sheet 12711 Sheet 12712 Sheet 12713 Sheet 12714 Sheet 12715 Sheet 12716 Sheet 12717 Sheet 12718 Sheet 12719 Sheet 12720 Sheet 12721 Sheet 12722 Sheet 12723 Sheet 12724 Sheet 12725 Sheet 12726 Sheet 12727 Sheet 12728 Sheet 12729 Sheet 12730 Sheet 12731 Sheet 12732 Sheet 12733 Sheet 12734 Sheet 12735 Sheet 12736 Sheet 12737 Sheet 12738 Sheet 12739 Sheet 12740 Sheet 12741 Sheet 12742 Sheet 12743 Sheet 12744 Sheet 12745 Sheet 12746 Sheet 12747 Sheet 12748 Sheet 12749 Sheet 12750 Sheet 12751 Sheet 12752 Sheet 12753 Sheet 12754 Sheet 12755 Sheet 12756 Sheet 12757 Sheet 12758 Sheet 12759 Sheet 12760 Sheet 12761 Sheet 12762 Sheet 12763 Sheet 12764 Sheet 12765 Sheet 12766 Sheet 12767 Sheet 12768 Sheet 12769 Sheet 12770 Sheet 12771 Sheet 12772 Sheet 12773 Sheet 12774 Sheet 12775 Sheet 12776 Sheet 12777 Sheet 12778 Sheet 12779 Sheet 12780 Sheet 12781 Sheet 12782 Sheet 12783 Sheet 12784 Sheet 12785 Sheet 12786 Sheet 12787 Sheet 12788 Sheet 12789 Sheet 12790 Sheet 12791 Sheet 12792 Sheet 12793 Sheet 12794 Sheet 12795 Sheet 12796 Sheet 12797 Sheet 12798 Sheet 12799 Sheet 12800 Sheet 12801 Sheet 12802 Sheet 12803 Sheet 12804 Sheet 12805 Sheet 12806 Sheet 12807 Sheet 12808 Sheet 12809 Sheet 12810 Sheet 12811 Sheet 12812 Sheet 12813 Sheet 12814 Sheet 12815 Sheet 12816 Sheet 12817 Sheet 12818 Sheet 12819 Sheet 12820 Sheet 12821 Sheet 12822 Sheet 12823 Sheet 12824 Sheet 12825 Sheet 12826 Sheet 12827 Sheet 12828 Sheet 12829 Sheet 12830 Sheet 12831 Sheet 12832 Sheet 12833 Sheet 12834 Sheet 12835 Sheet 12836 Sheet 12837 Sheet 12838 Sheet 12839 Sheet 12840 Sheet 12841 Sheet 12842 Sheet 12843 Sheet 12844 Sheet 12845 Sheet 12846 Sheet 12847 Sheet 12848 Sheet 12849 Sheet 12850 Sheet 12851 Sheet 12852 Sheet 12853 Sheet 12854 Sheet 12855 Sheet 12856 Sheet 12857 Sheet 12858 Sheet 12859 Sheet 12860 Sheet 12861 Sheet 12862 Sheet 12863 Sheet 12864 Sheet 12865 Sheet 12866 Sheet 12867 Sheet 12868 Sheet 12869 Sheet 12870 Sheet 12871 Sheet 12872 Sheet 12873 Sheet 12874 Sheet 12875 Sheet 12876 Sheet 12877 Sheet 12878 Sheet 12879 Sheet 12880 Sheet 12881 Sheet 12882 Sheet 12883 Sheet 12884 Sheet 12885 Sheet 12886 Sheet 12887 Sheet 12888 Sheet 12889 Sheet 12890 Sheet 12891 Sheet 12892 Sheet 12893 Sheet 12894 Sheet 12895 Sheet 12896 Sheet 12897 Sheet 12898 Sheet 12899 Sheet 12900 Sheet 12901 Sheet 12902 Sheet 12903 Sheet 12904 Sheet 12905 Sheet 12906 Sheet 12907 Sheet 12908 Sheet 12909 Sheet 12910 Sheet 12911 Sheet 12912 Sheet 12913 Sheet 12914 Sheet 12915 Sheet 12916 Sheet 12917 Sheet 12918 Sheet 12919 Sheet 12920 Sheet 12921 Sheet 12922 Sheet 12923 Sheet 12924 Sheet 12925 Sheet 12926 Sheet 12927 Sheet 12928 Sheet 12929 Sheet 12930 Sheet 12931 Sheet 12932 Sheet 12933 Sheet 12934 Sheet 12935 Sheet 12936 Sheet 12937 Sheet 12938 Sheet 12939 Sheet 12940 Sheet 12941 Sheet 12942 Sheet 12943 Sheet 12944 Sheet 12945 Sheet 12946 Sheet 12947 Sheet 12948 Sheet 12949 Sheet 12950 Sheet 12951 Sheet 12952 Sheet 12953 Sheet 12954 Sheet 12955 Sheet 12956 Sheet 12957 Sheet 12958 Sheet 12959 Sheet 12960 Sheet 12961 Sheet 12962 Sheet 12963 Sheet 12964 Sheet 12965 Sheet 12966 Sheet 12967 Sheet 12968 Sheet 12969 Sheet 12970 Sheet 12971 Sheet 12972 Sheet 12973 Sheet 12974 Sheet 12975 Sheet 12976 Sheet 12977 Sheet 12978 Sheet 12979 Sheet 12980 Sheet 12981 Sheet 12982 Sheet 12983 Sheet 12984 Sheet 12985 Sheet 12986 Sheet 12987 Sheet 12988 Sheet 12989 Sheet 12990 Sheet 12991 Sheet 12992 Sheet 12993 Sheet 12994 Sheet 12995 Sheet 12996 Sheet 12997 Sheet 12998 Sheet 12999 Sheet 13000 Sheet 13001 Sheet 13002 Sheet 13003 Sheet 13004 Sheet 13005 Sheet 13006 Sheet 13007 Sheet 13008 Sheet 13009 Sheet 13010 Sheet 13011 Sheet 13012 Sheet 13013 Sheet 13014 Sheet 13015 Sheet 13016 Sheet 13017 Sheet 13018 Sheet 13019 Sheet 13020 Sheet 13021 Sheet 13022 Sheet 13023 Sheet 13024 Sheet 13025 Sheet 13026 Sheet 13027 Sheet 13028 Sheet 13029 Sheet 13030 Sheet 13031 Sheet 13032 Sheet 13033 Sheet 13034 Sheet 13035 Sheet 13036 Sheet 13037 Sheet 13038 Sheet 13039 Sheet 13040 Sheet 13041 Sheet 13042 Sheet 13043 Sheet 13044 Sheet 13045 Sheet 13046 Sheet 13047 Sheet 13048 Sheet 13049 Sheet 13050 Sheet 13051 Sheet 13052 Sheet 13053 Sheet 13054 Sheet 13055 Sheet 13056 Sheet 13057 Sheet 13058 Sheet 13059 Sheet 13060 Sheet 13061 Sheet 13062 Sheet 13063 Sheet 13064 Sheet 13065 Sheet 13066 Sheet 13067 Sheet 13068 Sheet 13069 Sheet 13070 Sheet 13071 Sheet 13072 Sheet 13073 Sheet 13074 Sheet 13075 Sheet 13076 Sheet 13077 Sheet 13078 Sheet 13079 Sheet 13080 Sheet 13081 Sheet 13082 Sheet 13083 Sheet 13084 Sheet 13085 Sheet 13086 Sheet 13087 Sheet 13088 Sheet 13089 Sheet 13090 Sheet 13091 Sheet 13092 Sheet 13093 Sheet 13094 Sheet 13095 Sheet 13096 Sheet 13097 Sheet 13098 Sheet 13099 Sheet 13100 Sheet 13101 Sheet 13102 Sheet 13103 Sheet 13104 Sheet 13105 Sheet 13106 Sheet 13107 Sheet 13108 Sheet 13109 Sheet 13110 Sheet 13111 Sheet 13112 Sheet 13113 Sheet 13114 Sheet 13115 Sheet 13116 Sheet 13117 Sheet 13118 Sheet 13119 Sheet 13120 Sheet 13121 Sheet 13122 Sheet 13123 Sheet 13124 Sheet 13125 Sheet 13126 Sheet 13127 Sheet 13128 Sheet 13129 Sheet 13130 Sheet 13131 Sheet 13132 Sheet 13133 Sheet 13134 Sheet 13135 Sheet 13136 Sheet 13137 Sheet 13138 Sheet 13139 Sheet 13140 Sheet 13141 Sheet 13142 Sheet 13143 Sheet 13144 Sheet 13145 Sheet 13146 Sheet 13147 Sheet 13148 Sheet 13149 Sheet 13150 Sheet 13151 Sheet 13152 Sheet 13153 Sheet 13154 Sheet 13155 Sheet 13156 Sheet 13157 Sheet 13158 Sheet 13159 Sheet 13160 Sheet 13161 Sheet 13162 Sheet 13163 Sheet 13164 Sheet 13165 Sheet 13166 Sheet 13167 Sheet 13168 Sheet 13169 Sheet 13170 Sheet 13171 Sheet 13172 Sheet 13173 Sheet 13174 Sheet 13175 Sheet 13176 Sheet 13177 Sheet 13178 Sheet 13179 Sheet 13180 Sheet 13181 Sheet 13182 Sheet 13183 Sheet 13184 Sheet 13185 Sheet 13186 Sheet 13187 Sheet 13188 Sheet 13189 Sheet 13190 Sheet 13191 Sheet 13192 Sheet 13193 Sheet 13194 Sheet 13195 Sheet 13196 Sheet 13197 Sheet 13198 Sheet 13199 Sheet 13200 Sheet 13201 Sheet 13202 Sheet 13203 Sheet 13204 Sheet 13205 Sheet 13206 Sheet 13207 Sheet 13208 Sheet 13209 Sheet 13210 Sheet 13211 Sheet 13212 Sheet 13213 Sheet 13214 Sheet 13215 Sheet 13216 Sheet 13217 Sheet 13218 Sheet 13219 Sheet 13220 Sheet 13221 Sheet 13222 Sheet 13223 Sheet 13224 Sheet 13225 Sheet 13226 Sheet 13227 Sheet 13228 Sheet 13229 Sheet 13230 Sheet 13231 Sheet 13232 Sheet 13233 Sheet 13234 Sheet 13235 Sheet 13236 Sheet 13237 Sheet 13238 Sheet 13239 Sheet 13240 Sheet 13241 Sheet 13242 Sheet 13243 Sheet 13244 Sheet 13245 Sheet 13246 Sheet 13247 Sheet 13248 Sheet 13249 Sheet 13250 Sheet 13251 Sheet 13252 Sheet 13253 Sheet 13254 Sheet 13255 Sheet 13256 Sheet 13257 Sheet 13258 Sheet 13259 Sheet 13260 Sheet 13261 Sheet 13262 Sheet 13263 Sheet 13264 Sheet 13265 Sheet 13266 Sheet 13267 Sheet 13268 Sheet 13269 Sheet 13270 Sheet 13271 Sheet 13272 Sheet 13273 Sheet 13274 Sheet 13275 Sheet 13276 Sheet 13277 Sheet 13278 Sheet 13279 Sheet 13280 Sheet 13281 Sheet 13282 Sheet 13283 Sheet 13284 Sheet 13285 Sheet 13286 Sheet 13287 Sheet 13288 Sheet 13289 Sheet 13290 Sheet 13291 Sheet 13292 Sheet 13293 Sheet 13294 Sheet 13295 Sheet 13296 Sheet 13297 Sheet 13298 Sheet 13299 Sheet 13300 Sheet 13301 Sheet 13302 Sheet 13303 Sheet 13304 Sheet 13305 Sheet 13306 Sheet 13307 Sheet 13308 Sheet 13309 Sheet 13310 Sheet 13311 Sheet 13312 Sheet 13313 Sheet 13314 Sheet 13315 Sheet 13316 Sheet 13317 Sheet 13318 Sheet 13319 Sheet 13320 Sheet 13321 Sheet 13322 Sheet 13323 Sheet 13324 Sheet 13325 Sheet 13326 Sheet 13327 Sheet 13328 Sheet 13329 Sheet 13330 Sheet 13331 Sheet 13332 Sheet 13333 Sheet 13334 Sheet 13335 Sheet 13336 Sheet 13337 Sheet 13338 Sheet 13339 Sheet 13340 Sheet 13341 Sheet 13342 Sheet 13343 Sheet 13344 Sheet 13345 Sheet 13346 Sheet 13347 Sheet 13348 Sheet 13349 Sheet 13350 Sheet 13351 Sheet 13352 Sheet 13353 Sheet 13354 Sheet 13355 Sheet 13356 Sheet 13357 Sheet 13358 Sheet 13359 Sheet 13360 Sheet 13361 Sheet 13362 Sheet 13363 Sheet 13364 Sheet 13365 Sheet 13366 Sheet 13367 Sheet 13368 Sheet 13369 Sheet 13370 Sheet 13371 Sheet 13372 Sheet 13373 Sheet 13374 Sheet 13375 Sheet 13376 Sheet 13377 Sheet 13378 Sheet 13379 Sheet 13380 Sheet 13381 Sheet 13382 Sheet 13383 Sheet 13384 Sheet 13385 Sheet 13386 Sheet 13387 Sheet 13388 Sheet 13389 Sheet 13390 Sheet 13391 Sheet 13392 Sheet 13393 Sheet 13394 Sheet 13395 Sheet 13396 Sheet 13397 Sheet 13398 Sheet 13399 Sheet 13400 Sheet 13401 Sheet 13402 Sheet 13403 Sheet 13404 Sheet 13405 Sheet 13406 Sheet 13407 Sheet 13408 Sheet 13409 Sheet 13410 Sheet 13411 Sheet 13412 Sheet 13413 Sheet 13414 Sheet 13415 Sheet 13416 Sheet 13417 Sheet 13418 Sheet 13419 Sheet 13420 Sheet 13421 Sheet 13422 Sheet 13423 Sheet 13424 Sheet 13425 Sheet 13426 Sheet 13427 Sheet 13428 Sheet 13429 Sheet 13430 Sheet 13431 Sheet 13432 Sheet 13433 Sheet 13434 Sheet 13435 Sheet 13436 Sheet 13437 Sheet 13438 Sheet 13439 Sheet 13440 Sheet 13441 Sheet 13442 Sheet 13443 Sheet 13444 Sheet 13445 Sheet 13446 Sheet 13447 Sheet 13448 Sheet 13449 Sheet 13450 Sheet 13451 Sheet 13452 Sheet 13453 Sheet 13454 Sheet 13455 Sheet 13456 Sheet 13457 Sheet 13458 Sheet 13459 Sheet 13460 Sheet 13461 Sheet 13462 Sheet 13463 Sheet 13464 Sheet 13465 Sheet 13466 Sheet 13467 Sheet 13468 Sheet 13469 Sheet 13470 Sheet 13471 Sheet 13472 Sheet 13473 Sheet 13474 Sheet 13475 Sheet 13476 Sheet 13477 Sheet 13478 Sheet 13479 Sheet 13480 Sheet 13481 Sheet 13482 Sheet 13483 Sheet 13484 Sheet 13485 Sheet 13486 Sheet 13487 Sheet 13488 Sheet 13489 Sheet 13490 Sheet 13491 Sheet 13492 Sheet 13493 Sheet 13494 Sheet 13495 Sheet 13496 Sheet 13497 Sheet 13498 Sheet 13499 Sheet 13500 Sheet 13501 Sheet 13502 Sheet 13503 Sheet 13504 Sheet 13505 Sheet 13506 Sheet 13507 Sheet 13508 Sheet 13509 Sheet 13510 Sheet 13511 Sheet 13512 Sheet 13513 Sheet 13514 Sheet 13515 Sheet 13516 Sheet 13517 Sheet 13518 Sheet 13519 Sheet 13520 Sheet 13521 Sheet 13522 Sheet 13523 Sheet 13524 Sheet 13525 Sheet 13526 Sheet 13527 Sheet 13528 Sheet 13529 Sheet 13530 Sheet 13531 Sheet 13532 Sheet 13533 Sheet 13534 Sheet 13535 Sheet 13536 Sheet 13537 Sheet 13538 Sheet 13539 Sheet 13540 Sheet 13541 Sheet 13542 Sheet 13543 Sheet 13544 Sheet 13545 Sheet 13546 Sheet 13547 Sheet 13548 Sheet 13549 Sheet 13550 Sheet 13551 Sheet 13552 Sheet 13553 Sheet 13554 Sheet 13555 Sheet 13556 Sheet 13557 Sheet 13558 Sheet 13559 Sheet 13560 Sheet 13561 Sheet 13562 Sheet 13563 Sheet 13564 Sheet 13565 Sheet 13566 Sheet 13567 Sheet 13568 Sheet 13569 Sheet 13570 Sheet 13571 Sheet 13572 Sheet 13573 Sheet 13574 Sheet 13575 Sheet 13576 Sheet 13577 Sheet 13578 Sheet 13579 Sheet 13580 Sheet 13581 Sheet 13582 Sheet 13583 Sheet 13584 Sheet 13585 Sheet 13586 Sheet 13587 Sheet 13588 Sheet 13589 Sheet 13590 Sheet 13591 Sheet 13592 Sheet 13593 Sheet 13594 Sheet 13595 Sheet 13596 Sheet 13597 Sheet 13598 Sheet 13599 Sheet 13600 Sheet 13601 Sheet 13602 Sheet 13603 Sheet 13604 Sheet 13605 Sheet 13606 Sheet 13607 Sheet 13608 Sheet 13609 Sheet 13610 Sheet 13611 Sheet 13612 Sheet 13613 Sheet 13614 Sheet 13615 Sheet 13616 Sheet 13617 Sheet 13618 Sheet 13619 Sheet 13620 Sheet 13621 Sheet 13622 Sheet 13623 Sheet 13624 Sheet 13625 Sheet 13626 Sheet 13627 Sheet 13628 Sheet 13629 Sheet 13630 Sheet 13631 Sheet 13632 Sheet 13633 Sheet 13634 Sheet 13635 Sheet 13636 Sheet 13637 Sheet 13638 Sheet 13639 Sheet 13640 Sheet 13641 Sheet 13642 Sheet 13643 Sheet 13644 Sheet 13645 Sheet 13646 Sheet 13647 Sheet 13648 Sheet 13649 Sheet 13650 Sheet 13651 Sheet 13652 Sheet 13653 Sheet 13654 Sheet 13655 Sheet 13656 Sheet 13657 Sheet 13658 Sheet 13659 Sheet 13660 Sheet 13661 Sheet 13662 Sheet 13663 Sheet 13664 Sheet 13665 Sheet 13666 Sheet 13667 Sheet 13668 Sheet 13669 Sheet 13670 Sheet 13671 Sheet 13672 Sheet 13673 Sheet 13674 Sheet 13675 Sheet 13676 Sheet 13677 Sheet 13678 Sheet 13679 Sheet 13680 Sheet 13681 Sheet 13682 Sheet 13683 Sheet 13684 Sheet 13685 Sheet 13686 Sheet 13687 Sheet 13688 Sheet 13689 Sheet 13690 Sheet 13691 Sheet 13692 Sheet 13693 Sheet 13694 Sheet 13695 Sheet 13696 Sheet 13697 Sheet 13698 Sheet 13699 Sheet 13700 Sheet 13701 Sheet 13702 Sheet 13703 Sheet 13704 Sheet 13705 Sheet 13706 Sheet 13707 Sheet 13708 Sheet 13709 Sheet 13710 Sheet 13711 Sheet 13712 Sheet 13713 Sheet 13714 Sheet 13715 Sheet 13716 Sheet 13717 Sheet 13718 Sheet 13719 Sheet 13720 Sheet 13721 Sheet 13722 Sheet 13723 Sheet 13724 Sheet 13725 Sheet 13726 Sheet 13727 Sheet 13728 Sheet 13729 Sheet 13730 Sheet 13731 Sheet 13732 Sheet 13733 Sheet 13734 Sheet 13735 Sheet 13736 Sheet 13737 Sheet 13738 Sheet 13739 Sheet 13740 Sheet 13741 Sheet 13742 Sheet 13743 Sheet 13744 Sheet 13745 Sheet 13746 Sheet 13747 Sheet 13748 Sheet 13749 Sheet 13750 Sheet 13751 Sheet 13752 Sheet 13753 Sheet 13754 Sheet 13755 Sheet 13756 Sheet 13757 Sheet 13758 Sheet 13759 Sheet 13760 Sheet 13761 Sheet 13762 Sheet 13763 Sheet 13764 Sheet 13765 Sheet 13766 Sheet 13767 Sheet 13768 Sheet 13769 Sheet 13770 Sheet 13771 Sheet 13772 Sheet 13773 Sheet 13774 Sheet 13775 Sheet 13776 Sheet 13777 Sheet 13778 Sheet 13779 Sheet 13780 Sheet 13781 Sheet 13782 Sheet 13783 Sheet 13784 Sheet 13785 Sheet 13786 Sheet 13787 Sheet 13788 Sheet 13789 Sheet 13790 Sheet 13791 Sheet 13792 Sheet 13793 Sheet 13794 Sheet 13795 Sheet 13796 Sheet 13797 Sheet 13798 Sheet 13799 Sheet 13800 Sheet 13801 Sheet 13802 Sheet 13803 Sheet 13804 Sheet 13805 Sheet 13806 Sheet 13807 Sheet 13808 Sheet 13809 Sheet 13810 Sheet 13811 Sheet 13812 Sheet 13813 Sheet 13814 Sheet 13815 Sheet 13816 Sheet 13817 Sheet 13818 Sheet 13819 Sheet 13820 Sheet 13821 Sheet 13822 Sheet 13823 Sheet 13824 Sheet 13825 Sheet 13826 Sheet 13827 Sheet 13828 Sheet 13829 Sheet 13830 Sheet 13831 Sheet 13832 Sheet 13833 Sheet 13834 Sheet 13835 Sheet 13836 Sheet 13837 Sheet 13838 Sheet 13839 Sheet 13840 Sheet 13841 Sheet 13842 Sheet 13843 Sheet 13844 Sheet 13845 Sheet 13846 Sheet 13847 Sheet 13848 Sheet 13849 Sheet 13850 Sheet 13851 Sheet 13852 Sheet 13853 Sheet 13854 Sheet 13855 Sheet 13856 Sheet 13857 Sheet 13858 Sheet 13859 Sheet 13860 Sheet 13861 Sheet 13862 Sheet 13863 Sheet 13864 Sheet 13865 Sheet 13866 Sheet 13867 Sheet 13868 Sheet 13869 Sheet 13870 Sheet 13871 Sheet 13872 Sheet 13873 Sheet 13874 Sheet 13875 Sheet 13876 Sheet 13877 Sheet 13878 Sheet 13879 Sheet 13880 Sheet 13881 Sheet 13882 Sheet 13883 Sheet 13884 Sheet 13885 Sheet 13886 Sheet 13887 Sheet 13888 Sheet 13889 Sheet 13890 Sheet 13891 Sheet 13892 Sheet 13893 Sheet 13894 Sheet 13895 Sheet 13896 Sheet 13897 Sheet 13898 Sheet 13899 Sheet 13900 Sheet 13901 Sheet 13902 Sheet 13903 Sheet 13904 Sheet 13905 Sheet 13906 Sheet 13907 Sheet 13908 Sheet 13909 Sheet 13910 Sheet 13911 Sheet 13912 Sheet 13913 Sheet 13914 Sheet 13915 Sheet 13916 Sheet 13917 Sheet 13918 Sheet 13919 Sheet 13920 Sheet 13921 Sheet 13922 Sheet 13923 Sheet 13924 Sheet 13925 Sheet 13926 Sheet 13927 Sheet 13928 Sheet 13929 Sheet 13930 Sheet 13931 Sheet 13932 Sheet 13933 Sheet 13934 Sheet 13935 Sheet 13936 Sheet 13937 Sheet 13938 Sheet 13939 Sheet 13940 Sheet 13941 Sheet 13942 Sheet 13943 Sheet 13944 Sheet 13945 Sheet 13946 Sheet 13947 Sheet 13948 Sheet 13949 Sheet 13950 Sheet 13951 Sheet 13952 Sheet 13953 Sheet 13954 Sheet 13955 Sheet 13956 Sheet 13957 Sheet 13958 Sheet 13959 Sheet 13960 Sheet 13961 Sheet 13962 Sheet 13963 Sheet 13964 Sheet 13965 Sheet 13966 Sheet 13967 Sheet 13968 Sheet 13969 Sheet 13970 Sheet 13971 Sheet 13972 Sheet 13973 Sheet 13974 Sheet 13975 Sheet 13976 Sheet 13977 Sheet 13978 Sheet 13979 Sheet 13980 Sheet 13981 Sheet 13982 Sheet 13983 Sheet 13984 Sheet 13985 Sheet 13986 Sheet 13987 Sheet 13988 Sheet 13989 Sheet 13990 Sheet 13991 Sheet 13992 Sheet 13993 Sheet 13994 Sheet 13995 Sheet 13996 Sheet 13997 Sheet 13998 Sheet 13999 Sheet 14000 Sheet 14001 Sheet 14002 Sheet 14003 Sheet 14004 Sheet 14005 Sheet 14006 Sheet 14007 Sheet 14008 Sheet 14009 Sheet 14010 Sheet 14011 Sheet 14012 Sheet 14013 Sheet 14014 Sheet 14015 Sheet 14016 Sheet 14017 Sheet 14018 Sheet 14019 Sheet 14020 Sheet 14021 Sheet 14022 Sheet 14023 Sheet 14024 Sheet 14025 Sheet 14026 Sheet 14027 Sheet 14028 Sheet 14029 Sheet 14030 Sheet 14031 Sheet 14032 Sheet 14033 Sheet 14034 Sheet 14035 Sheet 14036 Sheet 14037 Sheet 14038 Sheet 14039 Sheet 14040 Sheet 14041 Sheet 14042 Sheet 14043 Sheet 14044 Sheet 14045 Sheet 14046 Sheet 14047 Sheet 14048 Sheet 14049 Sheet 14050 Sheet 14051 Sheet 14052 Sheet 14053 Sheet 14054 Sheet 14055 Sheet 14056 Sheet 14057 Sheet 14058 Sheet 14059 Sheet 14060 Sheet 14061 Sheet 14062 Sheet 14063 Sheet 14064 Sheet 14065 Sheet 14066 Sheet 14067 Sheet 14068 Sheet 14069 Sheet 14070 Sheet 14071 Sheet 14072 Sheet 14073 Sheet 14074 Sheet 14075 Sheet 14076 Sheet 14077 Sheet 14078 Sheet 14079 Sheet 14080 Sheet 14081 Sheet 14082 Sheet 14083 Sheet 14084 Sheet 14085 Sheet 14086 Sheet 14087 Sheet 14088 Sheet 14089 Sheet 14090 Sheet 14091 Sheet 14092 Sheet 14093 Sheet 14094 Sheet 14095 Sheet 14096 Sheet 14097 Sheet 14098 Sheet 14099 Sheet 14100 Sheet 14101 Sheet 14102 Sheet 14103 Sheet 14104 Sheet 14105 Sheet 14106 Sheet 14107 Sheet 14108 Sheet 14109 Sheet 14110 Sheet 14111 Sheet 14112 Sheet 14113 Sheet 14114 Sheet 14115 Sheet 14116 Sheet 14117 Sheet 14118 Sheet 14119 Sheet 14120 Sheet 14121 Sheet 14122 Sheet 14123 Sheet 14124 Sheet 14125 Sheet 14126 Sheet 14127 Sheet 14128 Sheet 14129 Sheet 14130 Sheet 14131 Sheet 14132 Sheet 14133 Sheet 14134 Sheet 14135 Sheet 14136 Sheet 14137 Sheet 14138 Sheet 14139 Sheet 14140 Sheet 14141 Sheet 14142 Sheet 14143 Sheet 14144 Sheet 14145 Sheet 14146 Sheet 14147 Sheet 14148 Sheet 14149 Sheet 14150 Sheet 14151 Sheet 14152 Sheet 14153 Sheet 14154 Sheet 14155 Sheet 14156 Sheet 14157 Sheet 14158 Sheet 14159 Sheet 14160 Sheet 14161 Sheet 14162 Sheet 14163 Sheet 14164 Sheet 14165 Sheet 14166 Sheet 14167 Sheet 14168 Sheet 14169 Sheet 14170 Sheet 14171 Sheet 14172 Sheet 14173 Sheet 14174 Sheet 14175 Sheet 14176 Sheet 14177 Sheet 14178 Sheet 14179 Sheet 14180 Sheet 14181 Sheet 14182 Sheet 14183 Sheet 14184 Sheet 14185 Sheet 14186 Sheet 14187 Sheet 14188 Sheet 14189 Sheet 14190 Sheet 14191 Sheet 14192 Sheet 14193 Sheet 14194 Sheet 14195 Sheet 14196 Sheet 14197 Sheet 14198 Sheet 14199 Sheet 14200 Sheet 14201 Sheet 14202 Sheet 14203 Sheet 14204 Sheet 14205 Sheet 14206 Sheet 14207 Sheet 14208 Sheet 14209 Sheet 14210 Sheet 14211 Sheet 14212 Sheet 14213 Sheet 14214 Sheet 14215 Sheet 14216 Sheet 14217 Sheet 14218 Sheet 14219 Sheet 14220 Sheet 14221 Sheet 14222 Sheet 14223 Sheet 14224 Sheet 14225 Sheet 14226 Sheet 14227 Sheet 14228 Sheet 14229 Sheet 14230 Sheet 14231 Sheet 14232 Sheet 14233 Sheet 14234 Sheet 14235 Sheet 14236 Sheet 14237 Sheet 14238 Sheet 14239 Sheet 14240 Sheet 14241 Sheet 14242 Sheet 14243 Sheet 14244 Sheet 14245 Sheet 14246 Sheet 14247 Sheet 14248 Sheet 14249 Sheet 14250 Sheet 14251 Sheet 14252 Sheet 14253 Sheet 14254 Sheet 14255 Sheet 14256 Sheet 14257 Sheet 14258 Sheet 14259 Sheet 14260 Sheet 14261 Sheet 14262 Sheet 14263 Sheet 14264 Sheet 14265 Sheet 14266 Sheet 14267 Sheet 14268 Sheet 14269 Sheet 14270 Sheet 14271 Sheet 14272 Sheet 14273 Sheet 14274 Sheet 14275 Sheet 14276 Sheet 14277 Sheet 14278 Sheet 14279 Sheet 14280 Sheet 14281 Sheet 14282 Sheet 14283 Sheet 14284 Sheet 14285 Sheet 14286 Sheet 14287 Sheet 14288 Sheet 14289 Sheet 14290 Sheet 14291 Sheet 14292 Sheet 14293 Sheet 14294 Sheet 14295 Sheet 14296 Sheet 14297 Sheet 14298 Sheet 14299 Sheet 14300 Sheet 14301 Sheet 14302 Sheet 14303 Sheet 14304 Sheet 14305 Sheet 14306 Sheet 14307 Sheet 14308 Sheet 14309 Sheet 14310 Sheet 14311 Sheet 14312 Sheet 14313 Sheet 14314 Sheet 14315 Sheet 14316 Sheet 14317 Sheet 14318 Sheet 14319 Sheet 14320 Sheet 14321 Sheet 14322 Sheet 14323 Sheet 14324 Sheet 14325 Sheet 14326 Sheet 14327 Sheet 14328 Sheet 14329 Sheet 14330 Sheet 14331 Sheet 14332 Sheet 14333 Sheet 14334 Sheet 14335 Sheet 14336 Sheet 14337 Sheet 14338 Sheet 14339 Sheet 14340 Sheet 14341 Sheet 14342 Sheet 14343 Sheet 14344 Sheet 14345 Sheet 14346 Sheet 14347 Sheet 14348 Sheet 14349 Sheet 14350 Sheet 14351 Sheet 14352 Sheet 14353 Sheet 14354 Sheet 14355 Sheet 14356 Sheet 14357 Sheet 14358 Sheet 14359 Sheet 14360 Sheet 14361 Sheet 14362 Sheet 14363 Sheet 14364 Sheet 14365 Sheet 14366 Sheet 14367 Sheet 14368 Sheet 14369 Sheet 14370 Sheet 14371 Sheet 14372 Sheet 14373 Sheet 14374 Sheet 14375 Sheet 14376 Sheet 14377 Sheet 14378 Sheet 14379 Sheet 14380 Sheet 14381 Sheet 14382 Sheet 14383 Sheet 14384 Sheet 14385 Sheet 14386 Sheet 14387 Sheet 14388 Sheet 14389 Sheet 14390 Sheet 14391 Sheet 14392 Sheet 14393 Sheet 14394 Sheet 14395 Sheet 14396 Sheet 14397 Sheet 14398 Sheet 14399 Sheet 14400 Sheet 14401 Sheet 14402 Sheet 14403 Sheet 14404 Sheet 14405 Sheet 14406 Sheet 14407 Sheet 14408 Sheet 14409 Sheet 14410 Sheet 14411 Sheet 14412 Sheet 14413 Sheet 14414 Sheet 14415 Sheet 14416 Sheet 14417 Sheet 14418 Sheet 14419 Sheet 14420 Sheet 14421 Sheet 14422 Sheet 14423 Sheet 14424 Sheet 14425 Sheet 14426 Sheet 14427 Sheet 14428 Sheet 14429 Sheet 14430 Sheet 14431 Sheet 14432 Sheet 14433 Sheet 14434 Sheet 14435 Sheet 14436 Sheet 14437 Sheet 14438 Sheet 14439 Sheet 14440 Sheet 14441 Sheet 14442 Sheet 14443 Sheet 14444 Sheet 14445 Sheet 14446 Sheet 14447 Sheet 14448 Sheet 14449 Sheet 14450 Sheet 14451 Sheet 14452 Sheet 14453 Sheet 14454 Sheet 14455 Sheet 14456 Sheet 14457 Sheet 14458 Sheet 14459 Sheet 14460 Sheet 14461 Sheet 14462 Sheet 14463 Sheet 14464 Sheet 14465 Sheet 14466 Sheet 14467 Sheet 14468 Sheet 14469 Sheet 14470 Sheet 14471 Sheet 14472 Sheet 14473 Sheet 14474 Sheet 14475 Sheet 14476 Sheet 14477 Sheet 14478 Sheet 14479 Sheet 14480 Sheet 14481 Sheet 14482 Sheet 14483 Sheet 14484 Sheet 14485 Sheet 14486 Sheet 14487 Sheet 14488 Sheet 14489 Sheet 14490 Sheet 14491 Sheet 14492 Sheet 14493 Sheet 14494 Sheet 14495 Sheet 14496 Sheet 14497 Sheet 14498 Sheet 14499 Sheet 14500 Sheet 14501 Sheet 14502 Sheet 14503 Sheet 14504 Sheet 14505 Sheet 14506 Sheet 14507 Sheet 14508 Sheet 14509 Sheet 14510 Sheet 14511 Sheet 14512 Sheet 14513 Sheet 14514 Sheet 14515 Sheet 14516 Sheet 14517 Sheet 14518 Sheet 14519 Sheet 14520 Sheet 14521 Sheet 14522 Sheet 14523 Sheet 14524 Sheet 14525 Sheet 14526 Sheet 14527 Sheet 14528 Sheet 14529 Sheet 14530 Sheet 14531 Sheet 14532 Sheet 14533 Sheet 14534 Sheet 14535 Sheet 14536 Sheet 14537 Sheet 14538 Sheet 14539 Sheet 14540 Sheet 14541 Sheet 14542 Sheet 14543 Sheet 14544 Sheet 14545 Sheet 14546 Sheet 14547 Sheet 14548 Sheet 14549 Sheet 14550 Sheet 14551 Sheet 14552 Sheet 14553 Sheet 14554 Sheet 14555 Sheet 14556 Sheet 14557 Sheet 14558 Sheet 14559 Sheet 14560 Sheet 14561 Sheet 14562 Sheet 14563 Sheet 14564 Sheet 14565 Sheet 14566 Sheet 14567 Sheet 14568 Sheet 14569 Sheet 14570 Sheet 14571 Sheet 14572 Sheet 14573 Sheet 14574 Sheet 14575 Sheet 14576 Sheet 14577 Sheet 14578 Sheet 14579 Sheet 14580 Sheet 14581 Sheet 14582 Sheet 14583 Sheet 14584 Sheet 14585 Sheet 14586 Sheet 14587 Sheet 14588 Sheet 14589 Sheet 14590 Sheet 14591 Sheet 14592 Sheet 14593 Sheet 14594 Sheet 14595 Sheet 14596 Sheet 14597 Sheet 14598 Sheet 14599 Sheet 14600 Sheet 14601 Sheet 14602 Sheet 14603 Sheet 14604 Sheet 14605 Sheet 14606 Sheet 14607 Sheet 14608 Sheet 14609 Sheet 14610 Sheet 14611 Sheet 14612 Sheet 14613 Sheet 14614 Sheet 14615 Sheet 14616 Sheet 14617 Sheet 14618 Sheet 14619 Sheet 14620 Sheet 14621 Sheet 14622 Sheet 14623 Sheet 14624 Sheet 14625 Sheet 14626 Sheet 14627 Sheet 14628 Sheet 14629 Sheet 14630 Sheet 14631 Sheet 14632 Sheet 14633 Sheet 14634 Sheet 14635 Sheet 14636 Sheet 14637 Sheet 14638 Sheet 14639 Sheet 14640 Sheet 14641 Sheet 14642 Sheet 14643 Sheet 14644 Sheet 14645 Sheet 14646 Sheet 14647 Sheet 14648 Sheet 14649 Sheet 14650 Sheet 14651 Sheet 14652 Sheet 14653 Sheet 14654 Sheet 14655 Sheet 14656 Sheet 14657 Sheet 14658 Sheet 14659 Sheet 14660 Sheet 14661 Sheet 14662 Sheet 14663 Sheet 14664 Sheet 14665 Sheet 14666 Sheet 14667 Sheet 14668 Sheet 14669 Sheet 14670 Sheet 14671 Sheet 14672 Sheet 14673 Sheet 14674 Sheet 14675 Sheet 14676 Sheet 14677 Sheet 14678 Sheet 14679 Sheet 14680 Sheet 14681 Sheet 14682 Sheet 14683 Sheet 14684 Sheet 14685 Sheet 14686 Sheet 14687 Sheet 14688 Sheet 14689 Sheet 14690 Sheet 14691 Sheet 14692 Sheet 14693 Sheet 14694 Sheet 14695 Sheet 14696 Sheet 14697 Sheet 14698 Sheet 14699 Sheet 14700 Sheet 14701 Sheet 14702 Sheet 14703 Sheet 14704 Sheet 14705 Sheet 14706 Sheet 14707 Sheet 14708 Sheet 14709 Sheet 14710 Sheet 14711 Sheet 14712 Sheet 14713 Sheet 14714 Sheet 14715 Sheet 14716 Sheet 14717 Sheet 14718 Sheet 14719 Sheet 14720 Sheet 14721 Sheet 14722 Sheet 14723 Sheet 14724 Sheet 14725 Sheet 14726 Sheet 14727 Sheet 14728 Sheet 14729 Sheet 14730 Sheet 14731 Sheet 14732 Sheet 14733 Sheet 14734 Sheet 14735 Sheet 14736 Sheet 14737 Sheet 14738 Sheet 14739 Sheet 14740 Sheet 14741 Sheet 14742 Sheet 14743 Sheet 14744 Sheet 14745 Sheet 14746 Sheet 14747 Sheet 14748 Sheet 14749 Sheet 14750 Sheet 14751 Sheet 14752 Sheet 14753 Sheet 14754 Sheet 14755 Sheet 14756 Sheet 14757 Sheet 14758 Sheet 14759 Sheet 14760 Sheet 14761 Sheet 14762 Sheet 14763 Sheet 14764 Sheet 14765 Sheet 14766 Sheet 14767 Sheet 14768 Sheet 14769 Sheet 14770 Sheet 14771 Sheet 14772 Sheet 14773 Sheet 14774 Sheet 14775 Sheet 14776 Sheet 14777 Sheet 14778 Sheet 14779 Sheet 14780 Sheet 14781 Sheet 14782 Sheet 14783 Sheet 14784 Sheet 14785 Sheet 14786 Sheet 14787 Sheet 14788 Sheet 14789 Sheet 14790 Sheet 14791 Sheet 14792 Sheet 14793 Sheet 14794 Sheet 14795 Sheet 14796 Sheet 14797 Sheet 14798 Sheet 14799 Sheet 14800 Sheet 14801 Sheet 14802 Sheet 14803 Sheet 14804 Sheet 14805 Sheet 14806 Sheet 14807 Sheet 14808 Sheet 14809 Sheet 14810 Sheet 14811 Sheet 14812 Sheet 14813 Sheet 14814 Sheet 14815 Sheet 14816 Sheet 14817 Sheet 14818 Sheet 14819 Sheet 14820 Sheet 14821 Sheet 14822 Sheet 14823 Sheet 14824 Sheet 14825 Sheet 14826 Sheet 14827 Sheet 14828 Sheet 14829 Sheet 14830 Sheet 14831 Sheet 14832 Sheet 14833 Sheet 14834 Sheet 14835 Sheet 14836 Sheet 14837 Sheet 14838 Sheet 14839 Sheet 14840 Sheet 14841 Sheet 14842 Sheet 14843 Sheet 14844 Sheet 14845 Sheet 14846 Sheet 14847 Sheet 14848 Sheet 14849 Sheet 14850 Sheet 14851 Sheet 14852 Sheet 14853 Sheet 14854 Sheet 14855 Sheet 14856 Sheet 14857 Sheet 14858 Sheet 14859 Sheet 14860 Sheet 14861 Sheet 14862 Sheet 14863 Sheet 14864 Sheet 14865 Sheet 14866 Sheet 14867 Sheet 14868 Sheet 14869 Sheet 14870 Sheet 14871 Sheet 14872 Sheet 14873 Sheet 14874 Sheet 14875 Sheet 14876 Sheet 14877 Sheet 14878 Sheet 14879 Sheet 14880 Sheet 14881 Sheet 14882 Sheet 14883 Sheet 14884 Sheet 14885 Sheet 14886 Sheet 14887 Sheet 14888 Sheet 14889 Sheet 14890 Sheet 14891 Sheet 14892 Sheet 14893 Sheet 14894 Sheet 14895 Sheet 14896 Sheet 14897 Sheet 14898 Sheet 14899 Sheet 14900 Sheet 14901 Sheet 14902 Sheet 14903 Sheet 14904 Sheet 14905 Sheet 14906 Sheet 14907 Sheet 14908 Sheet 14909 Sheet 14910 Sheet 14911 Sheet 14912 Sheet 14913 Sheet 14914 Sheet 14915 Sheet 14916 Sheet 14917 Sheet 14918 Sheet 14919 Sheet 14920 Sheet 14921 Sheet 14922 Sheet 14923 Sheet 14924 Sheet 14925 Sheet 14926 Sheet 14927 Sheet 14928 Sheet 14929 Sheet 14930 Sheet 14931 Sheet 14932 Sheet 14933 Sheet 14934 Sheet 14935 Sheet 14936 Sheet 14937 Sheet 14938 Sheet 14939 Sheet 14940 Sheet 14941 Sheet 14942 Sheet 14943 Sheet 14944 Sheet 14945 Sheet 14946 Sheet 14947 Sheet 14948 Sheet 14949 Sheet 14950 Sheet 14951 Sheet 14952 Sheet 14953 Sheet 14954 Sheet 14955 Sheet 14956 Sheet 14957 Sheet 14958 Sheet 14959 Sheet 14960 Sheet 14961 Sheet 14962 Sheet 14963 Sheet 14964 Sheet 14965 Sheet 14966 Sheet 14967 Sheet 14968 Sheet 14969 Sheet 14970 Sheet 14971 Sheet 14972 Sheet 14973 Sheet 14974 Sheet 14975 Sheet 14976 Sheet 14977 Sheet 14978 Sheet 14979 Sheet 14980 Sheet 14981 Sheet 14982 Sheet 14983 Sheet 14984 Sheet 14985 Sheet 14986 Sheet 14987 Sheet 14988 Sheet 14989 Sheet 14990 Sheet 14991 Sheet 14992 Sheet 14993 Sheet 14994 Sheet 14995 Sheet 14996 Sheet 14997 Sheet 14998 Sheet 14999 Sheet 15000 Sheet 15001 Sheet 15002 Sheet 15003 Sheet 15004 Sheet 15005 Sheet 15006 Sheet 15007 Sheet 15008 Sheet 15009 Sheet 15010 Sheet 15011 Sheet 15012 Sheet 15013 Sheet 15014 Sheet 15015 Sheet 15016 Sheet 15017 Sheet 15018 Sheet 15019 Sheet 15020 Sheet 15021 Sheet 15022 Sheet 15023 Sheet 15024 Sheet 15025 Sheet 15026 Sheet 15027 Sheet 15028 Sheet 15029 Sheet 15030 Sheet 15031 Sheet 15032 Sheet 15033 Sheet 15034 Sheet 15035 Sheet 15036 Sheet 15037 Sheet 15038 Sheet 15039 Sheet 15040 Sheet 15041 Sheet 15042 Sheet 15043 Sheet 15044 Sheet 15045 Sheet 15046 Sheet 15047 Sheet 15048 Sheet 15049 Sheet 15050 Sheet 15051 Sheet 15052 Sheet 15053 Sheet 15054 Sheet 15055 Sheet 15056 Sheet 15057 Sheet 15058 Sheet 15059 Sheet 15060 Sheet 15061 Sheet 15062 Sheet 15063 Sheet 15064 Sheet 15065 Sheet 15066 Sheet 15067 Sheet 15068 Sheet 15069 Sheet 15070 Sheet 15071 Sheet 15072 Sheet 15073 Sheet 15074 Sheet 15075 Sheet 15076 Sheet 15077 Sheet 15078 Sheet 15079 Sheet 15080 Sheet 15081 Sheet 15082 Sheet 15083 Sheet 15084 Sheet 15085 Sheet 15086 Sheet 15087 Sheet 15088 Sheet 15089 Sheet 15090 Sheet 15091 Sheet 15092 Sheet 15093 Sheet 15094 Sheet 15095 Sheet 15096 Sheet 15097 Sheet 15098 Sheet 15099 Sheet 15100 Sheet 15101 Sheet 15102 Sheet 15103 Sheet 15104 Sheet 15105 Sheet 15106 Sheet 15107 Sheet 15108 Sheet 15109 Sheet 15110 Sheet 15111 Sheet 15112 Sheet 15113 Sheet 15114 Sheet 15115 Sheet 15116 Sheet 15117 Sheet 15118 Sheet 15119 Sheet 15120 Sheet 15121 Sheet 15122 Sheet 15123 Sheet 15124 Sheet 15125 Sheet 15126 Sheet 15127 Sheet 15128 Sheet 15129 Sheet 15130 Sheet 15131 Sheet 15132 Sheet 15133 Sheet 15134 Sheet 15135 Sheet 15136 Sheet 15137 Sheet 15138 Sheet 15139 Sheet 15140 Sheet 15141 Sheet 15142 Sheet 15143 Sheet 15144 Sheet 15145 Sheet 15146 Sheet 15147 Sheet 15148 Sheet 15149 Sheet 15150 Sheet 15151 Sheet 15152 Sheet 15153 Sheet 15154 Sheet 15155 Sheet 15156 Sheet 15157 Sheet 15158 Sheet 15159 Sheet 15160 Sheet 15161 Sheet 15162 Sheet 15163 Sheet 15164 Sheet 15165 Sheet 15166 Sheet 15167 Sheet 15168 Sheet 15169 Sheet 15170 Sheet 15171 Sheet 15172 Sheet 15173 Sheet 15174 Sheet 15175 Sheet 15176 Sheet 15177 Sheet 15178 Sheet 15179 Sheet 15180 Sheet 15181 Sheet 15182 Sheet 15183 Sheet 15184 Sheet 15185 Sheet 15186 Sheet 15187 Sheet 15188 Sheet 15189 Sheet 15190 Sheet 15191 Sheet 15192 Sheet 15193 Sheet 15194 Sheet 15195 Sheet 15196 Sheet 15197 Sheet 15198 Sheet 15199 Sheet 15200 Sheet 15201 Sheet 15202 Sheet 15203 Sheet 15204 Sheet 15205 Sheet 15206 Sheet 15207 Sheet 15208 Sheet 15209 Sheet 15210 Sheet 15211 Sheet 15212 Sheet 15213 Sheet 15214 Sheet 15215 Sheet 15216 Sheet 15217 Sheet 15218 Sheet 15219 Sheet 15220 Sheet 15221 Sheet 15222 Sheet 15223 Sheet 15224 Sheet 15225 Sheet 15226 Sheet 15227 Sheet 15228 Sheet 15229 Sheet 15230 Sheet 15231 Sheet 15232 Sheet 15233 Sheet 15234 Sheet 15235 Sheet 15236 Sheet 15237 Sheet 15238 Sheet 15239 Sheet 15240 Sheet 15241 Sheet 15242 Sheet 15243 Sheet 15244 Sheet 15245 Sheet 15246 Sheet 15247 Sheet 15248 Sheet 15249 Sheet 15250 Sheet 15251 Sheet 15252 Sheet 15253 Sheet 15254 Sheet 15255 Sheet 15256 Sheet 15257 Sheet 15258 Sheet 15259 Sheet 15260 Sheet 15261 Sheet 15262 Sheet 15263 Sheet 15264 Sheet 15265 Sheet 15266 Sheet 15267 Sheet 15268 Sheet 15269 Sheet 15270 Sheet 15271 Sheet 15272 Sheet 15273 Sheet 15274 Sheet 15275 Sheet 15276 Sheet 15277 Sheet 15278 Sheet 15279 Sheet 15280 Sheet 15281 Sheet 15282 Sheet 15283 Sheet 15284 Sheet 15285 Sheet 15286 Sheet 15287 Sheet 15288 Sheet 15289 Sheet 15290 Sheet 15291 Sheet 15292 Sheet 15293 Sheet 15294 Sheet 15295 Sheet 15296 Sheet 15297 Sheet 15298 Sheet 15299 Sheet 15300 Sheet 15301 Sheet 15302 Sheet 15303 Sheet 15304 Sheet 15305 Sheet 15306 Sheet 15307 Sheet 15308 Sheet 15309 Sheet 15310 Sheet 15311 Sheet 15312 Sheet 15313 Sheet 15314 Sheet 15315 Sheet 15316 Sheet 15317 Sheet 15318 Sheet 15319 Sheet 15320 Sheet 15321 Sheet 15322 Sheet 15323 Sheet 15324 Sheet 15325 Sheet 15326 Sheet 15327 Sheet 15328 Sheet 15329 Sheet 15330 Sheet 15331 Sheet 15332 Sheet 15333 Sheet 15334 Sheet 15335 Sheet 15336 Sheet 15337 Sheet 15338 Sheet 15339 Sheet 15340 Sheet 15341 Sheet 15342 Sheet 15343 Sheet 15344 Sheet 15345 Sheet 15346 Sheet 15347 Sheet 15348 Sheet 15349 Sheet 15350 Sheet 15351 Sheet 15352 Sheet 15353 Sheet 15354 Sheet 15355 Sheet 15356 Sheet 15357 Sheet 15358 Sheet 15359 Sheet 15360 Sheet 15361 Sheet 15362 Sheet 15363 Sheet 15364 Sheet 15365 Sheet 15366 Sheet 15367 Sheet 15368 Sheet 15369 Sheet 15370 Sheet 15371 Sheet 15372 Sheet 15373 Sheet 15374 Sheet 15375 Sheet 15376 Sheet 15377 Sheet 15378 Sheet 15379 Sheet 15380 Sheet 15381 Sheet 15382 Sheet 15383 Sheet 15384 Sheet 15385 Sheet 15386 Sheet 15387 Sheet 15388 Sheet 15389 Sheet 15390 Sheet 15391 Sheet 15392 Sheet 15393 Sheet 15394 Sheet 15395 Sheet 15396 Sheet 15397 Sheet 15398 Sheet 15399 Sheet 15400 Sheet 15401 Sheet 15402 Sheet 15403 Sheet 15404 Sheet 15405 Sheet 15406 Sheet 15407 Sheet 15408 Sheet 15409 Sheet 15410 Sheet 15411 Sheet 15412 Sheet 15413 Sheet 15414 Sheet 15415 Sheet 15416 Sheet 15417 Sheet 15418 Sheet 15419 Sheet 15420 Sheet 15421 Sheet 15422 Sheet 15423 Sheet 15424 Sheet 15425 Sheet 15426 Sheet 15427 Sheet 15428 Sheet 15429 Sheet 15430 Sheet 15431 Sheet 15432 Sheet 15433 Sheet 15434 Sheet 15435 Sheet 15436 Sheet 15437 Sheet 15438 Sheet 15439 Sheet 15440 Sheet 15441 Sheet 15442 Sheet 15443 Sheet 15444 Sheet 15445 Sheet 15446 Sheet 15447 Sheet 15448 Sheet 15449 Sheet 15450 Sheet 15451 Sheet 15452 Sheet 15453 Sheet 15454 Sheet 15455 Sheet 15456 Sheet 15457 Sheet 15458 Sheet 15459 Sheet 15460 Sheet 15461 Sheet 15462 Sheet 15463 Sheet 15464 Sheet 15465 Sheet 15466 Sheet 15467 Sheet 15468 Sheet 15469 Sheet 15470 Sheet 15471 Sheet 15472 Sheet 15473 Sheet 15474 Sheet 15475 Sheet 15476 Sheet 15477 Sheet 15478 Sheet 15479 Sheet 15480 Sheet 15481 Sheet 15482 Sheet 15483 Sheet 15484 Sheet 15485 Sheet 15486 Sheet 15487 Sheet 15488 Sheet 15489 Sheet 15490 Sheet 15491 Sheet 15492 Sheet 15493 Sheet 15494 Sheet 15495 Sheet 15496 Sheet 15497 Sheet 15498 Sheet 15499 Sheet 15500 Sheet 15501 Sheet 15502 Sheet 15503 Sheet 15504 Sheet 15505 Sheet 15506 Sheet 15507 Sheet 15508 Sheet 15509 Sheet 15510 Sheet 15511 Sheet 15512 Sheet 15513 Sheet 15514 Sheet 15515 Sheet 15516 Sheet 15517 Sheet 15518 Sheet 15519 Sheet 15520 Sheet 15521 Sheet 15522 Sheet 15523 Sheet 15524 Sheet 15525 Sheet 15526 Sheet 15527 Sheet 15528 Sheet 15529 Sheet 15530 Sheet 15531 Sheet 15532 Sheet 15533 Sheet 15534 Sheet 15535 Sheet 15536 Sheet 15537 Sheet 15538 Sheet 15539 Sheet 15540 Sheet 15541 Sheet 15542 Sheet 15543 Sheet 15544 Sheet 15545 Sheet 15546 Sheet 15547 Sheet 15548 Sheet 15549 Sheet 15550 Sheet 15551 Sheet 15552 Sheet 15553 Sheet 15554 Sheet 15555 Sheet 15556 Sheet 15557 Sheet 15558 Sheet 15559 Sheet 15560 Sheet 15561 Sheet 15562 Sheet 15563 Sheet 15564 Sheet 15565 Sheet 15566 Sheet 15567 Sheet 15568 Sheet 15569 Sheet 15570 Sheet 15571 Sheet 15572 Sheet 15573 Sheet 15574 Sheet 15575 Sheet 15576 Sheet 15577 Sheet 15578 Sheet 15579 Sheet 15580 Sheet 15581 Sheet 15582 Sheet 15583 Sheet 15584 Sheet 15585 Sheet 15586 Sheet 15587 Sheet 15588 Sheet 15589 Sheet 15590 Sheet 15591 Sheet 15592 Sheet 15593 Sheet 15594 Sheet 15595 Sheet 15596 Sheet 15597 Sheet 15598 Sheet 15599 Sheet 15600 Sheet 15601 Sheet 15602 Sheet 15603 Sheet 15604 Sheet 15605 Sheet 15606 Sheet 15607 Sheet 15608 Sheet 15609 Sheet 15610 Sheet 15611 Sheet 15612 Sheet 15613 Sheet 15614 Sheet 15615 Sheet 15616 Sheet 15617 Sheet 15618 Sheet 15619 Sheet 15620 Sheet 15621 Sheet 15622 Sheet 15623 Sheet 15624 Sheet 15625 Sheet 15626 Sheet 15627 Sheet 15628 Sheet 15629 Sheet 15630 Sheet 15631 Sheet 15632 Sheet 15633 Sheet 15634 Sheet 15635 Sheet 15636 Sheet 15637 Sheet 15638 Sheet 15639 Sheet 15640 Sheet 15641 Sheet 15642 Sheet 15643 Sheet 15644 Sheet 15645 Sheet 15646 Sheet 15647 Sheet 15648 Sheet 15649 Sheet 15650 Sheet 15651 Sheet 15652 Sheet 15653 Sheet 15654 Sheet 15655 Sheet 15656 Sheet 15657 Sheet 15658 Sheet 15659 Sheet 15660 Sheet 15661 Sheet 15662 Sheet 15663 Sheet 15664 Sheet 15665 Sheet 15666 Sheet 15667 Sheet 15668 Sheet 15669 Sheet 15670 Sheet 15671 Sheet 15672 Sheet 15673 Sheet 15674 Sheet 15675 Sheet 15676 Sheet 15677 Sheet 15678 Sheet 15679 Sheet 15680 Sheet 15681 Sheet 15682 Sheet 15683 Sheet 15684 Sheet 15685 Sheet 15686 Sheet 15687 Sheet 15688 Sheet 15689 Sheet 15690 Sheet 15691 Sheet 15692 Sheet 15693 Sheet 15694 Sheet 15695 Sheet 15696 Sheet 15697 Sheet 15698 Sheet 15699 Sheet 15700 Sheet 15701 Sheet 15702 Sheet 15703 Sheet 15704 Sheet 15705 Sheet 15706 Sheet 15707 Sheet 15708 Sheet 15709 Sheet 15710 Sheet 15711 Sheet 15712 Sheet 15713 Sheet 15714 Sheet 15715 Sheet 15716 Sheet 15717 Sheet 15718 Sheet 15719 Sheet 15720 Sheet 15721 Sheet 15722 Sheet 15723 Sheet 15724 Sheet 15725 Sheet 15726 Sheet 15727 Sheet 15728 Sheet 15729 Sheet 15730 Sheet 15731 Sheet 15732 Sheet 15733 Sheet 15734 Sheet 15735 Sheet 15736 Sheet 15737 Sheet 15738 Sheet 15739 Sheet 15740 Sheet 15741 Sheet 15742 Sheet 15743 Sheet 15744 Sheet 15745 Sheet 15746 Sheet 15747 Sheet 15748 Sheet 15749 Sheet 15750 Sheet 15751 Sheet 15752 Sheet 15753 Sheet 15754 Sheet 15755 Sheet 15756 Sheet 15757 Sheet 15758 Sheet 15759 Sheet 15760 Sheet 15761 Sheet 15762 Sheet 15763 Sheet 15764 Sheet 15765 Sheet 15766 Sheet 15767 Sheet 15768 Sheet 15769 Sheet 15770 Sheet 15771 Sheet 15772 Sheet 15773 Sheet 15774 Sheet 15775 Sheet 15776 Sheet 15777 Sheet 15778 Sheet 15779 Sheet 15780 Sheet 15781 Sheet 15782 Sheet 15783 Sheet 15784 Sheet 15785 Sheet 15786 Sheet 15787 Sheet 15788 Sheet 15789 Sheet 15790 Sheet 15791 Sheet 15792 Sheet 15793 Sheet 15794 Sheet 15795 Sheet 15796 Sheet 15797 Sheet 15798 Sheet 15799 Sheet 15800 Sheet 15801 Sheet 15802 Sheet 15803 Sheet 15804 Sheet 15805 Sheet 15806 Sheet 15807 Sheet 15808 Sheet 15809 Sheet 15810 Sheet 15811 Sheet 15812 Sheet 15813 Sheet 15814 Sheet 15815 Sheet 15816 Sheet 15817 Sheet 15818 Sheet 15819 Sheet 15820 Sheet 15821 Sheet 15822 Sheet 15823 Sheet 15824 Sheet 15825 Sheet 15826 Sheet 15827 Sheet 15828 Sheet 15829 Sheet 15830 Sheet 15831 Sheet 15832 Sheet 15833 Sheet 15834 Sheet 15835 Sheet 15836 Sheet 15837 Sheet 15838 Sheet 15839 Sheet 15840 Sheet 15841 Sheet 15842 Sheet 15843 Sheet 15844 Sheet 15845 Sheet 15846 Sheet 15847 Sheet 15848 Sheet 15849 Sheet 15850 Sheet 15851 Sheet 15852 Sheet 15853 Sheet 15854 Sheet 15855 Sheet 15856 Sheet 15857 Sheet 15858 Sheet 15859 Sheet 15860 Sheet 15861 Sheet 15862 Sheet 15863 Sheet 15864 Sheet 15865 Sheet 15866 Sheet 15867 Sheet 15868 Sheet 15869 Sheet 15870 Sheet 15871 Sheet 15872 Sheet 15873 Sheet 15874 Sheet 15875 Sheet 15876 Sheet 15877 Sheet 15878 Sheet 15879 Sheet 15880 Sheet 15881 Sheet 15882 Sheet 15883 Sheet 15884 Sheet 15885 Sheet 15886 Sheet 15887 Sheet 15888 Sheet 15889 Sheet 15890 Sheet 15891 Sheet 15892 Sheet 15893 Sheet 15894 Sheet 15895 Sheet 15896 Sheet 15897 Sheet 15898 Sheet 15899 Sheet 15900 Sheet 15901 Sheet 15902 Sheet 15903 Sheet 15904 Sheet 15905 Sheet 15906 Sheet 15907 Sheet 15908 Sheet 15909 Sheet 15910 Sheet 15911 Sheet 15912 Sheet 15913 Sheet 15914 Sheet 15915 Sheet 15916 Sheet 15917 Sheet 15918 Sheet 15919 Sheet 15920 Sheet 15921 Sheet 15922 Sheet 15923 Sheet 15924 Sheet 15925 Sheet 15926 Sheet 15927 Sheet 15928 Sheet 15929 Sheet 15930 Sheet 15931 Sheet 15932 Sheet 15933 Sheet 15934 Sheet 15935 Sheet 15936 Sheet 15937 Sheet 15938 Sheet 15939 Sheet 15940 Sheet 15941 Sheet 15942 Sheet 15943 Sheet 15944 Sheet 15945 Sheet 15946 Sheet 15947 Sheet 15948 Sheet 15949 Sheet 15950 Sheet 15951 Sheet 15952 Sheet 15953 Sheet 15954 Sheet 15955 Sheet 15956 Sheet 15957 Sheet 15958 Sheet 15959 Sheet 15960 Sheet 15961 Sheet 15962 Sheet 15963 Sheet 15964 Sheet 15965 Sheet 15966 Sheet 15967 Sheet 15968 Sheet 15969 Sheet 15970 Sheet 15971 Sheet 15972 Sheet 15973 Sheet 15974 Sheet 15975 Sheet 15976 Sheet 15977 Sheet 15978 Sheet 15979 Sheet 15980 Sheet 15981 Sheet 15982 Sheet 15983 Sheet 15984 Sheet 15985 Sheet 15986 Sheet 15987 Sheet 15988 Sheet 15989 Sheet 15990 Sheet 15991 Sheet 15992 Sheet 15993 Sheet 15994 Sheet 15995 Sheet 15996 Sheet 15997 Sheet 15998 Sheet 15999 Sheet 16000 Sheet 16001 Sheet 16002 Sheet 16003 Sheet 16004 Sheet 16005 Sheet 16006 Sheet 16007 Sheet 16008 Sheet 16009 Sheet 16010 Sheet 16011 Sheet 16012 Sheet 16013 Sheet 16014 Sheet 16015 Sheet 16016 Sheet 16017 Sheet 16018 Sheet 16019 Sheet 16020 Sheet 16021 Sheet 16022 Sheet 16023 Sheet 16024 Sheet 16025 Sheet 16026 Sheet 16027 Sheet 16028 Sheet 16029 Sheet 16030 Sheet 16031 Sheet 16032 Sheet 16033 Sheet 16034 Sheet 16035 Sheet 16036 Sheet 16037 Sheet 16038 Sheet 16039 Sheet 16040 Sheet 16041 Sheet 16042 Sheet 16043 Sheet 16044 Sheet 16045 Sheet 16046 Sheet 16047 Sheet 16048 Sheet 16049 Sheet 16050 Sheet 16051 Sheet 16052 Sheet 16053 Sheet 16054 Sheet 16055 Sheet 16056 Sheet 16057 Sheet 16058 Sheet 16059 Sheet 16060 Sheet 16061 Sheet 16062 Sheet 16063 Sheet 16064 Sheet 16065 Sheet 16066 Sheet 16067 Sheet 16068 Sheet 16069 Sheet 16070 Sheet 16071 Sheet 16072 Sheet 16073 Sheet 16074 Sheet 16075 Sheet 16076 Sheet 16077 Sheet 16078 Sheet 16079 Sheet 16080 Sheet 16081 Sheet 16082 Sheet 16083 Sheet 16084 Sheet 16085 Sheet 16086 Sheet 16087 Sheet 16088 Sheet 16089 Sheet 16090 Sheet 16091 Sheet 16092 Sheet 16093 Sheet 16094 Sheet 16095 Sheet 16096 Sheet 16097 Sheet 16098 Sheet 16099 Sheet 16100 Sheet 16101 Sheet 16102 Sheet 16103 Sheet 16104 Sheet 16105 Sheet 16106 Sheet 16107 Sheet 16108 Sheet 16109 Sheet 16110 Sheet 16111 Sheet 16112 Sheet 16113 Sheet 16114 Sheet 16115 Sheet 16116 Sheet 16117 Sheet 16118 Sheet 16119 Sheet 16120 Sheet 16121 Sheet 16122 Sheet 16123 Sheet 16124 Sheet 16125 Sheet 16126 Sheet 16127 Sheet 16128 Sheet 16129 Sheet 16130 Sheet 16131 Sheet 16132 Sheet 16133 Sheet 16134 Sheet 16135 Sheet 16136 Sheet 16137 Sheet 16138 Sheet 16139 Sheet 16140 Sheet 16141 Sheet 16142 Sheet 16143 Sheet 16144 Sheet 16145 Sheet 16146 Sheet 16147 Sheet 16148 Sheet 16149 Sheet 16150 Sheet 16151 Sheet 16152 Sheet 16153 Sheet 16154 Sheet 16155 Sheet 16156 Sheet 16157 Sheet 16158 Sheet 16159 Sheet 16160 Sheet 16161 Sheet 16162 Sheet 16163 Sheet 16164 Sheet 16165 Sheet 16166 Sheet 16167 Sheet 16168 Sheet 16169 Sheet 16170 Sheet 16171 Sheet 16172 Sheet 16173 Sheet 16174 Sheet 16175 Sheet 16176 Sheet 16177 Sheet 16178 Sheet 16179 Sheet 16180 Sheet 16181 Sheet 16182 Sheet 16183 Sheet 16184 Sheet 16185 Sheet 16186 Sheet 16187 Sheet 16188 Sheet 16189 Sheet 16190 Sheet 16191 Sheet 16192 Sheet 16193 Sheet 16194 Sheet 16195 Sheet 16196 Sheet 16197 Sheet 16198 Sheet 16199 Sheet 16200 Sheet 16201 Sheet 16202 Sheet 16203 Sheet 16204 Sheet 16205 Sheet 16206 Sheet 16207 Sheet 16208 Sheet 16209 Sheet 16210 Sheet 16211 Sheet 16212 Sheet 16213 Sheet 16214 Sheet 16215 Sheet 16216 Sheet 16217 Sheet 16218 Sheet 16219 Sheet 16220 Sheet 16221 Sheet 16222 Sheet 16223 Sheet 16224 Sheet 16225 Sheet 16226 Sheet 16227 Sheet 16228 Sheet 16229 Sheet 16230 Sheet 16231 Sheet 16232 Sheet 16233 Sheet 16234 Sheet 16235 Sheet 16236 Sheet 16237 Sheet 16238 Sheet 16239 Sheet 16240 Sheet 16241 Sheet 16242 Sheet 16243 Sheet 16244 Sheet 16245 Sheet 16246 Sheet 16247 Sheet 16248 Sheet 16249 Sheet 16250 Sheet 16251 Sheet 16252 Sheet 16253 Sheet 16254 Sheet 16255 Sheet 16256 Sheet 16257 Sheet 16258 Sheet 16259 Sheet 16260 Sheet 16261 Sheet 16262 Sheet 16263 Sheet 16264 Sheet 16265 Sheet 16266 Sheet 16267 Sheet 16268 Sheet 16269 Sheet 16270 Sheet 16271 Sheet 16272 Sheet 16273 Sheet 16274 Sheet 16275 Sheet 16276 Sheet 16277 Sheet 16278 Sheet 16279 Sheet 16280 Sheet 16281 Sheet 16282 Sheet 16283 Sheet 16284 Sheet 16285 Sheet 16286 Sheet 16287 Sheet 16288 Sheet 16289 Sheet 16290 Sheet 16291 Sheet 16292 Sheet 16293 Sheet 16294 Sheet 16295 Sheet 16296 Sheet 16297 Sheet 16298 Sheet 16299 Sheet 16300 Sheet 16301 Sheet 16302 Sheet 16303 Sheet 16304 Sheet 16305 Sheet 16306 Sheet 16307 Sheet 16308 Sheet 16309 Sheet 16310 Sheet 16311 Sheet 16312 Sheet 16313 Sheet 16314 Sheet 16315 Sheet 16316 Sheet 16317 Sheet 16318 Sheet 16319 Sheet 16320 Sheet 16321 Sheet 16322 Sheet 16323 Sheet 16324 Sheet 16325 Sheet 16326 Sheet 16327 Sheet 16328 Sheet 16329 Sheet 16330 Sheet 16331 Sheet 16332 Sheet 16333 Sheet 16334 Sheet 16335 Sheet 16336 Sheet 16337 Sheet 16338 Sheet 16339 Sheet 16340 Sheet 16341 Sheet 16342 Sheet 16343 Sheet 16344 Sheet 16345 Sheet 16346 Sheet 16347 Sheet 16348 Sheet 16349 Sheet 16350 Sheet 16351 Sheet 16352 Sheet 16353 Sheet 16354 Sheet 16355 Sheet 16356 Sheet 16357 Sheet 16358 Sheet 16359 Sheet 16360 Sheet 16361 Sheet 16362 Sheet 16363 Sheet 16364 Sheet 16365 Sheet 16366 Sheet 16367 Sheet 16368 Sheet 16369 Sheet 16370 Sheet 16371 Sheet 16372 Sheet 16373 Sheet 16374 Sheet 16375 Sheet 16376 Sheet 16377 Sheet 16378 Sheet 16379 Sheet 16380 Sheet 16381 Sheet 16382 Sheet 16383 Sheet 16384 Sheet 16385 Sheet 16386 Sheet 16387 Sheet 16388 Sheet 16389 Sheet 16390 Sheet 16391 Sheet 16392 Sheet 16393 Sheet 16394 Sheet 16395 Sheet 16396 Sheet 16397 Sheet 16398 Sheet 16399 Sheet 16400 Sheet 16401 Sheet 16402 Sheet 16403 Sheet 16404 Sheet 16405 Sheet 16406 Sheet 16407 Sheet 16408 Sheet 16409 Sheet 16410 Sheet 16411 Sheet 16412 Sheet 16413 Sheet 16414 Sheet 16415 Sheet 16416 Sheet 16417 Sheet 16418 Sheet 16419 Sheet 16420 Sheet 16421 Sheet 16422 Sheet 16423 Sheet 16424 Sheet 16425 Sheet 16426 Sheet 16427 Sheet 16428 Sheet 16429 Sheet 16430 Sheet 16431 Sheet 16432 Sheet 16433 Sheet 16434 Sheet 16435 Sheet 16436 Sheet 16437 Sheet 16438 Sheet 16439 Sheet 16440 Sheet 16441 Sheet 16442 Sheet 16443 Sheet 16444 Sheet 16445 Sheet 16446 Sheet 16447 Sheet 16448 Sheet 16449 Sheet 16450 Sheet 16451 Sheet 16452 Sheet 16453 Sheet 16454 Sheet 16455 Sheet 16456 Sheet 16457 Sheet 16458 Sheet 16459 Sheet 16460 Sheet 16461 Sheet 16462 Sheet 16463 Sheet 16464 Sheet 16465 Sheet 16466 Sheet 16467 Sheet 16468 Sheet 16469 Sheet 16470 Sheet 16471 Sheet 16472 Sheet 16473 Sheet 16474 Sheet 16475 Sheet 16476 Sheet 16477 Sheet 16478 Sheet 16479 Sheet 16480 Sheet 16481 Sheet 16482 Sheet 16483 Sheet 16484 Sheet 16485 Sheet 16486 Sheet 16487 Sheet 16488 Sheet 16489 Sheet 16490 Sheet 16491 Sheet 16492 Sheet 16493 Sheet 16494 Sheet 16495 Sheet 16496 Sheet 16497 Sheet 16498 Sheet 16499 Sheet 16500 Sheet 16501 Sheet 16502 Sheet 16503 Sheet 16504 Sheet 16505 Sheet 16506 Sheet 16507 Sheet 16508 Sheet 16509 Sheet 16510 Sheet 16511 Sheet 16512 Sheet 16513 Sheet 16514 Sheet 16515 Sheet 16516 Sheet 16517 Sheet 16518 Sheet 16519 Sheet 16520 Sheet 16521 Sheet 16522 Sheet 16523 Sheet 16524 Sheet 16525 Sheet 16526 Sheet 16527 Sheet 16528 Sheet 16529 Sheet 16530 Sheet 16531 Sheet 16532 Sheet 16533 Sheet 16534 Sheet 16535 Sheet 16536 Sheet 16537 Sheet 16538 Sheet 16539 Sheet 16540 Sheet 16541 Sheet 16542 Sheet 16543 Sheet 16544 Sheet 16545 Sheet 16546 Sheet 16547 Sheet 16548 Sheet 16549 Sheet 16550 Sheet 16551 Sheet 16552 Sheet 16553 Sheet 16554 Sheet 16555 Sheet 16556 Sheet 16557 Sheet 16558 Sheet 16559 Sheet 16560 Sheet 16561 Sheet 16562 Sheet 16563 Sheet 16564 Sheet 16565 Sheet 16566 Sheet 16567 Sheet 16568 Sheet 16569 Sheet 16570 Sheet 16571 Sheet 16572 Sheet 16573 Sheet 16574 Sheet 16575 Sheet 16576 Sheet 16577 Sheet 16578 Sheet 16579 Sheet 16580 Sheet 16581 Sheet 16582 Sheet 16583 Sheet 16584 Sheet 16585 Sheet 16586 Sheet 16587 Sheet 16588 Sheet 16589 Sheet 16590 Sheet 16591 Sheet 16592 Sheet 16593 Sheet 16594 Sheet 16595 Sheet 16596 Sheet 16597 Sheet 16598 Sheet 16599 Sheet 16600 Sheet 16601 Sheet 16602 Sheet 16603 Sheet 16604 Sheet 16605 Sheet 16606 Sheet 16607 Sheet 16608 Sheet 16609 Sheet 16610 Sheet 16611 Sheet 16612 Sheet 16613 Sheet 16614 Sheet 16615 Sheet 16616 Sheet 16617 Sheet 16618 Sheet 16619 Sheet 16620 Sheet 16621 Sheet 16622 Sheet 16623 Sheet 16624 Sheet 16625 Sheet 16626 Sheet 16627 Sheet 16628 Sheet 16629 Sheet 16630 Sheet 16631 Sheet 16632 Sheet 16633 Sheet 16634 Sheet 16635 Sheet 16636 Sheet 16637 Sheet 16638 Sheet 16639 Sheet 16640 Sheet 16641 Sheet 16642 Sheet 16643 Sheet 16644 Sheet 16645 Sheet 16646 Sheet 16647 Sheet 16648 Sheet 16649 Sheet 16650 Sheet 16651 Sheet 16652 Sheet 16653 Sheet 16654 Sheet 16655 Sheet 16656 Sheet 16657 Sheet 16658 Sheet 16659 Sheet 16660 Sheet 16661 Sheet 16662 Sheet 16663 Sheet 16664 Sheet 16665 Sheet 16666 Sheet 16667 Sheet 16668 Sheet 16669 Sheet 16670 Sheet 16671 Sheet 16672 Sheet 16673 Sheet 16674 Sheet 16675 Sheet 16676 Sheet 16677 Sheet 16678 Sheet 16679 Sheet 16680 Sheet 16681 Sheet 16682 Sheet 16683 Sheet 16684 Sheet 16685 Sheet 16686 Sheet 16687 Sheet 16688 Sheet 16689 Sheet 16690 Sheet 16691 Sheet 16692 Sheet 16693 Sheet 16694 Sheet 16695 Sheet 16696 Sheet 16697 Sheet 16698 Sheet 16699 Sheet 16700 Sheet 16701 Sheet 16702 Sheet 16703 Sheet 16704 Sheet 16705 Sheet 16706 Sheet 16707 Sheet 16708 Sheet 16709 Sheet 16710 Sheet 16711 Sheet 16712 Sheet 16713 Sheet 16714 Sheet 16715 Sheet 16716 Sheet 16717 Sheet 16718 Sheet 16719 Sheet 16720 Sheet 16721 Sheet 16722 Sheet 16723 Sheet 16724 Sheet 16725 Sheet 16726 Sheet 16727 Sheet 16728 Sheet 16729 Sheet 16730 Sheet 16731 Sheet 16732 Sheet 16733 Sheet 16734 Sheet 16735 Sheet 16736 Sheet 16737 Sheet 16738 Sheet 16739 Sheet 16740 Sheet 16741 Sheet 16742 Sheet 16743 Sheet 16744 Sheet 16745 Sheet 16746 Sheet 16747 Sheet 16748 Sheet 16749 Sheet 16750 Sheet 16751 Sheet 16752 Sheet 16753 Sheet 16754 Sheet 16755 Sheet 16756 Sheet 16757 Sheet 16758 Sheet 16759 Sheet 16760 Sheet 16761 Sheet 16762 Sheet 16763 Sheet 16764 Sheet 16765 Sheet 16766 Sheet 16767 Sheet 16768 Sheet 16769 Sheet 16770 Sheet 16771 Sheet 16772 Sheet 16773 Sheet 16774 Sheet 16775 Sheet 16776 Sheet 16777 Sheet 16778 Sheet 16779 Sheet 16780 Sheet 16781 Sheet 16782 Sheet 16783 Sheet 16784 Sheet 16785 Sheet 16786 Sheet 16787 Sheet 16788 Sheet 16789 Sheet 16790 Sheet 16791 Sheet 16792 Sheet 16793 Sheet 16794 Sheet 16795 Sheet 16796 Sheet 16797 Sheet 16798 Sheet 16799 Sheet 16800 Sheet 16801 Sheet 16802 Sheet 16803 Sheet 16804 Sheet 16805 Sheet 16806 Sheet 16807 Sheet 16808 Sheet 16809 Sheet 16810 Sheet 16811 Sheet 16812 Sheet 16813 Sheet 16814 Sheet 16815 Sheet 16816 Sheet 16817 Sheet 16818 Sheet 16819 Sheet 16820 Sheet 16821 Sheet 16822 Sheet 16823 Sheet 16824 Sheet 16825 Sheet 16826 Sheet 16827 Sheet 16828 Sheet 16829 Sheet 16830 Sheet 16831 Sheet 16832 Sheet 16833 Sheet 16834 Sheet 16835 Sheet 16836 Sheet 16837 Sheet 16838 Sheet 16839 Sheet 16840 Sheet 16841 Sheet 16842 Sheet 16843 Sheet 16844 Sheet 16845 Sheet 16846 Sheet 16847 Sheet 16848 Sheet 16849 Sheet 16850 Sheet 16851 Sheet 16852 Sheet 16853 Sheet 16854 Sheet 16855 Sheet 16856 Sheet 16857 Sheet 16858 Sheet 16859 Sheet 16860 Sheet 16861 Sheet 16862 Sheet 16863 Sheet 16864 Sheet 16865 Sheet 16866 Sheet 16867 Sheet 16868 Sheet 16869 Sheet 16870 Sheet 16871 Sheet 16872 Sheet 16873 Sheet 16874 Sheet 16875 Sheet 16876 Sheet 16877 Sheet 16878 Sheet 16879 Sheet 16880 Sheet 16881 Sheet 16882 Sheet 16883 Sheet 16884 Sheet 16885 Sheet 16886 Sheet 16887 Sheet 16888 Sheet 16889 Sheet 16890 Sheet 16891 Sheet 16892 Sheet 16893 Sheet 16894 Sheet 16895 Sheet 16896 Sheet 16897 Sheet 16898 Sheet 16899 Sheet 16900 Sheet 16901 Sheet 16902 Sheet 16903 Sheet 16904 Sheet 16905 Sheet 16906 Sheet 16907 Sheet 16908 Sheet 16909 Sheet 16910 Sheet 16911 Sheet 16912 Sheet 16913 Sheet 16914 Sheet 16915 Sheet 16916 Sheet 16917 Sheet 16918 Sheet 16919 Sheet 16920 Sheet 16921 Sheet 16922 Sheet 16923 Sheet 16924 Sheet 16925 Sheet 16926 Sheet 16927 Sheet 16928 Sheet 16929 Sheet 16930 Sheet 16931 Sheet 16932 Sheet 16933 Sheet 16934 Sheet 16935 Sheet 16936 Sheet 16937 Sheet 16938 Sheet 16939 Sheet 16940 Sheet 16941 Sheet 16942 Sheet 16943 Sheet 16944 Sheet 16945 Sheet 16946 Sheet 16947 Sheet 16948 Sheet 16949 Sheet 16950 Sheet 16951 Sheet 16952 Sheet 16953 Sheet 16954 Sheet 16955 Sheet 16956 Sheet 16957 Sheet 16958 Sheet 16959 Sheet 16960 Sheet 16961 Sheet 16962 Sheet 16963 Sheet 16964 Sheet 16965 Sheet 16966 Sheet 16967 Sheet 16968 Sheet 16969 Sheet 16970 Sheet 16971 Sheet 16972 Sheet 16973 Sheet 16974 Sheet 16975 Sheet 16976 Sheet 16977 Sheet 16978 Sheet 16979 Sheet 16980 Sheet 16981 Sheet 16982 Sheet 16983 Sheet 16984 Sheet 16985 Sheet 16986 Sheet 16987 Sheet 16988 Sheet 16989 Sheet 16990 Sheet 16991 Sheet 16992 Sheet 16993 Sheet 16994 Sheet 16995 Sheet 16996 Sheet 16997 Sheet 16998 Sheet 16999 Sheet 17000 Sheet 17001 Sheet 17002 Sheet 17003 Sheet 17004 Sheet 17005 Sheet 17006 Sheet 17007 Sheet 17008 Sheet 17009 Sheet 17010 Sheet 17011 Sheet 17012 Sheet 17013 Sheet 17014 Sheet 17015 Sheet 17016 Sheet 17017 Sheet 17018 Sheet 17019 Sheet 17020 Sheet 17021 Sheet 17022 Sheet 17023 Sheet 17024 Sheet 17025 Sheet 17026 Sheet 17027 Sheet 17028 Sheet 17029 Sheet 17030 Sheet 17031 Sheet 17032 Sheet 17033 Sheet 17034 Sheet 17035 Sheet 17036 Sheet 17037 Sheet 17038 Sheet 17039 Sheet 17040 Sheet 17041 Sheet 17042 Sheet 17043 Sheet 17044 Sheet 17045 Sheet 17046 Sheet 17047 Sheet 17048 Sheet 17049 Sheet 17050 Sheet 17051 Sheet 17052 Sheet 17053 Sheet 17054 Sheet 17055 Sheet 17056 Sheet 17057 Sheet 17058 Sheet 17059 Sheet 17060 Sheet 17061 Sheet 17062 Sheet 17063 Sheet 17064 Sheet 17065 Sheet 17066 Sheet 17067 Sheet 17068 Sheet 17069 Sheet 17070 Sheet 17071 Sheet 17072 Sheet 17073 Sheet 17074 Sheet 17075 Sheet 17076 Sheet 17077 Sheet 17078 Sheet 17079 Sheet 17080 Sheet 17081 Sheet 17082 Sheet 17083 Sheet 17084 Sheet 17085 Sheet 17086 Sheet 17087 Sheet 17088 Sheet 17089 Sheet 17090 Sheet 17091 Sheet 17092 Sheet 17093 Sheet 17094 Sheet 17095 Sheet 17096 Sheet 17097 Sheet 17098 Sheet 17099 Sheet 17100 Sheet 17101 Sheet 17102 Sheet 17103 Sheet 17104 Sheet 17105 Sheet 17106 Sheet 17107 Sheet 17108 Sheet 17109 Sheet 17110 Sheet 17111 Sheet 17112 Sheet 17113 Sheet 17114 Sheet 17115 Sheet 17116 Sheet 17117 Sheet 17118 Sheet 17119 Sheet 17120 Sheet 17121 Sheet 17122 Sheet 17123 Sheet 17124 Sheet 17125 Sheet 17126 Sheet 17127 Sheet 17128 Sheet 17129 Sheet 17130 Sheet 17131 Sheet 17132 Sheet 17133 Sheet 17134 Sheet 17135 Sheet 17136 Sheet 17137 Sheet 17138 Sheet 17139 Sheet 17140 Sheet 17141 Sheet 17142 Sheet 17143 Sheet 17144 Sheet 17145 Sheet 17146 Sheet 17147 Sheet 17148 Sheet 17149 Sheet 17150 Sheet 17151 Sheet 17152 Sheet 17153 Sheet 17154 Sheet 17155 Sheet 17156 Sheet 17157 Sheet 17158 Sheet 17159 Sheet 17160 Sheet 17161 Sheet 17162 Sheet 17163 Sheet 17164 Sheet 17165 Sheet 17166 Sheet 17167 Sheet 17168 Sheet 17169 Sheet 17170 Sheet 17171 Sheet 17172 Sheet 17173 Sheet 17174 Sheet 17175 Sheet 17176 Sheet 17177 Sheet 17178 Sheet 17179 Sheet 17180 Sheet 17181 Sheet 17182 Sheet 17183 Sheet 17184 Sheet 17185 Sheet 17186 Sheet 17187 Sheet 17188 Sheet 17189 Sheet 17190 Sheet 17191 Sheet 17192 Sheet 17193 Sheet 17194 Sheet 17195 Sheet 17196 Sheet 17197 Sheet 17198 Sheet 17199 Sheet 17200 Sheet 17201 Sheet 17202 Sheet 17203 Sheet 17204 Sheet 17205 Sheet 17206 Sheet 17207 Sheet 17208 Sheet 17209 Sheet 17210 Sheet 17211 Sheet 17212 Sheet 17213 Sheet 17214 Sheet 17215 Sheet 17216 Sheet 17217 Sheet 17218 Sheet 17219 Sheet 17220 Sheet 17221 Sheet 17222 Sheet 17223 Sheet 17224 Sheet 17225 Sheet 17226 Sheet 17227 Sheet 17228 Sheet 17229 Sheet 17230 Sheet 17231 Sheet 17232 Sheet 17233 Sheet 17234 Sheet 17235 Sheet 17236 Sheet 17237 Sheet 17238 Sheet 17239 Sheet 17240 Sheet 17241 Sheet 17242 Sheet 17243 Sheet 17244 Sheet 17245 Sheet 17246 Sheet 17247 Sheet 17248 Sheet 17249 Sheet 17250 Sheet 17251 Sheet 17252 Sheet 17253 Sheet 17254 Sheet 17255 Sheet 17256 Sheet 17257 Sheet 17258 Sheet 17259 Sheet 17260 Sheet 17261 Sheet 17262 Sheet 17263 Sheet 17264 Sheet 17265 Sheet 17266 Sheet 17267 Sheet 17268 Sheet 17269 Sheet 17270 Sheet 17271 Sheet 17272 Sheet 17273 Sheet 17274 Sheet 17275 Sheet 17276 Sheet 17277 Sheet 17278 Sheet 17279 Sheet 17280 Sheet 17281 Sheet 17282 Sheet 17283 Sheet 17284 Sheet 17285 Sheet 17286 Sheet 17287 Sheet 17288 Sheet 17289 Sheet 17290 Sheet 17291 Sheet 17292 Sheet 17293 Sheet 17294 Sheet 17295 Sheet 17296 Sheet 17297 Sheet 17298 Sheet 17299 Sheet 17300 Sheet 17301 Sheet 17302 Sheet 17303 Sheet 17304 Sheet 17305 Sheet 17306 Sheet 17307 Sheet 17308 Sheet 17309 Sheet 17310 Sheet 17311 Sheet 17312 Sheet 17313 Sheet 17314 Sheet 17315 Sheet 17316 Sheet 17317 Sheet 17318 Sheet 17319 Sheet 17320 Sheet 17321 Sheet 17322 Sheet 17323 Sheet 17324 Sheet 17325 Sheet 17326 Sheet 17327 Sheet 17328 Sheet 17329 Sheet 17330 Sheet 17331 Sheet 17332 Sheet 17333 Sheet 17334 Sheet 17335 Sheet 17336 Sheet 17337 Sheet 17338 Sheet 17339 Sheet 17340 Sheet 17341 Sheet 17342 Sheet 17343 Sheet 17344 Sheet 17345 Sheet 17346 Sheet 17347 Sheet 17348 Sheet 17349 Sheet 17350 Sheet 17351 Sheet 17352 Sheet 17353 Sheet 17354 Sheet 17355 Sheet 17356 Sheet 17357 Sheet 17358 Sheet 17359 Sheet 17360 Sheet 17361 Sheet 17362 Sheet 17363 Sheet 17364 Sheet 17365 Sheet 17366 Sheet 17367 Sheet 17368 Sheet 17369 Sheet 17370 Sheet 17371 Sheet 17372 Sheet 17373 Sheet 17374 Sheet 17375 Sheet 17376 Sheet 17377 Sheet 17378 Sheet 17379 Sheet 17380 Sheet 17381 Sheet 17382 Sheet 17383 Sheet 17384 Sheet 17385 Sheet 17386 Sheet 17387 Sheet 17388 Sheet 17389 Sheet 17390 Sheet 17391 Sheet 17392 Sheet 17393 Sheet 17394 Sheet 17395 Sheet 17396 Sheet 17397 Sheet 17398 Sheet 17399 Sheet 17400 Sheet 17401 Sheet 17402 Sheet 17403 Sheet 17404 Sheet 17405 Sheet 17406 Sheet 17407 Sheet 17408 Sheet 17409 Sheet 17410 Sheet 17411 Sheet 17412 Sheet 17413 Sheet 17414 Sheet 17415 Sheet 17416 Sheet 17417 Sheet 17418 Sheet 17419 Sheet 17420 Sheet 17421 Sheet 17422 Sheet 17423 Sheet 17424 Sheet 17425 Sheet 17426 Sheet 17427 Sheet 17428 Sheet 17429 Sheet 17430 Sheet 17431 Sheet 17432 Sheet 17433 Sheet 17434 Sheet 17435 Sheet 17436 Sheet 17437 Sheet 17438 Sheet 17439 Sheet 17440 Sheet 17441 Sheet 17442 Sheet 17443 Sheet 17444 Sheet 17445 Sheet 17446 Sheet 17447 Sheet 17448 Sheet 17449 Sheet 17450 Sheet 17451 Sheet 17452 Sheet 17453 Sheet 17454 Sheet 17455 Sheet 17456 Sheet 17457 Sheet 17458 Sheet 17459 Sheet 17460 Sheet 17461 Sheet 17462 Sheet 17463 Sheet 17464 Sheet 17465 Sheet 17466 Sheet 17467 Sheet 17468 Sheet 17469 Sheet 17470 Sheet 17471 Sheet 17472 Sheet 17473 Sheet 17474 Sheet 17475 Sheet 17476 Sheet 17477 Sheet 17478 Sheet 17479 Sheet 17480 Sheet 17481 Sheet 17482 Sheet 17483 Sheet 17484 Sheet 17485 Sheet 17486 Sheet 17487 Sheet 17488 Sheet 17489 Sheet 17490 Sheet 17491 Sheet 17492 Sheet 17493 Sheet 17494 Sheet 17495 Sheet 17496 Sheet 17497 Sheet 17498 Sheet 17499 Sheet 17500 Sheet 17501 Sheet 17502 Sheet 17503 Sheet 17504 Sheet 17505 Sheet 17506 Sheet 17507 Sheet 17508 Sheet 17509 Sheet 17510 Sheet 17511 Sheet 17512 Sheet 17513 Sheet 17514 Sheet 17515 Sheet 17516 Sheet 17517 Sheet 17518 Sheet 17519 Sheet 17520 Sheet 17521 Sheet 17522 Sheet 17523 Sheet 17524 Sheet 17525 Sheet 17526 Sheet 17527 Sheet 17528 Sheet 17529 Sheet 17530 Sheet 17531 Sheet 17532 Sheet 17533 Sheet 17534 Sheet 17535 Sheet 17536 Sheet 17537 Sheet 17538 Sheet 17539 Sheet 17540 Sheet 17541 Sheet 17542 Sheet 17543 Sheet 17544 Sheet 17545 Sheet 17546 Sheet 17547 Sheet 17548 Sheet 17549 Sheet 17550 Sheet 17551 Sheet 17552 Sheet 17553 Sheet 17554 Sheet 17555 Sheet 17556 Sheet 17557 Sheet 17558 Sheet 17559 Sheet 17560 Sheet 17561 Sheet 17562 Sheet 17563 Sheet 17564 Sheet 17565 Sheet 17566 Sheet 17567 Sheet 17568 Sheet 17569 Sheet 17570 Sheet 17571 Sheet 17572 Sheet 17573 Sheet 17574 Sheet 17575 Sheet 17576 Sheet 17577 Sheet 17578 Sheet 17579 Sheet 17580 Sheet 17581 Sheet 17582 Sheet 17583 Sheet 17584 Sheet 17585 Sheet 17586 Sheet 17587 Sheet 17588 Sheet 17589 Sheet 17590 Sheet 17591 Sheet 17592 Sheet 17593 Sheet 17594 Sheet 17595 Sheet 17596 Sheet 17597 Sheet 17598 Sheet 17599 Sheet 17600 Sheet 17601 Sheet 17602 Sheet 17603 Sheet 17604 Sheet 17605 Sheet 17606 Sheet 17607 Sheet 17608 Sheet 17609 Sheet 17610 Sheet 17611 Sheet 17612 Sheet 17613 Sheet 17614 Sheet 17615 Sheet 17616 Sheet 17617 Sheet 17618 Sheet 17619 Sheet 17620 Sheet 17621 Sheet 17622 Sheet 17623 Sheet 17624 Sheet 17625 Sheet 17626 Sheet 17627 Sheet 17628 Sheet 17629 Sheet 17630 Sheet 17631 Sheet 17632 Sheet 17633 Sheet 17634 Sheet 17635 Sheet 17636 Sheet 17637 Sheet 17638 Sheet 17639 Sheet 17640 Sheet 17641 Sheet 17642 Sheet 17643 Sheet 17644 Sheet 17645 Sheet 17646 Sheet 17647 Sheet 17648 Sheet 17649 Sheet 17650 Sheet 17651 Sheet 17652 Sheet 17653 Sheet 17654 Sheet 17655 Sheet 17656 Sheet 17657 Sheet 17658 Sheet 17659 Sheet 17660 Sheet 17661 Sheet 17662 Sheet 17663 Sheet 17664 Sheet 17665 Sheet 17666 Sheet 17667 Sheet 17668 Sheet 17669 Sheet 17670 Sheet 17671 Sheet 17672 Sheet 17673 Sheet 17674 Sheet 17675 Sheet 17676 Sheet 17677 Sheet 17678 Sheet 17679 Sheet 17680 Sheet 17681 Sheet 17682 Sheet 17683 Sheet 17684 Sheet 17685 Sheet 17686 Sheet 17687 Sheet 17688 Sheet 17689 Sheet 17690 Sheet 17691 Sheet 17692 Sheet 17693 Sheet 17694 Sheet 17695 Sheet 17696 Sheet 17697 Sheet 17698 Sheet 17699 Sheet 17700 Sheet 17701 Sheet 17702 Sheet 17703 Sheet 17704 Sheet 17705 Sheet 17706 Sheet 17707 Sheet 17708 Sheet 17709 Sheet 17710 Sheet 17711 Sheet 17712 Sheet 17713 Sheet 17714 Sheet 17715 Sheet 17716 Sheet 17717 Sheet 17718 Sheet 17719 Sheet 17720 Sheet 17721 Sheet 17722 Sheet 17723 Sheet 17724 Sheet 17725 Sheet 17726 Sheet 17727 Sheet 17728 Sheet 17729 Sheet 17730 Sheet 17731 Sheet 17732 Sheet 17733 Sheet 17734 Sheet 17735 Sheet 17736 Sheet 17737 Sheet 17738 Sheet 17739 Sheet 17740 Sheet 17741 Sheet 17742 Sheet 17743 Sheet 17744 Sheet 17745 Sheet 17746 Sheet 17747 Sheet 17748 Sheet 17749 Sheet 17750 Sheet 17751 Sheet 17752 Sheet 17753 Sheet 17754 Sheet 17755 Sheet 17756 Sheet 17757 Sheet 17758 Sheet 17759 Sheet 17760 Sheet 17761 Sheet 17762 Sheet 17763 Sheet 17764 Sheet 17765 Sheet 17766 Sheet 17767 Sheet 17768 Sheet 17769 Sheet 17770 Sheet 17771 Sheet 17772 Sheet 17773 Sheet 17774 Sheet 17775 Sheet 17776 Sheet 17777 Sheet 17778 Sheet 17779 Sheet 17780 Sheet 17781 Sheet 17782 Sheet 17783 Sheet 17784 Sheet 17785 Sheet 17786 Sheet 17787 Sheet 17788 Sheet 17789 Sheet 17790 Sheet 17791 Sheet 17792 Sheet 17793 Sheet 17794 Sheet 17795 Sheet 17796 Sheet 17797 Sheet 17798 Sheet 17799 Sheet 17800 Sheet 17801 Sheet 17802 Sheet 17803 Sheet 17804 Sheet 17805 Sheet 17806 Sheet 17807 Sheet 17808 Sheet 17809 Sheet 17810 Sheet 17811 Sheet 17812 Sheet 17813 Sheet 17814 Sheet 17815 Sheet 17816 Sheet 17817 Sheet 17818 Sheet 17819 Sheet 17820 Sheet 17821 Sheet 17822 Sheet 17823 Sheet 17824 Sheet 17825 Sheet 17826 Sheet 17827 Sheet 17828 Sheet 17829 Sheet 17830 Sheet 17831 Sheet 17832 Sheet 17833 Sheet 17834 Sheet 17835 Sheet 17836 Sheet 17837 Sheet 17838 Sheet 17839 Sheet 17840 Sheet 17841 Sheet 17842 Sheet 17843 Sheet 17844 Sheet 17845 Sheet 17846 Sheet 17847 Sheet 17848 Sheet 17849 Sheet 17850 Sheet 17851 Sheet 17852 Sheet 17853 Sheet 17854 Sheet 17855 Sheet 17856 Sheet 17857 Sheet 17858 Sheet 17859 Sheet 17860 Sheet 17861 Sheet 17862 Sheet 17863 Sheet 17864 Sheet 17865 Sheet 17866 Sheet 17867 Sheet 17868 Sheet 17869 Sheet 17870 Sheet 17871 Sheet 17872 Sheet 17873 Sheet 17874 Sheet 17875 Sheet 17876 Sheet 17877 Sheet 17878 Sheet 17879 Sheet 17880 Sheet 17881 Sheet 17882 Sheet 17883 Sheet 17884 Sheet 17885 Sheet 17886 Sheet 17887 Sheet 17888 Sheet 17889 Sheet 17890 Sheet 17891 Sheet 17892 Sheet 17893 Sheet 17894 Sheet 17895 Sheet 17896 Sheet 17897 Sheet 17898 Sheet 17899 Sheet 17900 Sheet 17901 Sheet 17902 Sheet 17903 Sheet 17904 Sheet 17905 Sheet 17906 Sheet 17907 Sheet 17908 Sheet 17909 Sheet 17910 Sheet 17911 Sheet 17912 Sheet 17913 Sheet 17914 Sheet 17915 Sheet 17916 Sheet 17917 Sheet 17918 Sheet 17919 Sheet 17920 Sheet 17921 Sheet 17922 Sheet 17923 Sheet 17924 Sheet 17925 Sheet 17926 Sheet 17927 Sheet 17928 Sheet 17929 Sheet 17930 Sheet 17931 Sheet 17932 Sheet 17933 Sheet 17934 Sheet 17935 Sheet 17936 Sheet 17937 Sheet 17938 Sheet 17939 Sheet 17940 Sheet 17941 Sheet 17942 Sheet 17943 Sheet 17944 Sheet 17945 Sheet 17946 Sheet 17947 Sheet 17948 Sheet 17949 Sheet 17950 Sheet 17951 Sheet 17952 Sheet 17953 Sheet 17954 Sheet 17955 Sheet 17956 Sheet 17957 Sheet 17958 Sheet 17959 Sheet 17960 Sheet 17961 Sheet 17962 Sheet 17963 Sheet 17964 Sheet 17965 Sheet 17966 Sheet 17967 Sheet 17968 Sheet 17969 Sheet 17970 Sheet 17971 Sheet 17972 Sheet 17973 Sheet 17974 Sheet 17975 Sheet 17976 Sheet 17977 Sheet 17978 Sheet 17979 Sheet 17980 Sheet 17981 Sheet 17982 Sheet 17983 Sheet 17984 Sheet 17985 Sheet 17986 Sheet 17987 Sheet 17988 Sheet 17989 Sheet 17990 Sheet 17991 Sheet 17992 Sheet 17993 Sheet 17994 Sheet 17995 Sheet 17996 Sheet 17997 Sheet 17998 Sheet 17999 Sheet 18000 Sheet 18001 Sheet 18002 Sheet 18003 Sheet 18004 Sheet 18005 Sheet 18006 Sheet 18007 Sheet 18008 Sheet 18009 Sheet 18010 Sheet 18011 Sheet 18012 Sheet 18013 Sheet 18014 Sheet 18015 Sheet 18016 Sheet 18017 Sheet 18018 Sheet 18019 Sheet 18020 Sheet 18021 Sheet 18022 Sheet 18023 Sheet 18024 Sheet 18025 Sheet 18026 Sheet 18027 Sheet 18028 Sheet 18029 Sheet 18030 Sheet 18031 Sheet 18032 Sheet 18033 Sheet 18034 Sheet 18035 Sheet 18036 Sheet 18037 Sheet 18038 Sheet 18039 Sheet 18040 Sheet 18041 Sheet 18042 Sheet 18043 Sheet 18044 Sheet 18045 Sheet 18046 Sheet 18047 Sheet 18048 Sheet 18049 Sheet 18050 Sheet 18051 Sheet 18052 Sheet 18053 Sheet 18054 Sheet 18055 Sheet 18056 Sheet 18057 Sheet 18058 Sheet 18059 Sheet 18060 Sheet 18061 Sheet 18062 Sheet 18063 Sheet 18064 Sheet 18065 Sheet 18066 Sheet 18067 Sheet 18068 Sheet 18069 Sheet 18070 Sheet 18071 Sheet 18072 Sheet 18073 Sheet 18074 Sheet 18075 Sheet 18076 Sheet 18077 Sheet 18078 Sheet 18079 Sheet 18080 Sheet 18081 Sheet 18082 Sheet 18083 Sheet 18084 Sheet 18085 Sheet 18086 Sheet 18087 Sheet 18088 Sheet 18089 Sheet 18090 Sheet 18091 Sheet 18092 Sheet 18093 Sheet 18094 Sheet 18095 Sheet 18096 Sheet 18097 Sheet 18098 Sheet 18099 Sheet 18100 Sheet 18101 Sheet 18102 Sheet 18103 Sheet 18104 Sheet 18105 Sheet 18106 Sheet 18107 Sheet 18108 Sheet 18109 Sheet 18110 Sheet 18111 Sheet 18112 Sheet 18113 Sheet 18114 Sheet 18115 Sheet 18116 Sheet 18117 Sheet 18118 Sheet 18119 Sheet 18120 Sheet 18121 Sheet 18122 Sheet 18123 Sheet 18124 Sheet 18125 Sheet 18126 Sheet 18127 Sheet 18128 Sheet 18129 Sheet 18130 Sheet 18131 Sheet 18132 Sheet 18133 Sheet 18134 Sheet 18135 Sheet 18136 Sheet 18137 Sheet 18138 Sheet 18139 Sheet 18140 Sheet 18141 Sheet 18142 Sheet 18143 Sheet 18144 Sheet 18145 Sheet 18146 Sheet 18147 Sheet 18148 Sheet 18149 Sheet 18150 Sheet 18151 Sheet 18152 Sheet 18153 Sheet 18154 Sheet 18155 Sheet 18156 Sheet 18157 Sheet 18158 Sheet 18159 Sheet 18160 Sheet 18161 Sheet 18162 Sheet 18163 Sheet 18164 Sheet 18165 Sheet 18166 Sheet 18167 Sheet 18168 Sheet 18169 Sheet 18170 Sheet 18171 Sheet 18172 Sheet 18173 Sheet 18174 Sheet 18175 Sheet 18176 Sheet 18177 Sheet 18178 Sheet 18179 Sheet 18180 Sheet 18181 Sheet 18182 Sheet 18183 Sheet 18184 Sheet 18185 Sheet 18186 Sheet 18187 Sheet 18188 Sheet 18189 Sheet 18190 Sheet 18191 Sheet 18192 Sheet 18193 Sheet 18194 Sheet 18195 Sheet 18196 Sheet 18197 Sheet 18198 Sheet 18199 Sheet 18200 Sheet 18201 Sheet 18202 Sheet 18203 Sheet 18204 Sheet 18205 Sheet 18206 Sheet 18207 Sheet 18208 Sheet 18209 Sheet 18210 Sheet 18211 Sheet 18212 Sheet 18213 Sheet 18214 Sheet 18215 Sheet 18216 Sheet 18217 Sheet 18218 Sheet 18219 Sheet 18220 Sheet 18221 Sheet 18222 Sheet 18223 Sheet 18224 Sheet 18225 Sheet 18226 Sheet 18227 Sheet 18228 Sheet 18229 Sheet 18230 Sheet 18231 Sheet 18232 Sheet 18233 Sheet 18234 Sheet 18235 Sheet 18236 Sheet 18237 Sheet 18238 Sheet 18239 Sheet 18240 Sheet 18241 Sheet 18242 Sheet 18243 Sheet 18244 Sheet 18245 Sheet 18246 Sheet 18247 Sheet 18248 Sheet 18249 Sheet 18250 Sheet 18251 Sheet 18252 Sheet 18253 Sheet 18254 Sheet 18255 Sheet 18256 Sheet 18257 Sheet 18258 Sheet 18259 Sheet 18260 Sheet 18261 Sheet 18262 Sheet 18263 Sheet 18264 Sheet 18265 Sheet 18266 Sheet 18267 Sheet 18268 Sheet 18269 Sheet 18270 Sheet 18271 Sheet 18272 Sheet 18273 Sheet 18274 Sheet 18275 Sheet 18276 Sheet 18277 Sheet 18278 Sheet 18279 Sheet 18280 Sheet 18281 Sheet 18282 Sheet 18283 Sheet 18284 Sheet 18285 Sheet 18286 Sheet 18287 Sheet 18288 Sheet 18289 Sheet 18290 Sheet 18291 Sheet 18292 Sheet 18293 Sheet 18294 Sheet 18295 Sheet 18296 Sheet 18297 Sheet 18298 Sheet 18299 Sheet 18300 Sheet 18301 Sheet 18302 Sheet 18303 Sheet 18304 Sheet 18305 Sheet 18306 Sheet 18307 Sheet 18308 Sheet 18309 Sheet 18310 Sheet 18311 Sheet 18312 Sheet 18313 Sheet 18314 Sheet 18315 Sheet 18316 Sheet 18317 Sheet 18318 Sheet 18319 Sheet 18320 Sheet 18321 Sheet 18322 Sheet 18323 Sheet 18324 Sheet 18325 Sheet 18326 Sheet 18327 Sheet 18328 Sheet 18329 Sheet 18330 Sheet 18331 Sheet 18332 Sheet 18333 Sheet 18334 Sheet 18335 Sheet 18336 Sheet 18337 Sheet 18338 Sheet 18339 Sheet 18340 Sheet 18341 Sheet 18342 Sheet 18343 Sheet 18344 Sheet 18345 Sheet 18346 Sheet 18347 Sheet 18348 Sheet 18349 Sheet 18350 Sheet 18351 Sheet 18352 Sheet 18353 Sheet 18354 Sheet 18355 Sheet 18356 Sheet 18357 Sheet 18358 Sheet 18359 Sheet 18360 Sheet 18361 Sheet 18362 Sheet 18363 Sheet 18364 Sheet 18365 Sheet 18366 Sheet 18367 Sheet 18368 Sheet 18369 Sheet 18370 Sheet 18371 Sheet 18372 Sheet 18373 Sheet 18374 Sheet 18375 Sheet 18376 Sheet 18377 Sheet 18378 Sheet 18379 Sheet 18380 Sheet 18381 Sheet 18382 Sheet 18383 Sheet 18384 Sheet 18385 Sheet 18386 Sheet 18387 Sheet 18388 Sheet 18389 Sheet 18390 Sheet 18391 Sheet 18392 Sheet 18393 Sheet 18394 Sheet 18395 Sheet 18396 Sheet 18397 Sheet 18398 Sheet 18399 Sheet 18400 Sheet 18401 Sheet 18402 Sheet 18403 Sheet 18404 Sheet 18405 Sheet 18406 Sheet 18407 Sheet 18408 Sheet 18409 Sheet 18410 Sheet 18411 Sheet 18412 Sheet 18413 Sheet 18414 Sheet 18415 Sheet 18416 Sheet 18417 Sheet 18418 Sheet 18419 Sheet 18420 Sheet 18421 Sheet 18422 Sheet 18423 Sheet 18424 Sheet 18425 Sheet 18426 Sheet 18427 Sheet 18428 Sheet 18429 Sheet 18430 Sheet 18431 Sheet 18432 Sheet 18433 Sheet 18434 Sheet 18435 Sheet 18436 Sheet 18437 Sheet 18438 Sheet 18439 Sheet 18440 Sheet 18441 Sheet 18442 Sheet 18443 Sheet 18444 Sheet 18445 Sheet 18446 Sheet 18447 Sheet 18448 Sheet 18449 Sheet 18450 Sheet 18451 Sheet 18452 Sheet 18453 Sheet 18454 Sheet 18455 Sheet 18456 Sheet 18457 Sheet 18458 Sheet 18459 Sheet 18460 Sheet 18461 Sheet 18462 Sheet 18463 Sheet 18464 Sheet 18465 Sheet 18466 Sheet 18467 Sheet 18468 Sheet 18469 Sheet 18470 Sheet 18471 Sheet 18472 Sheet 18473 Sheet 18474 Sheet 18475 Sheet 18476 Sheet 18477 Sheet 18478 Sheet 18479 Sheet 18480 Sheet 18481 Sheet 18482 Sheet 18483 Sheet 18484 Sheet 18485 Sheet 18486 Sheet 18487 Sheet 18488 Sheet 18489 Sheet 18490 Sheet 18491 Sheet 18492 Sheet 18493 Sheet 18494 Sheet 18495 Sheet 18496 Sheet 18497 Sheet 18498 Sheet 18499 Sheet 18500 Sheet 18501 Sheet 18502 Sheet 18503 Sheet 18504 Sheet 18505 Sheet 18506 Sheet 18507 Sheet 18508 Sheet 18509 Sheet 18510 Sheet 18511 Sheet 18512 Sheet 18513 Sheet 18514 Sheet 18515 Sheet 18516 Sheet 18517 Sheet 18518 Sheet 18519 Sheet 18520 Sheet 18521 Sheet 18522 Sheet 18523 Sheet 18524 Sheet 18525 Sheet 18526 Sheet 18527 Sheet 18528 Sheet 18529 Sheet 18530 Sheet 18531 Sheet 18532 Sheet 18533 Sheet 18534 Sheet 18535 Sheet 18536 Sheet 18537 Sheet 18538 Sheet 18539 Sheet 18540 Sheet 18541 Sheet 18542 Sheet 18543 Sheet 18544 Sheet 18545 Sheet 18546 Sheet 18547 Sheet 18548 Sheet 18549 Sheet 18550 Sheet 18551 Sheet 18552 Sheet 18553 Sheet 18554 Sheet 18555 Sheet 18556 Sheet 18557 Sheet 18558 Sheet 18559 Sheet 18560 Sheet 18561 Sheet 18562 Sheet 18563 Sheet 18564 Sheet 18565 Sheet 18566 Sheet 18567 Sheet 18568 Sheet 18569 Sheet 18570 Sheet 18571 Sheet 18572 Sheet 18573 Sheet 18574 Sheet 18575 Sheet 18576 Sheet 18577 Sheet 18578 Sheet 18579 Sheet 18580 Sheet 18581 Sheet 18582 Sheet 18583 Sheet 18584 Sheet 18585 Sheet 18586 Sheet 18587 Sheet 18588 Sheet 18589 Sheet 18590 Sheet 18591 Sheet 18592 Sheet 18593 Sheet 18594 Sheet 18595 Sheet 18596 Sheet 18597 Sheet 18598 Sheet 18599 Sheet 18600 Sheet 18601 Sheet 18602 Sheet 18603 Sheet 18604 Sheet 18605 Sheet 18606 Sheet 18607 Sheet 18608 Sheet 18609 Sheet 18610 Sheet 18611 Sheet 18612 Sheet 18613 Sheet 18614 Sheet 18615 Sheet 18616 Sheet 18617 Sheet 18618 Sheet 18619 Sheet 18620 Sheet 18621 Sheet 18622 Sheet 18623 Sheet 18624 Sheet 18625 Sheet 18626 Sheet 18627 Sheet 18628 Sheet 18629 Sheet 18630 Sheet 18631 Sheet 18632 Sheet 18633 Sheet 18634 Sheet 18635 Sheet 18636 Sheet 18637 Sheet 18638 Sheet 18639 Sheet 18640 Sheet 18641 Sheet 18642 Sheet 18643 Sheet 18644 Sheet 18645 Sheet 18646 Sheet 18647 Sheet 18648 Sheet 18649 Sheet 18650 Sheet 18651 Sheet 18652 Sheet 18653 Sheet 18654 Sheet 18655 Sheet 18656 Sheet 18657 Sheet 18658 Sheet 18659 Sheet 18660 Sheet 18661 Sheet 18662 Sheet 18663 Sheet 18664 Sheet 18665 Sheet 18666 Sheet 18667 Sheet 18668 Sheet 18669 Sheet 18670 Sheet 18671 Sheet 18672 Sheet 18673 Sheet 18674 Sheet 18675 Sheet 18676 Sheet 18677 Sheet 18678 Sheet 18679 Sheet 18680 Sheet 18681 Sheet 18682 Sheet 18683 Sheet 18684 Sheet 18685 Sheet 18686 Sheet 18687 Sheet 18688 Sheet 18689 Sheet 18690 Sheet 18691 Sheet 18692 Sheet 18693 Sheet 18694 Sheet 18695 Sheet 18696 Sheet 18697 Sheet 18698 Sheet 18699 Sheet 18700 Sheet 18701 Sheet 18702 Sheet 18703 Sheet 18704 Sheet 18705 Sheet 18706 Sheet 18707 Sheet 18708 Sheet 18709 Sheet 18710 Sheet 18711 Sheet 18712 Sheet 18713 Sheet 18714 Sheet 18715 Sheet 18716 Sheet 18717 Sheet 18718 Sheet 18719 Sheet 18720 Sheet 18721 Sheet 18722 Sheet 18723 Sheet 18724 Sheet 18725 Sheet 18726 Sheet 18727 Sheet 18728 Sheet 18729 Sheet 18730 Sheet 18731 Sheet 18732 Sheet 18733 Sheet 18734 Sheet 18735 Sheet 18736 Sheet 18737 Sheet 18738 Sheet 18739 Sheet 18740 Sheet 18741 Sheet 18742 Sheet 18743 Sheet 18744 Sheet 18745 Sheet 18746 Sheet 18747 Sheet 18748 Sheet 18749 Sheet 18750 Sheet 18751 Sheet 18752 Sheet 18753 Sheet 18754 Sheet 18755 Sheet 18756 Sheet 18757 Sheet 18758 Sheet 18759 Sheet 18760 Sheet 18761 Sheet 18762 Sheet 18763 Sheet 18764 Sheet 18765 Sheet 18766 Sheet 18767 Sheet 18768 Sheet 18769 Sheet 18770 Sheet 18771 Sheet 18772 Sheet 18773 Sheet 18774 Sheet 18775 Sheet 18776 Sheet 18777 Sheet 18778 Sheet 18779 Sheet 18780 Sheet 18781 Sheet 18782 Sheet 18783 Sheet 18784 Sheet 18785 Sheet 18786 Sheet 18787 Sheet 18788 Sheet 18789 Sheet 18790 Sheet 18791 Sheet 18792 Sheet 18793 Sheet 18794 Sheet 18795 Sheet 18796 Sheet 18797 Sheet 18798 Sheet 18799 Sheet 18800 Sheet 18801 Sheet 18802 Sheet 18803 Sheet 18804 Sheet 18805 Sheet 18806 Sheet 18807 Sheet 18808 Sheet 18809 Sheet 18810 Sheet 18811 Sheet 18812 Sheet 18813 Sheet 18814 Sheet 18815 Sheet 18816 Sheet 18817 Sheet 18818 Sheet 18819 Sheet 18820 Sheet 18821 Sheet 18822 Sheet 18823 Sheet 18824 Sheet 18825 Sheet 18826 Sheet 18827 Sheet 18828 Sheet 18829 Sheet 18830 Sheet 18831 Sheet 18832 Sheet 18833 Sheet 18834 Sheet 18835 Sheet 18836 Sheet 18837 Sheet 18838 Sheet 18839 Sheet 18840 Sheet 18841 Sheet 18842 Sheet 18843 Sheet 18844 Sheet 18845 Sheet 18846 Sheet 18847 Sheet 18848 Sheet 18849 Sheet 18850 Sheet 18851 Sheet 18852 Sheet 18853 Sheet 18854 Sheet 18855 Sheet 18856 Sheet 18857 Sheet 18858 Sheet 18859 Sheet 18860 Sheet 18861 Sheet 18862 Sheet 18863 Sheet 18864 Sheet 18865 Sheet 18866 Sheet 18867 Sheet 18868 Sheet 18869 Sheet 18870 Sheet 18871 Sheet 18872 Sheet 18873 Sheet 18874 Sheet 18875 Sheet 18876 Sheet 18877 Sheet 18878 Sheet 18879 Sheet 18880 Sheet 18881 Sheet 18882 Sheet 18883 Sheet 18884 Sheet 18885 Sheet 18886 Sheet 18887 Sheet 18888 Sheet 18889 Sheet 18890 Sheet 18891 Sheet 18892 Sheet 18893 Sheet 18894 Sheet 18895 Sheet 18896 Sheet 18897 Sheet 18898 Sheet 18899 Sheet 18900 Sheet 18901 Sheet 18902 Sheet 18903 Sheet 18904 Sheet 18905 Sheet 18906 Sheet 18907 Sheet 18908 Sheet 18909 Sheet 18910 Sheet 18911 Sheet 18912 Sheet 18913 Sheet 18914 Sheet 18915 Sheet 18916 Sheet 18917 Sheet 18918 Sheet 18919 Sheet 18920 Sheet 18921 Sheet 18922 Sheet 18923 Sheet 18924 Sheet 18925 Sheet 18926 Sheet 18927 Sheet 18928 Sheet 18929 Sheet 18930 Sheet 18931 Sheet 18932 Sheet 18933 Sheet 18934 Sheet 18935 Sheet 18936 Sheet 18937 Sheet 18938 Sheet 18939 Sheet 18940 Sheet 18941 Sheet 18942 Sheet 18943 Sheet 18944 Sheet 18945 Sheet 18946 Sheet 18947 Sheet 18948 Sheet 18949 Sheet 18950 Sheet 18951 Sheet 18952 Sheet 18953 Sheet 18954 Sheet 18955 Sheet 18956 Sheet 18957 Sheet 18958 Sheet 18959 Sheet 18960 Sheet 18961 Sheet 18962 Sheet 18963 Sheet 18964 Sheet 18965 Sheet 18966 Sheet 18967 Sheet 18968 Sheet 18969 Sheet 18970 Sheet 18971 Sheet 18972 Sheet 18973 Sheet 18974 Sheet 18975 Sheet 18976 Sheet 18977 Sheet 18978 Sheet 18979 Sheet 18980 Sheet 18981 Sheet 18982 Sheet 18983 Sheet 18984 Sheet 18985 Sheet 18986 Sheet 18987 Sheet 18988 Sheet 18989 Sheet 18990 Sheet 18991 Sheet 18992 Sheet 18993 Sheet 18994 Sheet 18995 Sheet 18996 Sheet 18997 Sheet 18998 Sheet 18999 Sheet 19000 Sheet 19001 Sheet 19002 Sheet 19003 Sheet 19004 Sheet 19005 Sheet 19006 Sheet 19007 Sheet 19008 Sheet 19009 Sheet 19010 Sheet 19011 Sheet 19012 Sheet 19013 Sheet 19014 Sheet 19015 Sheet 19016 Sheet 19017 Sheet 19018 Sheet 19019 Sheet 19020 Sheet 19021 Sheet 19022 Sheet 19023 Sheet 19024 Sheet 19025 Sheet 19026 Sheet 19027 Sheet 19028 Sheet 19029 Sheet 19030 Sheet 19031 Sheet 19032 Sheet 19033 Sheet 19034 Sheet 19035 Sheet 19036 Sheet 19037 Sheet 19038 Sheet 19039 Sheet 19040 Sheet 19041 Sheet 19042 Sheet 19043 Sheet 19044 Sheet 19045 Sheet 19046 Sheet 19047 Sheet 19048 Sheet 19049 Sheet 19050 Sheet 19051 Sheet 19052 Sheet 19053 Sheet 19054 Sheet 19055 Sheet 19056 Sheet 19057 Sheet 19058 Sheet 19059 Sheet 19060 Sheet 19061 Sheet 19062 Sheet 19063 Sheet 19064 Sheet 19065 Sheet 19066 Sheet 19067 Sheet 19068 Sheet 19069 Sheet 19070 Sheet 19071 Sheet 19072 Sheet 19073 Sheet 19074 Sheet 19075 Sheet 19076 Sheet 19077 Sheet 19078 Sheet 19079 Sheet 19080 Sheet 19081 Sheet 19082 Sheet 19083 Sheet 19084 Sheet 19085 Sheet 19086 Sheet 19087 Sheet 19088 Sheet 19089 Sheet 19090 Sheet 19091 Sheet 19092 Sheet 19093 Sheet 19094 Sheet 19095 Sheet 19096 Sheet 19097 Sheet 19098 Sheet 19099 Sheet 19100 Sheet 19101 Sheet 19102 Sheet 19103 Sheet 19104 Sheet 19105 Sheet 19106 Sheet 19107 Sheet 19108 Sheet 19109 Sheet 19110 Sheet 19111 Sheet 19112 Sheet 19113 Sheet 19114 Sheet 19115 Sheet 19116 Sheet 19117 Sheet 19118 Sheet 19119 Sheet 19120 Sheet 19121 Sheet 19122 Sheet 19123 Sheet 19124 Sheet 19125 Sheet 19126 Sheet 19127 Sheet 19128 Sheet 19129 Sheet 19130 Sheet 19131 Sheet 19132 Sheet 19133 Sheet 19134 Sheet 19135 Sheet 19136 Sheet 19137 Sheet 19138 Sheet 19139 Sheet 19140 Sheet 19141 Sheet 19142 Sheet 19143 Sheet 19144 Sheet 19145 Sheet 19146 Sheet 19147 Sheet 19148 Sheet 19149 Sheet 19150 Sheet 19151 Sheet 19152 Sheet 19153 Sheet 19154 Sheet 19155 Sheet 19156 Sheet 19157 Sheet 19158 Sheet 19159 Sheet 19160 Sheet 19161 Sheet 19162 Sheet 19163 Sheet 19164 Sheet 19165 Sheet 19166 Sheet 19167 Sheet 19168 Sheet 19169 Sheet 19170 Sheet 19171 Sheet 19172 Sheet 19173 Sheet 19174 Sheet 19175 Sheet 19176 Sheet 19177 Sheet 19178 Sheet 19179 Sheet 19180 Sheet 19181 Sheet 19182 Sheet 19183 Sheet 19184 Sheet 19185 Sheet 19186 Sheet 19187 Sheet 19188 Sheet 19189 Sheet 19190 Sheet 19191 Sheet 19192 Sheet 19193 Sheet 19194 Sheet 19195 Sheet 19196 Sheet 19197 Sheet 19198 Sheet 19199 Sheet 19200 Sheet 19201 Sheet 19202 Sheet 19203 Sheet 19204 Sheet 19205 Sheet 19206 Sheet 19207 Sheet 19208 Sheet 19209 Sheet 19210 Sheet 19211 Sheet 19212 Sheet 19213 Sheet 19214 Sheet 19215 Sheet 19216 Sheet 19217 Sheet 19218 Sheet 19219 Sheet 19220 Sheet 19221 Sheet 19222 Sheet 19223 Sheet 19224 Sheet 19225 Sheet 19226 Sheet 19227 Sheet 19228 Sheet 19229 Sheet 19230 Sheet 19231 Sheet 19232 Sheet 19233 Sheet 19234 Sheet 19235 Sheet 19236 Sheet 19237 Sheet 19238 Sheet 19239 Sheet 19240 Sheet 19241 Sheet 19242 Sheet 19243 Sheet 19244 Sheet 19245 Sheet 19246 Sheet 19247 Sheet 19248 Sheet 19249 Sheet 19250 Sheet 19251 Sheet 19252 Sheet 19253 Sheet 19254 Sheet 19255 Sheet 19256 Sheet 19257 Sheet 19258 Sheet 19259 Sheet 19260 Sheet 19261 Sheet 19262 Sheet 19263 Sheet 19264 Sheet 19265 Sheet 19266 Sheet 19267 Sheet 19268 Sheet 19269 Sheet 19270 Sheet 19271 Sheet 19272 Sheet 19273 Sheet 19274 Sheet 19275 Sheet 19276 Sheet 19277 Sheet 19278 Sheet 19279 Sheet 19280 Sheet 19281 Sheet 19282 Sheet 19283 Sheet 19284 Sheet 19285 Sheet 19286 Sheet 19287 Sheet 19288 Sheet 19289 Sheet 19290 Sheet 19291 Sheet 19292 Sheet 19293 Sheet 19294 Sheet 19295 Sheet 19296 Sheet 19297 Sheet 19298 Sheet 19299 Sheet 19300 Sheet 19301 Sheet 19302 Sheet 19303 Sheet 19304 Sheet 19305 Sheet 19306 Sheet 19307 Sheet 19308 Sheet 19309 Sheet 19310 Sheet 19311 Sheet 19312 Sheet 19313 Sheet 19314 Sheet 19315 Sheet 19316 Sheet 19317 Sheet 19318 Sheet 19319 Sheet 19320 Sheet 19321 Sheet 19322 Sheet 19323 Sheet 19324 Sheet 19325 Sheet 19326 Sheet 19327 Sheet 19328 Sheet 19329 Sheet 19330 Sheet 19331 Sheet 19332 Sheet 19333 Sheet 19334 Sheet 19335 Sheet 19336 Sheet 19337 Sheet 19338 Sheet 19339 Sheet 19340 Sheet 19341 Sheet 19342 Sheet 19343 Sheet 19344 Sheet 19345 Sheet 19346 Sheet 19347 Sheet 19348 Sheet 19349 Sheet 19350 Sheet 19351 Sheet 19352 Sheet 19353 Sheet 19354 Sheet 19355 Sheet 19356 Sheet 19357 Sheet 19358 Sheet 19359 Sheet 19360 Sheet 19361 Sheet 19362 Sheet 19363 Sheet 19364 Sheet 19365 Sheet 19366 Sheet 19367 Sheet 19368 Sheet 19369 Sheet 19370 Sheet 19371 Sheet 19372 Sheet 19373 Sheet 19374 Sheet 19375 Sheet 19376 Sheet 19377 Sheet 19378 Sheet 19379 Sheet 19380 Sheet 19381 Sheet 19382 Sheet 19383 Sheet 19384 Sheet 19385 Sheet 19386 Sheet 19387 Sheet 19388 Sheet 19389 Sheet 19390 Sheet 19391 Sheet 19392 Sheet 19393 Sheet 19394 Sheet 19395 Sheet 19396 Sheet 19397 Sheet 19398 Sheet 19399 Sheet 19400 Sheet 19401 Sheet 19402 Sheet 19403 Sheet 19404 Sheet 19405 Sheet 19406 Sheet 19407 Sheet 19408 Sheet 19409 Sheet 19410 Sheet 19411 Sheet 19412 Sheet 19413 Sheet 19414 Sheet 19415 Sheet 19416 Sheet 19417 Sheet 19418 Sheet 19419 Sheet 19420 Sheet 19421 Sheet 19422 Sheet 19423 Sheet 19424 Sheet 19425 Sheet 19426 Sheet 19427 Sheet 19428 Sheet 19429 Sheet 19430 Sheet 19431 Sheet 19432 Sheet 19433 Sheet 19434 Sheet 19435 Sheet 19436 Sheet 19437 Sheet 19438 Sheet 19439 Sheet 19440 Sheet 19441 Sheet 19442 Sheet 19443 Sheet 19444 Sheet 19445 Sheet 19446 Sheet 19447 Sheet 19448 Sheet 19449 Sheet 19450 Sheet 19451 Sheet 19452 Sheet 19453 Sheet 19454 Sheet 19455 Sheet 19456 Sheet 19457 Sheet 19458 Sheet 19459 Sheet 19460 Sheet 19461 Sheet 19462 Sheet 19463 Sheet 19464 Sheet 19465 Sheet 19466 Sheet 19467 Sheet 19468 Sheet 19469 Sheet 19470 Sheet 19471 Sheet 19472 Sheet 19473 Sheet 19474 Sheet 19475 Sheet 19476 Sheet 19477 Sheet 19478 Sheet 19479 Sheet 19480 Sheet 19481 Sheet 19482 Sheet 19483 Sheet 19484 Sheet 19485 Sheet 19486 Sheet 19487 Sheet 19488 Sheet 19489 Sheet 19490 Sheet 19491 Sheet 19492 Sheet 19493 Sheet 19494 Sheet 19495 Sheet 19496 Sheet 19497 Sheet 19498 Sheet 19499 Sheet 19500 Sheet 19501 Sheet 19502 Sheet 19503 Sheet 19504 Sheet 19505 Sheet 19506 Sheet 19507 Sheet 19508 Sheet 19509 Sheet 19510 Sheet 19511 Sheet 19512 Sheet 19513 Sheet 19514 Sheet 19515 Sheet 19516 Sheet 19517 Sheet 19518 Sheet 19519 Sheet 19520 Sheet 19521 Sheet 19522 Sheet 19523 Sheet 19524 Sheet 19525 Sheet 19526 Sheet 19527 Sheet 19528 Sheet 19529 Sheet 19530 Sheet 19531 Sheet 19532 Sheet 19533 Sheet 19534 Sheet 19535 Sheet 19536 Sheet 19537 Sheet 19538 Sheet 19539 Sheet 19540 Sheet 19541 Sheet 19542 Sheet 19543 Sheet 19544 Sheet 19545 Sheet 19546 Sheet 19547 Sheet 19548 Sheet 19549 Sheet 19550 Sheet 19551 Sheet 19552 Sheet 19553 Sheet 19554 Sheet 19555 Sheet 19556 Sheet 19557 Sheet 19558 Sheet 19559 Sheet 19560 Sheet 19561 Sheet 19562 Sheet 19563 Sheet 19564 Sheet 19565 Sheet 19566 Sheet 19567 Sheet 19568 Sheet 19569 Sheet 19570 Sheet 19571 Sheet 19572 Sheet 19573 Sheet 19574 Sheet 19575 Sheet 19576 Sheet 19577 Sheet 19578 Sheet 19579 Sheet 19580 Sheet 19581 Sheet 19582 Sheet 19583 Sheet 19584 Sheet 19585 Sheet 19586 Sheet 19587 Sheet 19588 Sheet 19589 Sheet 19590 Sheet 19591 Sheet 19592 Sheet 19593 Sheet 19594 Sheet 19595 Sheet 19596 Sheet 19597 Sheet 19598 Sheet 19599 Sheet 19600 Sheet 19601 Sheet 19602 Sheet 19603 Sheet 19604 Sheet 19605 Sheet 19606 Sheet 19607 Sheet 19608 Sheet 19609 Sheet 19610 Sheet 19611 Sheet 19612 Sheet 19613 Sheet 19614 Sheet 19615 Sheet 19616 Sheet 19617 Sheet 19618 Sheet 19619 Sheet 19620 Sheet 19621 Sheet 19622 Sheet 19623 Sheet 19624 Sheet 19625 Sheet 19626 Sheet 19627 Sheet 19628 Sheet 19629 Sheet 19630 Sheet 19631 Sheet 19632 Sheet 19633 Sheet 19634 Sheet 19635 Sheet 19636 Sheet 19637 Sheet 19638 Sheet 19639 Sheet 19640 Sheet 19641 Sheet 19642 Sheet 19643 Sheet 19644 Sheet 19645 Sheet 19646 Sheet 19647 Sheet 19648 Sheet 19649 Sheet 19650 Sheet 19651 Sheet 19652 Sheet 19653 Sheet 19654 Sheet 19655 Sheet 19656 Sheet 19657 Sheet 19658 Sheet 19659 Sheet 19660 Sheet 19661 Sheet 19662 Sheet 19663 Sheet 19664 Sheet 19665 Sheet 19666 Sheet 19667 Sheet 19668 Sheet 19669 Sheet 19670 Sheet 19671 Sheet 19672 Sheet 19673 Sheet 19674 Sheet 19675 Sheet 19676 Sheet 19677 Sheet 19678 Sheet 19679 Sheet 19680 Sheet 19681 Sheet 19682 Sheet 19683 Sheet 19684 Sheet 19685 Sheet 19686 Sheet 19687 Sheet 19688 Sheet 19689 Sheet 19690 Sheet 19691 Sheet 19692 Sheet 19693 Sheet 19694 Sheet 19695 Sheet 19696 Sheet 19697 Sheet 19698 Sheet 19699 Sheet 19700 Sheet 19701 Sheet 19702 Sheet 19703 Sheet 19704 Sheet 19705 Sheet 19706 Sheet 19707 Sheet 19708 Sheet 19709 Sheet 19710 Sheet 19711 Sheet 19712 Sheet 19713 Sheet 19714 Sheet 19715 Sheet 19716 Sheet 19717 Sheet 19718 Sheet 19719 Sheet 19720 Sheet 19721 Sheet 19722 Sheet 19723 Sheet 19724 Sheet 19725 Sheet 19726 Sheet 19727 Sheet 19728 Sheet 19729 Sheet 19730 Sheet 19731 Sheet 19732 Sheet 19733 Sheet 19734 Sheet 19735 Sheet 19736 Sheet 19737 Sheet 19738 Sheet 19739 Sheet 19740 Sheet 19741 Sheet 19742 Sheet 19743 Sheet 19744 Sheet 19745 Sheet 19746 Sheet 19747 Sheet 19748 Sheet 19749 Sheet 19750 Sheet 19751 Sheet 19752 Sheet 19753 Sheet 19754 Sheet 19755 Sheet 19756 Sheet 19757 Sheet 19758 Sheet 19759 Sheet 19760 Sheet 19761 Sheet 19762 Sheet 19763 Sheet 19764 Sheet 19765 Sheet 19766 Sheet 19767 Sheet 19768 Sheet 19769 Sheet 19770 Sheet 19771 Sheet 19772 Sheet 19773 Sheet 19774 Sheet 19775 Sheet 19776 Sheet 19777 Sheet 19778 Sheet 19779 Sheet 19780 Sheet 19781 Sheet 19782 Sheet 19783 Sheet 19784 Sheet 19785 Sheet 19786 Sheet 19787 Sheet 19788 Sheet 19789 Sheet 19790 Sheet 19791 Sheet 19792 Sheet 19793 Sheet 19794 Sheet 19795 Sheet 19796 Sheet 19797 Sheet 19798 Sheet 19799 Sheet 19800 Sheet 19801 Sheet 19802 Sheet 19803 Sheet 19804 Sheet 19805 Sheet 19806 Sheet 19807 Sheet 19808 Sheet 19809 Sheet 19810 Sheet 19811 Sheet 19812 Sheet 19813 Sheet 19814 Sheet 19815 Sheet 19816 Sheet 19817 Sheet 19818 Sheet 19819 Sheet 19820 Sheet 19821 Sheet 19822 Sheet 19823 Sheet 19824 Sheet 19825 Sheet 19826 Sheet 19827 Sheet 19828 Sheet 19829 Sheet 19830 Sheet 19831 Sheet 19832 Sheet 19833 Sheet 19834 Sheet 19835 Sheet 19836 Sheet 19837 Sheet 19838 Sheet 19839 Sheet 19840 Sheet 19841 Sheet 19842 Sheet 19843 Sheet 19844 Sheet 19845 Sheet 19846 Sheet 19847 Sheet 19848 Sheet 19849 Sheet 19850 Sheet 19851 Sheet 19852 Sheet 19853 Sheet 19854 Sheet 19855 Sheet 19856 Sheet 19857 Sheet 19858 Sheet 19859 Sheet 19860 Sheet 19861 Sheet 19862 Sheet 19863 Sheet 19864 Sheet 19865 Sheet 19866 Sheet 19867 Sheet 19868 Sheet 19869 Sheet 19870 Sheet 19871 Sheet 19872 Sheet 19873 Sheet 19874 Sheet 19875 Sheet 19876 Sheet 19877 Sheet 19878 Sheet 19879 Sheet 19880 Sheet 19881 Sheet 19882 Sheet 19883 Sheet 19884 Sheet 19885 Sheet 19886 Sheet 19887 Sheet 19888 Sheet 19889 Sheet 19890 Sheet 19891 Sheet 19892 Sheet 19893 Sheet 19894 Sheet 19895 Sheet 19896 Sheet 19897 Sheet 19898 Sheet 19899 Sheet 19900 Sheet 19901 Sheet 19902 Sheet 19903 Sheet 19904 Sheet 19905 Sheet 19906 Sheet 19907 Sheet 19908 Sheet 19909 Sheet 19910 Sheet 19911 Sheet 19912 Sheet 19913 Sheet 19914 Sheet 19915 Sheet 19916 Sheet 19917 Sheet 19918 Sheet 19919 Sheet 19920 Sheet 19921 Sheet 19922 Sheet 19923 Sheet 19924 Sheet 19925 Sheet 19926 Sheet 19927 Sheet 19928 Sheet 19929 Sheet 19930 Sheet 19931 Sheet 19932 Sheet 19933 Sheet 19934 Sheet 19935 Sheet 19936 Sheet 19937 Sheet 19938 Sheet 19939 Sheet 19940 Sheet 19941 Sheet 19942 Sheet 19943 Sheet 19944 Sheet 19945 Sheet 19946 Sheet 19947 Sheet 19948 Sheet 19949 Sheet 19950 Sheet 19951 Sheet 19952 Sheet 19953 Sheet 19954 Sheet 19955 Sheet 19956 Sheet 19957 Sheet 19958 Sheet 19959 Sheet 19960 Sheet 19961 Sheet 19962 Sheet 19963 Sheet 19964 Sheet 19965 Sheet 19966 Sheet 19967 Sheet 19968 Sheet 19969 Sheet 19970 Sheet 19971 Sheet 19972 Sheet 19973 Sheet 19974 Sheet 19975 Sheet 19976 Sheet 19977 Sheet 19978 Sheet 19979 Sheet 19980 Sheet 19981 Sheet 19982 Sheet 19983 Sheet 19984 Sheet 19985 Sheet 19986 Sheet 19987 Sheet 19988 Sheet 19989 Sheet 19990 Sheet 19991 Sheet 19992 Sheet 19993 Sheet 19994 Sheet 19995 Sheet 19996 Sheet 19997 Sheet 19998 Sheet 19999 Sheet 20000 Sheet 20001 Sheet 20002 Sheet 20003 Sheet 20004 Sheet 20005 Sheet 20006 Sheet 20007 Sheet 20008 Sheet 20009 Sheet 20010 Sheet 20011 Sheet 20012 Sheet 20013 Sheet 20014 Sheet 20015 Sheet 20016 Sheet 20017 Sheet 20018 Sheet 20019 Sheet 20020 Sheet 20021 Sheet 20022 Sheet 20023 Sheet 20024 Sheet 20025 Sheet 20026 Sheet 20027 Sheet 20028 Sheet 20029 Sheet 20030 Sheet 20031 Sheet 20032 Sheet 20033 Sheet 20034 Sheet 20035 Sheet 20036 Sheet 20037 Sheet 20038 Sheet 20039 Sheet 20040 Sheet 20041 Sheet 20042 Sheet 20043 Sheet 20044 Sheet 20045 Sheet 20046 Sheet 20047 Sheet 20048 Sheet 20049 Sheet 20050 Sheet 20051 Sheet 20052 Sheet 20053 Sheet 20054 Sheet 20055 Sheet 20056 Sheet 20057 Sheet 20058 Sheet 20059 Sheet 20060 Sheet 20061 Sheet 20062 Sheet 20063 Sheet 20064 Sheet 20065 Sheet 20066 Sheet 20067 Sheet 20068 Sheet 20069 Sheet 20070 Sheet 20071 Sheet 20072 Sheet 20073 Sheet 20074 Sheet 20075 Sheet 20076 Sheet 20077 Sheet 20078 Sheet 20079 Sheet 20080 Sheet 20081 Sheet 20082 Sheet 20083 Sheet 20084 Sheet 20085 Sheet 20086 Sheet 20087 Sheet 20088 Sheet 20089 Sheet 20090 Sheet 20091 Sheet 20092 Sheet 20093 Sheet 20094 Sheet 20095 Sheet 20096 Sheet 20097 Sheet 20098 Sheet 20099 Sheet 20100 Sheet 20101 Sheet 20102 Sheet 20103 Sheet 20104 Sheet 20105 Sheet 20106 Sheet 20107 Sheet 20108 Sheet 20109 Sheet 20110 Sheet 20111 Sheet 20112 Sheet 20113 Sheet 20114 Sheet 20115 Sheet 20116 Sheet 20117 Sheet 20118 Sheet 20119 Sheet 20120 Sheet 20121 Sheet 20122 Sheet 20123 Sheet 20124 Sheet 20125 Sheet 20126 Sheet 20127 Sheet 20128 Sheet 20129 Sheet 20130 Sheet 20131 Sheet 20132 Sheet 20133 Sheet 20134 Sheet 20135 Sheet 20136 Sheet 20137 Sheet 20138 Sheet 20139 Sheet 20140 Sheet 20141 Sheet 20142 Sheet 20143 Sheet 20144 Sheet 20145 Sheet 20146 Sheet 20147 Sheet 20148 Sheet 20149 Sheet 20150 Sheet 20151 Sheet 20152 Sheet 20153 Sheet 20154 Sheet 20155 Sheet 20156 Sheet 20157 Sheet 20158 Sheet 20159 Sheet 20160 Sheet 20161 Sheet 20162 Sheet 20163 Sheet 20164 Sheet 20165 Sheet 20166 Sheet 20167 Sheet 20168 Sheet 20169 Sheet 20170 Sheet 20171 Sheet 20172 Sheet 20173 Sheet 20174 Sheet 20175 Sheet 20176 Sheet 20177 Sheet 20178 Sheet 20179 Sheet 20180 Sheet 20181 Sheet 20182 Sheet 20183 Sheet 20184 Sheet 20185 Sheet 20186 Sheet 20187 Sheet 20188 Sheet 20189 Sheet 20190 Sheet 20191 Sheet 20192 Sheet 20193 Sheet 20194 Sheet 20195 Sheet 20196 Sheet 20197 Sheet 20198 Sheet 20199 Sheet 20200 Sheet 20201 Sheet 20202 Sheet 20203 Sheet 20204 Sheet 20205 Sheet 20206 Sheet 20207 Sheet 20208 Sheet 20209 Sheet 20210 Sheet 20211 Sheet 20212 Sheet 20213 Sheet 20214 Sheet 20215 Sheet 20216 Sheet 20217 Sheet 20218 Sheet 20219 Sheet 20220 Sheet 20221 Sheet 20222 Sheet 20223 Sheet 20224 Sheet 20225 Sheet 20226 Sheet 20227 Sheet 20228 Sheet 20229 Sheet 20230 Sheet 20231 Sheet 20232 Sheet 20233 Sheet 20234 Sheet 20235 Sheet 20236 Sheet 20237 Sheet 20238 Sheet 20239 Sheet 20240 Sheet 20241 Sheet 20242 Sheet 20243 Sheet 20244 Sheet 20245 Sheet 20246 Sheet 20247 Sheet 20248 Sheet 20249 Sheet 20250 Sheet 20251 Sheet 20252 Sheet 20253 Sheet 20254 Sheet 20255 Sheet 20256 Sheet 20257 Sheet 20258 Sheet 20259 Sheet 20260 Sheet 20261 Sheet 20262 Sheet 20263 Sheet 20264 Sheet 20265 Sheet 20266 Sheet 20267 Sheet 20268 Sheet 20269 Sheet 20270 Sheet 20271 Sheet 20272 Sheet 20273 Sheet 20274 Sheet 20275 Sheet 20276 Sheet 20277 Sheet 20278 Sheet 20279 Sheet 20280 Sheet 20281 Sheet 20282 Sheet 20283 Sheet 20284 Sheet 20285 Sheet 20286 Sheet 20287 Sheet 20288 Sheet 20289 Sheet 20290 Sheet 20291 Sheet 20292 Sheet 20293 Sheet 20294 Sheet 20295 Sheet 20296 Sheet 20297 Sheet 20298 Sheet 20299 Sheet 20300 Sheet 20301 Sheet 20302 Sheet 20303 Sheet 20304 Sheet 20305 Sheet 20306 Sheet 20307 Sheet 20308 Sheet 20309 Sheet 20310 Sheet 20311 Sheet 20312 Sheet 20313 Sheet 20314 Sheet 20315 Sheet 20316 Sheet 20317 Sheet 20318 Sheet 20319 Sheet 20320 Sheet 20321 Sheet 20322 Sheet 20323 Sheet 20324 Sheet 20325 Sheet 20326 Sheet 20327 Sheet 20328 Sheet 20329 Sheet 20330 Sheet 20331 Sheet 20332 Sheet 20333 Sheet 20334 Sheet 20335 Sheet 20336 Sheet 20337 Sheet 20338 Sheet 20339 Sheet 20340 Sheet 20341 Sheet 20342 Sheet 20343 Sheet 20344 Sheet 20345 Sheet 20346 Sheet 20347 Sheet 20348 Sheet 20349 Sheet 20350 Sheet 20351 Sheet 20352 Sheet 20353 Sheet 20354 Sheet 20355 Sheet 20356 Sheet 20357 Sheet 20358 Sheet 20359 Sheet 20360 Sheet 20361 Sheet 20362 Sheet 20363 Sheet 20364 Sheet 20365 Sheet 20366 Sheet 20367 Sheet 20368 Sheet 20369 Sheet 20370 Sheet 20371 Sheet 20372 Sheet 20373 Sheet 20374 Sheet 20375 Sheet 20376 Sheet 20377 Sheet 20378 Sheet 20379 Sheet 20380 Sheet 20381 Sheet 20382 Sheet 20383 Sheet 20384 Sheet 20385 Sheet 20386 Sheet 20387 Sheet 20388 Sheet 20389 Sheet 20390 Sheet 20391 Sheet 20392 Sheet 20393 Sheet 20394 Sheet 20395 Sheet 20396 Sheet 20397 Sheet 20398 Sheet 20399 Sheet 20400 Sheet 20401 Sheet 20402 Sheet 20403 Sheet 20404 Sheet 20405 Sheet 20406 Sheet 20407 Sheet 20408 Sheet 20409 Sheet 20410 Sheet 20411 Sheet 20412 Sheet 20413 Sheet 20414 Sheet 20415 Sheet 20416 Sheet 20417 Sheet 20418 Sheet 20419 Sheet 20420 Sheet 20421 Sheet 20422 Sheet 20423 Sheet 20424 Sheet 20425 Sheet 20426 Sheet 20427 Sheet 20428 Sheet 20429 Sheet 20430 Sheet 20431 Sheet 20432 Sheet 20433 Sheet 20434 Sheet 20435 Sheet 20436 Sheet 20437 Sheet 20438 Sheet 20439 Sheet 20440 Sheet 20441 Sheet 20442 Sheet 20443 Sheet 20444 Sheet 20445 Sheet 20446 Sheet 20447 Sheet 20448 Sheet 20449 Sheet 20450 Sheet 20451 Sheet 20452 Sheet 20453 Sheet 20454 Sheet 20455 Sheet 20456 Sheet 20457 Sheet 20458 Sheet 20459 Sheet 20460 Sheet 20461 Sheet 20462 Sheet 20463 Sheet 20464 Sheet 20465 Sheet 20466 Sheet 20467 Sheet 20468 Sheet 20469 Sheet 20470 Sheet 20471 Sheet 20472 Sheet 20473 Sheet 20474 Sheet 20475 Sheet 20476 Sheet 20477 Sheet 20478 Sheet 20479 Sheet 20480 Sheet 20481 Sheet 20482 Sheet 20483 Sheet 20484 Sheet 20485 Sheet 20486 Sheet 20487 Sheet 20488 Sheet 20489 Sheet 20490 Sheet 20491 Sheet 20492 Sheet 20493 Sheet 20494 Sheet 20495 Sheet 20496 Sheet 20497 Sheet 20498 Sheet 20499 Sheet 20500 Sheet 20501 Sheet 20502 Sheet 20503 Sheet 20504 Sheet 20505 Sheet 20506 Sheet 20507 Sheet 20508 Sheet 20509 Sheet 20510 Sheet 20511 Sheet 20512 Sheet 20513 Sheet 20514 Sheet 20515 Sheet 20516 Sheet 20517 Sheet 20518 Sheet 20519 Sheet 20520 Sheet 20521 Sheet 20522 Sheet 20523 Sheet 20524 Sheet 20525 Sheet 20526 Sheet 20527 Sheet 20528 Sheet 20529 Sheet 20530 Sheet 20531 Sheet 20532 Sheet 20533 Sheet 20534 Sheet 20535 Sheet 20536 Sheet 20537 Sheet 20538 Sheet 20539 Sheet 20540 Sheet 20541 Sheet 20542 Sheet 20543 Sheet 20544 Sheet 20545 Sheet 20546 Sheet 20547 Sheet 20548 Sheet 20549 Sheet 20550 Sheet 20551 Sheet 20552 Sheet 20553 Sheet 20554 Sheet 20555 Sheet 20556 Sheet 20557 Sheet 20558 Sheet 20559 Sheet 20560 Sheet 20561 Sheet 20562 Sheet 20563 Sheet 20564 Sheet 20565 Sheet 20566 Sheet 20567 Sheet 20568 Sheet 20569 Sheet 20570 Sheet 20571 Sheet 20572 Sheet 20573 Sheet 20574 Sheet 20575 Sheet 20576 Sheet 20577 Sheet 20578 Sheet 20579 Sheet 20580 Sheet 20581 Sheet 20582 Sheet 20583 Sheet 20584 Sheet 20585 Sheet 20586 Sheet 20587 Sheet 20588 Sheet 20589 Sheet 20590 Sheet 20591 Sheet 20592 Sheet 20593 Sheet 20594 Sheet 20595 Sheet 20596 Sheet 20597 Sheet 20598 Sheet 20599 Sheet 20600 Sheet 20601 Sheet 20602 Sheet 20603 Sheet 20604 Sheet 20605 Sheet 20606 Sheet 20607 Sheet 20608 Sheet 20609 Sheet 20610 Sheet 20611 Sheet 20612 Sheet 20613 Sheet 20614 Sheet 20615 Sheet 20616 Sheet 20617 Sheet 20618 Sheet 20619 Sheet 20620 Sheet 20621 Sheet 20622 Sheet 20623 Sheet 20624 Sheet 20625 Sheet 20626 Sheet 20627 Sheet 20628 Sheet 20629 Sheet 20630 Sheet 20631 Sheet 20632 Sheet 20633 Sheet 20634 Sheet 20635 Sheet 20636 Sheet 20637 Sheet 20638 Sheet 20639 Sheet 20640 Sheet 20641 Sheet 20642 Sheet 20643 Sheet 20644 Sheet 20645 Sheet 20646 Sheet 20647 Sheet 20648 Sheet 20649 Sheet 20650 Sheet 20651 Sheet 20652 Sheet 20653 Sheet 20654 Sheet 20655 Sheet 20656 Sheet 20657 Sheet 20658 Sheet 20659 Sheet 20660 Sheet 20661 Sheet 20662 Sheet 20663 Sheet 20664 Sheet 20665 Sheet 20666 Sheet 20667 Sheet 20668 Sheet 20669 Sheet 20670 Sheet 20671 Sheet 20672 Sheet 20673 Sheet 20674 Sheet 20675 Sheet 20676 Sheet 20677 Sheet 20678 Sheet 20679 Sheet 20680 Sheet 20681 Sheet 20682 Sheet 20683 Sheet 20684 Sheet 20685 Sheet 20686 Sheet 20687 Sheet 20688 Sheet 20689 Sheet 20690 Sheet 20691 Sheet 20692 Sheet 20693 Sheet 20694 Sheet 20695 Sheet 20696 Sheet 20697 Sheet 20698 Sheet 20699 Sheet 20700 Sheet 20701 Sheet 20702 Sheet 20703 Sheet 20704 Sheet 20705 Sheet 20706 Sheet 20707 Sheet 20708 Sheet 20709 Sheet 20710 Sheet 20711 Sheet 20712 Sheet 20713 Sheet 20714 Sheet 20715 Sheet 20716 Sheet 20717 Sheet 20718 Sheet 20719 Sheet 20720 Sheet 20721 Sheet 20722 Sheet 20723 Sheet 20724 Sheet 20725 Sheet 20726 Sheet 20727 Sheet 20728 Sheet 20729 Sheet 20730 Sheet 20731 Sheet 20732 Sheet 20733 Sheet 20734 Sheet 20735 Sheet 20736 Sheet 20737 Sheet 20738 Sheet 20739 Sheet 20740 Sheet 20741 Sheet 20742 Sheet 20743 Sheet 20744 Sheet 20745 Sheet 20746 Sheet 20747 Sheet 20748 Sheet 20749 Sheet 20750 Sheet 20751 Sheet 20752 Sheet 20753 Sheet 20754 Sheet 20755 Sheet 20756 Sheet 20757 Sheet 20758 Sheet 20759 Sheet 20760 Sheet 20761 Sheet 20762 Sheet 20763 Sheet 20764 Sheet 20765 Sheet 20766 Sheet 20767 Sheet 20768 Sheet 20769 Sheet 20770 Sheet 20771 Sheet 20772 Sheet 20773 Sheet 20774 Sheet 20775 Sheet 20776 Sheet 20777 Sheet 20778 Sheet 20779 Sheet 20780 Sheet 20781 Sheet 20782 Sheet 20783 Sheet 20784 Sheet 20785 Sheet 20786 Sheet 20787 Sheet 20788 Sheet 20789 Sheet 20790 Sheet 20791 Sheet 20792 Sheet 20793 Sheet 20794 Sheet 20795 Sheet 20796 Sheet 20797 Sheet 20798 Sheet 20799 Sheet 20800 Sheet 20801 Sheet 20802 Sheet 20803 Sheet 20804 Sheet 20805 Sheet 20806 Sheet 20807 Sheet 20808 Sheet 20809 Sheet 20810 Sheet 20811 Sheet 20812 Sheet 20813 Sheet 20814 Sheet 20815 Sheet 20816 Sheet 20817 Sheet 20818 Sheet 20819 Sheet 20820 Sheet 20821 Sheet 20822 Sheet 20823 Sheet 20824 Sheet 20825 Sheet 20826 Sheet 20827 Sheet 20828 Sheet 20829 Sheet 20830 Sheet 20831 Sheet 20832 Sheet 20833 Sheet 20834 Sheet 20835 Sheet 20836 Sheet 20837 Sheet 20838 Sheet 20839 Sheet 20840 Sheet 20841 Sheet 20842 Sheet 20843 Sheet 20844 Sheet 20845 Sheet 20846 Sheet 20847 Sheet 20848 Sheet 20849 Sheet 20850 Sheet 20851 Sheet 20852 Sheet 20853 Sheet 20854 Sheet 20855 Sheet 20856 Sheet 20857 Sheet 20858 Sheet 20859 Sheet 20860 Sheet 20861 Sheet 20862 Sheet 20863 Sheet 20864 Sheet 20865 Sheet 20866 Sheet 20867 Sheet 20868 Sheet 20869 Sheet 20870 Sheet 20871 Sheet 20872 Sheet 20873 Sheet 20874 Sheet 20875 Sheet 20876 Sheet 20877 Sheet 20878 Sheet 20879 Sheet 20880 Sheet 20881 Sheet 20882 Sheet 20883 Sheet 20884 Sheet 20885 Sheet 20886 Sheet 20887 Sheet 20888 Sheet 20889 Sheet 20890 Sheet 20891 Sheet 20892 Sheet 20893 Sheet 20894 Sheet 20895 Sheet 20896 Sheet 20897 Sheet 20898 Sheet 20899 Sheet 20900 Sheet 20901 Sheet 20902 Sheet 20903 Sheet 20904 Sheet 20905 Sheet 20906 Sheet 20907 Sheet 20908 Sheet 20909 Sheet 20910 Sheet 20911 Sheet 20912 Sheet 20913 Sheet 20914 Sheet 20915 Sheet 20916 Sheet 20917 Sheet 20918 Sheet 20919 Sheet 20920 Sheet 20921 Sheet 20922 Sheet 20923 Sheet 20924 Sheet 20925 Sheet 20926 Sheet 20927 Sheet 20928 Sheet 20929 Sheet 20930 Sheet 20931 Sheet 20932 Sheet 20933 Sheet 20934 Sheet 20935 Sheet 20936 Sheet 20937 Sheet 20938 Sheet 20939 Sheet 20940 Sheet 20941 Sheet 20942 Sheet 20943 Sheet 20944 Sheet 20945 Sheet 20946 Sheet 20947 Sheet 20948 Sheet 20949 Sheet 20950 Sheet 20951 Sheet 20952 Sheet 20953 Sheet 20954 Sheet 20955 Sheet 20956 Sheet 20957 Sheet 20958 Sheet 20959 Sheet 20960 Sheet 20961 Sheet 20962 Sheet 20963 Sheet 20964 Sheet 20965 Sheet 20966 Sheet 20967 Sheet 20968 Sheet 20969 Sheet 20970 Sheet 20971 Sheet 20972 Sheet 20973 Sheet 20974 Sheet 20975 Sheet 20976 Sheet 20977 Sheet 20978 Sheet 20979 Sheet 20980 Sheet 20981 Sheet 20982 Sheet 20983 Sheet 20984 Sheet 20985 Sheet 20986 Sheet 20987 Sheet 20988 Sheet 20989 Sheet 20990 Sheet 20991 Sheet 20992 Sheet 20993 Sheet 20994 Sheet 20995 Sheet 20996 Sheet 20997 Sheet 20998 Sheet 20999 Sheet 21000 Sheet 21001 Sheet 21002 Sheet 21003 Sheet 21004 Sheet 21005 Sheet 21006 Sheet 21007 Sheet 21008 Sheet 21009 Sheet 21010 Sheet 21011 Sheet 21012 Sheet 21013 Sheet 21014 Sheet 21015 Sheet 21016 Sheet 21017 Sheet 21018 Sheet 21019 Sheet 21020 Sheet 21021 Sheet 21022 Sheet 21023 Sheet 21024 Sheet 21025 Sheet 21026 Sheet 21027 Sheet 21028 Sheet 21029 Sheet 21030 Sheet 21031 Sheet 21032 Sheet 21033 Sheet 21034 Sheet 21035 Sheet 21036 Sheet 21037 Sheet 21038 Sheet 21039 Sheet 21040 Sheet 21041 Sheet 21042 Sheet 21043 Sheet 21044 Sheet 21045 Sheet 21046 Sheet 21047 Sheet 21048 Sheet 21049 Sheet 21050 Sheet 21051 Sheet 21052 Sheet 21053 Sheet 21054 Sheet 21055 Sheet 21056 Sheet 21057 Sheet 21058 Sheet 21059 Sheet 21060 Sheet 21061 Sheet 21062 Sheet 21063 Sheet 21064 Sheet 21065 Sheet 21066 Sheet 21067 Sheet 21068 Sheet 21069 Sheet 21070 Sheet 21071 Sheet 21072 Sheet 21073 Sheet 21074 Sheet 21075 Sheet 21076 Sheet 21077 Sheet 21078 Sheet 21079 Sheet 21080 Sheet 21081 Sheet 21082 Sheet 21083 Sheet 21084 Sheet 21085 Sheet 21086 Sheet 21087 Sheet 21088 Sheet 21089 Sheet 21090 Sheet 21091 Sheet 21092 Sheet 21093 Sheet 21094 Sheet 21095 Sheet 21096 Sheet 21097 Sheet 21098 Sheet 21099 Sheet 21100 Sheet 21101 Sheet 21102 Sheet 21103 Sheet 21104 Sheet 21105 Sheet 21106 Sheet 21107 Sheet 21108 Sheet 21109 Sheet 21110 Sheet 21111 Sheet 21112 Sheet 21113 Sheet 21114 Sheet 21115 Sheet 21116 Sheet 21117 Sheet 21118 Sheet 21119 Sheet 21120 Sheet 21121 Sheet 21122 Sheet 21123 Sheet 21124 Sheet 21125 Sheet 21126 Sheet 21127 Sheet 21128 Sheet 21129 Sheet 21130 Sheet 21131 Sheet 21132 Sheet 21133 Sheet 21134 Sheet 21135 Sheet 21136 Sheet 21137 Sheet 21138 Sheet 21139 Sheet 21140 Sheet 21141 Sheet 21142 Sheet 21143 Sheet 21144 Sheet 21145 Sheet 21146 Sheet 21147 Sheet 21148 Sheet 21149 Sheet 21150 Sheet 21151 Sheet 21152 Sheet 21153 Sheet 21154 Sheet 21155 Sheet 21156 Sheet 21157 Sheet 21158 Sheet 21159 Sheet 21160 Sheet 21161 Sheet 21162 Sheet 21163 Sheet 21164 Sheet 21165 Sheet 21166 Sheet 21167 Sheet 21168 Sheet 21169 Sheet 21170 Sheet 21171 Sheet 21172 Sheet 21173 Sheet 21174 Sheet 21175 Sheet 21176 Sheet 21177 Sheet 21178 Sheet 21179 Sheet 21180 Sheet 21181 Sheet 21182 Sheet 21183 Sheet 21184 Sheet 21185 Sheet 21186 Sheet 21187 Sheet 21188 Sheet 21189 Sheet 21190 Sheet 21191 Sheet 21192 Sheet 21193 Sheet 21194 Sheet 21195 Sheet 21196 Sheet 21197 Sheet 21198 Sheet 21199 Sheet 21200 Sheet 21201 Sheet 21202 Sheet 21203 Sheet 21204 Sheet 21205 Sheet 21206 Sheet 21207 Sheet 21208 Sheet 21209 Sheet 21210 Sheet 21211 Sheet 21212 Sheet 21213 Sheet 21214 Sheet 21215 Sheet 21216 Sheet 21217 Sheet 21218 Sheet 21219 Sheet 21220 Sheet 21221 Sheet 21222 Sheet 21223 Sheet 21224 Sheet 21225 Sheet 21226 Sheet 21227 Sheet 21228 Sheet 21229 Sheet 21230 Sheet 21231 Sheet 21232 Sheet 21233 Sheet 21234 Sheet 21235 Sheet 21236 Sheet 21237 Sheet 21238 Sheet 21239 Sheet 21240 Sheet 21241 Sheet 21242 Sheet 21243 Sheet 21244 Sheet 21245 Sheet 21246 Sheet 21247 Sheet 21248 Sheet 21249 Sheet 21250 Sheet 21251 Sheet 21252 Sheet 21253 Sheet 21254 Sheet 21255 Sheet 21256 Sheet 21257 Sheet 21258 Sheet 21259 Sheet 21260 Sheet 21261 Sheet 21262 Sheet 21263 Sheet 21264 Sheet 21265 Sheet 21266 Sheet 21267 Sheet 21268 Sheet 21269 Sheet 21270 Sheet 21271 Sheet 21272 Sheet 21273 Sheet 21274 Sheet 21275 Sheet 21276 Sheet 21277 Sheet 21278 Sheet 21279 Sheet 21280 Sheet 21281 Sheet 21282 Sheet 21283 Sheet 21284 Sheet 21285 Sheet 21286 Sheet 21287 Sheet 21288 Sheet 21289 Sheet 21290 Sheet 21291 Sheet 21292 Sheet 21293 Sheet 21294 Sheet 21295 Sheet 21296 Sheet 21297 Sheet 21298 Sheet 21299 Sheet 21300 Sheet 21301 Sheet 21302 Sheet 21303 Sheet 21304 Sheet 21305 Sheet 21306 Sheet 21307 Sheet 21308 Sheet 21309 Sheet 21310 Sheet 21311 Sheet 21312 Sheet 21313 Sheet 21314 Sheet 21315 Sheet 21316 Sheet 21317 Sheet 21318 Sheet 21319 Sheet 21320 Sheet 21321 Sheet 21322 Sheet 21323 Sheet 21324 Sheet 21325 Sheet 21326 Sheet 21327 Sheet 21328 Sheet 21329 Sheet 21330 Sheet 21331 Sheet 21332 Sheet 21333 Sheet 21334 Sheet 21335 Sheet 21336 Sheet 21337 Sheet 21338 Sheet 21339 Sheet 21340 Sheet 21341 Sheet 21342 Sheet 21343 Sheet 21344 Sheet 21345 Sheet 21346 Sheet 21347 Sheet 21348 Sheet 21349 Sheet 21350 Sheet 21351 Sheet 21352 Sheet 21353 Sheet 21354 Sheet 21355 Sheet 21356 Sheet 21357 Sheet 21358 Sheet 21359 Sheet 21360 Sheet 21361 Sheet 21362 Sheet 21363 Sheet 21364 Sheet 21365 Sheet 21366 Sheet 21367 Sheet 21368 Sheet 21369 Sheet 21370 Sheet 21371 Sheet 21372 Sheet 21373 Sheet 21374 Sheet 21375 Sheet 21376 Sheet 21377 Sheet 21378 Sheet 21379 Sheet 21380 Sheet 21381 Sheet 21382 Sheet 21383 Sheet 21384 Sheet 21385 Sheet 21386 Sheet 21387 Sheet 21388 Sheet 21389 Sheet 21390 Sheet 21391 Sheet 21392 Sheet 21393 Sheet 21394 Sheet 21395 Sheet 21396 Sheet 21397 Sheet 21398 Sheet 21399 Sheet 21400 Sheet 21401 Sheet 21402 Sheet 21403 Sheet 21404 Sheet 21405 Sheet 21406 Sheet 21407 Sheet 21408 Sheet 21409 Sheet 21410 Sheet 21411 Sheet 21412 Sheet 21413 Sheet 21414 Sheet 21415 Sheet 21416 Sheet 21417 Sheet 21418 Sheet 21419 Sheet 21420 Sheet 21421 Sheet 21422 Sheet 21423 Sheet 21424 Sheet 21425 Sheet 21426 Sheet 21427 Sheet 21428 Sheet 21429 Sheet 21430 Sheet 21431 Sheet 21432 Sheet 21433 Sheet 21434 Sheet 21435 Sheet 21436 Sheet 21437 Sheet 21438 Sheet 21439 Sheet 21440 Sheet 21441 Sheet 21442 Sheet 21443 Sheet 21444 Sheet 21445 Sheet 21446 Sheet 21447 Sheet 21448 Sheet 21449 Sheet 21450 Sheet 21451 Sheet 21452 Sheet 21453 Sheet 21454 Sheet 21455 Sheet 21456 Sheet 21457 Sheet 21458 Sheet 21459 Sheet 21460 Sheet 21461 Sheet 21462 Sheet 21463 Sheet 21464 Sheet 21465 Sheet 21466 Sheet 21467 Sheet 21468 Sheet 21469 Sheet 21470 Sheet 21471 Sheet 21472 Sheet 21473 Sheet 21474 Sheet 21475 Sheet 21476 Sheet 21477 Sheet 21478 Sheet 21479 Sheet 21480 Sheet 21481 Sheet 21482 Sheet 21483 Sheet 21484 Sheet 21485 Sheet 21486 Sheet 21487 Sheet 21488 Sheet 21489 Sheet 21490 Sheet 21491 Sheet 21492 Sheet 21493 Sheet 21494 Sheet 21495 Sheet 21496 Sheet 21497 Sheet 21498 Sheet 21499 Sheet 21500 Sheet 21501 Sheet 21502 Sheet 21503 Sheet 21504 Sheet 21505 Sheet 21506 Sheet 21507 Sheet 21508 Sheet 21509 Sheet 21510 Sheet 21511 Sheet 21512 Sheet 21513 Sheet 21514 Sheet 21515 Sheet 21516 Sheet 21517 Sheet 21518 Sheet 21519 Sheet 21520 Sheet 21521 Sheet 21522 Sheet 21523 Sheet 21524 Sheet 21525 Sheet 21526 Sheet 21527 Sheet 21528 Sheet 21529 Sheet 21530 Sheet 21531 Sheet 21532 Sheet 21533 Sheet 21534 Sheet 21535 Sheet 21536 Sheet 21537 Sheet 21538 Sheet 21539 Sheet 21540 Sheet 21541 Sheet 21542 Sheet 21543 Sheet 21544 Sheet 21545 Sheet 21546 Sheet 21547 Sheet 21548 Sheet 21549 Sheet 21550 Sheet 21551 Sheet 21552 Sheet 21553 Sheet 21554 Sheet 21555 Sheet 21556 Sheet 21557 Sheet 21558 Sheet 21559 Sheet 21560 Sheet 21561 Sheet 21562 Sheet 21563 Sheet 21564 Sheet 21565 Sheet 21566 Sheet 21567 Sheet 21568 Sheet 21569 Sheet 21570 Sheet 21571 Sheet 21572 Sheet 21573 Sheet 21574 Sheet 21575 Sheet 21576 Sheet 21577 Sheet 21578 Sheet 21579 Sheet 21580 Sheet 21581 Sheet 21582 Sheet 21583 Sheet 21584 Sheet 21585 Sheet 21586 Sheet 21587 Sheet 21588 Sheet 21589 Sheet 21590 Sheet 21591 Sheet 21592 Sheet 21593 Sheet 21594 Sheet 21595 Sheet 21596 Sheet 21597 Sheet 21598 Sheet 21599 Sheet 21600 Sheet 21601 Sheet 21602 Sheet 21603 Sheet 21604 Sheet 21605 Sheet 21606 Sheet 21607 Sheet 21608 Sheet 21609 Sheet 21610 Sheet 21611 Sheet 21612 Sheet 21613 Sheet 21614 Sheet 21615 Sheet 21616 Sheet 21617 Sheet 21618 Sheet 21619 Sheet 21620 Sheet 21621 Sheet 21622 Sheet 21623 Sheet 21624 Sheet 21625 Sheet 21626 Sheet 21627 Sheet 21628 Sheet 21629 Sheet 21630 Sheet 21631 Sheet 21632 Sheet 21633 Sheet 21634 Sheet 21635 Sheet 21636 Sheet 21637 Sheet 21638 Sheet 21639 Sheet 21640 Sheet 21641 Sheet 21642 Sheet 21643 Sheet 21644 Sheet 21645 Sheet 21646 Sheet 21647 Sheet 21648 Sheet 21649 Sheet 21650 Sheet 21651 Sheet 21652 Sheet 21653 Sheet 21654 Sheet 21655 Sheet 21656 Sheet 21657 Sheet 21658 Sheet 21659 Sheet 21660 Sheet 21661 Sheet 21662 Sheet 21663 Sheet 21664 Sheet 21665 Sheet 21666 Sheet 21667 Sheet 21668 Sheet 21669 Sheet 21670 Sheet 21671 Sheet 21672 Sheet 21673 Sheet 21674 Sheet 21675 Sheet 21676 Sheet 21677 Sheet 21678 Sheet 21679 Sheet 21680 Sheet 21681 Sheet 21682 Sheet 21683 Sheet 21684 Sheet 21685 Sheet 21686 Sheet 21687 Sheet 21688 Sheet 21689 Sheet 21690 Sheet 21691 Sheet 21692 Sheet 21693 Sheet 21694 Sheet 21695 Sheet 21696 Sheet 21697 Sheet 21698 Sheet 21699 Sheet 21700 Sheet 21701 Sheet 21702 Sheet 21703 Sheet 21704 Sheet 21705 Sheet 21706 Sheet 21707 Sheet 21708 Sheet 21709 Sheet 21710 Sheet 21711 Sheet 21712 Sheet 21713 Sheet 21714 Sheet 21715 Sheet 21716 Sheet 21717 Sheet 21718 Sheet 21719 Sheet 21720 Sheet 21721 Sheet 21722 Sheet 21723 Sheet 21724 Sheet 21725 Sheet 21726 Sheet 21727 Sheet 21728 Sheet 21729 Sheet 21730 Sheet 21731 Sheet 21732 Sheet 21733 Sheet 21734 Sheet 21735 Sheet 21736 Sheet 21737 Sheet 21738 Sheet 21739 Sheet 21740 Sheet 21741 Sheet 21742 Sheet 21743 Sheet 21744 Sheet 21745 Sheet 21746 Sheet 21747 Sheet 21748 Sheet 21749 Sheet 21750 Sheet 21751 Sheet 21752 Sheet 21753 Sheet 21754 Sheet 21755 Sheet 21756 Sheet 21757 Sheet 21758 Sheet 21759 Sheet 21760 Sheet 21761 Sheet 21762 Sheet 21763 Sheet 21764 Sheet 21765 Sheet 21766 Sheet 21767 Sheet 21768 Sheet 21769 Sheet 21770 Sheet 21771 Sheet 21772 Sheet 21773 Sheet 21774 Sheet 21775 Sheet 21776 Sheet 21777 Sheet 21778 Sheet 21779 Sheet 21780 Sheet 21781 Sheet 21782 Sheet 21783 Sheet 21784 Sheet 21785 Sheet 21786 Sheet 21787 Sheet 21788 Sheet 21789 Sheet 21790 Sheet 21791 Sheet 21792 Sheet 21793 Sheet 21794 Sheet 21795 Sheet 21796 Sheet 21797 Sheet 21798 Sheet 21799 Sheet 21800 Sheet 21801 Sheet 21802 Sheet 21803 Sheet 21804 Sheet 21805 Sheet 21806 Sheet 21807 Sheet 21808 Sheet 21809 Sheet 21810 Sheet 21811 Sheet 21812 Sheet 21813 Sheet 21814 Sheet 21815 Sheet 21816 Sheet 21817 Sheet 21818 Sheet 21819 Sheet 21820 Sheet 21821 Sheet 21822 Sheet 21823 Sheet 21824 Sheet 21825 Sheet 21826 Sheet 21827 Sheet 21828 Sheet 21829 Sheet 21830 Sheet 21831 Sheet 21832 Sheet 21833 Sheet 21834 Sheet 21835 Sheet 21836 Sheet 21837 Sheet 21838 Sheet 21839 Sheet 21840 Sheet 21841 Sheet 21842 Sheet 21843 Sheet 21844 Sheet 21845 Sheet 21846 Sheet 21847 Sheet 21848 Sheet 21849 Sheet 21850 Sheet 21851 Sheet 21852 Sheet 21853 Sheet 21854 Sheet 21855 Sheet 21856 Sheet 21857 Sheet 21858 Sheet 21859 Sheet 21860 Sheet 21861 Sheet 21862 Sheet 21863 Sheet 21864 Sheet 21865 Sheet 21866 Sheet 21867 Sheet 21868 Sheet 21869 Sheet 21870 Sheet 21871 Sheet 21872 Sheet 21873 Sheet 21874 Sheet 21875 Sheet 21876 Sheet 21877 Sheet 21878 Sheet 21879 Sheet 21880 Sheet 21881 Sheet 21882 Sheet 21883 Sheet 21884 Sheet 21885 Sheet 21886 Sheet 21887 Sheet 21888 Sheet 21889 Sheet 21890 Sheet 21891 Sheet 21892 Sheet 21893 Sheet 21894 Sheet 21895 Sheet 21896 Sheet 21897 Sheet 21898 Sheet 21899 Sheet 21900 Sheet 21901 Sheet 21902 Sheet 21903 Sheet 21904 Sheet 21905 Sheet 21906 Sheet 21907 Sheet 21908 Sheet 21909 Sheet 21910 Sheet 21911 Sheet 21912 Sheet 21913 Sheet 21914 Sheet 21915 Sheet 21916 Sheet 21917 Sheet 21918 Sheet 21919 Sheet 21920 Sheet 21921 Sheet 21922 Sheet 21923 Sheet 21924 Sheet 21925 Sheet 21926 Sheet 21927 Sheet 21928 Sheet 21929 Sheet 21930 Sheet 21931 Sheet 21932 Sheet 21933 Sheet 21934 Sheet 21935 Sheet 21936 Sheet 21937 Sheet 21938 Sheet 21939 Sheet 21940 Sheet 21941 Sheet 21942 Sheet 21943 Sheet 21944 Sheet 21945 Sheet 21946 Sheet 21947 Sheet 21948 Sheet 21949 Sheet 21950 Sheet 21951 Sheet 21952 Sheet 21953 Sheet 21954 Sheet 21955 Sheet 21956 Sheet 21957 Sheet 21958 Sheet 21959 Sheet 21960 Sheet 21961 Sheet 21962 Sheet 21963 Sheet 21964 Sheet 21965 Sheet 21966 Sheet 21967 Sheet 21968 Sheet 21969 Sheet 21970 Sheet 21971 Sheet 21972 Sheet 21973 Sheet 21974 Sheet 21975 Sheet 21976 Sheet 21977 Sheet 21978 Sheet 21979 Sheet 21980 Sheet 21981 Sheet 21982 Sheet 21983 Sheet 21984 Sheet 21985 Sheet 21986 Sheet 21987 Sheet 21988 Sheet 21989 Sheet 21990 Sheet 21991 Sheet 21992 Sheet 21993 Sheet 21994 Sheet 21995 Sheet 21996 Sheet 21997 Sheet 21998 Sheet 21999 Sheet 22000 Sheet 22001 Sheet 22002 Sheet 22003 Sheet 22004 Sheet 22005 Sheet 22006 Sheet 22007 Sheet 22008 Sheet 22009 Sheet 22010 Sheet 22011 Sheet 22012 Sheet 22013 Sheet 22014 Sheet 22015 Sheet 22016 Sheet 22017 Sheet 22018 Sheet 22019 Sheet 22020 Sheet 22021 Sheet 22022 Sheet 22023 Sheet 22024 Sheet 22025 Sheet 22026 Sheet 22027 Sheet 22028 Sheet 22029 Sheet 22030 Sheet 22031 Sheet 22032 Sheet 22033 Sheet 22034 Sheet 22035 Sheet 22036 Sheet 22037 Sheet 22038 Sheet 22039 Sheet 22040 Sheet 22041 Sheet 22042 Sheet 22043 Sheet 22044 Sheet 22045 Sheet 22046 Sheet 22047 Sheet 22048 Sheet 22049 Sheet 22050 Sheet 22051 Sheet 22052 Sheet 22053 Sheet 22054 Sheet 22055 Sheet 22056 Sheet 22057 Sheet 22058 Sheet 22059 Sheet 22060 Sheet 22061 Sheet 22062 Sheet 22063 Sheet 22064 Sheet 22065 Sheet 22066 Sheet 22067 Sheet 22068 Sheet 22069 Sheet 22070 Sheet 22071 Sheet 22072 Sheet 22073 Sheet 22074 Sheet 22075 Sheet 22076 Sheet 22077 Sheet 22078 Sheet 22079 Sheet 22080 Sheet 22081 Sheet 22082 Sheet 22083 Sheet 22084 Sheet 22085 Sheet 22086 Sheet 22087 Sheet 22088 Sheet 22089 Sheet 22090 Sheet 22091 Sheet 22092 Sheet 22093 Sheet 22094 Sheet 22095 Sheet 22096 Sheet 22097 Sheet 22098 Sheet 22099 Sheet 22100 Sheet 22101 Sheet 22102 Sheet 22103 Sheet 22104 Sheet 22105 Sheet 22106 Sheet 22107 Sheet 22108 Sheet 22109 Sheet 22110 Sheet 22111 Sheet 22112 Sheet 22113 Sheet 22114 Sheet 22115 Sheet 22116 Sheet 22117 Sheet 22118 Sheet 22119 Sheet 22120 Sheet 22121 Sheet 22122 Sheet 22123 Sheet 22124 Sheet 22125 Sheet 22126 Sheet 22127 Sheet 22128 Sheet 22129 Sheet 22130 Sheet 22131 Sheet 22132 Sheet 22133 Sheet 22134 Sheet 22135 Sheet 22136 Sheet 22137 Sheet 22138 Sheet 22139 Sheet 22140 Sheet 22141 Sheet 22142 Sheet 22143 Sheet 22144 Sheet 22145 Sheet 22146 Sheet 22147 Sheet 22148 Sheet 22149 Sheet 22150 Sheet 22151 Sheet 22152 Sheet 22153 Sheet 22154 Sheet 22155 Sheet 22156 Sheet 22157 Sheet 22158 Sheet 22159 Sheet 22160 Sheet 22161 Sheet 22162 Sheet 22163 Sheet 22164 Sheet 22165 Sheet 22166 Sheet 22167 Sheet 22168 Sheet 22169 Sheet 22170 Sheet 22171 Sheet 22172 Sheet 22173 Sheet 22174 Sheet 22175 Sheet 22176 Sheet 22177 Sheet 22178 Sheet 22179 Sheet 22180 Sheet 22181 Sheet 22182 Sheet 22183 Sheet 22184 Sheet 22185 Sheet 22186 Sheet 22187 Sheet 22188 Sheet 22189 Sheet 22190 Sheet 22191 Sheet 22192 Sheet 22193 Sheet 22194 Sheet 22195 Sheet 22196 Sheet 22197 Sheet 22198 Sheet 22199 Sheet 22200 Sheet 22201 Sheet 22202 Sheet 22203 Sheet 22204 Sheet 22205 Sheet 22206 Sheet 22207 Sheet 22208 Sheet 22209 Sheet 22210 Sheet 22211 Sheet 22212 Sheet 22213 Sheet 22214 Sheet 22215 Sheet 22216 Sheet 22217 Sheet 22218 Sheet 22219 Sheet 22220 Sheet 22221 Sheet 22222 Sheet 22223 Sheet 22224 Sheet 22225 Sheet 22226 Sheet 22227 Sheet 22228 Sheet 22229 Sheet 22230 Sheet 22231 Sheet 22232 Sheet 22233 Sheet 22234 Sheet 22235 Sheet 22236 Sheet 22237 Sheet 22238 Sheet 22239 Sheet 22240 Sheet 22241 Sheet 22242 Sheet 22243 Sheet 22244 Sheet 22245 Sheet 22246 Sheet 22247 Sheet 22248 Sheet 22249 Sheet 22250 Sheet 22251 Sheet 22252 Sheet 22253 Sheet 22254 Sheet 22255 Sheet 22256 Sheet 22257 Sheet 22258 Sheet 22259 Sheet 22260 Sheet 22261 Sheet 22262 Sheet 22263 Sheet 22264 Sheet 22265 Sheet 22266 Sheet 22267 Sheet 22268 Sheet 22269 Sheet 22270 Sheet 22271 Sheet 22272 Sheet 22273 Sheet 22274 Sheet 22275 Sheet 22276 Sheet 22277 Sheet 22278 Sheet 22279 Sheet 22280 Sheet 22281 Sheet 22282 Sheet 22283 Sheet 22284 Sheet 22285 Sheet 22286 Sheet 22287 Sheet 22288 Sheet 22289 Sheet 22290 Sheet 22291 Sheet 22292 Sheet 22293 Sheet 22294 Sheet 22295 Sheet 22296 Sheet 22297 Sheet 22298 Sheet 22299 Sheet 22300 Sheet 22301 Sheet 22302 Sheet 22303 Sheet 22304 Sheet 22305 Sheet 22306 Sheet 22307 Sheet 22308 Sheet 22309 Sheet 22310 Sheet 22311 Sheet 22312 Sheet 22313 Sheet 22314 Sheet 22315 Sheet 22316 Sheet 22317 Sheet 22318 Sheet 22319 Sheet 22320 Sheet 22321 Sheet 22322 Sheet 22323 Sheet 22324 Sheet 22325 Sheet 22326 Sheet 22327 Sheet 22328 Sheet 22329 Sheet 22330 Sheet 22331 Sheet 22332 Sheet 22333 Sheet 22334 Sheet 22335 Sheet 22336 Sheet 22337 Sheet 22338 Sheet 22339 Sheet 22340 Sheet 22341 Sheet 22342 Sheet 22343 Sheet 22344 Sheet 22345 Sheet 22346 Sheet 22347 Sheet 22348 Sheet 22349 Sheet 22350 Sheet 22351 Sheet 22352 Sheet 22353 Sheet 22354 Sheet 22355 Sheet 22356 Sheet 22357 Sheet 22358 Sheet 22359 Sheet 22360 Sheet 22361 Sheet 22362 Sheet 22363 Sheet 22364 Sheet 22365 Sheet 22366 Sheet 22367 Sheet 22368 Sheet 22369 Sheet 22370 Sheet 22371 Sheet 22372 Sheet 22373 Sheet 22374 Sheet 22375 Sheet 22376 Sheet 22377 Sheet 22378 Sheet 22379 Sheet 22380 Sheet 22381 Sheet 22382 Sheet 22383 Sheet 22384 Sheet 22385 Sheet 22386 Sheet 22387 Sheet 22388 Sheet 22389 Sheet 22390 Sheet 22391 Sheet 22392 Sheet 22393 Sheet 22394 Sheet 22395 Sheet 22396 Sheet 22397 Sheet 22398 Sheet 22399 Sheet 22400 Sheet 22401 Sheet 22402 Sheet 22403 Sheet 22404 Sheet 22405 Sheet 22406 Sheet 22407 Sheet 22408 Sheet 22409 Sheet 22410 Sheet 22411 Sheet 22412 Sheet 22413 Sheet 22414 Sheet 22415 Sheet 22416 Sheet 22417 Sheet 22418 Sheet 22419 Sheet 22420 Sheet 22421 Sheet 22422 Sheet 22423 Sheet 22424 Sheet 22425 Sheet 22426 Sheet 22427 Sheet 22428 Sheet 22429 Sheet 22430 Sheet 22431 Sheet 22432 Sheet 22433 Sheet 22434 Sheet 22435 Sheet 22436 Sheet 22437 Sheet 22438 Sheet 22439 Sheet 22440 Sheet 22441 Sheet 22442 Sheet 22443 Sheet 22444 Sheet 22445 Sheet 22446 Sheet 22447 Sheet 22448 Sheet 22449 Sheet 22450 Sheet 22451 Sheet 22452 Sheet 22453 Sheet 22454 Sheet 22455 Sheet 22456 Sheet 22457 Sheet 22458 Sheet 22459 Sheet 22460 Sheet 22461 Sheet 22462 Sheet 22463 Sheet 22464 Sheet 22465 Sheet 22466 Sheet 22467 Sheet 22468 Sheet 22469 Sheet 22470 Sheet 22471 Sheet 22472 Sheet 22473 Sheet 22474 Sheet 22475 Sheet 22476 Sheet 22477 Sheet 22478 Sheet 22479 Sheet 22480 Sheet 22481 Sheet 22482 Sheet 22483 Sheet 22484 Sheet 22485 Sheet 22486 Sheet 22487 Sheet 22488 Sheet 22489 Sheet 22490 Sheet 22491 Sheet 22492 Sheet 22493 Sheet 22494 Sheet 22495 Sheet 22496 Sheet 22497 Sheet 22498 Sheet 22499 Sheet 22500 Sheet 22501 Sheet 22502 Sheet 22503 Sheet 22504 Sheet 22505 Sheet 22506 Sheet 22507 Sheet 22508 Sheet 22509 Sheet 22510 Sheet 22511 Sheet 22512 Sheet 22513 Sheet 22514 Sheet 22515 Sheet 22516 Sheet 22517 Sheet 22518 Sheet 22519 Sheet 22520 Sheet 22521 Sheet 22522 Sheet 22523 Sheet 22524 Sheet 22525 Sheet 22526 Sheet 22527 Sheet 22528 Sheet 22529 Sheet 22530 Sheet 22531 Sheet 22532 Sheet 22533 Sheet 22534 Sheet 22535 Sheet 22536 Sheet 22537 Sheet 22538 Sheet 22539 Sheet 22540 Sheet 22541 Sheet 22542 Sheet 22543 Sheet 22544 Sheet 22545 Sheet 22546 Sheet 22547 Sheet 22548 Sheet 22549 Sheet 22550 Sheet 22551 Sheet 22552 Sheet 22553 Sheet 22554 Sheet 22555 Sheet 22556 Sheet 22557 Sheet 22558 Sheet 22559 Sheet 22560 Sheet 22561 Sheet 22562 Sheet 22563 Sheet 22564 Sheet 22565 Sheet 22566 Sheet 22567 Sheet 22568 Sheet 22569 Sheet 22570 Sheet 22571 Sheet 22572 Sheet 22573 Sheet 22574 Sheet 22575 Sheet 22576 Sheet 22577 Sheet 22578 Sheet 22579 Sheet 22580 Sheet 22581 Sheet 22582 Sheet 22583 Sheet 22584 Sheet 22585 Sheet 22586 Sheet 22587 Sheet 22588 Sheet 22589 Sheet 22590 Sheet 22591 Sheet 22592 Sheet 22593 Sheet 22594 Sheet 22595 Sheet 22596 Sheet 22597 Sheet 22598 Sheet 22599 Sheet 22600 Sheet 22601 Sheet 22602 Sheet 22603 Sheet 22604 Sheet 22605 Sheet 22606 Sheet 22607 Sheet 22608 Sheet 22609 Sheet 22610 Sheet 22611 Sheet 22612 Sheet 22613 Sheet 22614 Sheet 22615 Sheet 22616 Sheet 22617 Sheet 22618 Sheet 22619 Sheet 22620 Sheet 22621 Sheet 22622 Sheet 22623 Sheet 22624 Sheet 22625 Sheet 22626 Sheet 22627 Sheet 22628 Sheet 22629 Sheet 22630 Sheet 22631 Sheet 22632 Sheet 22633 Sheet 22634 Sheet 22635 Sheet 22636 Sheet 22637 Sheet 22638 Sheet 22639 Sheet 22640 Sheet 22641 Sheet 22642 Sheet 22643 Sheet 22644 Sheet 22645 Sheet 22646 Sheet 22647 Sheet 22648 Sheet 22649 Sheet 22650 Sheet 22651 Sheet 22652 Sheet 22653 Sheet 22654 Sheet 22655 Sheet 22656 Sheet 22657 Sheet 22658 Sheet 22659 Sheet 22660 Sheet 22661 Sheet 22662 Sheet 22663 Sheet 22664 Sheet 22665 Sheet 22666 Sheet 22667 Sheet 22668 Sheet 22669 Sheet 22670 Sheet 22671 Sheet 22672 Sheet 22673 Sheet 22674 Sheet 22675 Sheet 22676 Sheet 22677 Sheet 22678 Sheet 22679 Sheet 22680 Sheet 22681 Sheet 22682 Sheet 22683 Sheet 22684 Sheet 22685 Sheet 22686 Sheet 22687 Sheet 22688 Sheet 22689 Sheet 22690 Sheet 22691 Sheet 22692 Sheet 22693 Sheet 22694 Sheet 22695 Sheet 22696 Sheet 22697 Sheet 22698 Sheet 22699 Sheet 22700 Sheet 22701 Sheet 22702 Sheet 22703 Sheet 22704 Sheet 22705 Sheet 22706 Sheet 22707 Sheet 22708 Sheet 22709 Sheet 22710 Sheet 22711 Sheet 22712 Sheet 22713 Sheet 22714 Sheet 22715 Sheet 22716 Sheet 22717 Sheet 22718 Sheet 22719 Sheet 22720 Sheet 22721 Sheet 22722 Sheet 22723 Sheet 22724 Sheet 22725 Sheet 22726 Sheet 22727 Sheet 22728 Sheet 22729 Sheet 22730 Sheet 22731 Sheet 22732 Sheet 22733 Sheet 22734 Sheet 22735 Sheet 22736 Sheet 22737 Sheet 22738 Sheet 22739 Sheet 22740 Sheet 22741 Sheet 22742 Sheet 22743 Sheet 22744 Sheet 22745 Sheet 22746 Sheet 22747 Sheet 22748 Sheet 22749 Sheet 22750 Sheet 22751 Sheet 22752 Sheet 22753 Sheet 22754 Sheet 22755 Sheet 22756 Sheet 22757 Sheet 22758 Sheet 22759 Sheet 22760 Sheet 22761 Sheet 22762 Sheet 22763 Sheet 22764 Sheet 22765 Sheet 22766 Sheet 22767 Sheet 22768 Sheet 22769 Sheet 22770 Sheet 22771 Sheet 22772 Sheet 22773 Sheet 22774 Sheet 22775 Sheet 22776 Sheet 22777 Sheet 22778 Sheet 22779 Sheet 22780 Sheet 22781 Sheet 22782 Sheet 22783 Sheet 22784 Sheet 22785 Sheet 22786 Sheet 22787 Sheet 22788 Sheet 22789 Sheet 22790 Sheet 22791 Sheet 22792 Sheet 22793 Sheet 22794 Sheet 22795 Sheet 22796 Sheet 22797 Sheet 22798 Sheet 22799 Sheet 22800 Sheet 22801 Sheet 22802 Sheet 22803 Sheet 22804 Sheet 22805 Sheet 22806 Sheet 22807 Sheet 22808 Sheet 22809 Sheet 22810 Sheet 22811 Sheet 22812 Sheet 22813 Sheet 22814 Sheet 22815 Sheet 22816 Sheet 22817 Sheet 22818 Sheet 22819 Sheet 22820 Sheet 22821 Sheet 22822 Sheet 22823 Sheet 22824 Sheet 22825 Sheet 22826 Sheet 22827 Sheet 22828 Sheet 22829 Sheet 22830 Sheet 22831 Sheet 22832 Sheet 22833 Sheet 22834 Sheet 22835 Sheet 22836 Sheet 22837 Sheet 22838 Sheet 22839 Sheet 22840 Sheet 22841 Sheet 22842 Sheet 22843 Sheet 22844 Sheet 22845 Sheet 22846 Sheet 22847 Sheet 22848 Sheet 22849 Sheet 22850 Sheet 22851 Sheet 22852 Sheet 22853 Sheet 22854 Sheet 22855 Sheet 22856 Sheet 22857 Sheet 22858 Sheet 22859 Sheet 22860 Sheet 22861 Sheet 22862 Sheet 22863 Sheet 22864 Sheet 22865 Sheet 22866 Sheet 22867 Sheet 22868 Sheet 22869 Sheet 22870 Sheet 22871 Sheet 22872 Sheet 22873 Sheet 22874 Sheet 22875 Sheet 22876 Sheet 22877 Sheet 22878 Sheet 22879 Sheet 22880 Sheet 22881 Sheet 22882 Sheet 22883 Sheet 22884 Sheet 22885 Sheet 22886 Sheet 22887 Sheet 22888 Sheet 22889 Sheet 22890 Sheet 22891 Sheet 22892 Sheet 22893 Sheet 22894 Sheet 22895 Sheet 22896 Sheet 22897 Sheet 22898 Sheet 22899 Sheet 22900 Sheet 22901 Sheet 22902 Sheet 22903 Sheet 22904 Sheet 22905 Sheet 22906 Sheet 22907 Sheet 22908 Sheet 22909 Sheet 22910 Sheet 22911 Sheet 22912 Sheet 22913 Sheet 22914 Sheet 22915 Sheet 22916 Sheet 22917 Sheet 22918 Sheet 22919 Sheet 22920 Sheet 22921 Sheet 22922 Sheet 22923 Sheet 22924 Sheet 22925 Sheet 22926 Sheet 22927 Sheet 22928 Sheet 22929 Sheet 22930 Sheet 22931 Sheet 22932 Sheet 22933 Sheet 22934 Sheet 22935 Sheet 22936 Sheet 22937 Sheet 22938 Sheet 22939 Sheet 22940 Sheet 22941 Sheet 22942 Sheet 22943 Sheet 22944 Sheet 22945 Sheet 22946 Sheet 22947 Sheet 22948 Sheet 22949 Sheet 22950 Sheet 22951 Sheet 22952 Sheet 22953 Sheet 22954 Sheet 22955 Sheet 22956 Sheet 22957 Sheet 22958 Sheet 22959 Sheet 22960 Sheet 22961 Sheet 22962 Sheet 22963 Sheet 22964 Sheet 22965 Sheet 22966 Sheet 22967 Sheet 22968 Sheet 22969 Sheet 22970 Sheet 22971 Sheet 22972 Sheet 22973 Sheet 22974 Sheet 22975 Sheet 22976 Sheet 22977 Sheet 22978 Sheet 22979 Sheet 22980 Sheet 22981 Sheet 22982 Sheet 22983 Sheet 22984 Sheet 22985 Sheet 22986 Sheet 22987 Sheet 22988 Sheet 22989 Sheet 22990 Sheet 22991 Sheet 22992 Sheet 22993 Sheet 22994 Sheet 22995 Sheet 22996 Sheet 22997 Sheet 22998 Sheet 22999 Sheet 23000 Sheet 23001 Sheet 23002 Sheet 23003 Sheet 23004 Sheet 23005 Sheet 23006 Sheet 23007 Sheet 23008 Sheet 23009 Sheet 23010 Sheet 23011 Sheet 23012 Sheet 23013 Sheet 23014 Sheet 23015 Sheet 23016 Sheet 23017 Sheet 23018 Sheet 23019 Sheet 23020 Sheet 23021 Sheet 23022 Sheet 23023 Sheet 23024 Sheet 23025 Sheet 23026 Sheet 23027 Sheet 23028 Sheet 23029 Sheet 23030 Sheet 23031 Sheet 23032 Sheet 23033 Sheet 23034 Sheet 23035 Sheet 23036 Sheet 23037 Sheet 23038 Sheet 23039 Sheet 23040 Sheet 23041 Sheet 23042 Sheet 23043 Sheet 23044 Sheet 23045 Sheet 23046 Sheet 23047 Sheet 23048 Sheet 23049 Sheet 23050 Sheet 23051 Sheet 23052 Sheet 23053 Sheet 23054 Sheet 23055 Sheet 23056 Sheet 23057 Sheet 23058 Sheet 23059 Sheet 23060 Sheet 23061 Sheet 23062 Sheet 23063 Sheet 23064 Sheet 23065 Sheet 23066 Sheet 23067 Sheet 23068 Sheet 23069 Sheet 23070 Sheet 23071 Sheet 23072 Sheet 23073 Sheet 23074 Sheet 23075 Sheet 23076 Sheet 23077 Sheet 23078 Sheet 23079 Sheet 23080 Sheet 23081 Sheet 23082 Sheet 23083 Sheet 23084 Sheet 23085 Sheet 23086 Sheet 23087 Sheet 23088 Sheet 23089 Sheet 23090 Sheet 23091 Sheet 23092 Sheet 23093 Sheet 23094 Sheet 23095 Sheet 23096 Sheet 23097 Sheet 23098 Sheet 23099 Sheet 23100 Sheet 23101 Sheet 23102 Sheet 23103 Sheet 23104 Sheet 23105 Sheet 23106 Sheet 23107 Sheet 23108 Sheet 23109 Sheet 23110 Sheet 23111 Sheet 23112 Sheet 23113 Sheet 23114 Sheet 23115 Sheet 23116 Sheet 23117 Sheet 23118 Sheet 23119 Sheet 23120 Sheet 23121 Sheet 23122 Sheet 23123 Sheet 23124 Sheet 23125 Sheet 23126 Sheet 23127 Sheet 23128 Sheet 23129 Sheet 23130 Sheet 23131 Sheet 23132 Sheet 23133 Sheet 23134 Sheet 23135 Sheet 23136 Sheet 23137 Sheet 23138 Sheet 23139 Sheet 23140 Sheet 23141 Sheet 23142 Sheet 23143 Sheet 23144 Sheet 23145 Sheet 23146 Sheet 23147 Sheet 23148 Sheet 23149 Sheet 23150 Sheet 23151 Sheet 23152 Sheet 23153 Sheet 23154 Sheet 23155 Sheet 23156 Sheet 23157 Sheet 23158 Sheet 23159 Sheet 23160 Sheet 23161 Sheet 23162 Sheet 23163 Sheet 23164 Sheet 23165 Sheet 23166 Sheet 23167 Sheet 23168 Sheet 23169 Sheet 23170 Sheet 23171 Sheet 23172 Sheet 23173 Sheet 23174 Sheet 23175 Sheet 23176 Sheet 23177 Sheet 23178 Sheet 23179 Sheet 23180 Sheet 23181 Sheet 23182 Sheet 23183 Sheet 23184 Sheet 23185 Sheet 23186 Sheet 23187 Sheet 23188 Sheet 23189 Sheet 23190 Sheet 23191 Sheet 23192 Sheet 23193 Sheet 23194 Sheet 23195 Sheet 23196 Sheet 23197 Sheet 23198 Sheet 23199 Sheet 23200 Sheet 23201 Sheet 23202 Sheet 23203 Sheet 23204 Sheet 23205 Sheet 23206 Sheet 23207 Sheet 23208 Sheet 23209 Sheet 23210 Sheet 23211 Sheet 23212 Sheet 23213 Sheet 23214 Sheet 23215 Sheet 23216 Sheet 23217 Sheet 23218 Sheet 23219 Sheet 23220 Sheet 23221 Sheet 23222 Sheet 23223 Sheet 23224 Sheet 23225 Sheet 23226 Sheet 23227 Sheet 23228 Sheet 23229 Sheet 23230 Sheet 23231 Sheet 23232 Sheet 23233 Sheet 23234 Sheet 23235 Sheet 23236 Sheet 23237 Sheet 23238 Sheet 23239 Sheet 23240 Sheet 23241 Sheet 23242 Sheet 23243 Sheet 23244 Sheet 23245 Sheet 23246 Sheet 23247 Sheet 23248 Sheet 23249 Sheet 23250 Sheet 23251 Sheet 23252 Sheet 23253 Sheet 23254 Sheet 23255 Sheet 23256 Sheet 23257 Sheet 23258 Sheet 23259 Sheet 23260 Sheet 23261 Sheet 23262 Sheet 23263 Sheet 23264 Sheet 23265 Sheet 23266 Sheet 23267 Sheet 23268 Sheet 23269 Sheet 23270 Sheet 23271 Sheet 23272 Sheet 23273 Sheet 23274 Sheet 23275 Sheet 23276 Sheet 23277 Sheet 23278 Sheet 23279 Sheet 23280 Sheet 23281 Sheet 23282 Sheet 23283 Sheet 23284 Sheet 23285 Sheet 23286 Sheet 23287 Sheet 23288 Sheet 23289 Sheet 23290 Sheet 23291 Sheet 23292 Sheet 23293 Sheet 23294 Sheet 23295 Sheet 23296 Sheet 23297 Sheet 23298 Sheet 23299 Sheet 23300 Sheet 23301 Sheet 23302 Sheet 23303 Sheet 23304 Sheet 23305 Sheet 23306 Sheet 23307 Sheet 23308 Sheet 23309 Sheet 23310 Sheet 23311 Sheet 23312 Sheet 23313 Sheet 23314 Sheet 23315 Sheet 23316 Sheet 23317 Sheet 23318 Sheet 23319 Sheet 23320 Sheet 23321 Sheet 23322 Sheet 23323 Sheet 23324 Sheet 23325 Sheet 23326 Sheet 23327 Sheet 23328 Sheet 23329 Sheet 23330 Sheet 23331 Sheet 23332 Sheet 23333 Sheet 23334 Sheet 23335 Sheet 23336 Sheet 23337 Sheet 23338 Sheet 23339 Sheet 23340 Sheet 23341 Sheet 23342 Sheet 23343 Sheet 23344 Sheet 23345 Sheet 23346 Sheet 23347 Sheet 23348 Sheet 23349 Sheet 23350 Sheet 23351 Sheet 23352 Sheet 23353 Sheet 23354 Sheet 23355 Sheet 23356 Sheet 23357 Sheet 23358 Sheet 23359 Sheet 23360 Sheet 23361 Sheet 23362 Sheet 23363 Sheet 23364 Sheet 23365 Sheet 23366 Sheet 23367 Sheet 23368 Sheet 23369 Sheet 23370 Sheet 23371 Sheet 23372 Sheet 23373 Sheet 23374 Sheet 23375 Sheet 23376 Sheet 23377 Sheet 23378 Sheet 23379 Sheet 23380 Sheet 23381 Sheet 23382 Sheet 23383 Sheet 23384 Sheet 23385 Sheet 23386 Sheet 23387 Sheet 23388 Sheet 23389 Sheet 23390 Sheet 23391 Sheet 23392 Sheet 23393 Sheet 23394 Sheet 23395 Sheet 23396 Sheet 23397 Sheet 23398 Sheet 23399 Sheet 23400 Sheet 23401 Sheet 23402 Sheet 23403 Sheet 23404 Sheet 23405 Sheet 23406 Sheet 23407 Sheet 23408 Sheet 23409 Sheet 23410 Sheet 23411 Sheet 23412 Sheet 23413 Sheet 23414 Sheet 23415 Sheet 23416 Sheet 23417 Sheet 23418 Sheet 23419 Sheet 23420 Sheet 23421 Sheet 23422 Sheet 23423 Sheet 23424 Sheet 23425 Sheet 23426 Sheet 23427 Sheet 23428 Sheet 23429 Sheet 23430 Sheet 23431 Sheet 23432 Sheet 23433 Sheet 23434 Sheet 23435 Sheet 23436 Sheet 23437 Sheet 23438 Sheet 23439 Sheet 23440 Sheet 23441 Sheet 23442 Sheet 23443 Sheet 23444 Sheet 23445 Sheet 23446 Sheet 23447 Sheet 23448 Sheet 23449 Sheet 23450 Sheet 23451 Sheet 23452 Sheet 23453 Sheet 23454 Sheet 23455 Sheet 23456 Sheet 23457 Sheet 23458 Sheet 23459 Sheet 23460 Sheet 23461 Sheet 23462 Sheet 23463 Sheet 23464 Sheet 23465 Sheet 23466 Sheet 23467 Sheet 23468 Sheet 23469 Sheet 23470 Sheet 23471 Sheet 23472 Sheet 23473 Sheet 23474 Sheet 23475 Sheet 23476 Sheet 23477 Sheet 23478 Sheet 23479 Sheet 23480 Sheet 23481 Sheet 23482 Sheet 23483 Sheet 23484 Sheet 23485 Sheet 23486 Sheet 23487 Sheet 23488 Sheet 23489 Sheet 23490 Sheet 23491 Sheet 23492 Sheet 23493 Sheet 23494 Sheet 23495 Sheet 23496 Sheet 23497 Sheet 23498 Sheet 23499 Sheet 23500 Sheet 23501 Sheet 23502 Sheet 23503 Sheet 23504 Sheet 23505 Sheet 23506 Sheet 23507 Sheet 23508 Sheet 23509 Sheet 23510 Sheet 23511 Sheet 23512 Sheet 23513 Sheet 23514 Sheet 23515 Sheet 23516 Sheet 23517 Sheet 23518 Sheet 23519 Sheet 23520 Sheet 23521 Sheet 23522 Sheet 23523 Sheet 23524 Sheet 23525 Sheet 23526 Sheet 23527 Sheet 23528 Sheet 23529 Sheet 23530 Sheet 23531 Sheet 23532 Sheet 23533 Sheet 23534 Sheet 23535 Sheet 23536 Sheet 23537 Sheet 23538 Sheet 23539 Sheet 23540 Sheet 23541 Sheet 23542 Sheet 23543 Sheet 23544 Sheet 23545 Sheet 23546 Sheet 23547 Sheet 23548 Sheet 23549 Sheet 23550 Sheet 23551 Sheet 23552 Sheet 23553 Sheet 23554 Sheet 23555 Sheet 23556 Sheet 23557 Sheet 23558 Sheet 23559 Sheet 23560 Sheet 23561 Sheet 23562 Sheet 23563 Sheet 23564 Sheet 23565 Sheet 23566 Sheet 23567 Sheet 23568 Sheet 23569 Sheet 23570 Sheet 23571 Sheet 23572 Sheet 23573 Sheet 23574 Sheet 23575 Sheet 23576 Sheet 23577 Sheet 23578 Sheet 23579 Sheet 23580 Sheet 23581 Sheet 23582 Sheet 23583 Sheet 23584 Sheet 23585 Sheet 23586 Sheet 23587 Sheet 23588 Sheet 23589 Sheet 23590 Sheet 23591 Sheet 23592 Sheet 23593 Sheet 23594 Sheet 23595 Sheet 23596 Sheet 23597 Sheet 23598 Sheet 23599 Sheet 23600 Sheet 23601 Sheet 23602 Sheet 23603 Sheet 23604 Sheet 23605 Sheet 23606 Sheet 23607 Sheet 23608 Sheet 23609 Sheet 23610 Sheet 23611 Sheet 23612 Sheet 23613 Sheet 23614 Sheet 23615 Sheet 23616 Sheet 23617 Sheet 23618 Sheet 23619 Sheet 23620 Sheet 23621 Sheet 23622 Sheet 23623 Sheet 23624 Sheet 23625 Sheet 23626 Sheet 23627 Sheet 23628 Sheet 23629 Sheet 23630 Sheet 23631 Sheet 23632 Sheet 23633 Sheet 23634 Sheet 23635 Sheet 23636 Sheet 23637 Sheet 23638 Sheet 23639 Sheet 23640 Sheet 23641 Sheet 23642 Sheet 23643 Sheet 23644 Sheet 23645 Sheet 23646 Sheet 23647 Sheet 23648 Sheet 23649 Sheet 23650 Sheet 23651 Sheet 23652 Sheet 23653 Sheet 23654 Sheet 23655 Sheet 23656 Sheet 23657 Sheet 23658 Sheet 23659 Sheet 23660 Sheet 23661 Sheet 23662 Sheet 23663 Sheet 23664 Sheet 23665 Sheet 23666 Sheet 23667 Sheet 23668 Sheet 23669 Sheet 23670 Sheet 23671 Sheet 23672 Sheet 23673 Sheet 23674 Sheet 23675 Sheet 23676 Sheet 23677 Sheet 23678 Sheet 23679 Sheet 23680 Sheet 23681 Sheet 23682 Sheet 23683 Sheet 23684 Sheet 23685 Sheet 23686 Sheet 23687 Sheet 23688 Sheet 23689 Sheet 23690 Sheet 23691 Sheet 23692 Sheet 23693 Sheet 23694 Sheet 23695 Sheet 23696 Sheet 23697 Sheet 23698 Sheet 23699 Sheet 23700 Sheet 23701 Sheet 23702 Sheet 23703 Sheet 23704 Sheet 23705 Sheet 23706 Sheet 23707 Sheet 23708 Sheet 23709 Sheet 23710 Sheet 23711 Sheet 23712 Sheet 23713 Sheet 23714 Sheet 23715 Sheet 23716 Sheet 23717 Sheet 23718 Sheet 23719 Sheet 23720 Sheet 23721 Sheet 23722 Sheet 23723 Sheet 23724 Sheet 23725 Sheet 23726 Sheet 23727 Sheet 23728 Sheet 23729 Sheet 23730 Sheet 23731 Sheet 23732 Sheet 23733 Sheet 23734 Sheet 23735 Sheet 23736 Sheet 23737 Sheet 23738 Sheet 23739 Sheet 23740 Sheet 23741 Sheet 23742 Sheet 23743 Sheet 23744 Sheet 23745 Sheet 23746 Sheet 23747 Sheet 23748 Sheet 23749 Sheet 23750 Sheet 23751 Sheet 23752 Sheet 23753 Sheet 23754 Sheet 23755 Sheet 23756 Sheet 23757 Sheet 23758 Sheet 23759 Sheet 23760 Sheet 23761 Sheet 23762 Sheet 23763 Sheet 23764 Sheet 23765 Sheet 23766 Sheet 23767 Sheet 23768 Sheet 23769 Sheet 23770 Sheet 23771 Sheet 23772 Sheet 23773 Sheet 23774 Sheet 23775 Sheet 23776 Sheet 23777 Sheet 23778 Sheet 23779 Sheet 23780 Sheet 23781 Sheet 23782 Sheet 23783 Sheet 23784 Sheet 23785 Sheet 23786 Sheet 23787 Sheet 23788 Sheet 23789 Sheet 23790 Sheet 23791 Sheet 23792 Sheet 23793 Sheet 23794 Sheet 23795 Sheet 23796 Sheet 23797 Sheet 23798 Sheet 23799 Sheet 23800 Sheet 23801 Sheet 23802 Sheet 23803 Sheet 23804 Sheet 23805 Sheet 23806 Sheet 23807 Sheet 23808 Sheet 23809 Sheet 23810 Sheet 23811 Sheet 23812 Sheet 23813 Sheet 23814 Sheet 23815 Sheet 23816 Sheet 23817 Sheet 23818 Sheet 23819 Sheet 23820 Sheet 23821 Sheet 23822 Sheet 23823 Sheet 23824 Sheet 23825 Sheet 23826 Sheet 23827 Sheet 23828 Sheet 23829 Sheet 23830 Sheet 23831 Sheet 23832 Sheet 23833 Sheet 23834 Sheet 23835 Sheet 23836 Sheet 23837 Sheet 23838 Sheet 23839 Sheet 23840 Sheet 23841 Sheet 23842 Sheet 23843 Sheet 23844 Sheet 23845 Sheet 23846 Sheet 23847 Sheet 23848 Sheet 23849 Sheet 23850 Sheet 23851 Sheet 23852 Sheet 23853 Sheet 23854 Sheet 23855 Sheet 23856 Sheet 23857 Sheet 23858 Sheet 23859 Sheet 23860 Sheet 23861 Sheet 23862 Sheet 23863 Sheet 23864 Sheet 23865 Sheet 23866 Sheet 23867 Sheet 23868 Sheet 23869 Sheet 23870 Sheet 23871 Sheet 23872 Sheet 23873 Sheet 23874 Sheet 23875 Sheet 23876 Sheet 23877 Sheet 23878 Sheet 23879 Sheet 23880 Sheet 23881 Sheet 23882 Sheet 23883 Sheet 23884 Sheet 23885 Sheet 23886 Sheet 23887 Sheet 23888 Sheet 23889 Sheet 23890 Sheet 23891 Sheet 23892 Sheet 23893 Sheet 23894 Sheet 23895 Sheet 23896 Sheet 23897 Sheet 23898 Sheet 23899 Sheet 23900 Sheet 23901 Sheet 23902 Sheet 23903 Sheet 23904 Sheet 23905 Sheet 23906 Sheet 23907 Sheet 23908 Sheet 23909 Sheet 23910 Sheet 23911 Sheet 23912 Sheet 23913 Sheet 23914 Sheet 23915 Sheet 23916 Sheet 23917 Sheet 23918 Sheet 23919 Sheet 23920 Sheet 23921 Sheet 23922 Sheet 23923 Sheet 23924 Sheet 23925 Sheet 23926 Sheet 23927 Sheet 23928 Sheet 23929 Sheet 23930 Sheet 23931 Sheet 23932 Sheet 23933 Sheet 23934 Sheet 23935 Sheet 23936 Sheet 23937 Sheet 23938 Sheet 23939 Sheet 23940 Sheet 23941 Sheet 23942 Sheet 23943 Sheet 23944 Sheet 23945 Sheet 23946 Sheet 23947 Sheet 23948 Sheet 23949 Sheet 23950 Sheet 23951 Sheet 23952 Sheet 23953 Sheet 23954 Sheet 23955 Sheet 23956 Sheet 23957 Sheet 23958 Sheet 23959 Sheet 23960 Sheet 23961 Sheet 23962 Sheet 23963 Sheet 23964 Sheet 23965 Sheet 23966 Sheet 23967 Sheet 23968 Sheet 23969 Sheet 23970 Sheet 23971 Sheet 23972 Sheet 23973 Sheet 23974 Sheet 23975 Sheet 23976 Sheet 23977 Sheet 23978 Sheet 23979 Sheet 23980 Sheet 23981 Sheet 23982 Sheet 23983 Sheet 23984 Sheet 23985 Sheet 23986 Sheet 23987 Sheet 23988 Sheet 23989 Sheet 23990 Sheet 23991 Sheet 23992 Sheet 23993 Sheet 23994 Sheet 23995 Sheet 23996 Sheet 23997 Sheet 23998 Sheet 23999 Sheet 24000 Sheet 24001 Sheet 24002 Sheet 24003 Sheet 24004 Sheet 24005 Sheet 24006 Sheet 24007 Sheet 24008 Sheet 24009 Sheet 24010 Sheet 24011 Sheet 24012 Sheet 24013 Sheet 24014 Sheet 24015 Sheet 24016 Sheet 24017 Sheet 24018 Sheet 24019 Sheet 24020 Sheet 24021 Sheet 24022 Sheet 24023 Sheet 24024 Sheet 24025 Sheet 24026 Sheet 24027 Sheet 24028 Sheet 24029 Sheet 24030 Sheet 24031 Sheet 24032 Sheet 24033 Sheet 24034 Sheet 24035 Sheet 24036 Sheet 24037 Sheet 24038 Sheet 24039 Sheet 24040 Sheet 24041 Sheet 24042 Sheet 24043 Sheet 24044 Sheet 24045 Sheet 24046 Sheet 24047 Sheet 24048 Sheet 24049 Sheet 24050 Sheet 24051 Sheet 24052 Sheet 24053 Sheet 24054 Sheet 24055 Sheet 24056 Sheet 24057 Sheet 24058 Sheet 24059 Sheet 24060 Sheet 24061 Sheet 24062 Sheet 24063 Sheet 24064 Sheet 24065 Sheet 24066 Sheet 24067 Sheet 24068 Sheet 24069 Sheet 24070 Sheet 24071 Sheet 24072 Sheet 24073 Sheet 24074 Sheet 24075 Sheet 24076 Sheet 24077 Sheet 24078 Sheet 24079 Sheet 24080 Sheet 24081 Sheet 24082 Sheet 24083 Sheet 24084 Sheet 24085 Sheet 24086 Sheet 24087 Sheet 24088 Sheet 24089 Sheet 24090 Sheet 24091 Sheet 24092 Sheet 24093 Sheet 24094 Sheet 24095 Sheet 24096 Sheet 24097 Sheet 24098 Sheet 24099 Sheet 24100 Sheet 24101 Sheet 24102 Sheet 24103 Sheet 24104 Sheet 24105 Sheet 24106 Sheet 24107 Sheet 24108 Sheet 24109 Sheet 24110 Sheet 24111 Sheet 24112 Sheet 24113 Sheet 24114 Sheet 24115 Sheet 24116 Sheet 24117 Sheet 24118 Sheet 24119 Sheet 24120 Sheet 24121 Sheet 24122 Sheet 24123 Sheet 24124 Sheet 24125 Sheet 24126 Sheet 24127 Sheet 24128 Sheet 24129 Sheet 24130 Sheet 24131 Sheet 24132 Sheet 24133 Sheet 24134 Sheet 24135 Sheet 24136 Sheet 24137 Sheet 24138 Sheet 24139 Sheet 24140 Sheet 24141 Sheet 24142 Sheet 24143 Sheet 24144 Sheet 24145 Sheet 24146 Sheet 24147 Sheet 24148 Sheet 24149 Sheet 24150 Sheet 24151 Sheet 24152 Sheet 24153 Sheet 24154 Sheet 24155 Sheet 24156 Sheet 24157 Sheet 24158 Sheet 24159 Sheet 24160 Sheet 24161 Sheet 24162 Sheet 24163 Sheet 24164 Sheet 24165 Sheet 24166 Sheet 24167 Sheet 24168 Sheet 24169 Sheet 24170 Sheet 24171 Sheet 24172 Sheet 24173 Sheet 24174 Sheet 24175 Sheet 24176 Sheet 24177 Sheet 24178 Sheet 24179 Sheet 24180 Sheet 24181 Sheet 24182 Sheet 24183 Sheet 24184 Sheet 24185 Sheet 24186 Sheet 24187 Sheet 24188 Sheet 24189 Sheet 24190 Sheet 24191 Sheet 24192 Sheet 24193 Sheet 24194 Sheet 24195 Sheet 24196 Sheet 24197 Sheet 24198 Sheet 24199 Sheet 24200 Sheet 24201 Sheet 24202 Sheet 24203 Sheet 24204 Sheet 24205 Sheet 24206 Sheet 24207 Sheet 24208 Sheet 24209 Sheet 24210 Sheet 24211 Sheet 24212 Sheet 24213 Sheet 24214 Sheet 24215 Sheet 24216 Sheet 24217 Sheet 24218 Sheet 24219 Sheet 24220 Sheet 24221 Sheet 24222 Sheet 24223 Sheet 24224 Sheet 24225 Sheet 24226 Sheet 24227 Sheet 24228 Sheet 24229 Sheet 24230 Sheet 24231 Sheet 24232 Sheet 24233 Sheet 24234 Sheet 24235 Sheet 24236 Sheet 24237 Sheet 24238 Sheet 24239 Sheet 24240 Sheet 24241 Sheet 24242 Sheet 24243 Sheet 24244 Sheet 24245 Sheet 24246 Sheet 24247 Sheet 24248 Sheet 24249 Sheet 24250 Sheet 24251 Sheet 24252 Sheet 24253 Sheet 24254 Sheet 24255 Sheet 24256 Sheet 24257 Sheet 24258 Sheet 24259 Sheet 24260 Sheet 24261 Sheet 24262 Sheet 24263 Sheet 24264 Sheet 24265 Sheet 24266 Sheet 24267 Sheet 24268 Sheet 24269 Sheet 24270 Sheet 24271 Sheet 24272 Sheet 24273 Sheet 24274 Sheet 24275 Sheet 24276 Sheet 24277 Sheet 24278 Sheet 24279 Sheet 24280 Sheet 24281 Sheet 24282 Sheet 24283 Sheet 24284 Sheet 24285 Sheet 24286 Sheet 24287 Sheet 24288 Sheet 24289 Sheet 24290 Sheet 24291 Sheet 24292 Sheet 24293 Sheet 24294 Sheet 24295 Sheet 24296 Sheet 24297 Sheet 24298 Sheet 24299 Sheet 24300 Sheet 24301 Sheet 24302 Sheet 24303 Sheet 24304 Sheet 24305 Sheet 24306 Sheet 24307 Sheet 24308 Sheet 24309 Sheet 24310 Sheet 24311 Sheet 24312 Sheet 24313 Sheet 24314 Sheet 24315 Sheet 24316 Sheet 24317 Sheet 24318 Sheet 24319 Sheet 24320 Sheet 24321 Sheet 24322 Sheet 24323 Sheet 24324 Sheet 24325 Sheet 24326 Sheet 24327 Sheet 24328 Sheet 24329 Sheet 24330 Sheet 24331 Sheet 24332 Sheet 24333 Sheet 24334 Sheet 24335 Sheet 24336 Sheet 24337 Sheet 24338 Sheet 24339 Sheet 24340 Sheet 24341 Sheet 24342 Sheet 24343 Sheet 24344 Sheet 24345 Sheet 24346 Sheet 24347 Sheet 24348 Sheet 24349 Sheet 24350 Sheet 24351 Sheet 24352 Sheet 24353 Sheet 24354 Sheet 24355 Sheet 24356 Sheet 24357 Sheet 24358 Sheet 24359 Sheet 24360 Sheet 24361 Sheet 24362 Sheet 24363 Sheet 24364 Sheet 24365 Sheet 24366 Sheet 24367 Sheet 24368 Sheet 24369 Sheet 24370 Sheet 24371 Sheet 24372 Sheet 24373 Sheet 24374 Sheet 24375 Sheet 24376 Sheet 24377 Sheet 24378 Sheet 24379 Sheet 24380 Sheet 24381 Sheet 24382 Sheet 24383 Sheet 24384 Sheet 24385 Sheet 24386 Sheet 24387 Sheet 24388 Sheet 24389 Sheet 24390 Sheet 24391 Sheet 24392 Sheet 24393 Sheet 24394 Sheet 24395 Sheet 24396 Sheet 24397 Sheet 24398 Sheet 24399 Sheet 24400 Sheet 24401 Sheet 24402 Sheet 24403 Sheet 24404 Sheet 24405 Sheet 24406 Sheet 24407 Sheet 24408 Sheet 24409 Sheet 24410 Sheet 24411 Sheet 24412 Sheet 24413 Sheet 24414 Sheet 24415 Sheet 24416 Sheet 24417 Sheet 24418 Sheet 24419 Sheet 24420 Sheet 24421 Sheet 24422 Sheet 24423 Sheet 24424 Sheet 24425 Sheet 24426 Sheet 24427 Sheet 24428 Sheet 24429 Sheet 24430 Sheet 24431 Sheet 24432 Sheet 24433 Sheet 24434 Sheet 24435 Sheet 24436 Sheet 24437 Sheet 24438 Sheet 24439 Sheet 24440 Sheet 24441 Sheet 24442 Sheet 24443 Sheet 24444 Sheet 24445 Sheet 24446 Sheet 24447 Sheet 24448 Sheet 24449 Sheet 24450 Sheet 24451 Sheet 24452 Sheet 24453 Sheet 24454 Sheet 24455 Sheet 24456 Sheet 24457 Sheet 24458 Sheet 24459 Sheet 24460 Sheet 24461 Sheet 24462 Sheet 24463 Sheet 24464 Sheet 24465 Sheet 24466 Sheet 24467 Sheet 24468 Sheet 24469 Sheet 24470 Sheet 24471 Sheet 24472 Sheet 24473 Sheet 24474 Sheet 24475 Sheet 24476 Sheet 24477 Sheet 24478 Sheet 24479 Sheet 24480 Sheet 24481 Sheet 24482 Sheet 24483 Sheet 24484 Sheet 24485 Sheet 24486 Sheet 24487 Sheet 24488 Sheet 24489 Sheet 24490 Sheet 24491 Sheet 24492 Sheet 24493 Sheet 24494 Sheet 24495 Sheet 24496 Sheet 24497 Sheet 24498 Sheet 24499 Sheet 24500 Sheet 24501 Sheet 24502 Sheet 24503 Sheet 24504 Sheet 24505 Sheet 24506 Sheet 24507 Sheet 24508 Sheet 24509 Sheet 24510 Sheet 24511 Sheet 24512 Sheet 24513 Sheet 24514 Sheet 24515 Sheet 24516 Sheet 24517 Sheet 24518 Sheet 24519 Sheet 24520 Sheet 24521 Sheet 24522 Sheet 24523 Sheet 24524 Sheet 24525 Sheet 24526 Sheet 24527 Sheet 24528 Sheet 24529 Sheet 24530 Sheet 24531 Sheet 24532 Sheet 24533 Sheet 24534 Sheet 24535 Sheet 24536 Sheet 24537 Sheet 24538 Sheet 24539 Sheet 24540 Sheet 24541 Sheet 24542 Sheet 24543 Sheet 24544 Sheet 24545 Sheet 24546 Sheet 24547 Sheet 24548 Sheet 24549 Sheet 24550 Sheet 24551 Sheet 24552 Sheet 24553 Sheet 24554 Sheet 24555 Sheet 24556 Sheet 24557 Sheet 24558 Sheet 24559 Sheet 24560 Sheet 24561 Sheet 24562 Sheet 24563 Sheet 24564 Sheet 24565 Sheet 24566 Sheet 24567 Sheet 24568 Sheet 24569 Sheet 24570 Sheet 24571 Sheet 24572 Sheet 24573 Sheet 24574 Sheet 24575 Sheet 24576 Sheet 24577 Sheet 24578 Sheet 24579 Sheet 24580 Sheet 24581 Sheet 24582 Sheet 24583 Sheet 24584 Sheet 24585 Sheet 24586 Sheet 24587 Sheet 24588 Sheet 24589 Sheet 24590 Sheet 24591 Sheet 24592 Sheet 24593 Sheet 24594 Sheet 24595 Sheet 24596 Sheet 24597 Sheet 24598 Sheet 24599 Sheet 24600 Sheet 24601 Sheet 24602 Sheet 24603 Sheet 24604 Sheet 24605 Sheet 24606 Sheet 24607 Sheet 24608 Sheet 24609 Sheet 24610 Sheet 24611 Sheet 24612 Sheet 24613 Sheet 24614 Sheet 24615 Sheet 24616 Sheet 24617 Sheet 24618 Sheet 24619 Sheet 24620 Sheet 24621 Sheet 24622 Sheet 24623 Sheet 24624 Sheet 24625 Sheet 24626 Sheet 24627 Sheet 24628 Sheet 24629 Sheet 24630 Sheet 24631 Sheet 24632 Sheet 24633 Sheet 24634 Sheet 24635 Sheet 24636 Sheet 24637 Sheet 24638 Sheet 24639 Sheet 24640 Sheet 24641 Sheet 24642 Sheet 24643 Sheet 24644 Sheet 24645 Sheet 24646 Sheet 24647 Sheet 24648 Sheet 24649 Sheet 24650 Sheet 24651 Sheet 24652 Sheet 24653 Sheet 24654 Sheet 24655 Sheet 24656 Sheet 24657 Sheet 24658 Sheet 24659 Sheet 24660 Sheet 24661 Sheet 24662 Sheet 24663 Sheet 24664 Sheet 24665 Sheet 24666 Sheet 24667 Sheet 24668 Sheet 24669 Sheet 24670 Sheet 24671 Sheet 24672 Sheet 24673 Sheet 24674 Sheet 24675 Sheet 24676 Sheet 24677 Sheet 24678 Sheet 24679 Sheet 24680 Sheet 24681 Sheet 24682 Sheet 24683 Sheet 24684 Sheet 24685 Sheet 24686 Sheet 24687 Sheet 24688 Sheet 24689 Sheet 24690 Sheet 24691 Sheet 24692 Sheet 24693 Sheet 24694 Sheet 24695 Sheet 24696 Sheet 24697 Sheet 24698 Sheet 24699 Sheet 24700 Sheet 24701 Sheet 24702 Sheet 24703 Sheet 24704 Sheet 24705 Sheet 24706 Sheet 24707 Sheet 24708 Sheet 24709 Sheet 24710 Sheet 24711 Sheet 24712 Sheet 24713 Sheet 24714 Sheet 24715 Sheet 24716 Sheet 24717 Sheet 24718 Sheet 24719 Sheet 24720 Sheet 24721 Sheet 24722 Sheet 24723 Sheet 24724 Sheet 24725 Sheet 24726 Sheet 24727 Sheet 24728 Sheet 24729 Sheet 24730 Sheet 24731 Sheet 24732 Sheet 24733 Sheet 24734 Sheet 24735 Sheet 24736 Sheet 24737 Sheet 24738 Sheet 24739 Sheet 24740 Sheet 24741 Sheet 24742 Sheet 24743 Sheet 24744 Sheet 24745 Sheet 24746 Sheet 24747 Sheet 24748 Sheet 24749 Sheet 24750 Sheet 24751 Sheet 24752 Sheet 24753 Sheet 24754 Sheet 24755 Sheet 24756 Sheet 24757 Sheet 24758 Sheet 24759 Sheet 24760 Sheet 24761 Sheet 24762 Sheet 24763 Sheet 24764 Sheet 24765 Sheet 24766 Sheet 24767 Sheet 24768 Sheet 24769 Sheet 24770 Sheet 24771 Sheet 24772 Sheet 24773 Sheet 24774 Sheet 24775 Sheet 24776 Sheet 24777 Sheet 24778 Sheet 24779 Sheet 24780 Sheet 24781 Sheet 24782 Sheet 24783 Sheet 24784 Sheet 24785 Sheet 24786 Sheet 24787 Sheet 24788 Sheet 24789 Sheet 24790 Sheet 24791 Sheet 24792 Sheet 24793 Sheet 24794 Sheet 24795 Sheet 24796 Sheet 24797 Sheet 24798 Sheet 24799 Sheet 24800 Sheet 24801 Sheet 24802 Sheet 24803 Sheet 24804 Sheet 24805 Sheet 24806 Sheet 24807 Sheet 24808 Sheet 24809 Sheet 24810 Sheet 24811 Sheet 24812 Sheet 24813 Sheet 24814 Sheet 24815 Sheet 24816 Sheet 24817 Sheet 24818 Sheet 24819 Sheet 24820 Sheet 24821 Sheet 24822 Sheet 24823 Sheet 24824 Sheet 24825 Sheet 24826 Sheet 24827 Sheet 24828 Sheet 24829 Sheet 24830 Sheet 24831 Sheet 24832 Sheet 24833 Sheet 24834 Sheet 24835 Sheet 24836 Sheet 24837 Sheet 24838 Sheet 24839 Sheet 24840 Sheet 24841 Sheet 24842 Sheet 24843 Sheet 24844 Sheet 24845 Sheet 24846 Sheet 24847 Sheet 24848 Sheet 24849 Sheet 24850 Sheet 24851 Sheet 24852 Sheet 24853 Sheet 24854 Sheet 24855 Sheet 24856 Sheet 24857 Sheet 24858 Sheet 24859 Sheet 24860 Sheet 24861 Sheet 24862 Sheet 24863 Sheet 24864 Sheet 24865 Sheet 24866 Sheet 24867 Sheet 24868 Sheet 24869 Sheet 24870 Sheet 24871 Sheet 24872 Sheet 24873 Sheet 24874 Sheet 24875 Sheet 24876 Sheet 24877 Sheet 24878 Sheet 24879 Sheet 24880 Sheet 24881 Sheet 24882 Sheet 24883 Sheet 24884 Sheet 24885 Sheet 24886 Sheet 24887 Sheet 24888 Sheet 24889 Sheet 24890 Sheet 24891 Sheet 24892 Sheet 24893 Sheet 24894 Sheet 24895 Sheet 24896 Sheet 24897 Sheet 24898 Sheet 24899 Sheet 24900 Sheet 24901 Sheet 24902 Sheet 24903 Sheet 24904 Sheet 24905 Sheet 24906 Sheet 24907 Sheet 24908 Sheet 24909 Sheet 24910 Sheet 24911 Sheet 24912 Sheet 24913 Sheet 24914 Sheet 24915 Sheet 24916 Sheet 24917 Sheet 24918 Sheet 24919 Sheet 24920 Sheet 24921 Sheet 24922 Sheet 24923 Sheet 24924 Sheet 24925 Sheet 24926 Sheet 24927 Sheet 24928 Sheet 24929 Sheet 24930 Sheet 24931 Sheet 24932 Sheet 24933 Sheet 24934 Sheet 24935 Sheet 24936 Sheet 24937 Sheet 24938 Sheet 24939 Sheet 24940 Sheet 24941 Sheet 24942 Sheet 24943 Sheet 24944 Sheet 24945 Sheet 24946 Sheet 24947 Sheet 24948 Sheet 24949 Sheet 24950 Sheet 24951 Sheet 24952 Sheet 24953 Sheet 24954 Sheet 24955 Sheet 24956 Sheet 24957 Sheet 24958 Sheet 24959 Sheet 24960 Sheet 24961 Sheet 24962 Sheet 24963 Sheet 24964 Sheet 24965 Sheet 24966 Sheet 24967 Sheet 24968 Sheet 24969 Sheet 24970 Sheet 24971 Sheet 24972 Sheet 24973 Sheet 24974 Sheet 24975 Sheet 24976 Sheet 24977 Sheet 24978 Sheet 24979 Sheet 24980 Sheet 24981 Sheet 24982 Sheet 24983 Sheet 24984 Sheet 24985 Sheet 24986 Sheet 24987 Sheet 24988 Sheet 24989 Sheet 24990 Sheet 24991 Sheet 24992 Sheet 24993 Sheet 24994 Sheet 24995 Sheet 24996 Sheet 24997 Sheet 24998 Sheet 24999 Sheet 25000 Sheet 25001 Sheet 25002 Sheet 25003 Sheet 25004 Sheet 25005 Sheet 25006 Sheet 25007 Sheet 25008 Sheet 25009 Sheet 25010 Sheet 25011 Sheet 25012 Sheet 25013 Sheet 25014 Sheet 25015 Sheet 25016 Sheet 25017 Sheet 25018 Sheet 25019 Sheet 25020 Sheet 25021 Sheet 25022 Sheet 25023 Sheet 25024 Sheet 25025 Sheet 25026 Sheet 25027 Sheet 25028 Sheet 25029 Sheet 25030 Sheet 25031 Sheet 25032 Sheet 25033 Sheet 25034 Sheet 25035 Sheet 25036 Sheet 25037 Sheet 25038 Sheet 25039 Sheet 25040 Sheet 25041 Sheet 25042 Sheet 25043 Sheet 25044 Sheet 25045 Sheet 25046 Sheet 25047 Sheet 25048 Sheet 25049 Sheet 25050 Sheet 25051 Sheet 25052 Sheet 25053 Sheet 25054 Sheet 25055 Sheet 25056 Sheet 25057 Sheet 25058 Sheet 25059 Sheet 25060 Sheet 25061 Sheet 25062 Sheet 25063 Sheet 25064 Sheet 25065 Sheet 25066 Sheet 25067 Sheet 25068 Sheet 25069 Sheet 25070 Sheet 25071 Sheet 25072 Sheet 25073 Sheet 25074 Sheet 25075 Sheet 25076 Sheet 25077 Sheet 25078 Sheet 25079 Sheet 25080 Sheet 25081 Sheet 25082 Sheet 25083 Sheet 25084 Sheet 25085 Sheet 25086 Sheet 25087 Sheet 25088 Sheet 25089 Sheet 25090 Sheet 25091 Sheet 25092 Sheet 25093 Sheet 25094 Sheet 25095 Sheet 25096 Sheet 25097 Sheet 25098 Sheet 25099 Sheet 25100 Sheet 25101 Sheet 25102 Sheet 25103 Sheet 25104 Sheet 25105 Sheet 25106 Sheet 25107 Sheet 25108 Sheet 25109 Sheet 25110 Sheet 25111 Sheet 25112 Sheet 25113 Sheet 25114 Sheet 25115 Sheet 25116 Sheet 25117 Sheet 25118 Sheet 25119 Sheet 25120 Sheet 25121 Sheet 25122 Sheet 25123 Sheet 25124 Sheet 25125 Sheet 25126 Sheet 25127 Sheet 25128 Sheet 25129 Sheet 25130 Sheet 25131 Sheet 25132 Sheet 25133 Sheet 25134 Sheet 25135 Sheet 25136 Sheet 25137 Sheet 25138 Sheet 25139 Sheet 25140 Sheet 25141 Sheet 25142 Sheet 25143 Sheet 25144 Sheet 25145 Sheet 25146 Sheet 25147 Sheet 25148 Sheet 25149 Sheet 25150 Sheet 25151 Sheet 25152 Sheet 25153 Sheet 25154 Sheet 25155 Sheet 25156 Sheet 25157 Sheet 25158 Sheet 25159 Sheet 25160 Sheet 25161 Sheet 25162 Sheet 25163 Sheet 25164 Sheet 25165 Sheet 25166 Sheet 25167 Sheet 25168 Sheet 25169 Sheet 25170 Sheet 25171 Sheet 25172 Sheet 25173 Sheet 25174 Sheet 25175 Sheet 25176 Sheet 25177 Sheet 25178 Sheet 25179 Sheet 25180 Sheet 25181 Sheet 25182 Sheet 25183 Sheet 25184 Sheet 25185 Sheet 25186 Sheet 25187 Sheet 25188 Sheet 25189 Sheet 25190 Sheet 25191 Sheet 25192 Sheet 25193 Sheet 25194 Sheet 25195 Sheet 25196 Sheet 25197 Sheet 25198 Sheet 25199 Sheet 25200 Sheet 25201 Sheet 25202 Sheet 25203 Sheet 25204 Sheet 25205 Sheet 25206 Sheet 25207 Sheet 25208 Sheet 25209 Sheet 25210 Sheet 25211 Sheet 25212 Sheet 25213 Sheet 25214 Sheet 25215 Sheet 25216 Sheet 25217 Sheet 25218 Sheet 25219 Sheet 25220 Sheet 25221 Sheet 25222 Sheet 25223 Sheet 25224 Sheet 25225 Sheet 25226 Sheet 25227 Sheet 25228 Sheet 25229 Sheet 25230 Sheet 25231 Sheet 25232 Sheet 25233 Sheet 25234 Sheet 25235 Sheet 25236 Sheet 25237 Sheet 25238 Sheet 25239 Sheet 25240 Sheet 25241 Sheet 25242 Sheet 25243 Sheet 25244 Sheet 25245 Sheet 25246 Sheet 25247 Sheet 25248 Sheet 25249 Sheet 25250 Sheet 25251 Sheet 25252 Sheet 25253 Sheet 25254 Sheet 25255 Sheet 25256 Sheet 25257 Sheet 25258 Sheet 25259 Sheet 25260 Sheet 25261 Sheet 25262 Sheet 25263 Sheet 25264 Sheet 25265 Sheet 25266 Sheet 25267 Sheet 25268 Sheet 25269 Sheet 25270 Sheet 25271 Sheet 25272 Sheet 25273 Sheet 25274 Sheet 25275 Sheet 25276 Sheet 25277 Sheet 25278 Sheet 25279 Sheet 25280 Sheet 25281 Sheet 25282 Sheet 25283 Sheet 25284 Sheet 25285 Sheet 25286 Sheet 25287 Sheet 25288 Sheet 25289 Sheet 25290 Sheet 25291 Sheet 25292 Sheet 25293 Sheet 25294 Sheet 25295 Sheet 25296 Sheet 25297 Sheet 25298 Sheet 25299 Sheet 25300 Sheet 25301 Sheet 25302 Sheet 25303 Sheet 25304 Sheet 25305 Sheet 25306 Sheet 25307 Sheet 25308 Sheet 25309 Sheet 25310 Sheet 25311 Sheet 25312 Sheet 25313 Sheet 25314 Sheet 25315 Sheet 25316 Sheet 25317 Sheet 25318 Sheet 25319 Sheet 25320 Sheet 25321 Sheet 25322 Sheet 25323 Sheet 25324 Sheet 25325 Sheet 25326 Sheet 25327 Sheet 25328 Sheet 25329 Sheet 25330 Sheet 25331 Sheet 25332 Sheet 25333 Sheet 25334 Sheet 25335 Sheet 25336 Sheet 25337 Sheet 25338 Sheet 25339 Sheet 25340 Sheet 25341 Sheet 25342 Sheet 25343 Sheet 25344 Sheet 25345 Sheet 25346 Sheet 25347 Sheet 25348 Sheet 25349 Sheet 25350 Sheet 25351 Sheet 25352 Sheet 25353 Sheet 25354 Sheet 25355 Sheet 25356 Sheet 25357 Sheet 25358 Sheet 25359 Sheet 25360 Sheet 25361 Sheet 25362 Sheet 25363 Sheet 25364 Sheet 25365 Sheet 25366 Sheet 25367 Sheet 25368 Sheet 25369 Sheet 25370 Sheet 25371 Sheet 25372 Sheet 25373 Sheet 25374 Sheet 25375 Sheet 25376 Sheet 25377 Sheet 25378 Sheet 25379 Sheet 25380 Sheet 25381 Sheet 25382 Sheet 25383 Sheet 25384 Sheet 25385 Sheet 25386 Sheet 25387 Sheet 25388 Sheet 25389 Sheet 25390 Sheet 25391 Sheet 25392 Sheet 25393 Sheet 25394 Sheet 25395 Sheet 25396 Sheet 25397 Sheet 25398 Sheet 25399 Sheet 25400 Sheet 25401 Sheet 25402 Sheet 25403 Sheet 25404 Sheet 25405 Sheet 25406 Sheet 25407 Sheet 25408 Sheet 25409 Sheet 25410 Sheet 25411 Sheet 25412 Sheet 25413 Sheet 25414 Sheet 25415 Sheet 25416 Sheet 25417 Sheet 25418 Sheet 25419 Sheet 25420 Sheet 25421 Sheet 25422 Sheet 25423 Sheet 25424 Sheet 25425 Sheet 25426 Sheet 25427 Sheet 25428 Sheet 25429 Sheet 25430 Sheet 25431 Sheet 25432 Sheet 25433 Sheet 25434 Sheet 25435 Sheet 25436 Sheet 25437 Sheet 25438 Sheet 25439 Sheet 25440 Sheet 25441 Sheet 25442 Sheet 25443 Sheet 25444 Sheet 25445 Sheet 25446 Sheet 25447 Sheet 25448 Sheet 25449 Sheet 25450 Sheet 25451 Sheet 25452 Sheet 25453 Sheet 25454 Sheet 25455 Sheet 25456 Sheet 25457 Sheet 25458 Sheet 25459 Sheet 25460 Sheet 25461 Sheet 25462 Sheet 25463 Sheet 25464 Sheet 25465 Sheet 25466 Sheet 25467 Sheet 25468 Sheet 25469 Sheet 25470 Sheet 25471 Sheet 25472 Sheet 25473 Sheet 25474 Sheet 25475 Sheet 25476 Sheet 25477 Sheet 25478 Sheet 25479 Sheet 25480 Sheet 25481 Sheet 25482 Sheet 25483 Sheet 25484 Sheet 25485 Sheet 25486 Sheet 25487 Sheet 25488 Sheet 25489 Sheet 25490 Sheet 25491 Sheet 25492 Sheet 25493 Sheet 25494 Sheet 25495 Sheet 25496 Sheet 25497 Sheet 25498 Sheet 25499 Sheet 25500 Sheet 25501 Sheet 25502 Sheet 25503 Sheet 25504 Sheet 25505 Sheet 25506 Sheet 25507 Sheet 25508 Sheet 25509 Sheet 25510 Sheet 25511 Sheet 25512 Sheet 25513 Sheet 25514 Sheet 25515 Sheet 25516 Sheet 25517 Sheet 25518 Sheet 25519 Sheet 25520 Sheet 25521 Sheet 25522 Sheet 25523 Sheet 25524 Sheet 25525 Sheet 25526 Sheet 25527 Sheet 25528 Sheet 25529 Sheet 25530 Sheet 25531 Sheet 25532 Sheet 25533 Sheet 25534 Sheet 25535 Sheet 25536 Sheet 25537 Sheet 25538 Sheet 25539 Sheet 25540 Sheet 25541 Sheet 25542 Sheet 25543 Sheet 25544 Sheet 25545 Sheet 25546 Sheet 25547 Sheet 25548 Sheet 25549 Sheet 25550 Sheet 25551 Sheet 25552 Sheet 25553 Sheet 25554 Sheet 25555 Sheet 25556 Sheet 25557 Sheet 25558 Sheet 25559 Sheet 25560 Sheet 25561 Sheet 25562 Sheet 25563 Sheet 25564 Sheet 25565 Sheet 25566 Sheet 25567 Sheet 25568 Sheet 25569 Sheet 25570 Sheet 25571 Sheet 25572 Sheet 25573 Sheet 25574 Sheet 25575 Sheet 25576 Sheet 25577 Sheet 25578 Sheet 25579 Sheet 25580 Sheet 25581 Sheet 25582 Sheet 25583 Sheet 25584 Sheet 25585 Sheet 25586 Sheet 25587 Sheet 25588 Sheet 25589 Sheet 25590 Sheet 25591 Sheet 25592 Sheet 25593 Sheet 25594 Sheet 25595 Sheet 25596 Sheet 25597 Sheet 25598 Sheet 25599 Sheet 25600 Sheet 25601 Sheet 25602 Sheet 25603 Sheet 25604 Sheet 25605 Sheet 25606 Sheet 25607 Sheet 25608 Sheet 25609 Sheet 25610 Sheet 25611 Sheet 25612 Sheet 25613 Sheet 25614 Sheet 25615 Sheet 25616 Sheet 25617 Sheet 25618 Sheet 25619 Sheet 25620 Sheet 25621 Sheet 25622 Sheet 25623 Sheet 25624 Sheet 25625 Sheet 25626 Sheet 25627 Sheet 25628 Sheet 25629 Sheet 25630 Sheet 25631 Sheet 25632 Sheet 25633 Sheet 25634 Sheet 25635 Sheet 25636 Sheet 25637 Sheet 25638 Sheet 25639 Sheet 25640 Sheet 25641 Sheet 25642 Sheet 25643 Sheet 25644 Sheet 25645 Sheet 25646 Sheet 25647 Sheet 25648 Sheet 25649 Sheet 25650 Sheet 25651 Sheet 25652 Sheet 25653 Sheet 25654 Sheet 25655 Sheet 25656 Sheet 25657 Sheet 25658 Sheet 25659 Sheet 25660 Sheet 25661 Sheet 25662 Sheet 25663 Sheet 25664 Sheet 25665 Sheet 25666 Sheet 25667 Sheet 25668 Sheet 25669 Sheet 25670 Sheet 25671 Sheet 25672 Sheet 25673 Sheet 25674 Sheet 25675 Sheet 25676 Sheet 25677 Sheet 25678 Sheet 25679 Sheet 25680 Sheet 25681 Sheet 25682 Sheet 25683 Sheet 25684 Sheet 25685 Sheet 25686 Sheet 25687 Sheet 25688 Sheet 25689 Sheet 25690 Sheet 25691 Sheet 25692 Sheet 25693 Sheet 25694 Sheet 25695 Sheet 25696 Sheet 25697 Sheet 25698 Sheet 25699 Sheet 25700 Sheet 25701 Sheet 25702 Sheet 25703 Sheet 25704 Sheet 25705 Sheet 25706 Sheet 25707 Sheet 25708 Sheet 25709 Sheet 25710 Sheet 25711 Sheet 25712 Sheet 25713 Sheet 25714 Sheet 25715 Sheet 25716 Sheet 25717 Sheet 25718 Sheet 25719 Sheet 25720 Sheet 25721 Sheet 25722 Sheet 25723 Sheet 25724 Sheet 25725 Sheet 25726 Sheet 25727 Sheet 25728 Sheet 25729 Sheet 25730 Sheet 25731 Sheet 25732 Sheet 25733 Sheet 25734 Sheet 25735 Sheet 25736 Sheet 25737 Sheet 25738 Sheet 25739 Sheet 25740 Sheet 25741 Sheet 25742 Sheet 25743 Sheet 25744 Sheet 25745 Sheet 25746 Sheet 25747 Sheet 25748 Sheet 25749 Sheet 25750 Sheet 25751 Sheet 25752 Sheet 25753 Sheet 25754 Sheet 25755 Sheet 25756 Sheet 25757 Sheet 25758 Sheet 25759 Sheet 25760 Sheet 25761 Sheet 25762 Sheet 25763 Sheet 25764 Sheet 25765 Sheet 25766 Sheet 25767 Sheet 25768 Sheet 25769 Sheet 25770 Sheet 25771 Sheet 25772 Sheet 25773 Sheet 25774 Sheet 25775 Sheet 25776 Sheet 25777 Sheet 25778 Sheet 25779 Sheet 25780 Sheet 25781 Sheet 25782 Sheet 25783 Sheet 25784 Sheet 25785 Sheet 25786 Sheet 25787 Sheet 25788 Sheet 25789 Sheet 25790 Sheet 25791 Sheet 25792 Sheet 25793 Sheet 25794 Sheet 25795 Sheet 25796 Sheet 25797 Sheet 25798 Sheet 25799 Sheet 25800 Sheet 25801 Sheet 25802 Sheet 25803 Sheet 25804 Sheet 25805 Sheet 25806 Sheet 25807 Sheet 25808 Sheet 25809 Sheet 25810 Sheet 25811 Sheet 25812 Sheet 25813 Sheet 25814 Sheet 25815 Sheet 25816 Sheet 25817 Sheet 25818 Sheet 25819 Sheet 25820 Sheet 25821 Sheet 25822 Sheet 25823 Sheet 25824 Sheet 25825 Sheet 25826 Sheet 25827 Sheet 25828 Sheet 25829 Sheet 25830 Sheet 25831 Sheet 25832 Sheet 25833 Sheet 25834 Sheet 25835 Sheet 25836 Sheet 25837 Sheet 25838 Sheet 25839 Sheet 25840 Sheet 25841 Sheet 25842 Sheet 25843 Sheet 25844 Sheet 25845 Sheet 25846 Sheet 25847 Sheet 25848 Sheet 25849 Sheet 25850 Sheet 25851 Sheet 25852 Sheet 25853 Sheet 25854 Sheet 25855 Sheet 25856 Sheet 25857 Sheet 25858 Sheet 25859 Sheet 25860 Sheet 25861 Sheet 25862 Sheet 25863 Sheet 25864 Sheet 25865 Sheet 25866 Sheet 25867 Sheet 25868 Sheet 25869 Sheet 25870 Sheet 25871 Sheet 25872 Sheet 25873 Sheet 25874 Sheet 25875 Sheet 25876 Sheet 25877 Sheet 25878 Sheet 25879 Sheet 25880 Sheet 25881 Sheet 25882 Sheet 25883 Sheet 25884 Sheet 25885 Sheet 25886 Sheet 25887 Sheet 25888 Sheet 25889 Sheet 25890 Sheet 25891 Sheet 25892 Sheet 25893 Sheet 25894 Sheet 25895 Sheet 25896 Sheet 25897 Sheet 25898 Sheet 25899 Sheet 25900 Sheet 25901 Sheet 25902 Sheet 25903 Sheet 25904 Sheet 25905 Sheet 25906 Sheet 25907 Sheet 25908 Sheet 25909 Sheet 25910 Sheet 25911 Sheet 25912 Sheet 25913 Sheet 25914 Sheet 25915 Sheet 25916 Sheet 25917 Sheet 25918 Sheet 25919 Sheet 25920 Sheet 25921 Sheet 25922 Sheet 25923 Sheet 25924 Sheet 25925 Sheet 25926 Sheet 25927 Sheet 25928 Sheet 25929 Sheet 25930 Sheet 25931 Sheet 25932 Sheet 25933 Sheet 25934 Sheet 25935 Sheet 25936 Sheet 25937 Sheet 25938 Sheet 25939 Sheet 25940 Sheet 25941 Sheet 25942 Sheet 25943 Sheet 25944 Sheet 25945 Sheet 25946 Sheet 25947 Sheet 25948 Sheet 25949 Sheet 25950 Sheet 25951 Sheet 25952 Sheet 25953 Sheet 25954 Sheet 25955 Sheet 25956 Sheet 25957 Sheet 25958 Sheet 25959 Sheet 25960 Sheet 25961 Sheet 25962 Sheet 25963 Sheet 25964 Sheet 25965 Sheet 25966 Sheet 25967 Sheet 25968 Sheet 25969 Sheet 25970 Sheet 25971 Sheet 25972 Sheet 25973 Sheet 25974 Sheet 25975 Sheet 25976 Sheet 25977 Sheet 25978 Sheet 25979 Sheet 25980 Sheet 25981 Sheet 25982 Sheet 25983 Sheet 25984 Sheet 25985 Sheet 25986 Sheet 25987 Sheet 25988 Sheet 25989 Sheet 25990 Sheet 25991 Sheet 25992 Sheet 25993 Sheet 25994 Sheet 25995 Sheet 25996 Sheet 25997 Sheet 25998 Sheet 25999 Sheet 26000 Sheet 26001 Sheet 26002 Sheet 26003 Sheet 26004 Sheet 26005 Sheet 26006 Sheet 26007 Sheet 26008 Sheet 26009 Sheet 26010 Sheet 26011 Sheet 26012 Sheet 26013 Sheet 26014 Sheet 26015 Sheet 26016 Sheet 26017 Sheet 26018 Sheet 26019 Sheet 26020 Sheet 26021 Sheet 26022 Sheet 26023 Sheet 26024 Sheet 26025 Sheet 26026 Sheet 26027 Sheet 26028 Sheet 26029 Sheet 26030 Sheet 26031 Sheet 26032 Sheet 26033 Sheet 26034 Sheet 26035 Sheet 26036 Sheet 26037 Sheet 26038 Sheet 26039 Sheet 26040 Sheet 26041 Sheet 26042 Sheet 26043 Sheet 26044 Sheet 26045 Sheet 26046 Sheet 26047 Sheet 26048 Sheet 26049 Sheet 26050 Sheet 26051 Sheet 26052 Sheet 26053 Sheet 26054 Sheet 26055 Sheet 26056 Sheet 26057 Sheet 26058 Sheet 26059 Sheet 26060 Sheet 26061 Sheet 26062 Sheet 26063 Sheet 26064 Sheet 26065 Sheet 26066 Sheet 26067 Sheet 26068 Sheet 26069 Sheet 26070 Sheet 26071 Sheet 26072 Sheet 26073 Sheet 26074 Sheet 26075 Sheet 26076 Sheet 26077 Sheet 26078 Sheet 26079 Sheet 26080 Sheet 26081 Sheet 26082 Sheet 26083 Sheet 26084 Sheet 26085 Sheet 26086 Sheet 26087 Sheet 26088 Sheet 26089 Sheet 26090 Sheet 26091 Sheet 26092 Sheet 26093 Sheet 26094 Sheet 26095 Sheet 26096 Sheet 26097 Sheet 26098 Sheet 26099 Sheet 26100 Sheet 26101 Sheet 26102 Sheet 26103 Sheet 26104 Sheet 26105 Sheet 26106 Sheet 26107 Sheet 26108 Sheet 26109 Sheet 26110 Sheet 26111 Sheet 26112 Sheet 26113 Sheet 26114 Sheet 26115 Sheet 26116 Sheet 26117 Sheet 26118 Sheet 26119 Sheet 26120 Sheet 26121 Sheet 26122 Sheet 26123 Sheet 26124 Sheet 26125 Sheet 26126 Sheet 26127 Sheet 26128 Sheet 26129 Sheet 26130 Sheet 26131 Sheet 26132 Sheet 26133 Sheet 26134 Sheet 26135 Sheet 26136 Sheet 26137 Sheet 26138 Sheet 26139 Sheet 26140 Sheet 26141 Sheet 26142 Sheet 26143 Sheet 26144 Sheet 26145 Sheet 26146 Sheet 26147 Sheet 26148 Sheet 26149 Sheet 26150 Sheet 26151 Sheet 26152 Sheet 26153 Sheet 26154 Sheet 26155 Sheet 26156 Sheet 26157 Sheet 26158 Sheet 26159 Sheet 26160 Sheet 26161 Sheet 26162 Sheet 26163 Sheet 26164 Sheet 26165 Sheet 26166 Sheet 26167 Sheet 26168 Sheet 26169 Sheet 26170 Sheet 26171 Sheet 26172 Sheet 26173 Sheet 26174 Sheet 26175 Sheet 26176 Sheet 26177 Sheet 26178 Sheet 26179 Sheet 26180 Sheet 26181 Sheet 26182 Sheet 26183 Sheet 26184 Sheet 26185 Sheet 26186 Sheet 26187 Sheet 26188 Sheet 26189 Sheet 26190 Sheet 26191 Sheet 26192 Sheet 26193 Sheet 26194 Sheet 26195 Sheet 26196 Sheet 26197 Sheet 26198 Sheet 26199 Sheet 26200 Sheet 26201 Sheet 26202 Sheet 26203 Sheet 26204 Sheet 26205 Sheet 26206 Sheet 26207 Sheet 26208 Sheet 26209 Sheet 26210 Sheet 26211 Sheet 26212 Sheet 26213 Sheet 26214 Sheet 26215 Sheet 26216 Sheet 26217 Sheet 26218 Sheet 26219 Sheet 26220 Sheet 26221 Sheet 26222 Sheet 26223 Sheet 26224 Sheet 26225 Sheet 26226 Sheet 26227 Sheet 26228 Sheet 26229 Sheet 26230 Sheet 26231 Sheet 26232 Sheet 26233 Sheet 26234 Sheet 26235 Sheet 26236 Sheet 26237 Sheet 26238 Sheet 26239 Sheet 26240 Sheet 26241 Sheet 26242 Sheet 26243 Sheet 26244 Sheet 26245 Sheet 26246 Sheet 26247 Sheet 26248 Sheet 26249 Sheet 26250 Sheet 26251 Sheet 26252 Sheet 26253 Sheet 26254 Sheet 26255 Sheet 26256 Sheet 26257 Sheet 26258 Sheet 26259 Sheet 26260 Sheet 26261 Sheet 26262 Sheet 26263 Sheet 26264 Sheet 26265 Sheet 26266 Sheet 26267 Sheet 26268 Sheet 26269 Sheet 26270 Sheet 26271 Sheet 26272 Sheet 26273 Sheet 26274 Sheet 26275 Sheet 26276 Sheet 26277 Sheet 26278 Sheet 26279 Sheet 26280 Sheet 26281 Sheet 26282 Sheet 26283 Sheet 26284 Sheet 26285 Sheet 26286 Sheet 26287 Sheet 26288 Sheet 26289 Sheet 26290 Sheet 26291 Sheet 26292 Sheet 26293 Sheet 26294 Sheet 26295 Sheet 26296 Sheet 26297 Sheet 26298 Sheet 26299 Sheet 26300 Sheet 26301 Sheet 26302 Sheet 26303 Sheet 26304 Sheet 26305 Sheet 26306 Sheet 26307 Sheet 26308 Sheet 26309 Sheet 26310 Sheet 26311 Sheet 26312 Sheet 26313 Sheet 26314 Sheet 26315 Sheet 26316 Sheet 26317 Sheet 26318 Sheet 26319 Sheet 26320 Sheet 26321 Sheet 26322 Sheet 26323 Sheet 26324 Sheet 26325 Sheet 26326 Sheet 26327 Sheet 26328 Sheet 26329 Sheet 26330 Sheet 26331 Sheet 26332 Sheet 26333 Sheet 26334 Sheet 26335 Sheet 26336 Sheet 26337 Sheet 26338 Sheet 26339 Sheet 26340 Sheet 26341 Sheet 26342 Sheet 26343 Sheet 26344 Sheet 26345 Sheet 26346 Sheet 26347 Sheet 26348 Sheet 26349 Sheet 26350 Sheet 26351 Sheet 26352 Sheet 26353 Sheet 26354 Sheet 26355 Sheet 26356 Sheet 26357 Sheet 26358 Sheet 26359 Sheet 26360 Sheet 26361 Sheet 26362 Sheet 26363 Sheet 26364 Sheet 26365 Sheet 26366 Sheet 26367 Sheet 26368 Sheet 26369 Sheet 26370 Sheet 26371 Sheet 26372 Sheet 26373 Sheet 26374 Sheet 26375 Sheet 26376 Sheet 26377 Sheet 26378 Sheet 26379 Sheet 26380 Sheet 26381 Sheet 26382 Sheet 26383 Sheet 26384 Sheet 26385 Sheet 26386 Sheet 26387 Sheet 26388 Sheet 26389 Sheet 26390 Sheet 26391 Sheet 26392 Sheet 26393 Sheet 26394 Sheet 26395 Sheet 26396 Sheet 26397 Sheet 26398 Sheet 26399 Sheet 26400 Sheet 26401 Sheet 26402 Sheet 26403 Sheet 26404 Sheet 26405 Sheet 26406 Sheet 26407 Sheet 26408 Sheet 26409 Sheet 26410 Sheet 26411 Sheet 26412 Sheet 26413 Sheet 26414 Sheet 26415 Sheet 26416 Sheet 26417 Sheet 26418 Sheet 26419 Sheet 26420 Sheet 26421 Sheet 26422 Sheet 26423 Sheet 26424 Sheet 26425 Sheet 26426 Sheet 26427 Sheet 26428 Sheet 26429 Sheet 26430 Sheet 26431 Sheet 26432 Sheet 26433 Sheet 26434 Sheet 26435 Sheet 26436 Sheet 26437 Sheet 26438 Sheet 26439 Sheet 26440 Sheet 26441 Sheet 26442 Sheet 26443 Sheet 26444 Sheet 26445 Sheet 26446 Sheet 26447 Sheet 26448 Sheet 26449 Sheet 26450 Sheet 26451 Sheet 26452 Sheet 26453 Sheet 26454 Sheet 26455 Sheet 26456 Sheet 26457 Sheet 26458 Sheet 26459 Sheet 26460 Sheet 26461 Sheet 26462 Sheet 26463 Sheet 26464 Sheet 26465 Sheet 26466 Sheet 26467 Sheet 26468 Sheet 26469 Sheet 26470 Sheet 26471 Sheet 26472 Sheet 26473 Sheet 26474 Sheet 26475 Sheet 26476 Sheet 26477 Sheet 26478 Sheet 26479 Sheet 26480 Sheet 26481 Sheet 26482 Sheet 26483 Sheet 26484 Sheet 26485 Sheet 26486 Sheet 26487 Sheet 26488 Sheet 26489 Sheet 26490 Sheet 26491 Sheet 26492 Sheet 26493 Sheet 26494 Sheet 26495 Sheet 26496 Sheet 26497 Sheet 26498 Sheet 26499 Sheet 26500 Sheet 26501 Sheet 26502 Sheet 26503 Sheet 26504 Sheet 26505 Sheet 26506 Sheet 26507 Sheet 26508 Sheet 26509 Sheet 26510 Sheet 26511 Sheet 26512 Sheet 26513 Sheet 26514 Sheet 26515 Sheet 26516 Sheet 26517 Sheet 26518 Sheet 26519 Sheet 26520 Sheet 26521 Sheet 26522 Sheet 26523 Sheet 26524 Sheet 26525 Sheet 26526 Sheet 26527 Sheet 26528 Sheet 26529 Sheet 26530 Sheet 26531 Sheet 26532 Sheet 26533 Sheet 26534 Sheet 26535 Sheet 26536 Sheet 26537 Sheet 26538 Sheet 26539 Sheet 26540 Sheet 26541 Sheet 26542 Sheet 26543 Sheet 26544 Sheet 26545 Sheet 26546 Sheet 26547 Sheet 26548 Sheet 26549 Sheet 26550 Sheet 26551 Sheet 26552 Sheet 26553 Sheet 26554 Sheet 26555 Sheet 26556 Sheet 26557 Sheet 26558 Sheet 26559 Sheet 26560 Sheet 26561 Sheet 26562 Sheet 26563 Sheet 26564 Sheet 26565 Sheet 26566 Sheet 26567 Sheet 26568 Sheet 26569 Sheet 26570 Sheet 26571 Sheet 26572 Sheet 26573 Sheet 26574 Sheet 26575 Sheet 26576 Sheet 26577 Sheet 26578 Sheet 26579 Sheet 26580 Sheet 26581 Sheet 26582 Sheet 26583 Sheet 26584 Sheet 26585 Sheet 26586 Sheet 26587 Sheet 26588 Sheet 26589 Sheet 26590 Sheet 26591 Sheet 26592 Sheet 26593 Sheet 26594 Sheet 26595 Sheet 26596 Sheet 26597 Sheet 26598 Sheet 26599 Sheet 26600 Sheet 26601 Sheet 26602 Sheet 26603 Sheet 26604 Sheet 26605 Sheet 26606 Sheet 26607 Sheet 26608 Sheet 26609 Sheet 26610 Sheet 26611 Sheet 26612 Sheet 26613 Sheet 26614 Sheet 26615 Sheet 26616 Sheet 26617 Sheet 26618 Sheet 26619 Sheet 26620 Sheet 26621 Sheet 26622 Sheet 26623 Sheet 26624 Sheet 26625 Sheet 26626 Sheet 26627 Sheet 26628 Sheet 26629 Sheet 26630 Sheet 26631 Sheet 26632 Sheet 26633 Sheet 26634 Sheet 26635 Sheet 26636 Sheet 26637 Sheet 26638 Sheet 26639 Sheet 26640 Sheet 26641 Sheet 26642 Sheet 26643 Sheet 26644 Sheet 26645 Sheet 26646 Sheet 26647 Sheet 26648 Sheet 26649 Sheet 26650 Sheet 26651 Sheet 26652 Sheet 26653 Sheet 26654 Sheet 26655 Sheet 26656 Sheet 26657 Sheet 26658 Sheet 26659 Sheet 26660 Sheet 26661 Sheet 26662 Sheet 26663 Sheet 26664 Sheet 26665 Sheet 26666 Sheet 26667 Sheet 26668 Sheet 26669 Sheet 26670 Sheet 26671 Sheet 26672 Sheet 26673 Sheet 26674 Sheet 26675 Sheet 26676 Sheet 26677 Sheet 26678 Sheet 26679 Sheet 26680 Sheet 26681 Sheet 26682 Sheet 26683 Sheet 26684 Sheet 26685 Sheet 26686 Sheet 26687 Sheet 26688 Sheet 26689 Sheet 26690 Sheet 26691 Sheet 26692 Sheet 26693 Sheet 26694 Sheet 26695 Sheet 26696 Sheet 26697 Sheet 26698 Sheet 26699 Sheet 26700 Sheet 26701 Sheet 26702 Sheet 26703 Sheet 26704 Sheet 26705 Sheet 26706 Sheet 26707 Sheet 26708 Sheet 26709 Sheet 26710 Sheet 26711 Sheet 26712 Sheet 26713 Sheet 26714 Sheet 26715 Sheet 26716 Sheet 26717 Sheet 26718 Sheet 26719 Sheet 26720 Sheet 26721 Sheet 26722 Sheet 26723 Sheet 26724 Sheet 26725 Sheet 26726 Sheet 26727 Sheet 26728 Sheet 26729 Sheet 26730 Sheet 26731 Sheet 26732 Sheet 26733 Sheet 26734 Sheet 26735 Sheet 26736 Sheet 26737 Sheet 26738 Sheet 26739 Sheet 26740 Sheet 26741 Sheet 26742 Sheet 26743 Sheet 26744 Sheet 26745 Sheet 26746 Sheet 26747 Sheet 26748 Sheet 26749 Sheet 26750 Sheet 26751 Sheet 26752 Sheet 26753 Sheet 26754 Sheet 26755 Sheet 26756 Sheet 26757 Sheet 26758 Sheet 26759 Sheet 26760 Sheet 26761 Sheet 26762 Sheet 26763 Sheet 26764 Sheet 26765 Sheet 26766 Sheet 26767 Sheet 26768 Sheet 26769 Sheet 26770 Sheet 26771 Sheet 26772 Sheet 26773 Sheet 26774 Sheet 26775 Sheet 26776 Sheet 26777 Sheet 26778 Sheet 26779 Sheet 26780 Sheet 26781 Sheet 26782 Sheet 26783 Sheet 26784 Sheet 26785 Sheet 26786 Sheet 26787 Sheet 26788 Sheet 26789 Sheet 26790 Sheet 26791 Sheet 26792 Sheet 26793 Sheet 26794 Sheet 26795 Sheet 26796 Sheet 26797 Sheet 26798 Sheet 26799 Sheet 26800 Sheet 26801 Sheet 26802 Sheet 26803 Sheet 26804 Sheet 26805 Sheet 26806 Sheet 26807 Sheet 26808 Sheet 26809 Sheet 26810 Sheet 26811 Sheet 26812 Sheet 26813 Sheet 26814 Sheet 26815 Sheet 26816 Sheet 26817 Sheet 26818 Sheet 26819 Sheet 26820 Sheet 26821 Sheet 26822 Sheet 26823 Sheet 26824 Sheet 26825 Sheet 26826 Sheet 26827 Sheet 26828 Sheet 26829 Sheet 26830 Sheet 26831 Sheet 26832 Sheet 26833 Sheet 26834 Sheet 26835 Sheet 26836 Sheet 26837 Sheet 26838 Sheet 26839 Sheet 26840 Sheet 26841 Sheet 26842 Sheet 26843 Sheet 26844 Sheet 26845 Sheet 26846 Sheet 26847 Sheet 26848 Sheet 26849 Sheet 26850 Sheet 26851 Sheet 26852 Sheet 26853 Sheet 26854 Sheet 26855 Sheet 26856 Sheet 26857 Sheet 26858 Sheet 26859 Sheet 26860 Sheet 26861 Sheet 26862 Sheet 26863 Sheet 26864 Sheet 26865 Sheet 26866 Sheet 26867 Sheet 26868 Sheet 26869 Sheet 26870 Sheet 26871 Sheet 26872 Sheet 26873 Sheet 26874 Sheet 26875 Sheet 26876 Sheet 26877 Sheet 26878 Sheet 26879 Sheet 26880 Sheet 26881 Sheet 26882 Sheet 26883 Sheet 26884 Sheet 26885 Sheet 26886 Sheet 26887 Sheet 26888 Sheet 26889 Sheet 26890 Sheet 26891 Sheet 26892 Sheet 26893 Sheet 26894 Sheet 26895 Sheet 26896 Sheet 26897 Sheet 26898 Sheet 26899 Sheet 26900 Sheet 26901 Sheet 26902 Sheet 26903 Sheet 26904 Sheet 26905 Sheet 26906 Sheet 26907 Sheet 26908 Sheet 26909 Sheet 26910 Sheet 26911 Sheet 26912 Sheet 26913 Sheet 26914 Sheet 26915 Sheet 26916 Sheet 26917 Sheet 26918 Sheet 26919 Sheet 26920 Sheet 26921 Sheet 26922 Sheet 26923 Sheet 26924 Sheet 26925 Sheet 26926 Sheet 26927 Sheet 26928 Sheet 26929 Sheet 26930 Sheet 26931 Sheet 26932 Sheet 26933 Sheet 26934 Sheet 26935 Sheet 26936 Sheet 26937 Sheet 26938 Sheet 26939 Sheet 26940 Sheet 26941 Sheet 26942 Sheet 26943 Sheet 26944 Sheet 26945 Sheet 26946 Sheet 26947 Sheet 26948 Sheet 26949 Sheet 26950 Sheet 26951 Sheet 26952 Sheet 26953 Sheet 26954 Sheet 26955 Sheet 26956 Sheet 26957 Sheet 26958 Sheet 26959 Sheet 26960 Sheet 26961 Sheet 26962 Sheet 26963 Sheet 26964 Sheet 26965 Sheet 26966 Sheet 26967 Sheet 26968 Sheet 26969 Sheet 26970 Sheet 26971 Sheet 26972 Sheet 26973 Sheet 26974 Sheet 26975 Sheet 26976 Sheet 26977 Sheet 26978 Sheet 26979 Sheet 26980 Sheet 26981 Sheet 26982 Sheet 26983 Sheet 26984 Sheet 26985 Sheet 26986 Sheet 26987 Sheet 26988 Sheet 26989 Sheet 26990 Sheet 26991 Sheet 26992 Sheet 26993 Sheet 26994 Sheet 26995 Sheet 26996 Sheet 26997 Sheet 26998 Sheet 26999 Sheet 27000 Sheet 27001 Sheet 27002 Sheet 27003 Sheet 27004 Sheet 27005 Sheet 27006 Sheet 27007 Sheet 27008 Sheet 27009 Sheet 27010 Sheet 27011 Sheet 27012 Sheet 27013 Sheet 27014 Sheet 27015 Sheet 27016 Sheet 27017 Sheet 27018 Sheet 27019 Sheet 27020 Sheet 27021 Sheet 27022 Sheet 27023 Sheet 27024 Sheet 27025 Sheet 27026 Sheet 27027 Sheet 27028 Sheet 27029 Sheet 27030 Sheet 27031 Sheet 27032 Sheet 27033 Sheet 27034 Sheet 27035 Sheet 27036 Sheet 27037 Sheet 27038 Sheet 27039 Sheet 27040 Sheet 27041 Sheet 27042 Sheet 27043 Sheet 27044 Sheet 27045 Sheet 27046 Sheet 27047 Sheet 27048 Sheet 27049 Sheet 27050 Sheet 27051 Sheet 27052 Sheet 27053 Sheet 27054 Sheet 27055 Sheet 27056 Sheet 27057 Sheet 27058 Sheet 27059 Sheet 27060 Sheet 27061 Sheet 27062 Sheet 27063 Sheet 27064 Sheet 27065 Sheet 27066 Sheet 27067 Sheet 27068 Sheet 27069 Sheet 27070 Sheet 27071 Sheet 27072 Sheet 27073 Sheet 27074 Sheet 27075 Sheet 27076 Sheet 27077 Sheet 27078 Sheet 27079 Sheet 27080 Sheet 27081 Sheet 27082 Sheet 27083 Sheet 27084 Sheet 27085 Sheet 27086 Sheet 27087 Sheet 27088 Sheet 27089 Sheet 27090 Sheet 27091 Sheet 27092 Sheet 27093 Sheet 27094 Sheet 27095 Sheet 27096 Sheet 27097 Sheet 27098 Sheet 27099 Sheet 27100 Sheet 27101 Sheet 27102 Sheet 27103 Sheet 27104 Sheet 27105 Sheet 27106 Sheet 27107 Sheet 27108 Sheet 27109 Sheet 27110 Sheet 27111 Sheet 27112 Sheet 27113 Sheet 27114 Sheet 27115 Sheet 27116 Sheet 27117 Sheet 27118 Sheet 27119 Sheet 27120 Sheet 27121 Sheet 27122 Sheet 27123 Sheet 27124 Sheet 27125 Sheet 27126 Sheet 27127 Sheet 27128 Sheet 27129 Sheet 27130 Sheet 27131 Sheet 27132 Sheet 27133 Sheet 27134 Sheet 27135 Sheet 27136 Sheet 27137 Sheet 27138 Sheet 27139 Sheet 27140 Sheet 27141 Sheet 27142 Sheet 27143 Sheet 27144 Sheet 27145 Sheet 27146 Sheet 27147 Sheet 27148 Sheet 27149 Sheet 27150 Sheet 27151 Sheet 27152 Sheet 27153 Sheet 27154 Sheet 27155 Sheet 27156 Sheet 27157 Sheet 27158 Sheet 27159 Sheet 27160 Sheet 27161 Sheet 27162 Sheet 27163 Sheet 27164 Sheet 27165 Sheet 27166 Sheet 27167 Sheet 27168 Sheet 27169 Sheet 27170 Sheet 27171 Sheet 27172 Sheet 27173 Sheet 27174 Sheet 27175 Sheet 27176 Sheet 27177 Sheet 27178 Sheet 27179 Sheet 27180 Sheet 27181 Sheet 27182 Sheet 27183 Sheet 27184 Sheet 27185 Sheet 27186 Sheet 27187 Sheet 27188 Sheet 27189 Sheet 27190 Sheet 27191 Sheet 27192 Sheet 27193 Sheet 27194 Sheet 27195 Sheet 27196 Sheet 27197 Sheet 27198 Sheet 27199 Sheet 27200 Sheet 27201 Sheet 27202 Sheet 27203 Sheet 27204 Sheet 27205 Sheet 27206 Sheet 27207 Sheet 27208 Sheet 27209 Sheet 27210 Sheet 27211 Sheet 27212 Sheet 27213 Sheet 27214 Sheet 27215 Sheet 27216 Sheet 27217 Sheet 27218 Sheet 27219 Sheet 27220 Sheet 27221 Sheet 27222 Sheet 27223 Sheet 27224 Sheet 27225 Sheet 27226 Sheet 27227 Sheet 27228 Sheet 27229 Sheet 27230 Sheet 27231 Sheet 27232 Sheet 27233 Sheet 27234 Sheet 27235 Sheet 27236 Sheet 27237 Sheet 27238 Sheet 27239 Sheet 27240 Sheet 27241 Sheet 27242 Sheet 27243 Sheet 27244 Sheet 27245 Sheet 27246 Sheet 27247 Sheet 27248 Sheet 27249 Sheet 27250 Sheet 27251 Sheet 27252 Sheet 27253 Sheet 27254 Sheet 27255 Sheet 27256 Sheet 27257 Sheet 27258 Sheet 27259 Sheet 27260 Sheet 27261 Sheet 27262 Sheet 27263 Sheet 27264 Sheet 27265 Sheet 27266 Sheet 27267 Sheet 27268 Sheet 27269 Sheet 27270 Sheet 27271 Sheet 27272 Sheet 27273 Sheet 27274 Sheet 27275 Sheet 27276 Sheet 27277 Sheet 27278 Sheet 27279 Sheet 27280 Sheet 27281 Sheet 27282 Sheet 27283 Sheet 27284 Sheet 27285 Sheet 27286 Sheet 27287 Sheet 27288 Sheet 27289 Sheet 27290 Sheet 27291 Sheet 27292 Sheet 27293 Sheet 27294 Sheet 27295 Sheet 27296 Sheet 27297 Sheet 27298 Sheet 27299 Sheet 27300 Sheet 27301 Sheet 27302 Sheet 27303 Sheet 27304 Sheet 27305 Sheet 27306 Sheet 27307 Sheet 27308 Sheet 27309 Sheet 27310 Sheet 27311 Sheet 27312 Sheet 27313 Sheet 27314 Sheet 27315 Sheet 27316 Sheet 27317 Sheet 27318 Sheet 27319 Sheet 27320 Sheet 27321 Sheet 27322 Sheet 27323 Sheet 27324 Sheet 27325 Sheet 27326 Sheet 27327 Sheet 27328 Sheet 27329 Sheet 27330 Sheet 27331 Sheet 27332 Sheet 27333 Sheet 27334 Sheet 27335 Sheet 27336 Sheet 27337 Sheet 27338 Sheet 27339 Sheet 27340 Sheet 27341 Sheet 27342 Sheet 27343 Sheet 27344 Sheet 27345 Sheet 27346 Sheet 27347 Sheet 27348 Sheet 27349 Sheet 27350 Sheet 27351 Sheet 27352 Sheet 27353 Sheet 27354 Sheet 27355 Sheet 27356 Sheet 27357 Sheet 27358 Sheet 27359 Sheet 27360 Sheet 27361 Sheet 27362 Sheet 27363 Sheet 27364 Sheet 27365 Sheet 27366 Sheet 27367 Sheet 27368 Sheet 27369 Sheet 27370 Sheet 27371 Sheet 27372 Sheet 27373 Sheet 27374 Sheet 27375 Sheet 27376 Sheet 27377 Sheet 27378 Sheet 27379 Sheet 27380 Sheet 27381 Sheet 27382 Sheet 27383 Sheet 27384 Sheet 27385 Sheet 27386 Sheet 27387 Sheet 27388 Sheet 27389 Sheet 27390 Sheet 27391 Sheet 27392 Sheet 27393 Sheet 27394 Sheet 27395 Sheet 27396 Sheet 27397 Sheet 27398 Sheet 27399 Sheet 27400 Sheet 27401 Sheet 27402 Sheet 27403 Sheet 27404 Sheet 27405 Sheet 27406 Sheet 27407 Sheet 27408 Sheet 27409 Sheet 27410 Sheet 27411 Sheet 27412 Sheet 27413 Sheet 27414 Sheet 27415 Sheet 27416 Sheet 27417 Sheet 27418 Sheet 27419 Sheet 27420 Sheet 27421 Sheet 27422 Sheet 27423 Sheet 27424 Sheet 27425 Sheet 27426 Sheet 27427 Sheet 27428 Sheet 27429 Sheet 27430 Sheet 27431 Sheet 27432 Sheet 27433 Sheet 27434 Sheet 27435 Sheet 27436 Sheet 27437 Sheet 27438 Sheet 27439 Sheet 27440 Sheet 27441 Sheet 27442 Sheet 27443 Sheet 27444 Sheet 27445 Sheet 27446 Sheet 27447 Sheet 27448 Sheet 27449 Sheet 27450 Sheet 27451 Sheet 27452 Sheet 27453 Sheet 27454 Sheet 27455 Sheet 27456 Sheet 27457 Sheet 27458 Sheet 27459 Sheet 27460 Sheet 27461 Sheet 27462 Sheet 27463 Sheet 27464 Sheet 27465 Sheet 27466 Sheet 27467 Sheet 27468 Sheet 27469 Sheet 27470 Sheet 27471 Sheet 27472 Sheet 27473 Sheet 27474 Sheet 27475 Sheet 27476 Sheet 27477 Sheet 27478 Sheet 27479 Sheet 27480 Sheet 27481 Sheet 27482 Sheet 27483 Sheet 27484 Sheet 27485 Sheet 27486 Sheet 27487 Sheet 27488 Sheet 27489 Sheet 27490 Sheet 27491 Sheet 27492 Sheet 27493 Sheet 27494 Sheet 27495 Sheet 27496 Sheet 27497 Sheet 27498 Sheet 27499 Sheet 27500 Sheet 27501 Sheet 27502 Sheet 27503 Sheet 27504 Sheet 27505 Sheet 27506 Sheet 27507 Sheet 27508 Sheet 27509 Sheet 27510 Sheet 27511 Sheet 27512 Sheet 27513 Sheet 27514 Sheet 27515 Sheet 27516 Sheet 27517 Sheet 27518 Sheet 27519 Sheet 27520 Sheet 27521 Sheet 27522 Sheet 27523 Sheet 27524 Sheet 27525 Sheet 27526 Sheet 27527 Sheet 27528 Sheet 27529 Sheet 27530 Sheet 27531 Sheet 27532 Sheet 27533 Sheet 27534 Sheet 27535 Sheet 27536 Sheet 27537 Sheet 27538 Sheet 27539 Sheet 27540 Sheet 27541 Sheet 27542 Sheet 27543 Sheet 27544 Sheet 27545 Sheet 27546 Sheet 27547 Sheet 27548 Sheet 27549 Sheet 27550 Sheet 27551 Sheet 27552 Sheet 27553 Sheet 27554 Sheet 27555 Sheet 27556 Sheet 27557 Sheet 27558 Sheet 27559 Sheet 27560 Sheet 27561 Sheet 27562 Sheet 27563 Sheet 27564 Sheet 27565 Sheet 27566 Sheet 27567 Sheet 27568 Sheet 27569 Sheet 27570 Sheet 27571 Sheet 27572 Sheet 27573 Sheet 27574 Sheet 27575 Sheet 27576 Sheet 27577 Sheet 27578 Sheet 27579 Sheet 27580 Sheet 27581 Sheet 27582 Sheet 27583 Sheet 27584 Sheet 27585 Sheet 27586 Sheet 27587 Sheet 27588 Sheet 27589 Sheet 27590 Sheet 27591 Sheet 27592 Sheet 27593 Sheet 27594 Sheet 27595 Sheet 27596 Sheet 27597 Sheet 27598 Sheet 27599 Sheet 27600 Sheet 27601 Sheet 27602 Sheet 27603 Sheet 27604 Sheet 27605 Sheet 27606 Sheet 27607 Sheet 27608 Sheet 27609 Sheet 27610 Sheet 27611 Sheet 27612 Sheet 27613 Sheet 27614 Sheet 27615 Sheet 27616 Sheet 27617 Sheet 27618 Sheet 27619 Sheet 27620 Sheet 27621 Sheet 27622 Sheet 27623 Sheet 27624 Sheet 27625 Sheet 27626 Sheet 27627 Sheet 27628 Sheet 27629 Sheet 27630 Sheet 27631 Sheet 27632 Sheet 27633 Sheet 27634 Sheet 27635 Sheet 27636 Sheet 27637 Sheet 27638 Sheet 27639 Sheet 27640 Sheet 27641 Sheet 27642 Sheet 27643 Sheet 27644 Sheet 27645 Sheet 27646 Sheet 27647 Sheet 27648 Sheet 27649 Sheet 27650 Sheet 27651 Sheet 27652 Sheet 27653 Sheet 27654 Sheet 27655 Sheet 27656 Sheet 27657 Sheet 27658 Sheet 27659 Sheet 27660 Sheet 27661 Sheet 27662 Sheet 27663 Sheet 27664 Sheet 27665 Sheet 27666 Sheet 27667 Sheet 27668 Sheet 27669 Sheet 27670 Sheet 27671 Sheet 27672 Sheet 27673 Sheet 27674 Sheet 27675 Sheet 27676 Sheet 27677 Sheet 27678 Sheet 27679 Sheet 27680 Sheet 27681 Sheet 27682 Sheet 27683 Sheet 27684 Sheet 27685 Sheet 27686 Sheet 27687 Sheet 27688 Sheet 27689 Sheet 27690 Sheet 27691 Sheet 27692 Sheet 27693 Sheet 27694 Sheet 27695 Sheet 27696 Sheet 27697 Sheet 27698 Sheet 27699 Sheet 27700 Sheet 27701 Sheet 27702 Sheet 27703 Sheet 27704 Sheet 27705 Sheet 27706 Sheet 27707 Sheet 27708 Sheet 27709 Sheet 27710 Sheet 27711
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| US2022335952A1 | Cited by | United States of America | Search report |
| US2022253951A1 | Cited by | United States of America | Search report |
| US12093198B2 | Cited by | United States of America | Search report |
| US12046072B2 | Cited by | United States of America | Search report |
| US2022076459A1 | Cited by | United States of America | Search report |
| US11875109B1 | Cited by | United States of America | Search report |
| US2023004749A1 | Cited by | United States of America | Search report |
| US2023217010A1 | Cited by | United States of America | Search report |
| US2023091581A1 | Cited by | United States of America | Search report |
| US12101317B2 | Cited by | United States of America | Search report |
| US2023102661A1 | Cited by | United States of America | Search report |
| CN115797496A | Cited by | China | Search report |
| CN115082129A | Cited by | China | Search report |
| US11947604B2 | Cited by | United States of America | Search report |
| US11978221B2 | Cited by | United States of America | Search report |
| US2021232805A1 | Cited by | United States of America | Search report |
| CN116467722A | Cited by | China | Search report |
| US11874862B2 | Cited by | United States of America | Search report |
| US2021303644A1 | Cited by | United States of America | Search report |
| US11756185B2 | Cited by | United States of America | Search report |
| US12093253B2 | Cited by | United States of America | Applicant |
| CN117576381A | Cited by | China | Search report |
| US2023401257A1 | Cited by | United States of America | Search report |
| US11568279B2 | Cited by | United States of America | Search report |
| US2022277327A1 | Cited by | United States of America | Search report |
| US2023066513A1 | Cited by | United States of America | Search report |
| US11966701B2 | Cited by | United States of America | Applicant |
| CN118135506A | Cited by | China | Search report |
| US2022050955A1 | Cited by | United States of America | Search report |
| CN115658014A | Cited by | China | Search report |
| US2022366170A1 | Cited by | United States of America | Search report |
| CN114882299A | Cited by | China | Search report |
| US12038884B2 | Cited by | United States of America | Search report |
| CN118115501A | Cited by | China | Search report |
| CN117635174A | Cited by | China | Search report |
| CN118157992A | Cited by | China | Search report |
| US2024265106A1 | Cited by | United States of America | Search report |
| US11925446B2 | Cited by | United States of America | Search report |
| US11687497B2 | Cited by | United States of America | Search report |
| US2023376547A1 | Cited by | United States of America | Search report |
| US2024095150A1 | Cited by | United States of America | Search report |
| US2021294863A1 | Cited by | United States of America | Search report |
| CN114781882A | Cited by | China | Search report |
| US2021192057A1 | Cited by | United States of America | Search report |
| US11829420B2 | Cited by | United States of America | Applicant |
| US11475343B2 | Cited by | United States of America | Search report |
| US2023030794A1 | Cited by | United States of America | Search report |
| US2021052176A1 | Cited by | United States of America | Search report |
| US11568877B2 | Cited by | United States of America | Search report |
| CN116993785A | Cited by | China | Search report |
| CN115146716A | Cited by | China | Search report |
| US2023082420A1 | Cited by | United States of America | Pre-grant |
| US2020111382A1 | Cited by | United States of America | Search report |
| US2023318938A1 | Cited by | United States of America | Search report |
| US11803599B2 | Cited by | United States of America | Search report |
| US11961593B2 | Cited by | United States of America | Applicant |
| US2024095457A1 | Cited by | United States of America | Search report |
| US2022351506A1 | Cited by | United States of America | Search report |
| CN117251555A | Cited by | China | Search report |
| CN116776984A | Cited by | China | Search report |
| US2023297633A1 | Cited by | United States of America | Search report |
| US2021232771A1 | Cited by | United States of America | Search report |
| US2023214822A1 | Cited by | United States of America | Search report |
| US2022197312A1 | Cited by | United States of America | Search report |
| CN115830009A | Cited by | China | Search report |
| CN114818095A | Cited by | China | Search report |
| US12050858B2 | Cited by | United States of America | Search report |
| US2023281648A1 | Cited by | United States of America | Search report |
| US11483621B2 | Cited by | United States of America | Search report |
| US2021171283A1 | Cited by | United States of America | Search report |
| US11748488B2 | Cited by | United States of America | Search report |
| US2023050280A1 | Cited by | United States of America | Search report |
| US11531724B2 | Cited by | United States of America | Search report |
| CN115115908A | Cited by | China | Search report |
| US2024005522A1 | Cited by | United States of America | Search report |
| US11789466B2 | Cited by | United States of America | Search report |
| US11971851B2 | Cited by | United States of America | Search report |
| US11777818B1 | Cited by | United States of America | Search report |
| US11928610B2 | Cited by | United States of America | Search report |
| CN118551191A | Cited by | China | Search report |
| US11687635B2 | Cited by | United States of America | Applicant |
| US11930162B2 | Cited by | United States of America | Search report |
| US2022335752A1 | Cited by | United States of America | Search report |
| US11599725B2 | Cited by | United States of America | Search report |
| US2023144757A1 | Cited by | United States of America | Search report |
| CN116760952A | Cited by | China | Search report |
| US2022215622A1 | Cited by | United States of America | Search report |
| CN116662645A | Cited by | China | Search report |
| US2021248541A1 | Cited by | United States of America | Search report |
| US12105647B2 | Cited by | United States of America | Search report |
| CN114920198A | Cited by | China | Search report |
| US2024135035A1 | Cited by | United States of America | Search report |
| US2022172511A1 | Cited by | United States of America | Search report |
| US11651443B2 | Cited by | United States of America | Search report |
| US2022092787A1 | Cited by | United States of America | Search report |
| WO2023235476A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| US2023069720A1 | Cited by | United States of America | Search report |
| US11875708B2 | Cited by | United States of America | Search report |
| US11816176B2 | Cited by | United States of America | Search report |
| US2023098137A1 | Cited by | United States of America | Search report |
26 members in 1 office
Priority claims27
| Document | Office | Kind | Date |
|---|---|---|---|
| 201161538824 | United States of America | P | |
| 201213423758 | United States of America | A | |
| 201213621135 | United States of America | A | |
| 201213621164 | United States of America | A | |
| 201261701789 | United States of America | P | |
| 201313781303 | United States of America | A | |
| 201361802810 | United States of America | P | |
| 201361832816 | United States of America | P | |
| 201313953047 | United States of America | A | |
| 201361864633 | United States of America | P | |
| 201361871860 | United States of America | P | |
| 201414201974 | United States of America | A | |
| 201414218923 | United States of America | A | |
| 201815919170 | United States of America | A | |
| 201815919170 | United States of America | A | |
| 201862786469 | United States of America | P | |
| 201862786469 | United States of America | P | |
| 201916729944 | United States of America | A | |
| 201916729944 | United States of America | A | |
| 202117543485 | United States of America | A | |
| 15919170 | – | – | – |
| 16729944 | – | – | – |
| 62786469 | – | – | – |
| US201815919170 | – | – | – |
| US201862786469P | – | – | – |
| US201916729944 | – | – | – |
| US202117543485 | – | – | – |
Members26
| Document | Office | Kind | |
|---|---|---|---|
| US8311973B1 | United States of America | B1 | |
| US2013080369A1 | United States of America | A1 | |
| US2013080370A1 | United States of America | A1 | |
| US8463735B2 | United States of America | B2 | |
| US8515890B2 | United States of America | B2 | |
| US2013330008A1 | United States of America | A1 | |
| US2014079297A1 | United States of America | A1 | |
| US8694459B2 | United States of America | B2 | |
| US2014188462A1 | United States of America | A1 | |
| US2014201126A1 | United States of America | A1 | |
| US8873813B2 | United States of America | B2 | |
| US8949170B2 | United States of America | B2 | |
| US2015149155A1 | United States of America | A1 | |
| US9063930B2 | United States of America | B2 | |
| US9171261B1 | United States of America | B1 | |
| US2015310301A1 | United States of America | A1 | |
| US9262688B1 | United States of America | B1 | |
| US9424533B1 | United States of America | B1 | |
| US9916538B2 | United States of America | B2 | |
| US2018204111A1 | United States of America | A1 | |
| US2020184278A1 | United States of America | A1 | |
| US11074495B2 | United States of America | B2 | |
| US11195057B2 | United States of America | B2 | |
| US2022121884A1 | United States of America | A1 | |
| US11914674B2 | United States of America | B2 | |
| US2024241924A1 | United States of America | A1 |
42 transactions on the USPTO file
Allowed without a rejection on record.
- Non-final rejections
- 0
- Final rejections
- 0
- RCEs
- 0
- Appeals
- 0
Over time
Point at a mark for the transactionTransactions
| Event | Code | |
|---|---|---|
| Mail Patent eGrant NotificationMEPG_NTF | MEPG_NTF | |
| Recordation of Patent Grant MailedPGM/ | PGM/ | |
| Patent eGrant NotificationEPG_NTF | EPG_NTF | |
| Recordation of Patent eGrantEPG/ | EPG/ | |
| Patent Issue Date Used in PTA CalculationAllowedPTAC | PTAC | |
| Issue Notification MailedAllowedWPIR | WPIR | |
| Dispatch to FDCD1935 | D1935 | |
| Application Is Considered Ready for IssuePILS | PILS | |
| Issue Fee Payment VerifiedN084 | N084 | |
| Issue Fee Payment ReceivedIFEE | IFEE | |
| Filing Receipt - ReplacementFLRCPT.R | FLRCPT.R | |
| Mail Notice of AllowanceAllowedMN/=. | MN/=. | |
| Notice of Allowance Data Verification CompletedAllowedN/=. | N/=. | |
| Information Disclosure Statement consideredIDSC | IDSC | |
| Information Disclosure Statement consideredIDSC | IDSC | |
| Information Disclosure Statement consideredIDSC | IDSC | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Application ready for PDX access by participating foreign officesCCRDY | CCRDY | |
| PG-Pub Issue NotificationPG-ISSUE | PG-ISSUE | |
| Filing Receipt - CorrectedFLRCPT.C | FLRCPT.C | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Application Dispatched from OIPEOIPE | OIPE | |
| FITF set to YES - revise initial settingFTFS | FTFS | |
| Application Is Now CompleteCOMP | COMP | |
| Filing Receipt - UpdatedFLRCPT.U | FLRCPT.U | |
| Mail Pre-Exam NoticeMPEN | MPEN | |
| Patent Term Adjustment - Ready for ExaminationPTA.RFE | PTA.RFE | |
| Pre-Exam Office Action WithdrawnW/OA | W/OA | |
| Change in Power of Attorney (May Include Associate POA)PA.. | PA.. | |
| Notice Mailed--Application Incomplete--Filing Date AssignedINCD | INCD | |
| Filing ReceiptFLRCPT.O | FLRCPT.O | |
| FITF set to YES - 1.55/1.78 statement filedFTFF | FTFF | |
| Applicant Has Filed a Verified Statement of Small Entity Status in Compliance with 37 CFR 1.27SMAL | SMAL | |
| Information Disclosure Statement (IDS) FiledM844 | M844 | |
| Information Disclosure Statement (IDS) FiledM844 | M844 | |
| Information Disclosure Statement (IDS) FiledM844 | M844 | |
| Additional Application Filing FeesADDFLFEE | ADDFLFEE | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| Entity Status Set To Undiscounted (Initial Default Setting or Status Change)BIG. | BIG. | |
| Initial Exam Team nnIEXX | IEXX |
7 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Information on status: patent grantGrantedSTCF | STCF | |
| Information on status: patent application and granting procedure in generalSTPP | STPP | |
| Information on status: patent application and granting procedure in generalSTPP | STPP | |
| AssignmentAS | AS | |
| Information on status: patent application and granting procedure in generalSTPP | STPP | |
| Fee payment procedureFEPP | FEPP | |
| Fee payment procedureFEPP | FEPP |
Numbers
- Publication
- 20220121884
- Publication, DOCDB
- 2022121884
- Publication, EPODOC
- US2022121884
- Application
- 17543485
- Application, DOCDB
- 202117543485
- Application, EPODOC
- US202117543485
Titles
- English
- System and Method for Extremely Efficient Image and Pattern Recognition and Artificial Intelligence Platform
Patent term adjustment
- A delay
- +246 daysthe office missed an examination deadline
- Net adjustment
- 246 days
Classification
- CPC, 20
- G06K9/6264
- G06V10/25
- G06F18/2185
- G06F16/3344
- G06N3/0436
- G06F16/43
- G06F16/953
- G06N3/006
- G06F18/2413
- G06N3/043
- G06N3/044
- G06N3/045
- G06N3/084
- G06N5/025
- G06N7/01
- G06N7/023
- G06V10/454
- G06V10/764
- G06V10/82
- G06V40/171
- IPC, 5
- G06K9 62
- G06N3 04
- G06F16 43
- G06F16 953
- G06N3 00