System and method for analysis of light-matter interaction based on spectral convolution

This application is incorporated herein by reference in its entirety below: U.S. Provisional Patent Application No. 61 / 019,440 filed on January 7, 2008, filed on June 16, 2008. Priority is claimed for US Provisional Patent Application No. 61 / 061,852 and US Patent Application No. 11 / 970,448 filed on January 7, 2008.

Embodiments of the invention include the collection of skin and non-skin images using a non-invasive imaging apparatus, the creation of skin conditions based at least in part on the analysis of such images, and at least subsequent images. Includes methods and devices that enable collection and preparation-based monitoring of skin conditions. Embodiments of the present invention further relate to the areas of skin care devices and systems that can facilitate skin care determinations, in particular the areas of devices for skin condition assessment, skin care prescription advice, and skin care prescription effect tracking.

Embodiments of the present invention further relate to image processing technology. More specifically, embodiments of the present invention relate to determining the skin phototype of images taken in a Red Green Blue (RGB) color imaging system and other skin features (eg, elasticity, etc.). It can be further applied to the classification of melanoma, oil concentration, etc.), melanoma, skin-related tumors, and skin-related diseases.

The skin is the largest organ in the integumentary system, further including ancillary structures such as hair, nails, scales, skin, feathers, sweat glands and their products. The skin contains multiple layers of epithelial tissue that protect the underlying muscles and organs. Since the skin is constantly attacked by a variety of external and internal factors, it can be affected by a number of illnesses. Therefore, it is important to monitor skin health and the effectiveness of any treatment, skin care product, or cosmetic applied to the skin.

Some well-known methods of conventional photographic skin care determination systems are known as "clinical imaging". Some of the well-known methods require illuminating the skin surface with white light as the digital image is captured by the camera. However, the effectiveness of clinical imaging is diminished by the mirror-like (mirror-like) reflexes of the skin.

Existing processes that make skin care decisions for both medical and cosmetic purposes are based on scattered information gathered from multiple sources over different periods of time. Existing processes are cumbersome, inefficient, and result in delayed, suboptimal skin care decisions. Examples of skin care determinations that can be significantly enhanced by the principles of the invention include diagnosing skin conditions, selecting skin care products and formulations, and tracking the effects of skin care products and formulations over time. Skin care formulations include both the selection of the appropriate skin care product and the entire procedure for applying the selected skin care product, including the appropriate amount, timing, method, and frequency of application of the skin care product.

There are various methods to determine and monitor skin health, but most require access to a dermatologist or dermatologist facility, making access to the necessary resources difficult and inconvenient. Yes, and can be very expensive. A brief skin health condition that can be performed by the user with or without training and without face-to-face consultation, and skin images may be presented to experts, analysis facilities, or for automated analysis. Judgment and monitoring solutions are needed.

Skin characteristics are typically determined using the Fitzpatrick classification. Skin phototypes are categorized according to the traditional Fitzpatrick skin typing test questionnaire (skin type scale), which ranges from very fair (eg, skin type I) to very dark (eg, skin type VI). To. Conventionally, various image processing techniques for determining skin characteristics using captured skin images have been disclosed. In conventional digital image processing techniques, it is often useful to detect multiple features in a captured skin image, such as skin color. This information is used, for example, to adjust the skin color in the image for comfortable perception. Skin color determination is further used in face detection and face recognition algorithms, automatic image retrieval algorithms, and red eye correction algorithms.

Few studies have been conducted on the objective measurement of human skin coloration, which allows for human skin color classification. The classification of human skin coloring will be useful in the medical field, for example, for quantifying skin erythema, trauma, the effects of UV radiation, and other skin coloring phenomena. In the field of computer graphics, human images can be depicted more accurately in video conferencing, and human appearance can be improved or modified. The technique of digital skin imaging analysis has identified various skin responses that are useful indicators of various skin condition parameters, but can identify and use additional unique responses of the skin that indicate skin condition and skin characteristics. It is still desirable. Cosmetological appearance is one of the top priorities for most modern working people. The technology or system existing in the prior art analyzes the skin condition and proposes an appropriate product in order to improve the cosmetic appearance of a person.<u style="single">Prior art document information related to the invention of this application includes the following (including documents cited at the international stage after the international filing date and documents cited when domestically transferred to another country).</u>[Prior Art Document] [Patent Document]

[Patent Document 1] US Patent Application Publication No. 2002/0084417 [Patent Document 2] U.S. Patent Application Publication No. 2006/0227137 [Patent Document 3] US Pat. No. 6,620,33 [Patent Document 4] U.S. Patent Application Publication No. 2006/0281068 [Patent Document 5] US Patent Application Publication No. 2007/0178067

<p num="0011"> There is a need for speed-efficient methods and systems that minimize errors to determine the phototype of the skin.</p><p num="0012"> Real-time analysis of digitally captured skin properties facilitates timely skin condition assessment, skin prescription advice, and skin prescription effect tracking.</p><p num="0013"> The problem of generating skin condition assessments in real time is that it is possible to perform real-time analysis of digital skin data obtained partially using diffuse spectroscopy and / or detect the three primary color components of re-radiated white light. It is solved by having a skin condition analysis module.</p><p num="0014"> From the point of view of the present invention, the skin care device comprises an electromagnetic radiation source capable of directing incident electromagnetic radiation to a part of the user's skin, and a radiation detector that measures various parameters of radiation re-emitted from the part. A skin condition analysis module coupled to a detector that can generate real-time skin condition assessments based in part on at least one of RGB analysis and scattering reflectance analysis of radiation parameters. May include modules. In the apparatus, the incident electromagnetic radiation may include at least one of the visible, near-infrared, and near-ultraviolet spectra. The incident radiation may include white light. In the device, the radiation parameters may include at least the degree of polarization of the re-radiated radiation. In the device, the source may be a set of light emitting diodes. In the device, the skin condition assessment may also be based, in part, on the analysis of photographic images of the skin area around the site. In the device, the device may be a small device. Small size means that the dimensions of the detector do not exceed 6 inches. The device may further include a memory module that stores a skin condition assessment. The device may further include a user interface. The user interface may also be manipulated using voice commands. In the device, the skin evaluation data of the site may be superimposed on the image of the larger skin area and displayed on the display surface. The device may also have an access restriction module used to restrict access to authorized users only. The access restriction module may be based on biometric access control. The device can generate warnings about abnormal skin conditions in real time. The device may also have a skin care prescription advice module that produces displayable skin care prescription advice. Skin care prescribing advice includes determining the user's skin profile and using skin care prescribing advice for people with similar profiles. May be at least partially based on. The Skin Care Prescription Advice Module may be linked to the product database. The product database may include products available in stores. The availability of certain products advised by the Skin Care Prescription Advice Module may be indicated by audiovisual signals. The device may also have a skin care prescription effect module that produces a displayable skin care prescription effect report. The device may also have a communication module that communicates with the remote computer. Communication may be done wirelessly. Communication may be made via the Internet. The remote computer may be operated by a doctor. The device may be rod-shaped. The device can be worn by the user.</p><p num="0015"> From the point of view of the present invention, the skin care device comprises an electromagnetic radiation source capable of directing incident electromagnetic radiation to a part of the user's skin, a detector for measuring various parameters of radiation re-radiated from the part, and detection. A skin condition analysis module coupled to a vessel that can generate real-time skin condition assessments based in part on at least one of RGB analysis and scattering reflectance analysis of radiation parameters. And a display panel that reflects the user's image. In the device, the display panel may be a touch sensor type so as to trigger the display of the enlarged image of the part by touching the part of the skin area image displayed on the display panel. The device may also have a camera. The camera may be integrated with the display panel. The camera may be wirelessly linked to the display panel. In the device, the display panel may be a mirror. In the device, the stored image of the user is used to automatically identify the person. The device may also have a user interface to control the skin care device. The user interface may also be manipulated using voice commands. The device may also have a skin care prescription advice module capable of generating displayable skin care prescription advice. Skin care prescribing advice may be at least partially based on determining the user's skin profile and using skin care prescribing advice for persons with similar profiles. The device may also have a skin care prescription effect module capable of generating a displayable skin care prescription effect report.</p><p num="0016"> In view of the present invention, the imaging device allows the user to take high-magnification photographs of the skin near the area of interest, selectively medical or non-medical text and data responses, cosmetic analysis, diagnostic and treatment advice. , And these photos can be submitted with follow-up.</p><p num="0017"> In view of the present invention, the methods and systems of non-invasive imaging devices include an illumination source that includes an incident light source to illuminate the skin and a detector that detects the degree of polarization of the light reflected from the skin. May have. In this method and system, the illumination source may be positioned to direct the light at a selected angle alpha. The changing alpha can change the measurement depth of the layers in the skin. Each depth may have a particular angle that produces total polarization reflection. In this method and system, the incident light source may be a non-polarized light source. The unpolarized light may be white light, multiple selection wavelengths, or a single selection wavelength. This method and system may further have sensors that capture images of reflected or re-radiated light. The method and system may further have optics to detect reflections or re-radiated light from the skin. This method may determine both reflected or re-reflected light and new emitted light through the process of absorption and re-emission. This method and system may further have communication equipment to transmit the detected information. This method and system may further have storage equipment to store the information collected by the device.</p><p num="0018"> In view of the present invention, methods and systems for determining skin condition include illuminating the skin with an incident light source, detecting the degree of polarization of light reflected from the skin, and polarization of reflected or re-synchrotron radiation. It has to judge the skin condition based on the appearance. In this method and system, the incident light may be directed at a selected angle alpha. The changing alpha can change the measurement depth of the layers in the skin. Each depth may have a particular angle that produces total polarization reflection. In this method and system, the incident light source may be a non-polarized light source. The unpolarized light may be white light, multiple selective wavelengths, or a single wavelength. In the method of claim, the state of polarization may be at least one of direction, amplitude, phase, angle, shape, degree, quantity and the like. In this method and system, the determination may be made using an algorithm. Algorithms may include artificial neural networks, non-linear regression, genetic algorithms, fuzzy logic, fractal analysis and multi-fractal analysis. The method and system may further have to filter the reflected or re-radiated light to obtain polarized light of at least one wavelength defined by the filter output. Algorithmic analysis may be performed on filtered images. In this method and system, the determination may include creating an image from the difference between the reflected scattered light and the reflected polarized light. In this method and system, the determination may include comparing the polarization of reflected or re-radiated light with a calibration signal. In this method and system, the determination may further have to consider at least one of user input and visual analysis.</p><p num="0019"> From the viewpoint of the present invention, the non-invasive imaging apparatus has an illumination source including an incident light source for directing light to the region of interest, and a detector for detecting the degree of polarization of the light reflected from the region of interest. There is. In this method and system, the illumination source may be positioned to direct the light at a selected angle alpha. The changing alpha can change the measurement depth of the layers in the skin. Each depth may have a particular angle that produces total polarization reflection. In this method and system, the incident light source may be a non-polarized light source. The unpolarized light source may be white light, multiple selective wavelengths, or a single wavelength. This method and system may further have sensors that capture images of reflected or re-radiated light. The method and system may further have optics to detect reflections or re-radiated light from the skin. This method and system may further have communication equipment to transmit the detected information. This method and system may further have storage equipment to store the information collected by the device.</p><p num="0020"> From the point of view of the present invention, the method of determining the water level in the skin is to emit incident light toward the skin structure, detect the degree of polarization of the light caused by the skin structure, and the polarized light. And to determine the moisture level based on the amount of reflected or re-radiated light. This method and system further comprises combining a moisture level assessment with a skin color index to determine brightness. In this method and system, the incident light may be unpolarized light. The unpolarized light may be white light, light of a plurality of selected wavelengths or a single wavelength, or monochromatic light of one or more. In this method and system, the determination may involve the use of algorithms. In this method and system, determining the moisture level may be based on the ratio of polarized light to reflected or re-radiated light.</p><p num="0021"> From the viewpoint of the present invention, the method and system for determining the elasticity of the skin are to emit incident light toward the skin structure, detect the state of polarization of the light reflected by the skin structure, and the state of polarization. To correlate with the concentration of elastin and to determine the elastic level based on the concentration of elastin. In this method and system, the determination may involve the use of algorithms. In this method and system, the incident light may be unpolarized light. The unpolarized light may be white light, light of multiple selection wavelengths, or a single wavelength of light.</p><p num="0022"> In view of the present invention, methods and systems for determining skin stiffness include emitting incident light toward the skin structure, detecting the state of polarization of the light reflected by the skin structure, and of the polarization. It has to correlate the appearance with the concentration of at least one of elastin or collagen and the activity of the sebaceous glands, and to determine the firmness based on the concentration of at least one of elastin or collagen and the activity of the sebaceous glands. In this method and system, sebaceous gland activity may be indicated by at least one of the number of glands, the rate of gland opening and closing, and the level of clogging / filling. In this method and system, correlation may involve the use of algorithms.</p><p num="0023"> In view of the present invention, methods and systems for acquiring the biophysical properties of the skin perform spectral analysis of image data captured from the degree of polarization and absorption and re-emission of reflection of incident light from the skin structure. Has the properties of melanin cells, melanin, hemoglobin, porphin, keratin, carotene, collagen, elastin, sebum, sebaceous gland activity, pores (sweat and sebum), water level, elasticity, lightness, firmness, fine wrinkles, Number and steps of wrinkles, pore size, percentage of open pores, skin elasticity, skin split lines, stains, skin color, psoriasis, allergic reactions, red areas, common skin disorders or infections, tumors, sun dermatitis, rashes, Scratch, acne, acne, insect bite, scab, bleeding, injury, inflammation, light damage, pigmentation, tone, tattoo, burn rate / burn classification, hokuro (mother spots, mother's spots), skin lesions (structure) , Color, size / asymmetry), melanoma, skin appearance disease, skin lesions, cellulite, swelling, vesicular disease, congenital skin syndrome, (sub) dermatomycosis, liver plaque, vascular condition, alcohol, cloudy Vein, skin texture, skin ulcers, wound healing, postoperative follow-up, melanin cell lesions, non-melanin cell lesions, basal cell carcinoma, seborrheic keratopathy, sebaceous (greasy), nail and / or hair related concerns At least one of the structure, form, concentration, number, size, condition, and stage of at least one of the above.</p><p num="0024"> In view of the present invention, the systems and methods provide an interface that includes a social networking domain or rating / ranking system and at least one of a skin condition determination facility and an advisory engine, and the user of the interface. All or selected parts may have to allow skin condition determination to be performed within the interface. In this method and system, the skin condition determination facility is a non-invasive imaging device that includes a light source having an incident light source to direct light to the skin and a detector that detects the degree of polarization of the light reflected from the skin. It may have to capture an image with and to determine the skin condition based on the appearance of polarized light reflected or re-radiated light. This method and system will receive product and prescription advice from the advice engine based on what other users with similar skin conditions are using and data on inclusions, efficacy, safety, etc. May have more. This method and system may further have to compare skin conditions, products, formulations, and recommended products or formulations with peers within the interface's social networking domain. The comparison may include an analysis of similarity based on a spectral analysis of the degree of polarization of the reflected or re-radiated light from the user's skin. In this method and system, the interface may include a prescription tracker. Prescription trackers may be popularized using drag-and-drop or click-to-add features. In this method and system, the interface may include rating equipment or product information equipment. Product information equipment may allow users to retrieve product information by searching. The search may be a product identifier, product rating, drag and drop item, image, barcode scan, skin condition, and profile search.</p><p num="0025"> In view of the present invention, the methods and systems for determining skin condition are to obtain answers to a series of subjective questions about the skin and to obtain an objective skin analysis using a skin imaging device. , May have an algorithmic combination of subjective and objective results to obtain skin condition.</p><p num="0026"> In view of the present invention, systems and methods that provide skin care advice based on skin condition and skin care goals achieve the skin care goals by acquiring the individual's skin condition, classifying the individual by skin condition, and achieving the skin care goals. Sometimes it has to advise other individuals in the category on effective products and formulations. In this method and system, the system may operate over a network. In this method and system, skin condition may be determined based on an analysis of the degree of polarization of light reflected from an individual's skin.</p><p num="0027"> In view of the present invention, the method of tracking the effectiveness of a skin care product or formulation is to obtain a basic skin condition assessment and advise monitoring intervals based on at least one of the skin care goals, products, and formulations. And to obtain a second skin condition assessment, compare the second assessment to the base assessment to determine progress towards skin care goals, and selectively prescribe or to improve skin condition. Has to optimize the product. In this method and system, skin assessment may be based on an analysis of the degree of polarization of light reflected from an individual's skin.</p><p num="0028"> In view of the present invention, personal skin condition analysis systems and related methods include an illumination source that includes an incident light source to direct light to the skin, a detector that detects the degree of polarization of the light reflected from the skin, and the like. It may have an imaging device that includes a user interface that controls the device. In this method and system, the device downloads image data to update at least one record of a performer, spa, salon, cosmetics sales, cosmetics manufacturer, clinical trial database, and third-party database. Suitable for interacting with physical interfaces. In this method and system, the illumination source may be positioned to direct the light at a selected angle alpha. The changing alpha can change the measurement depth of the layers in the skin. Each depth may have a particular angle that produces total polarization reflection. In this method and system, the incident light source may be a non-polarized light source. The unpolarized light may be white light, multiple selective wavelengths, or a single wavelength. This method and system may further have sensors that capture images of reflected or re-radiated light. The method and system may further have optics to detect reflections or re-radiated light from the skin. This method and system may further have communication equipment to transmit the detected information. This method and system may further have storage equipment to store the information collected by the device.</p><p num="0029"> From the viewpoint of the present invention, the non-invasive imaging apparatus may have an illumination source including an incident source for directing light to the skin and a detector for detecting the characteristics of the light reflected from the skin. In this device, the illumination source may be positioned to direct the light at a selected angle alpha. The changing alpha can change the measurement depth of the layers in the skin. Each depth may have a particular angle that produces total polarization reflection. In this device, the incident light source may be a polarized light source or a non-polarized light source. The unpolarized light may be at least one of white light, single wavelength light, and multiple single wavelength light. The device may further have a sensor that captures an image of reflected or re-radiated light. The device may further have optics to detect reflections or re-radiated light from the skin. The device may further have communication equipment to transmit the detected information. The device may further have storage equipment to store the information collected by the device. In this device, the reflected or re-radiated light may be at least one of polarized light and unpolarized light.</p><p num="0030"> In view of the present invention, methods and systems for determining skin condition include illuminating the skin with an incident light source, detecting the properties of light reflected from the skin, and at least one property of reflected or re-synchrotron radiation. It has to judge the skin condition based on. In this method and system, the incident light may be directed at a selected angle alpha. The changing alpha can change the measurement depth of the layers in the skin. Each depth may have a particular angle that produces total polarization reflection. In this method and system, the incident light may be unpolarized light or polarized light. The unpolarized light may be at least one of white light, single wavelength light, and multiple single wavelength light. In this method and system, the reflected or re-radiated light may be at least one of polarized light and unpolarized light. In this method and system, the properties may be at least one of a light source, light intensity, wavelength of light, angle of light, electrical and magnetic properties of light, and polarization state of light. .. The state of polarization may be at least one of direction, amplitude, phase, angle, shape, degree, amount and the like. In this method and system, the determination may be made using an algorithm. Algorithms may include artificial neural networks, non-linear regression, genetic algorithms, fuzzy logic, or fractal and multi-fractal analysis. This method and system may further include filtering reflected or re-radiated light to obtain light of the wavelength defined by the filter output. Analysis may be performed on filtered images. In this method and system, the determination may include creating an image of the difference between the reflected scattered light and the reflected polarized light. In this method and system, the determination may include comparing the polarization of reflected or re-radiated light with a calibration signal. In this method and system, the verdict considers at least one of user input and visual analysis.</p><p num="0031"> From the viewpoint of the present invention, the non-invasive imaging apparatus has an illumination source including an incident light source for directing light to the region of interest, and a detector for detecting the polarization characteristics of the light reflected from the region of interest. There is. In this device, the illumination source may be positioned to direct the light at a selected angle alpha. The changing alpha can change the measurement depth of the layers in the skin. Each depth may have a particular angle that produces total polarization reflection. In this device, the incident light source may be a polarized light source or a non-polarized light source. The unpolarized light source may be at least one of white light, single long light, and multiple single wavelength light. The device may further have a sensor that captures an image of reflected or re-radiated light. The device may further have optics to detect reflections or re-radiated light from the skin. The device may further have communication equipment to transmit the detected information. The device may further have storage equipment to store the information collected by the device. In this device, the reflected or re-radiated light may be at least one of polarized light and unpolarized light.</p><p num="0032"> In view of the present invention, systems and methods may be used to determine healthy melanocyte skin. The first reflection spectrum and / or emission spectrum from a sample that is skin malformation (SM) subtracts the reflection spectrum from normal and healthy skin (SN). The second obtained spectral plot (SM-SN) subtracts the reflection spectrum from the appropriate comparison screen, which represents the spectral plot of the light source (SO). Here, the pure changing properties produced by the skin emerged. Maximum, minimum, and zero position data on the wavelength scale, as well as maximum and minimum intensity data, are available to distinguish from melanoma, other malignant, or benign nevus and healthy skin. ..</p><p num="0033"> In view of the present invention, the systems and methods capture images of materials illuminated by angled incident white light and angled incident white light and generate normalized red and blue channel spectra for each image. And to correlate the normalized red and blue channel spectra to the wavelength scale to get the red and blue channel spectrum plots, and to get the red and blue normalized composite color channel spectrum plots. By subtracting the spectral plot of the angled light from the spectral plot of the unangled light for each color channel to generate, and also to generate the spectral label of the material, the synthesized synthetic red channel spectrum. It may have to convolve the spectral plot by subtracting the normalized synthetic blue channel spectral plot from the plot. In systems and methods, the illumination source may be positioned to direct the light at a selected angle alpha. The changing alpha can change the depth of measurement of a substance. In systems and methods, the unit scale of spectral labeling can also be wavelength differences. In systems and methods, substances are inorganic and / or organic substances. In systems and methods, spectral markers may be analyzed for the number of peaks and valleys, the amplitude and shape of the peaks, and at least one of the intermediate structures and patterns. In systems and methods, spectral labels may also be analyzed for metal composition, identification, purity, and intensity. In systems and methods, spectral labels may also be analyzed for water quality, composition, and purity. In systems and methods, the elements of the spectral label may be tagged and tracked over a long period of time to track changes in the properties of the substance. In systems and methods, spectral labels may also be analyzed to measure, track, or monitor skin conditions. In systems and methods, spectral labeling is counterfeit money It may be useful for the analysis of. In systems and methods, spectral labels may also be analyzed for at least one of sweat gland activity and antiperspirant effects. In systems and methods, spectral labeling may also be analyzed for mad cow disease. In the system, spectral labels may also be analyzed for food, all epidermis, melanoma and skin cancer, rheumatic diseases, and all diseases that appear on the skin. In systems and methods, spectral labeling can also be useful in monitoring postoperative cosmetic concerns. In systems and methods, spectral labeling can also be useful in predicting and monitoring secretions from the mammary glands of lactating women. In systems and methods, spectral labeling may be incorporated into the advisory engine to provide feedback and corrections to the formulation aspects. In the system and method, the ideal blue wavelength position of the Maxwell color triangle is aligned with the ideal red wavelength position of the Maxwell color triangle when convolving the synthetic spectrum plot to obtain a spectral label. ..</p><p num="0034"> Methods and systems for determining skin and cosmetological properties are disclosed. The minimum error output is generated. According to an exemplary embodiment of the invention, in the first aspect of the invention, the method of determining skin and cosmetic properties using color analysis is the three primary colors (Red Green Blue: RGB) for the acquired digital image. It may include a step of analyzing the color of the skin image for each pixel of the system. The process of analyzing the color of the skin image for each RGB pixel of the acquired digital image is to analyze a picture of a part of human skin by generating a table of colors that appear most frequently in the picture. May include.</p><p num="0035"> According to the first aspect, the method of determining skin and beauty properties using color analysis is after converting the colors acquired in the device-dependent RGB system to the device-independent standard RGB system (standard RGB: sRGB). It includes the step of generating the most frequent standard RGB (sRGB) samples in response to analyzing the color of the skin image for each RGB pixel of the acquired digital image. The process of generating the most frequent sRGB samples in response to analyzing the color of the skin image in an sRGB system for the acquired digital image may involve storing multiple sRGB values.</p><p num="0036"> In the present embodiment of the present invention, the sRGB system may be used for image analysis. For determination of other skin characteristics, melanoma, skin-related tumors, and skin-related diseases, YIQ, YCbCr, L^*a^*b b^*, L^*u^*v^*, And other color systems such as HSL / HSV require image analysis. Enhancements to current algorithms may include these color systems, and at least one of the presented sRGB analysis and this / these correlations.</p><p num="0037"> According to the first aspect, the method of determining skin and cosmetic properties using color analysis further comprises approximating the colors of the sRGB sample generated by the Gaussian normal distribution to generate the acquired digital image. It involves modeling the color distribution of the R, G and B components by a Gaussian probability distribution with the estimated parameters (expected values and standard deviations) of the sRGB sample. According to an exemplary embodiment of the invention, the step of approximating the color of an sRGB sample produced by a Gaussian normal distribution comprises approximating the color of an sRGB sample produced by superimposing a plurality of Gaussian normal distributions.</p><p num="0038"> According to the first aspect, the method of determining skin and cosmetological properties using color analysis comprises the step of generating a skin phototype by a determination tree unit in response to the color of the estimated distribution model parameters. Skin phototypes may be produced according to the corrected Fitzpatrick classification. According to an exemplary embodiment of the invention, the step of producing a skin phototype according to the corrected Fitzpatrick classification produces a skin phototype according to a skin type scale ranging from very light skin to very dark skin. Including doing.</p><p num="0039"> According to the second aspect, a skin phototyping system using photographic analysis may be disclosed. The system may include an image capture device that captures a digital image of the skin. The image capture device may include a digital camera unit.</p><p num="0040"> According to a second aspect, a skin phototyping system that uses photographic analysis may include an analyzer coupled to an image capture device that performs pixel-by-pixel analysis of a picture of a portion of human skin. .. The analyzer may include a quantizer that produces a color lookup table that most often appears in some pictures of human skin.</p><p num="0041"> According to the second aspect, a skin phototyping system using photo analysis was coupled to an image capture device that produced standard Red Green Blue (sRGB) samples for captured digital images of the skin. A sampling device may be included.</p><p num="0042"> According to the second aspect, a skin phototyping system using photo analysis approximates the color distribution parameters of an sRGB sample generated using estimates of captured digital images of the skin and standard deviations. May include an approximation device coupled to the sampling device. The approximation device may include at least one Gaussian normal distribution unit.</p><p num="0043"> According to the second aspect, a skin phototype determination system using photographic analysis is a determination tree unit coupled to an approximation device that uses the red and blue components of the approximated color to generate the skin phototype. May include. The determination tree unit may include a Fitzpatrick scaling unit that classifies skin phototypes according to a skin type scale ranging from very light skin to very dark skin.</p><p num="0044"> According to a second aspect, an exemplary embodiment of the invention is a scaled Gaussian that approximates the color of an sRGB sample generated using an estimate of the predicted and standard deviations of a captured digital image of the skin. The normal distribution unit is disclosed.</p><p num="0045"> According to a second aspect of the invention, a skin phototyping system that uses photographic analysis may include subsystems that determine the cosmetic properties of human and livestock elements. Cosmetological properties may further include properties relating to hair, nails, and skin.</p><p num="0046"> In another aspect, the system may include a sampling device that produces standard three primary color samples of captured digital images of the skin, the values of the generated standard three primary color samples range from 0 to 255, and for further processing. Be maintained.</p><p num="0047"> In another aspect, the system approximates the color distribution parameters of the sRGB sample generated with values in the range 0-255 by a Gaussian normal distribution using estimates of captured digital images of the skin and standard deviation. May include an approximation device coupled to the sampling device.</p><p num="0048"> In another aspect, the system further includes a determination tree unit coupled to an approximation device that uses the standard red and blue components of the approximated color to generate a phototype of the skin, making an algorithmic determination. The tree unit matches the estimated values and standard deviation estimates of captured images of the skin with the Fitzpatrick notation of skin analysis, which determines the phototype of the skin.</p><p num="0049"> In another aspect, the system may automatically adjust the light intensity, wavelength, and angle to assess various factors in the skin.</p><p num="0050"> In yet another aspect of the system, skin phototypes may be determined using photographic analysis used in the cosmetic and surgical industry.</p><p num="0051"> From the point of view of the present invention, the skin care device comprises an electromagnetic radiation source capable of directing incident electromagnetic radiation to a part of the user's skin, and a radiation detector that measures various parameters of radiation re-emitted from the part. A skin condition analysis module coupled to a detector that can generate real-time skin condition assessments based in part on at least one of RGB analysis and scattering reflectance analysis of radiation parameters. May include modules. In the apparatus, the incident electromagnetic radiation may include at least one of the visible, near-infrared, and near-ultraviolet spectra. The incident radiation may include white light. In the device, the radiation parameters may include at least the degree of polarization of the re-radiated radiation. In the device, the source may be a set of light emitting diodes. In the device, the skin condition assessment may also be based, in part, on the analysis of photographic images of the skin area around the site. In the device, the device may be a small device. Small size means that the dimensions of the detector do not exceed 6 inches. The device may further include a memory module that stores a skin condition assessment. The device may further include a user interface. The device may further include a display surface. The skin evaluation data of the site may be superimposed on an image of a larger skin area and displayed on the display surface. The device may further include an access restriction module used to restrict access to authorized users only. The access restriction module may be based on biometric access control. The device can generate warnings about abnormal skin conditions in real time. The user interface may be manipulated using voice commands and / or eye movement commands. The device may further include a skin care prescription advice module that produces displayable skin care prescription advice. Skin care prescribing advice is to determine the user's skin profile It may be at least partially based on the use of skin care prescribing advice for people with similar profiles. The Skin Care Prescription Advice Module may be linked to the product database. The product database may include products available in stores. The availability of certain products advised by the Skin Care Prescription Advice Module may be indicated by audiovisual signals. The device may further include a skin care prescription effect module that produces a displayable skin care prescription effect report. The device may further include a communication module that communicates with a remote computer. Communication may be done wirelessly. Communication may be made via the Internet. The remote computer may be operated by a doctor. The device may be rod-shaped. The device can be worn by the user.</p><p num="0052"> From the point of view of the present invention, the device is an electromagnetic radiation source capable of directing incident electromagnetic radiation to a part of the user's skin, a detector that measures various parameters of radiation re-radiated from the part, and a detector. A skin condition analysis module combined with a skin condition analysis module that can generate real-time skin condition assessments based in part on at least one of RGB analysis and scattering reflectance analysis of radiation parameters. May include a display panel that reflects the user's image. In the device, the display panel may be a touch sensor type so as to trigger the display of the enlarged image of the part by touching the part of the skin area image displayed on the display panel. Skin care devices may also include a camera. The camera may be integrated with the display panel. The camera may be wirelessly linked to the display panel. In the device, the display panel may be a mirror. In the device, the stored image of the user may be used to automatically identify the person. The device may further include a user interface that controls the skin care device. The user interface may be manipulated using voice commands and / or eye movement commands. The device may further include a skin care prescription advice module capable of generating displayable skin care prescription advice. Skin care prescribing advice may be at least partially based on determining the user's skin profile and using skin care prescribing advice for persons with similar profiles. The device may further include a skin care prescription effect module capable of generating a displayable skin care prescription effect report.</p><p num="0053"> From the point of view of the present invention, the systems and methods for moving information objects available on a website to a receptacle to communicate with a plurality of people in an access controlled community network include a person's prescription, a person's routine, and a plurality of people. Moving multiple information objects from a given website to a web-based network in response to the purpose of using one of the information objects and the degree of affinity of the first person for the second person. Drop-down movements in response to enabling and allowing the movement of multiple information objects from a given healthcare website, drag-and-drop movements that populate data, and a graphical user interface ( Graphical User It may include initiating at least one customized action from an action that includes a GUI) pop-up motion, and allowing the movement of multiple information objects between multiple websites. In systems and methods, multiple information objects ask questions about at least one of human skin condition, product information, articles, blog posts, images, videos, personalized messages, forum posts, and livestock skin condition. It may be related to votes. In systems and methods, multiple information objects relate to questionnaires about human cosmetology parameters and livestock cosmetology parameters. The questionnaire about human cosmetology parameters and livestock cosmetology parameters may include questions about at least one of human and livestock claws. The questionnaire about human cosmetology parameters and livestock cosmetology parameters may include questions about at least one of human hair and livestock hair. In systems and methods, information objects are used for purifying, protecting, treating, hydrating, elastic, firmness, radiance, lightness, anti-inflammatory properties, anti-scabies properties, anti-wrinkle action, tightening, exfoliating, It relates to controlling at least one of anti-redness properties, fat control, anti-aging properties, and black glow. In the system and method, the degree of affinity of the first person for the second person is the friendship between the first person and the second person, the friendship between the first person and the second person. Genetic similarities, lifestyle similarities between first and second people, weather similarities between first and second living environments, and with first people Have at least one of the skin type similarities with a second person. In systems and methods, the process of allowing the movement of multiple information objects between multiple websites is by dragging the item of interest to the user from one of the multiple websites in a given format. Includes sub-process of moving to affiliates of users accessing the website via electronic signals It doesn't matter. Affiliates of the user may be friends and relatives of the user or related experts. In systems and methods, the process of allowing the movement of multiple information objects from a given website to a web-based network is a Graphical User Interface in response to multiple end-user convenience and requirement parameters. : GUI) may include sub-steps that enable drop-down menus. In systems and devices, multiple people in a web-based network include multiple people in an online friendship network. In systems and devices, multiple people in a web-based network include multiple people in an online social network.</p><p num="0054"> In view of the present invention, including a social networking domain and at least one skin health assessment and advisory unit, the user of the interface performs the skin health assessment within the interface and determines the health assessment and maintenance data. An interface that allows you to receive product and prescription advice from the advice engine based on use is a prescription tracker populated using drag-and-drop equipment and a rating unit that ranks multiple healthcare equipment. And may include multiple web-based drag-and-drop products, web-based images, and product information units that allow users to obtain product information by performing a web-based search for bar code scanning. At the interface, the prescription tracker includes a diet tracking unit. At the interface, multiple healthcare facilities include skin cleansing, skin protection, skin moisture control, skin healing, skin elasticity, skin lightness, skin firmness, skin wrinkles, skin pore size, skin Have at least one of age and life stages, including stains, skin shine, hair color, hair type, and further including marriage, pregnancy, dating and social life. In the interface, product information includes product type, product function, product format, product relevance level, prescription information, product articles, product blogs, product safety, product toxicity, product effectiveness indicators, product cost. Have at least one of the information and the timeliness information of the product. In the interface, the interface is a multilingual customized interface for web-based applications, mobile phone applications, touch screen applications, and personal digital assistant applications. In the interface, the interface is a customized web-based access, control, of spectral analysis of image data obtained from the degree of polarization of incident light reflected and re-radiated from the skin structure. And seamlessly coupled with a skin imaging device for maintenance. The degree of polarization of incident light reflected and / or re-radiated from the skin structure is at least one of the three primary color (Red Green Blue: RGB) analysis of multiple digital images and the analysis by spectroscopic data image analysis. Derived from one.</p><p num="0055"> From the point of view of the present invention, the system and method for determining the health condition obtains answers to a series of subjective questions regarding the health condition and obtains an objective health condition evaluation report via a skin imaging device. It may include generating health output and actual skin type output by generating a combination of answers to a series of subjective questions and an objective health assessment report. .. In systems and methods, the output of the actual skin type is generated based on the biophysical properties produced by at least one of the person, spa, and cosmetic advisor who seeks skin health monitoring. In systems and methods, objective health assessment reports include systematic hydration, skin hydration, skin firmness, skin wrinkles, skin pore size, skin stains, skin shine, melanin cells, Melanin, hemoglobin, porphyrin, keratin, carotene, collagen, elastin, sebum, sebaceous gland activity, sweat pores, sebaceous pores, water level, elasticity, lightness, firmness, fine wrinkles, number of wrinkles, pore size, percentage of open pores , Skin elasticity, skin split line, stain, viscosity, epidermis, skin oil level, skin color, psoriasis, allergic reaction, redness, general skin diseases, infections, tumors, sunlight dermatitis, rash, scratches, acne, acne, Insect bites, scabs, bleeding, injuries, inflammation, light damage, pigmentation, tones, tattoos, burn rates, burn classification, hokuro, skin lesions, melanoma, skin appearance disorders, skin lesions, cellulite, blemishes, blisters Diseases, congenital skin syndrome, dermatomycosis, liver plaques, vascular condition, alcohol, spider veins, texture, skin ulcers, wound healing, postoperative follow-up, melanin cell lesions, non-melanin cell lesions, basal cell carcinoma Objective for at least one of age and life stages, including seborrheic keratopathy, sebaceous hair color, hair type, nail condition, and further including marriage, pregnancy, dating and social life A skin health assessment report may be included. Objective health assessment reports in systems and methods include email, SMS, MMS, and mobile. It is sent to the end user by at least one of Lefon, the Graphical User Interface (GUI) of the Internet connection device, and a personal digital assistant capable of a touch screen. Systems and methods may further include obtaining health assessment and maintenance data from physiologically polarized light data. The process of acquiring health status assessment and maintenance data from physiologically polarized light data involves acquiring health status assessment and maintenance data from a Red Green Blue (RGB) analyzer, which is white light data. , Blue light data, and at least one of ultraviolet light data. The process can further have to acquire at least one of white light data, blue light data and ultraviolet light data by reading and recording the condition of at least one of the dermis and epidermis. Obtaining health assessment and maintenance data from physiologically polarized light data has the acquisition of data on the age, geography, and demographics of persons subject to health monitoring. It has to acquire health condition assessment and maintenance data from an RGB) analyzer, which has at least one of white light data, blue light data, and ultraviolet light data. The process can further have to acquire at least one of white light data, blue light data and ultraviolet light data by reading and recording the condition of at least one of the dermis and epidermis. Obtaining health assessment and maintenance data from physiologically polarized light data has the acquisition of data on the age, geography, and demographics of persons subject to health monitoring. It has to acquire health condition assessment and maintenance data from an RGB) analyzer, which has at least one of white light data, blue light data, and ultraviolet light data. The process can further have to acquire at least one of white light data, blue light data and ultraviolet light data by reading and recording the condition of at least one of the dermis and epidermis. Obtaining health assessment and maintenance data from physiologically polarized light data has the acquisition of data on the age, geography, and demographics of persons subject to health monitoring.</p><p num="0056"> In view of the present invention, web-enabled health tracking methods and systems combine a camera with a photo-guide unit that generates notes for each captured photo and between the camera and a web-enabled computing system. Compare color parameters, symmetry parameters, and boundary parameters with an interface for uploading photos captured by a camera, a self-answer instruction module, and a scoring module combined with a frequently asked questionnaire unit. A graphical user interface included in a web-enabled computing system that produces a frequently asked questionnaire unit, which also has a comparison module combined with a scoring module, and a frequently asked questionnaire. An automation unit combined with a graphical user interface that enables time-based synchronization of units, scoring modules, and comparison modules, and a user training module, an article module combined with a user training module, a user training module, and articles. It may include a blogging unit coupled to a module and a learning unit coupled to an automation unit that launches a reporting unit that includes an email unit that emails health-related information. In systems and methods, the camera is provided to skin stains, laser treatment effects, cellulite inclusions in the skin, vein and capillary conditions, Botox treatment effects, anti-aging treatment effects, acne prevention treatment effects, and doctors. It has a tracking unit that tracks at least one of the skin's pictorial histories over a long period of time. Prolonged skin stains include at least one of scars, scars, rashes, lesions, and moles. In the system and method, the web-enabled computing system that uploads photos captured by the camera also has a walk-through module that walks through the characteristics of the skin health record of the first user of the system, and the system. Includes a personal skin photo album to view the pictorial history of regular users of the product, and a product quality menu to track product expiration dates. In the system and method, the interface for uploading photos also includes a photo reminder unit for the next photo of the system's regular users and a cosmetic state unit combined with the reminder unit that displays the current use of cosmetics to the system's regular users. including. Current use has the use of at least one of moisturizers, fungicides, toners, lasers, and Botox. The system and method may further include a photo-viewing unit that browses at least one of a given body condition, current use of cosmetics, and a recommended cosmetic use list on a date and time basis. In the system and method, the reporting unit also has a secure transmission unit that sends health assessment reports to health care providers, an affinity unit for discussing health assessment data with friends, and a printout that prints the health assessment data. It may include a unit.</p><p num="0057"> In view of the present invention, a mobile device-based health assessment system and method is combined with a photo capture device that captures a user's skin image of the mobile device and a photo capture device that uploads the captured skin image to a network location. Obtaining a remote diagnostic report by determining the location of the transmitted unit and the photo capture device, the global positioning device coupled to the photo capture device, and the weather condition at the user's position on the mobile device, photo capture It may include a weather estimation device coupled to the device. In the system and method, the photo capture device further comprises at least one of a skin photo-evaluation unit, a nail photo-evaluation unit, and a hair photo-evaluation unit. In the system and method, the global positioning device has a position tracker that answers the questions asked by the user regarding the user's geographical positioning. In systems and methods, location trackers include a database of weather-resistant cosmetics. The system and method may further include a telephone number tracker that allows the user of the mobile device to access the health assessment and cosmetic outlets.</p><p num="0058"> In view of the present invention, a system and method for estimating skin type and skin properties to create a unique spectral label is to convolve data from a first image captured by incident scattered white light. Is about reflected and / or re-emitted polarized or white light and convolution of data from a second image captured by incident polarized light, where the data is reflected and / or re-emitted polarized light. And at least to compare the edge positions of at least two unique convolutions generated by convolving data from the first and second images, and to generate a numerical skin type output. From two peculiar convolutions, determining the distance between the minimum intensity position and the maximum intensity position of the convoluted (RB) spectral plot may be included. In systems and methods, physiological white light has three spectral intervals, including a width of less than 100 nanometers. The three spectral intervals are for red, green, and blue (RGB). The three spectral intervals provide a natural sense of white light to the human eye. In the system and method, the step of comparing the edge positions of at least two unique convolutions compares the reflected and / or re-radiated polarized light component (RB) (WP) as well as the white light component (RB) W. Have that. The two unique convolutions of white light and polarized light also include a white red (WR) component, a white blue (Whilte Blue: WB) component, and reflected and / or re-radiated polarized blue (Polarized Blue: PB). Ingredients and reflected and / or re-radiated polarized red (Polarized Red) PR) Ingredients and. The two peculiar convolutions are based on numerical differences that correlate with medical standards. The system and method further determined a combination of multiple combinations of subtraction of the blue spectrum from red in white light and polarized white light, with spectral convolution schemes in which the spectral spacing is represented by wavelength scale spacing of 100 nanometers to 300 nanometers. It may be included.</p><p num="0059"> In view of the present invention, systems and methods for creating unique spectral labels for skin properties may also include RGB (three primary color) channel spectral plots generated from digital images containing the interaction of single wavelength photomaterials. Well, this allows skin type characteristic output, skin moisture conductivity, and skin elasticity to be generated on a numerical and descriptive basis. In systems and methods, RGB (three primary colors) channel spectral plots generated from digital images include multi-wavelength optical material interactions.</p><p num="0060"> From the point of view of the present invention, a system and method for tracking and storing the movement parameters of an imaging device that moves a target area include a step of capturing an image of the target area at a plurality of locations and an image in at least one captured frame. An imager by using processing technology to identify the direction of movement of the imager and by triangulating the position of the imager by comparing each frame with at least three unique characteristics captured. Including a step of recognizing the moving direction of the image and a step of comparing the captured image data with a predetermined image database in order to store the image of the target area and store the arrangement parameters of the imaging device. Good. In the system and method, the step of capturing an image of a target area at a plurality of locations includes a sub-step of capturing a continuous image of the target area. In a system and method, the step of capturing an image of a target area at multiple locations comprises a sub-step of capturing a frame-by-frame sequence of images of the target area. In the system and method, the step of identifying the moving direction of the imaging device using the image processing technique includes a sub-step of comparing the captured images on a frame-by-frame basis in order to identify the moving parameters of the imaging device. .. In systems and methods, the process of recognizing the direction of movement of an imager by comparing each frame with at least three unique properties captured to triangulate the position of the imager spans different frames. It has a sub-step of capturing the moving direction of the imaging device by comparing three or more peculiar positions.</p><p num="0061"> From the viewpoint of the present invention, the method of automatic position tracking and data storage of the imaging device, and the system include an image capturing unit, a positioning unit coupled to the image capturing unit that positions the imaging device in the target area, and an image. Triangularize the position of the imager to allow frame-by-frame comparison of captured images to identify the direction of movement of the imager, and the imager has three or more unique points. It may include an image processing unit that enables capture. In the system and method, the image capture unit has a digital camera. In systems and methods, image capture units are mobile devices and personal digital assistants (Personal Digital). Have at least one of Assistant: PDA). In the system and method, the image processing unit has a comparison unit that compares the positions of three or more unique points over different frames in order to capture the direction of movement of the imager. The system and method may further include a subsystem that measures the horizontal movement of the image capture unit from a given point to a new location in the area of interest.</p><p num="0062"> In view of the present invention, systems and methods for determining surgical resection margins include illuminating the skin of melanocyte lesions with an incident light source and the properties of light reflected and / or re-radiated from the melanocyte lesions. It may include detecting and determining the boundary between a melanocyte lesion and surrounding healthy tissue based on at least one property of reflection and / or re-radiation. In the system and method, the incident light is directed at the selected angle alpha. In the system and method, changing alpha changes the measurement depth of the layer of melanocyte lesions. Each depth has a specific angle that produces total polarization reflection. In systems and methods, the incident light is unpolarized light. Unpolarized light is at least one of white light, single wavelength light, and multiple single wavelength light. In systems and methods, the incident light is polarized light. In systems and methods, reflected and / or re-radiated light is at least one of polarized and unpolarized light. In systems and methods, a feature is at least one of a light source, light intensity, light wavelength, light angle, light electrical and magnetic properties, and light polarized state. The mode of polarization is at least one of direction, amplitude, phase, angle, shape, degree, and quantity. In systems and methods, the determination is made using an algorithm. Algorithms include at least one of artificial neural networks, fuzzy logic, fractal and multi-fractal analysis, non-linear regression, genetic algorithms, white light analysis, and RGB analysis. The system and method may further include filtering reflected and / or re-radiated light to obtain light of the wavelength defined by the filter output. Algorithm analysis is performed on the filtered image. In systems and methods, the determination involves creating an image of the difference between reflected scattered light and reflected polarized light. In systems and methods, the determination determines the mode of polarization of reflected and / or re-radiated light. Includes comparison with calibration signals. In systems and methods, the determination further includes taking into account at least one of user input and visual analysis.</p><p num="0063"> The above and other systems, methods, objectives, features, and advantages of the present invention will be apparent to those skilled in the art from the detailed description and drawings of the preferred embodiments below. All documents listed herein are incorporated herein by reference in their entirety.</p><p num="0064"> A detailed description of the present invention and certain embodiments of the present invention below will be understood by reference to the accompanying drawings.</p>

<figref num="1">Figure 1 represents a skin care system for skin health analysis and monitoring and skin care assessment and advice.</figref><figref num="2">Figure 2 shows the mechanism of light polarization by the skin structure.</figref><figref num="3">Figure 3 shows the process for a skin care test.</figref><figref num="4A">FIG. 4A represents a front view of the skin imaging device.</figref><figref num="4B">FIG. 4B shows a rear view of the skin imaging device.</figref><figref num="5">Figure 5 shows the skin health monitoring page of the skin care system.</figref><figref num="6">Figure 6 shows a conversational modeling tool for a skin care system.</figref><figref num="7">Figure 7 shows the skin care system advice page.</figref><figref num="8">Figure 8 shows the user interface of a skin care system.</figref><figref num="9">Figure 9 shows the welcome page for the skin care system.</figref><figref num="10">Figure 10 shows the skin care system questionnaire page.</figref><figref num="11">Figure 11 shows the skin image capture page of a skin care system.</figref><figref num="12">Figure 12 shows the bar chart results page for the skin care system.</figref><figref num="13">Figure 13 shows the results page with a line graph of the skin care system.</figref><figref num="14">Figure 14 shows an overview screen of the skin care system.</figref><figref num="15">FIG. 15 shows an elastic overview screen of a skin care system.</figref><figref num="16">Figure 16 shows an overview screen of the skin care system.</figref><figref num="17">FIG. 17 shows an elastic overview screen of a skin care system.</figref><figref num="18">Figure 18 shows a map of the skin care system user interface.</figref><figref num="19">Figure 19 shows the skin care system review page.</figref><figref num="20">Figure 20 shows the skin care system review page.</figref><figref num="21">Figure 21 represents the "My Experience page" of the skin care system.</figref><figref num="22">Figure 22 shows the What Works page of the skin care system.</figref><figref num="23">Figure 23 represents the Info For Me page of the skin care system.</figref><figref num="24">FIG. 24 shows an example of the skin care shelf portion of the user interface of the skin care system.</figref><figref num="25">Figure 25 shows an example of the skin care shelf portion of the skin care system user interface.</figref><figref num="26">Figure 26 shows the user interface of a skin care system.</figref><figref num="27">Figure 27 shows the registration page for a skin care system.</figref><figref num="28">Figure 28 shows the skin care system advice page.</figref><figref num="29">Figure 29 shows a mobile content map for the mobile user interface of a skin care system.</figref><figref num="30">Figure 30 illustrates the "How Good Is This Product Message" flow.</figref><figref num="31">Figure 31 illustrates the "What Should I Look For? Message" flow.</figref><figref num="32">Figure 32 illustrates the "Suncheck Message" flow.</figref><figref num="33">Figure 33 illustrates the "Alert Message" flow.</figref><figref num="34">Figure 34 illustrates the Options Message flow.</figref><figref num="35">Figure 35 shows the algorithms and methods for analyzing substances.</figref><figref num="36">FIG. 36 shows the reflection and capture of white and reflected polarized light from a sample based on varying angles.</figref><figref num="37">Figures 37A and 37B represent color coordinate systems that can be used in digital image processing.</figref><figref num="38">FIG. 38 shows a histogram of color densities.</figref><figref num="39">FIG. 39 represents a normalized color channel histogram correlated with the wavelength scale.</figref><figref num="40A">Figures 40A and 40B represent superimposed normalized color channel histograms.</figref><figref num="40B">Figures 40A and 40B represent superimposed normalized color channel histograms.</figref><figref num="41A">Figures 41A and 40B show the convolution of individual color channel histograms.</figref><figref num="41B">Figures 41A and 40B show the convolution of individual color channel histograms.</figref><figref num="42">FIG. 42 represents a combination of two convolutions of two color channel histograms.</figref><figref num="43">Figure 43 shows a mathematical modeling of some of Maxwell's color triangles.</figref><figref num="44A">Figures 44A and 44B represent spectral labels obtained for light and dark skin.</figref><figref num="44B">Figures 44A and 44B represent spectral labels obtained for light and dark skin.</figref><figref num="45A">Figures 45A-45C represent spectral labels obtained for pure metals and alloys.</figref><figref num="45B">Figures 45A-45C represent spectral labels obtained for pure metals and alloys.</figref><figref num="45C">Figures 45A-45C represent spectral labels obtained for pure metals and alloys.</figref><figref num="46A">Figures 46A and 46B represent spectral labels obtained for different types of water.</figref><figref num="46B">Figure46Aand46BRepresents the spectral labels obtained for different types of water.</figref><figref num="47">FIG. 47 shows a block diagram of an embodiment of a skin care device.</figref><figref num="48">FIG. 48 represents an embodiment of a rod-shaped skin care device.</figref><figref num="49">FIG. 49 shows a skin care device with a built-in vertical display panel.</figref><figref num="50">FIG. 50 represents an embodiment of a wearable skin care device.</figref><figref num="51">FIG. 51 shows the positive and negative intensities of the waveform, which is a function of radiation and absorption at specific wavelengths in the skin tissue.</figref><figref num="52">FIG. 52 shows a comparison of spectral labels for healthy and malignant skin near the reference wavelength.</figref><figref num="53">FIG. 53 represents malignant pigmented skin with white light and physiologically polarized white light.</figref><figref num="54">Figure 54 shows a comparison of convolutions of healthy, benign, and malignant skin lesions.</figref><figref num="55">Figure 55 shows an image tracking and targeting system.</figref><figref num="56">FIG. 56 shows a system for determining the excision margin.</figref><figref num="57">FIG. 57 shows a system for determining the excision margin.</figref><figref num="58">FIG. 58 is a flowchart showing the process of RGB color analysis.</figref><figref num="59">FIG. 59 is a diagram representing a pixel diagram of an acquired digital image of a human skin sample.</figref><figref num="60">FIG. 60 is a diagram representing a pixel diagram of an acquired digital image of a sample of human skin after quantization.</figref><figref num="61">FIG. 61 is a histogram / distribution of one standard R, G, and B color photograph of a patient whose skin phototype is classified as type III by Fitzpatrick and Gaussian normal approximation / hull.</figref><figref num="62">FIG. 62 is a histogram / distribution of one standard R, G, and B color photograph of a patient whose skin phototype is classified as type VI by Fitzpatrick and Gaussian normal approximation / hull.</figref><figref num="63">FIG. 63 is a flow chart showing an algorithm for determining skin phototypes according to estimates of mathematical expectations for R and B colors in a standard RGB color system.</figref><figref num="64">FIG. 64 shows an embodiment of the friend toolbar.</figref><figref num="65">FIG. 65 shows the autoscroll feature of the Friend Toolbar.</figref><figref num="66">Figure 66 shows the drag-and-drop sharing feature of the Friend Toolbar.</figref><figref num="67">Figure 67 shows the drag-and-drop sharing feature of the Friend Toolbar.</figref><figref num="68">FIG. 68 illustrates the sharing of skin data as a data object with a friend.</figref><figref num="69">Figure 69 shows the posting of skin care data as a data object to a blog or forum where users can discuss the data.</figref><figref num="70">FIG. 70 illustrates the sharing of skin data as a data object that becomes part of the content that the user wants to discuss.</figref>

This specification describes methods, systems, and devices for skin imaging and non-skin imaging. Throughout the present disclosure, the phrase "like" means "for example, without limitation,". Throughout the present disclosure, the phrase "for example" means "for example, without limitation." Throughout the present disclosure, the phrase "in the examples" means "in the examples, without limitation." Throughout this disclosure, the term "product" refers to any pharmaceutical, non-pharmaceutical, cosmetic, skin care product, hair care product, or nail care product. In general, all examples are given by way of illustration, not limitation.

Real-time analysis of digitally captured skin-related and other information facilitates real-time skin condition assessment, real-time skin prescription advice, and real-time assessment of the effectiveness of selected skin prescriptions. Real-time analysis of digitally captured data can be performed using skin care devices that embody the principles of the invention disclosed herein. Skin care devices that embody the principles of the present invention include, for example, an electromagnetic radiation source capable of directing incident electromagnetic radiation, a radiation detector that measures various parameters of re-radiated radiation, and real-time skin condition evaluation. May include a skin condition analysis module capable of producing.

Skin condition assessments are effectively cosmetic and / or medical. As an example, and without limiting the scope of the present invention, the skin condition evaluation includes acne condition evaluation, pore condition evaluation, wrinkle condition evaluation, skin elasticity evaluation, skin oiliness evaluation, skin moisture evaluation, skin lightness evaluation, and skin sebum. It may include any one of an evaluation, a skin redness evaluation, a skin inflammation evaluation, a skin texture evaluation, a skin color evaluation, or any combination of the above evaluations. For example, a pore condition assessment can help determine if the pores are clean, open, or extremely healthy.

Skin condition data is acquired, for example, by directing incident electromagnetic radiation to a location, such as a pinpoint location on a person's skin, and using a radiation detector to detect the re-radiated radiation from that location. be able to. The effectiveness of generating high quality, real-time skin condition assessments is enhanced in some embodiments by using a skin condition analysis module that is at least partially based on diffuse spectroscopy analysis. Can be done. The quality of real-time skin condition assessment can be further enhanced by using white light as incident radiation and detecting the red, green and blue components of the re-radiated light in other embodiments.

Like 168, removable memory 170, wireless communication device 174, computer 178, dermatologist, general physician, beautician, spa employee, salon employee, cosmetics salesperson, etc. performer record 180, personal production record 172, etc. May have a different data storage device 110. Skin embodiments have been considered throughout the disclosure, but unless these embodiments are excluded from the context, for example, hair, nails, agriculture, livestock, body, biological, and non-biological. It should be understood that non-skin embodiments, such as all embodiments relating to, are included, without limitation.

The imaging device 108 may be used, for example, in skin health tests 160, pre-diagnosis 162, remote monitoring 164, etc. to capture images of skin structures to obtain biophysical properties. The imaging device 108 may be further adapted to capture images of non-skin structures such as hair, nails, teeth, eyes, internal organs and structures. The imager 108 uses unpolarized light, such as scattered light, white light, monochromatic light, multiple single wavelength light, and then polarized light, to obtain data about the skin structure. The internal or external light source 127 may be used to provide a particular series of irradiations. In embodiments, the incident light may be polarized or unpolarized, and the reflected or re-radiated light may be polarized or unpolarized. Polarized light can be produced by reflections on the skin and is not polarized from the light source. Capture and accumulation of reflected light, along with skin lesions, allows imaging and analysis of all types of skin disorders, skin problems, and cosmetological concerns and signs. Analysis of polarized reflected light may make it possible to obtain the thermal, electrical and magnetic properties of the imaged skin area. Images may include assessments along with patient questionnaires and may be sent to analysis equipment 154, analysts, performers, etc. to determine the final analysis of skin health. Device 108 further utilizes specific targeted wavelengths, such as wavelengths, in the red, green, and blue regions to identify key feature shapes based on spectroscopic and quantitative analysis of skin lesions. Sometimes. Device 108 may be used with diffuse reflectance techniques and color imaging analysis based on indirect results of indirect results from spectroscopic techniques (DR, SF, etc.). In embodiments, device 108 may be adapted because it emits polarized light. The device 108 may be compatible because it emits more than one type of light, and it may be possible to switch or combine different light sources 127. Skin health analysis is also available on products

Referring to FIG. 2, in the embodiment, the imager 108 has a light source 127 that irradiates the skin with unpolarized light, scattered light, white light, monochromatic light, multiple single wavelength light, polarized light, etc. at an angle alpha. May have a sensor that detects reflected or re-radiated light from the skin structure and an image storage device that stores and transmits the captured image. The skin structure is at least among the cells, molecules, cell populations, molecular populations, epidermis and paralayers, basement membrane, dermis, subcutaneous tissue, glands, layers, follicles, pores, vascular components, etc. that are present in the skin. There may be one. In embodiments, the light source may be white light that produces reflected or re-radiated light and diffused radiation, such as polarized light, to measure the electrical and magnetic components of the skin. White light may be emitted as a composite of wavelengths of light over the spectrum of visible light. The incident unpolarized light is directed at the target at an angle "alpha" defined from the vertical. For example, incident unpolarized light is not limited to the range of 0 to 90 degrees from the vertical, because when the value of alpha changes, the changing angle of incidence affects the depth of penetration. May interact with different structural elements of the skin. The angle alpha may be changed by repositioning the light source either manually, by remote control, or by user interface 102. The relationship between intrusion depth and alpha is defined by the formula depth = f (alpha). For each skin structure that corresponds to a unique known depth within the skin, there may be a specific angle of incidence that causes total polarization reflection. Analyzing reflected or re-radiated light, which is either rebellious and / or diffuse, and / or diffuse radiation, obtains information about the underlying skin structure that is responsible for the reflection and / or re-radiation. There is. Diffuse radiation occurs because of the scattering and absorption that emerges from the light that flies around in the structure. The polarization of light may be due to the classical / quantum effect of skin-structure-interacting water. That is, the skin structure has sufficient magnetic and electric fields when the light collides with the structure, so that the light is biased. It can change the light and affect the wavelength of the light when it collides with the structure. The polarization of reflected or re-radiated light, such as direction, amplitude, phase, angle, shape, degree, quantity, etc., is a variety of indicators associated with the targeted specific skin structure, and ultimately May correlate with skin condition 158. For example, lesions present in distinctive skin structures can cause partial diffusion of reflected or re-radiated light that is partially polarized and results in partially diffused reflection or re-radiated light. For example, collagen structure is a marker of the biophysical difference between benign melanocyte skin damage and malignant melanocyte skin damage. Differences in collagen formation can affect the polarization state of reflected or re-radiated light, and the resulting image may show locations in and around the tumor. Such images may assist the performer in visualizing the ablation margin, as described herein. Since melanocytes are located in the lower part of the epidermis, appropriate wavelengths may be selected for this depth and for chromophores in various types of nevus. May assist the performer in visualizing. Since melanocytes are located in the lower part of the epidermis, appropriate wavelengths may be selected for this depth and for chromophores in various types of nevus. May assist the performer in visualizing. Since melanocytes are located in the lower part of the epidermis, appropriate wavelengths may be selected for this depth and for chromophores in various types of nevus.

When the incident light is polarized, only the electrical properties of the skin are revealed, but the unpolarized incident light may reveal both the electrical and magnetic properties of the skin. The use of polarized light can lead to improved induction of optical activity, but the resulting dataset will be incident unpolarized light such as white light, monochromatic light, multiple single wavelength light, etc. May be less valuable than the dataset captured using it. By measuring the effect between 10E-34 and 10E-30Js, the action of the electric and magnetic forces of the valence electrons of the skin biomolecules in the boundary region between the quantum physical effect and the classical physical effect on the skin. Measurements can be performed as a difference.

In embodiments, the wavelength and / or intensity of incident light may be modified to measure the presence or absence of specific molecules such as collagen, elastin, cadherin, hemoglobin and the like. Certain molecules possess autofluorescent properties. For example, if the incident light is limited to a specific wavelength such as 325 nm, collagen may be detected at emission wavelengths of 400 nm and 405 nm. Table 1 presents certain exemplary examples of excitation and radiation maximal values of autofluorescent biomolecules such as amino acids, structural proteins, enzymes and coenzymes, vitamins and vitamin derivatives, lipids, porphyrins, etc. ing. To detect the presence or absence of a particular molecule in the skin, the user irradiates the skin with light of a specified wavelength, for example, without limitation, such as the wavelength shown in the maximum excitation value sequence, and reflects it. Collect reflected or re-radiated light to identify the presence or absence of a particular radiation wavelength in the light. As will be understood by those familiar with this technique, the synthesis of a number of different single wavelengths and wavelengths of light may be used to illuminate the skin.

<tables num="1"><img id="000002" he="183" wi="138" file="JP5771007B2_D0001.tif" img-format="tif" img-content="drawing" /></tables>

In embodiments, the light may be emitted at any wavelength, such as the entire range from 280 nm to 3800 nm. The incident light may be blue, yellow, orange, red, or other light.

Continuing with reference to FIG. 1, in embodiments, the light source may be integrated with device 108 or may be sourced from an associated source. The light source is, for example, without limitation, incident excitation wavelengths of 280, 340, 360, 385, 405, 395, 400, or 480 nm, as well as light emitting or laser diodes (LEDs) of wavelengths such as infrared and near infrared. But it may be. Wavelengths in the ultraviolet and infrared range may also be emitted by device 108. The light source is scattered light, white light, monochromatic light, multiple single wavelength light, incandescent light, electroluminescence light, fluorescence, halogen light, ultraviolet light, polarized light, collimated light, and light supplied by a wireless communication device. , Light supplied by an optical fiber cable, or the like. In embodiments, the light source may have a scatterer to provide diffuse incident light.

In embodiments, sensors that detect reflections or re-emissions from the skin are built into a communication device such as a CCD camera, CMOS-based imaging system, digital camera, webcam, mobile phone or iPhone . Camera, Personal Digital Assistant It may be embodied in the optical system present in Assistant: PDA), watches for continuous skin monitoring or other wearable devices, third party devices, etc., as in the case of sports type displays. Sensors may be adapted to absorb wavelengths of light, such as near infrared or visible wavelengths. Sensors may be fitted because they automatically filter out specific wavelengths. The sensor may be suitable for imaging areas of any size, such as small parts of the skin, the entire face, a complete skin examination, and so on. The sensor may be compatible because it operates without the fluid intervening between the device 108 and the region of interest, or may be used with an oil-like application or other reflective medium to the region of interest. The sensor may be adapted to detect reflected or re-radiated light that may be used for subsequent visual and / or automatic analysis at any distance from the area or when in contact with the area of interest. is there. Images generated from this reflected or re-radiated light may be considered both visually and spectroscopically resolved images, or electromagnetic skin maps. The sensor may have an internal calibration scale that allows it to measure the size of the area to be imaged as well as the distance from the imaged area. In embodiments, the lens may focus reflected or re-radiated light from the detection optics on a visible / near-infrared sensitive CCD, CMOS, or other sensory device. In embodiments, the sensor may be fitted to capture the image at a high frame rate. In embodiments, the device may have a high magnification lens.

In embodiments, device 108 may store captured images for analysis and / or transmission to analysis equipment 154. The analysis equipment 154 may be an executor, an automatic analysis tool, an analysis tool used by the executor, or the like. Data storage 110 may occur manually when image acquisition is initiated, may occur automatically upon contact with the skin, may be controlled remotely, and the like. The data may be stored in the internal device memory 168 or externally stored in a memory medium 170 such as a USB memory, external hard drive, mass storage device, or the like. The device may be able to connect externally to a computer such as a laptop, kiosk terminal, desktop computer, central server, etc., either by wire or wirelessly. For example, the connection may be a direct USB connection. When the device 108 is connected to the computer, the captured data may be downloaded or transmitted from the device 108 to the computer, either automatically or manually. For example, device 108 may have a cradle connected to a computer. Data may be transmitted or downloaded from device 108 when device 108 is placed in the cradle. Additionally, device 108 may receive software update information when connected to a computer, for example, via a cradle or the like. In embodiments, device 108 may not have an internal storage device and may only be able to transmit or store data externally via persistent wiring or wireless connections. Data transmission and storage may be a fully automated process or may be manually activated. Data may be transmitted over wireless network connections, cellular connections, wired connections, Bluetooth connections, and so on. Data transmission from device 108 may enable remote evaluation techniques. In embodiments, non-image data such as voice response, text response, video data, etc. are also described, as described herein. May be remembered and / or sent. The device 108 may have an internal microphone for recording audio, a video camera for recording video, keyboard input for recording text responses, and the like. In embodiments, device 108 may use externally available audio and video.

In embodiments, the data memory may belong to the skin health record 121. The skin health record 121 may be a personal object or database or repository that stores information about the user's skin-related major medical, non-medical, and cosmetic signs. This record includes images, graphics, icons, written history, personal demographic information, cosmetic levels like moisture, elasticity, firmness, texture, color levels, and inflammation. May include non-medical conditions. The user may populate record 121 himself with data from any device 108, 109 or input 112. Record 121 may include a history of skin concerns, comments, user blogs, and so on. In the embodiment, the skin health record 121 is automatically incremented when the image is captured. For example, when the user presents the first image for analysis, record 121 may be populated with information that may be automatically created and edited and derived from the image and image analysis.

In an embodiment, the data storage 110 may be performed on the performer record 180. The performer record 180 may be a repository of key health condition characteristics including background demographic data, personal information, diet information, skin health condition record 121, and the like. The performer record has embedded images, links to other image data files, tracking effects for personal skin products, medical products, OTC products, etc., and a history of their impact on key parameters. Sometimes. Performer records may further capture community data, or data of selected individuals similar to patients or users, and may also include ratings and comments.

In embodiments, the data storage 110 may be in a personal production record 172. Based on the skin health measurement 160, product inclusions may be selected to obtain the desired effect for skin health. This inclusion selection uses device 108 to analyze and track changes in various skin health parameters due to application of different products and inclusions, and long-term skin health by personalized manufacturing record 172. May be achieved by tracking changes in. Once the selected product inclusions have been identified, the product inclusions may be mixed to create the most suitable product for the individual's skin characteristics and / or desired goals (eg, improving skin moisturization). is there. In this way, personal products may be developed for the user. Additionally, this same process can be used to create specific customized skin products and inclusions for medical and non-medical purposes and conditions.

In embodiments, the format of the captured data is compatible with any standard image processing and manipulation software and technology, word processing software, slideshow presentations, spreadsheet applications, and the like. For example, the captured data may be in any suitable image format such as jpeg, tiff, pict, png, bmp, gif, pdf and so on. In an embodiment, a plurality of images may be captured as a movie, and the movie may be constructed by combining the plurality of images.

In embodiments, the device 108 may be powered by a suitable source such as a power plug, battery, solar power, USB power, and the like. The user may initiate powering to device 108 to initiate image capture. Capture may start automatically, when device 108 is placed against the skin, when a button-like trigger is activated by the user, and so on.

The device 108 may have a display for observing the area to be imaged. For example, a user may use a display with a positioning tool to obtain a long-term accurate image, such as a series of images taken over different days. The display may be integrated with device 108 or may be a separate display. For example, device 108 may be connected to a monitor, such as a computer monitor, using a wired or wireless connection. In embodiments, the user interface 102 to device 108 may display a real-time view of the imaging.

Positioning tools can enable tracking and targeting. With reference to Figure 55, tracking and targeting methods are depicted. The positioning tool can be used to track and store the motion parameters of the imaging device 108 moving over the area of interest. First, the device can capture images of the target area at a plurality of locations. The device 108 can then use image processing techniques for at least one capture frame to identify the direction of motion of the imaging device 108. This image processing technique compares each frame with at least three different features captured, thereby triangulating the position of the imager, thereby moving the imager. Can recognize the direction of. The captured image data can store an image of a target area and store an arrangement parameter of the imaging device 108 as compared with a predetermined image database. If the entry does not exist in the database, a new entry can be created. The step of capturing an image of a target region at a plurality of locations can include a sub-step of capturing a continuous video image of the target region. The step of capturing an image of a target region at a plurality of locations can include a sub-step of capturing a series of images of the target region frame by frame. The step of identifying the direction of motion of the imaging device using the image processing technique can include a sub-step of comparing the captured images frame by frame to identify the motion parameters of the imaging device. The step of recognizing the direction of motion of an imager by triangulating the position of the imager by comparing each frame to at least three different features captured is three or more steps across different frames. By comparing different positions of the imager, a sub-step of capturing the direction of motion of the imaging device can be included. The positioning tool is coupled to the image capture unit and the image capture unit to position the imaging device on the target area. The positioning unit and the captured image can be compared frame by frame, and the imaging device captures three or more different points, triangulates the position of the imaging device, and performs an imaging device. It can be an automatic position tracking and data storage system for the imaging device 108, including an image processing unit that identifies the direction of motion of the imager. The image capture unit can include a digital camera. Image capture units are mobile devices and personal digital assistants. Can include at least one of Assistant: PDA). The image processing unit can include a comparison unit that captures the direction of motion of the imager by comparing the positions of three or more different points over different frames. The automatic position tracking and data storage system can further include a subsystem that measures the lateral motion of the image capture unit from a given point on the area of interest to a new position.

In embodiments, device 108 may have security features to protect the confidentiality of user data. For example, device 108 may have a unique MAC-ID using cryptographic techniques.

In embodiments, device 108 may be associated with peripherals or other functional accessories. For example, device 108 may be associated with a blood pressure monitor or sensor, heart rate monitor or sensor, and the like. For example, device 108 is used to perform pre-diagnosis 162 of skin lesions and at the same time monitor other endpoints such as blood pressure, heart rate, etc. to assess other aspects of health in addition to skin health. I have something to do.

In embodiments, the device 108 may be sized to allow the user to operate the device 108 in a handheld manner. The device 108 may be sized to be portable. Device 108 may be fitted for one-handed operation. For example, a device may be embodied as shown in Figures 4A and 4B, but such as a mirror, a large device adapted to image a large area, a PDA, a scanner, a mobile communication device, etc. There are several other embodiments in terms of shape and / or size. In Figure 4A, the illumination source appears as a ring of LEDs around the central detection area. Both images clearly show size, handheldness, and portability. The ease of operation allows even an inexperienced user, such as a home user connected to a laptop, to take advantage of device 108. Device 108 is a built-in unit and does not have to be part of a large camera system. In embodiments, device 108 may be designed for one-handed ergonomic retention. In embodiments, device 108 may be used with or without the application of a reflective medium. In embodiments, device 108 may be used to capture images, such as in close-up, direct contact, at some distance. For example, software loaded on a computer that interfaces with device 108 may facilitate short-range and long-range image capture.

In one embodiment, device 108 may be a stand-alone, non-handheld version that can be used to capture images or extract specific components or substances of the body.

In some embodiments of the skin care device, the device can be small enough to be portable and handheld for use. Some embodiments of the skin care device can be in the form of a handheld and portable pen-type scanner that can be conveniently moved over the area of skin to be inspected. Some other embodiments of the skin care device can be miniaturized so that the dimensions of the skin care device do not exceed 6 inches. Such skin care devices can be incorporated into wearable accessories such as bracelets, necklaces, earrings and the like. Some embodiments of the skin care device can have a convenient user interface and / or display surface. In some embodiments of the skin care device, the device can be coupled or incorporated into a vertical display panel, such as, but not limited to, a mirror, LCD screen, plasma screen, and the like.

With reference to FIG. 47, an exemplary skin care device 4700 embodying the principles of the present invention is shown in a block diagram. The skin care device 4700 can include an electromagnetic radiation source 4702, a radiation detector 4704, and a skin condition analysis module 4708.

Electromagnetic sources 4702 can direct incident electromagnetic radiation to one or more points on human skin. For example, and without limitation, the radiation source 4702 can be a set of light emitting diodes (LEDs). In certain embodiments, the incident radiation emitted by the radiation source 4702 can include radiation in the visible, near-infrared (NIR), and near-ultraviolet (NUV) spectra. In other particular embodiments, the incident radiation can include white light.

As shown in FIG. 47, the electromagnetic radiation source 4702 can be coupled to the radiation detector 4704. The radiation detector 4704 can detect the re-radiated radiation from the above location and measure various radiation parameters of the re-radiated radiation. As shown in FIG. 47, the radiation detector 4704 can be coupled to the skin condition analysis module 4708. The radiation detector can detect various radiation parameters, including, but not limited to, polarization degree, radiation intensity at different wavelengths, and the like. Electromagnetic radiation sources, radiation detectors, and skin condition analysis modules have already been described herein.

The skin condition analysis module 4708 can analyze the radiation parameters of the reflected radiation and other information to generate a skin condition assessment. The skin condition analysis module 4708 can be adapted to generate skin condition assessments in real time. In some embodiments, the radiation detector 4704 measures diffuse reflectance. In some other embodiments, the incident radiation can be white light, and the radiation detector 4704 can measure the red, green, and blue components of the re-emitted light.

In certain embodiments, the skin condition assessment may be based in part on the analysis of photographic images of the relevant portion of the skin.

The term "diffuse reflectance", as used herein and in the appended claims, means radiation and, in some cases, vaguely means light scattered in multiple directions from a target sample. Diffuse reflectance is a complement to specular or regular reflection. If the surface is completely non-mirror, the reflected or re-radiated light will be uniformly diffused into the hemisphere surrounding the surface. Diffuse reflectance is the reflection of incident light from a non-flat or granular surface of the target due to the minute irregularities on the surface of the target, so that the incident light hits the target and is scattered at a wide angle.

Some embodiments of the skin care device can have a memory module that stores a skin condition assessment and other data such as with a time stamp. Some embodiments of the skin care device can have a communication module that conveys a skin condition assessment and other data with a time stamp to a remote computer. Data can be transmitted using, for example, the Internet via wire or wireless. Skin condition assessments and other data can also be accessed remotely via mobile devices and / or computers. Such remote access is particularly convenient for service providers such as dermatologists.

Some embodiments of the skin care device can have a user interface that allows the user to interact with the skin care device. The user interface can allow the user to command the device, for example, to analyze the available information and generate a real-time skin condition assessment of an area of skin or a larger area of skin. it can. In some other embodiments, the user interface can be voice operated and can provide the ease of giving commands to the skin care device via voice commands. Other examples of user interfaces that can be used in skin care devices include graphical user interfaces (GUIs), web-based user interfaces (WUIs), command line interfaces, and more. A touch interface and any combination of the above.

In certain embodiments, the user interface can also warn the user when an abnormal skin condition, such as a clogged sweat gland, is detected. The warning can take the form of an optical signal, a beep, an email warning, an SMS warning, or the like. There are also other methods, such as electronic little bell sounds, marks, sounds, and light, thermal radiation signals, to alert the user of skin conditions that require the user's attention.

Some embodiments of the skin care device are for a more convenient and intuitive user interface and / or for viewing images of skin areas and / or for some useful skin-related information, such as skin condition assessment. It can also have a display surface for viewing reports, skin prescription advice reports, and / or skin prescription effect reports. In some embodiments, the display surface and / or user interface can be a touch sensor type that allows contact control of the device.

In some embodiments, the skin condition assessment data at multiple locations can be superimposed on one image of a larger skin area displayed on the display surface, providing a single useful image of the health of the entire skin area. Can be provided in view.

Some embodiments of the skin care device may also have an access restriction module that restricts access to patient data to authorized users only. The access restriction module can be based on username and password characteristics and / or biometric access control, such as fingerprint recognition, face recognition, retinal recognition and the like.

In some embodiments, the skin condition analysis module 4708 can access user information such as age, gender, ethnicity, etc., such information for creating user profiles and for skin condition analysis. It can be used.

The skin care device 4700 can be used in the user's home, the user's bathroom, the cosmetics store, the provider's office, the outdoors, and the like. The skin care device 4700 can be used at any time of the day, for example, before bedtime, before or after using a cleanser on the skin.

The skin care device 4700 can have a skin care prescription advice module 4710 capable of generating displayable skin care prescription advice. The skin care prescribing advisory module can include not only information about the most suitable skin care product, but also information about the best way to apply the product, when to use it, how much to use, and how often. The Skin Care Prescription Advice Module 4710 can be linked to the Skin Condition Analysis Module 4708 so that skin care prescription advice is personalized for each person's skin condition. Skin care prescription advice is provided in real time based on the skin condition assessment, product information, and other relevant information analyzed using the algorithm, as described herein, generated by the skin condition analysis module 4708. Can be generated. In some embodiments, the skin care prescription advice generated by the skin care prescription advice module 4710 can be displayed to the user, for example, on the display surface associated with the skin care device 4700.

In some embodiments, it is possible to print the skin care prescription advice generated by the skin care prescription advice module 4710.

In some embodiments, the skin care prescription advice generated by the skin care prescription advice module 4710 is at least partly in determining the user's skin profile or skin condition 158 and utilizing the skin care prescription advice of a person with a similar profile. Is based on.

In some embodiments, the Skin Care Prescription Advice Module 4710 is coupled to the Skin Care Product Database 190. If the product advised by the Skin Care Prescription Advice Module 4710 is available in the product database 190, the user can be immediately informed and offered the option to purchase the product. In some embodiments, the user can operate the skin care device 4700 in a store, eg, a retail store, and also an audiovisual signal of the availability of the product advised by the skin care prescription advice module 4710. Can be indicated, for example, by illuminating the shelf on which the product is placed.

Users who perform prescription use of a particular skin care prescription, eg, a skin care product, may be interested in tracking the effectiveness of the skin care prescription over a period of time. The skin care device 4700 can have a skin care prescription effect module 4712. The skin care prescription effect module 4712 can be combined with the skin condition analysis module 4708. The skin condition of the user can be tracked at different time points using the skin care device 4700 and can be displayed on the display surface to the user. The device can also assist in tracking changes due to various activities, such as exercise, food, smoking, labor, and so on.

FIG. 48 shows an embodiment of the skin care device 4700 in which the skin care device has a pen-shaped scanner shape. For example, the user can switch on the pen-type scanner shaping device 4800 and move the device on his face. The pen-type scanner geometry device can have a grip 4802, a radiation detector 4808, an indicator 4804 capable of giving instructions by, for example, light, warmth, sound, etc., an LED light 4810, and a power supply 4812. ..

The pen-type scanner shape device 4800 is functionally the same as the skin care device 4700 described above. The pen-type scanner shape device 4800 can have an electromagnetic radiation source, a radiation detector, and a skin condition analysis module. The pen scanner shaper 4800 can be small, handheld, and portable.

In some embodiments of the pen-type scanner shaping device, the electromagnetic radiation source can be one or more LEDs. Each of the LEDs can have a unique predetermined frequency. In some embodiments, one or more LEDs can be arranged in a row to form a linear illumination.

In some embodiments, the pen-type scanner shaper 4800 can be powered via USB coupled to an external power source, via an internal battery, or through other similar power sources. ..

As the pen-type scanner moves over the face, light is emitted from the radiation source 4702. The radiation detector 4704 then detects the re-radiated light and sends the information to the skin condition analysis module 4708. Module 4708 employs an algorithm for skin condition analysis.

FIG. 49 shows another embodiment of a skin care device 4800 that includes a vertical panel, in which the skin care device includes an electromagnetic radiation source 4702, a radiation detector 4704, a skin condition analysis module 4708, and a user interface 4714. It has a vertical display panel 4902 and.

The vertical display panel 4902 can have user interfaces 4714 on both sides of the vertical display panel 4902. In some embodiments, the display panel can be touch-sensitive, in which case the vertical panel itself may be part of the user interface. The image of the skin area can be displayed on the display panel. The user can touch some part of the image, which can trigger the display of the magnified image on the display panel or another screen. The user interface 4714 can bring up a menu bar that allows the user to view various reports, such as skin condition assessment reports, skin prescription advice reports, skin prescription effect tracking reports, and so on.

The user interface 4714 allows the user to command the device, for example, to analyze the information available to generate a real-time skin condition assessment of an area of skin or a larger area of skin. be able to. In some other embodiments, the user interface can be voice operated and can provide the ease of giving commands to the skin care device 4900 via typical voice commands. Other examples of user interfaces available on the skin care device 4900 include a graphical user interface (GUI), a web-based user interface (WUI), and a command line interface. , Touch interface, and any combination of the above.

The basic functions of the skin care device 4900, including the vertical panel described above, are in many respects similar to the skin care device 4700. The electromagnetic radiation source 4702 is capable of directing incident electromagnetic radiation to one or more points on human skin. For example, but not limited to, the radiation source 4702 can be a set of light emitting diodes (LEDs). In certain embodiments, the incident radiation emitted by the radiation source 4702 can include radiation in the visible, near-infrared (NIR), and near-ultraviolet (NUV) spectra. In other particular embodiments, the incident radiation may include white light.

As shown in FIG. 49, the electromagnetic radiation source 4702 can be coupled to the radiation detector 4704. For example, various radiation parameters, including but not limited to, degree of polarization, radiation intensity at different wavelengths, etc., can be detected by the radiation detector 4704.

In certain embodiments of skin care devices, including vertical panels, skin condition assessments can also be partially based on the analysis of photographic images of skin areas.

Some embodiments of the skin care device, including the vertical panel, can have a memory module that stores the skin condition assessment and other data such as with a time stamp.

Some embodiments of skin care devices, including vertical panels, may have a communication module that conveys a skin condition assessment and other data with a time stamp to a remote computer. Data transmission is not limited, but can be performed, for example, by using the Internet or the like via wire or wireless. Skin condition assessments and other data can also be accessed remotely via mobile devices and / or computers. Such remote access is particularly convenient for service providers such as dermatologists.

In certain embodiments, the user interface 4714 can also warn the user when an abnormal skin condition (eg, a sweat gland blockage) is detected. The warning can take the form of an optical signal, a beep, an email warning, an SMS warning, or the like. There are also other methods, such as electronic little bell sounds, marks, sounds, and light, thermal radiation signals, to alert the user of skin conditions that require the user's attention.

In some embodiments, the skin condition assessment data at multiple locations can be superimposed on one image of a larger skin area displayed on the vertical display panel 4902, simply providing a useful image of the health of the entire skin area. Can be provided in one view.

Some embodiments of skin care devices, including vertical panels, may also have access restriction modules that limit access to personal information to authorized users only. The access restriction module can be based on username and password characteristics and / or biometric access control, such as fingerprint recognition, face recognition, retinal recognition and the like.

In some embodiments, the skin condition analysis module 4708 can access user information such as age, gender, ethnicity, etc., such information for creating user profiles and for skin condition analysis. It can be used.

The skin care device 4900, which includes a vertical panel, can be used in the consumer's home, consumer's bathroom, cosmetics store, provider's office, and / or outdoors. The skin care device 4900, which includes a vertical panel, can be used at any time of the day, for example, before bedtime, before and after using a cleanser on the skin.

In some embodiments of a skin care device that includes a vertical panel, the device can include or combine with a skin care prescription advice module capable of producing displayable skin care prescription advice. it can.

In some other embodiments of the skin care device, including vertical panels, the device can include or combine with a skin care prescription effect module capable of producing a displayable skin care prescription effect report. can do.

In some embodiments of the skin care device, including the vertical panel, the vertical display panel is a mirror.

In some embodiments of skin care devices, including vertical panels, the vertical display panel is an LCD panel or plasma screen.

In some embodiments of the skin care device, the device also includes or is coupled with a camera that takes a photographic image of the skin area.

In some embodiments of the skin care device, the camera is integrally attached to the display surface or display panel. In some other embodiments, the camera is wired to the display surface or display panel. In other embodiments, the camera is wirelessly coupled to a display surface or display panel.

In some embodiments of the skin care device including the vertical panel, the user interface 4714 can have one or more buttons (not explicitly shown) for scanning and / or analyzing the skin. The button can be of a different type, eg, a push button, a wire-connected button, or a combination of both. The user can touch a button on the display panel to scan the skin, while the user can touch another button to direct the machine to analyze the skin.

FIG. 50 shows an embodiment of a wearable skin care device 5000, in which case the device is in the form of a wearable device. The wearable device can be worn by the user in the form of a necklace, earrings, bracelet, patch, or as a sensor attached to a strap or the like. Such a wearable device can be a permanent, personalized skin care monitor.

The wearable skin care device 5000 is functionally similar to the skin care device 4700 described above. Like the skin care device 4700, the wearable skin care device 5000 has an electromagnetic radiation source, a radiation detector, and a skin condition analysis module. Preferably, the wearable skin care device 5000 is small, handheld and portable, and the dimensions of the device do not exceed 6 inches.

In some embodiments of wearable skin care devices, the electromagnetic radiation source can be one or more LEDs. Each of the LEDs can have a unique predetermined frequency. In some embodiments, one or more LEDs can be arranged in a row to form a linear illumination.

In some embodiments, the wearable skin care device 5000 is via USB coupled to an external power source, or via built-in battery, motion power, photovoltaics, or other similar power sources. It can supply power.

Embodiments of wearable skin care devices can also have sensors that measure various body and environmental parameters. Examples of body parameters that can be measured by a wearable skin care device are body temperature, hemoglobin antioxidant levels, and so on. Examples of environmental parameters that can be measured by a wearable skin care device are air cleanliness, humidity, temperature, UV index, outside air quality, smoking index, and the like.

In embodiments, device 108 goes through laparoscopy, cytology, ureteroscopy, arthroscopy, endoscopy, dermoscopy, gynecology, urology, dentistry, ears, mouth, anus, nose, and the like. May be suitable for use as a component of minimally invasive medical devices associated with natural meat transluminal examinations, external breast examinations through the skin, etc. For example, the system may be able to process data and appear on a video monitor or other display in a surgical room or other medical environment. Medical experts may be able to select observation modes such as still image capture or video capture, and be able to manually adjust light source, sensor and display parameters to assist observation, identification and surveillance with device 108. is there. In embodiments, the system uses different protocols for different types of medical procedures and tissue types that medical experts may encounter, medical treatment for the type of procedure and the type of tissue the system is being examined for. It may be pre-programmed to automatically operate device 108 according to expert instructions.

For example, device 108 can be used as part of a system and method that distinguishes between healthy and suspicious tissue of a patient in real time or near real time. Imaging device 108 allows the surgeon or other practitioner to accurately determine the border area near the surgical intervention for primary skin melanoma, skin cancer, and other skin diseases that require skin resection. to enable. In general, surgical resection of suspicious tissue, such as cutaneous melanoma, is determined by the experience of the surgeon or by measuring the thickness of the melanoma and using a Breslow scale and punch biopsy to roughly recognize the border area. be able to. Device 108 enables automatic determination of resection margins for primary cutaneous melanoma based on the light properties of the surrounding skin. By clearly defining where there is healthy tissue and where there is suspicious tissue, the surgeon can leave a large amount of healthy tissue at the site, reduce recurrence, and reduce micrometastases in the surrounding skin. Allows minimal surgical morbidity and appearance improvement. Analytical methods such as convolution and RGB color analysis described herein, which are embodied in device 108, the associated algorithm 150, and software, image and demarcate specific sites before or during surgery. It can be used to determine areas, suspicious organizations. The software can also show postoperative analysis of affected skin tissue. Device 108 allows for more accurate judgment of boundary areas, instead of relying on subjective experiences or tables in medical journals and other publications. The advantage of this method is the retention of well-separated and suspicious tissue and many healthy tissues. Here, with reference to FIG. 56, lesions of pigment cells are shown. Visible melanoma 5602 or suspicious tissue is surrounded by normal-looking skin, which normal-looking site contains unhealthy / affected tissue 5604 (pseudo-normal skin 5604) that must be resected. There is a possibility that it is. Device 108 can visualize the boundary 5608 between healthy and unhealthy tissue, It allows the surgeon to leave a healthy tissue 5610 that should be left untouched. The device 108 can make a decision to generate a contour area 5612 that points to where the surgeon should cut the tissue. In Figure 57, to tools such as analyzing lesion images (5702), manually selecting borders (5704), automatically selecting borders (5708), and drawing border areas (5710). An embodiment of a user interface that visualizes pigment cell lesions along with access is presented.

In embodiments, device 108 may enable skin health test 160. The imaging device 108 may be used to perform a skin health test 160 to learn skin features and obtain findings. Hardware equipment may capture the image and allow the image to be analyzed. Imaging components inside device 108 may allow measurement of various skin health characteristics such as color, age, damage, collagen, elastin, pores and types, keratin. The skin health test 160 may be performed at home, in a spa, in a clinic, in a hospital, anywhere, etc. from a mobile phone. The skin health test 160 may be used in conjunction with specific background information through questionnaires, image uploads, genetic tests, DNA samples, and lifestyle to determine skin condition 158. Test 160 will respond with specific information related to the biophysical health of the skin, some of which is medical or non-medical or cosmetic. It may be a physical and genetic disposition regarding the problem or condition.

In embodiments, device 108 may allow pre-diagnosis 162. This requires the performer (eg, user, dermatologist, doctor, beautician, etc.) to receive skin-related images and questionnaires, etc., or to require the user to take skin-related images, questionnaires, etc. It is a pre-diagnosis system that obtains a pre-diagnosis based on an algorithmic analysis of existing conditions. The user may submit a questionnaire and images along with a pre-diagnosis of the condition before meeting the performer and enabling follow-up. Images captured by the device may be submitted to obtain a preliminary diagnosis to allow the case to be efficiently referred to the best performer. Pre-diagnosis 162 may be performed by software algorithms on images, manual analysis, combinations thereof, and the like. The pre-diagnosis 162 includes a preliminary evaluation and may indicate the time and stage required for the final diagnosis or evaluation. The function of this pre-diagnosis 162 may enable efficient scheduling of the performer. Pre-diagnosis 162 also helps to screen out specific skin problems and also identify users with certain problems.

In embodiments, device 108 may allow remote monitoring 164. Users perform remote monitoring 164 to track their skin health or medical condition, and keep away from the public at home, at work, or elsewhere to submit images. May be used. The practitioner may be able to provide remote guidance on treatment changes or preventive factors. Remote diagnostics significantly improve the efficiency of follow-up, as the user does not have to physically move back to the provider and the provider can conveniently choose the time to observe patient changes during the day. May increase. Surveillance data may be viewed as a record or in real time.

From the viewpoint of the present invention, the imaging device 108 may use unpolarized light to illuminate the region of interest at a known angle of incidence. Since the spectral diagram is acquired based only on the magnetic characteristics of the region, the reflected polarized light having the electrical characteristics of the region of interest may be subtracted from the reflected scattered light having the electromagnetic characteristics of the region of interest. The distribution of pixels in the image corresponding to scattered and reflected polarized light may be determined and indicated by conventional means. For known image sensors, a one-to-one mapping of the pixel image distribution between the scattered light image corresponding to the electromagnetic signal and the reflected polarized light corresponding to the electrical signal image is the intensity of the spectroscopic data for the same region. May be done using the distribution of. Area magnetic gradient images may be created in a one-to-one correspondence by equipment such as the Atomic Force Microscopy in Magnetic Mode Regime (AFM-MMR) in magnetic mode, skin condition 158. May be based on gradient images, scattered light images, and reflected polarized light images.

In embodiments, the device 108 may be an imaging device 108 that performs digital spectroscopic imaging of the skin. Incident unpolarized light, such as white light, scattered light, monochromatic light, multiple single wavelength light, etc., is targeted from the unpolarized light source associated with device 108, either vertically or vertically to angle alpha. May be sent to. White light, which has both electrical and magnetic properties, interacts with structural components when incident on the skin structure at a unique angle, resulting in reflected or re-radiated light with polarized light components. In embodiments, the incident light may be polarized. The unpolarized light reflected by the skin structure may be at least partially polarized. The reflected or re-radiated light, either polarized or scattered, may be captured by device 108. Such multispectral skin imaging may be used to create electromagnetic skin topography. Biophysical properties of skin structure by measuring the polarization of reflected or re-radiated light, such as rotation, amplitude, phase, angle, shape, degree, and quantity, and the wavelength of reflected or re-radiated light. May be obtained. Skin condition 158 is determined from total biophysical data obtained from one or more skin structures, visual analysis of captured images, and any additional data obtained case-wise from the user. Sometimes. For example, skin condition 158 may include data in moisture, wrinkles, pores, elastic lightness, and numerous measurements, as described herein. By changing the angle of the incident white light, alpha, the depth of light penetration into the skin structure can be changed. Each depth in the skin corresponds to a different skin structure. For each skin structure or depth, there may be specific angles that produce total polarization reflections. For example, a constant angle of incidence may be used to obtain data on the skin structure inside the epidermis, while an angle of incidence may be used to obtain data on the skin structure inside the subcutaneous tissue at different depths inside the skin. Must be changed to. The angle of incidence ranges from a few microns to a few centimeters. It may be modified to penetrate the skin somewhere up to the torr, which allows the capture of reflected light from other non-skin structures. For example, device 108 may be used as a non-invasive imaging tool, for example, to image tumors, breast cancers, melanomas, and the like. In embodiments, the region to be imaged may be a biological tissue having a normal or pathological deformation in its structure, such as the birefringence properties of the tissue. For example, scars, keloids, hypertrophic scars, and muscle may all have different collagen fiber organization than normal skin. Since collagen is a major determinant of skin wound repair, it may be interesting to monitor changes in collagen structure and concentration. For example, the stage of healing is due to the size of collagen fiber bundles that increase as healing progresses, the organization of collagen structures at the molecular or small fiber level that may increase as healing progresses, the recovery or increase of refractive index, etc. It may be judged. Because collagen structures are polarization sensitive, changes that occur in the structure are individually described herein and, as described below, polarization-based techniques during scar formation, healing progression, and scar treatment. May be monitored using. Alternatively, it may be determined by the organization of collagen structure at the small fiber level, the recovery or increase of the refractive index, and the like. Because collagen structures are polarization sensitive, changes that occur in the structure are individually described herein and, as described below, polarization-based techniques during scar formation, healing progression, and scar treatment. May be monitored using. Alternatively, it may be determined by the organization of collagen structure at the small fiber level, the recovery or increase of the refractive index, and the like. Because collagen structures are polarization sensitive, changes that occur in the structure are individually described herein and, as described below, polarization-based techniques during scar formation, healing progression, and scar treatment. May be monitored using.

The ability to measure the electrical and magnetic properties of various skin structures may allow the distinction between healthy and unhealthy skin structures. Normal or healthy skin structures exhibit unique appearances that differ from those exhibited by equivalent structures during unhealthy or abnormal conditions. These morphological changes can be detected by differences in the appearance of light reflected from the skin, re-radiation light, or absorption in the skin, such as the appearance of polarized light reflected or re-radiated light. The state of polarization may be the wavelength of light, the direction of polarization of light, the amplitude, the phase, the angle, the shape, the degree and the amount. According to Maxwell's equations, light can be described as consisting of an electric and magnetic fields that can be described as two vectors E and B that behave as waves. The vectors are perpendicular to the direction of light propagation and are orthogonal to each other. Furthermore, given the electric field E, B can be determined by Maxwell's equations and vice versa. Therefore, the magnetic component, or degree of polarization / polarization state, may be determined by measuring the electrical component of light reflected, re-radiated, or absorbed by the skin structure. Alternatively, the light may be diffused to other measurable wavelengths. By comparing these electrical and magnetic readings from the polarized components of reflected or re-reflected light and unpolarized white light with readings of normal or healthy skin structures incident with light of the same or similar angles. Changes may be detected in the skin structure and the molecular or structural morphology of the skin structure. Since each range of indicators may correspond to a unique form of defect, certain defects such as cancer, skin disease, cosmetic signs, etc., based on both electrical and magnetic amounts or other appearance determinations. May be detected. When the same type of light is incident on any other molecule, cell, or structure at the same angle, the intensity of a certain wavelength of the reflective component makes it possible to measure the intensity of the difference in the morphological state of the measuring component. The polarization state of reflected or re-radiated light may be described by a certain number of parameters. The polarization state is the direction and extension of the polarized ellipse, especially the ellipse. May be described from a point of view. The parameters that may be used to describe the polarization state are the semimajor axis (Ψ), which is the angle between the semimajor axis and the x-axis of the ellipse, and the ellipticity (ε), which is the ratio of the two half axes. ), The semi-major axis, which is the inverse semimajor axis of the ellipticity, the eccentricity, and the amplitude and phase of the oscillation of the two components of the electric field vector in the plane of polarization. For example, ellipticity 0 corresponds to linearly polarized light and ellipticity 1 corresponds to circularly polarized light. The polarized light of the reflected or re-radiated light may be an ellipse, a straight line, a circle, a left circle, a right circle, and at least one of these possible combinations.

In embodiments, the determination of skin condition 158 may include processing and analysis 154 of reflected or re-radiated light to obtain images for visual and spectroscopic analysis. Analysis 154 may be facilitated by examining the wavelength and other characteristics of reflected or re-radiated light. For example, if the incident light is white light, the reflected or re-radiated light may be filtered to inspect a set of wavelengths or a single wavelength, and finally a particular skin structure fluorescence. In another embodiment, monochromatic or quasi-monochromatic light, such as that supplied by an LED, may be used to excite the targeted fluorophore. In this example, the fluorescence of the deeper layer may be excited. The reflected or re-radiated light in this example may be further filtered to separate certain fluorescence. In another embodiment, the varying wavelengths of the illumination light may allow the detection of biophysical properties from various depths inside the skin. Moreover, certain chromophores, such as the various forms of hemoglobin found in blood, have specific absorption areas, so processing data created with different colors of light will result in polarization-sensitive color development. It will give information about the distribution of chromophores. Wavelength dependence can be done in several ways: 1) sequentially illuminating with single wavelength or multiple single wavelengths of light and collecting each resulting image separately, or 2) white light. It may be obtained by illuminating and inspecting reflected or re-radiated light for individual wavelengths or collections of individual wavelengths, either during detection or processing. Algorithm 150 is used to obtain information from data obtained by either processing and analyzing wavelengths of one or more of light to form an image based on spectroscopic polarization. There is. In embodiments, the combination of both techniques allows the removal of reflections from the surface of the skin.

In embodiments, filtering may be used to filter out a range of wavelengths, such as wavelengths belonging to ultraviolet, infrared, near-infrared, visible, and the like. The filter may be a digital filter or an analog filter. For example, the captured image may be processed by software that can utilize digital filter technology to process the image for analysis. For example, software may select any digitafilter parameters such as unique cutoff frequencies, single wavelength sets, sampling intervals, and so on. For example, without limitation, digital filters may be used to separate reflected light at wavelengths 405, 458, 488, 532, 580, and 633 nm. In another embodiment, an analog filter, such as a filter integrated into the optical system of device 108, is used to filter the image as it is captured, or an analog filter, such as an external analog filter, is stored. It may be used to filter images that have been transmitted, manipulated, processed, etc. Filtering an image can lead to the acquisition of an image of the underlying structure and / or pattern of a particular polarization. Filtering an image can result in the separation of electrical and magnetic components of reflected or re-radiated light. Filtered images may be subject to algorithmic analysis. Filtering removes reflections due to skin surface reflections by separating specific wavelengths of light. For example, sebaceous glands may appear as bright spots in an image when only certain wavelengths of light are separated for analysis, and separation of different wavelengths of light is all within the imaged region. Allows visualization of pores. Therefore, fluorescence from deeper layers may be separated. Image processing includes gland counting, size, activity, amount of sebum / other substances inside the sebaceous glands, amount of sebum / other substances inside the pores, age of the contents inside the glands, inside the pores. Count and measure changes in the sebaceous glands and pores, including the age of the contents, the amount of inflammatory processes surrounding the glands, etc. May be used for. Multiple images from different image sources may be combined for analysis. The results of the analysis provide functions, diagnosis, and prognosis of skin health conditions such as acne tendencies, greasiness, glow, and viscosity. The analysis may be combined with color image processing (eg, RGB analysis) to determine other skin features.

From the viewpoint of the present invention, the host system 104 may have algorithm 150, data integration 152, analysis tool / API 154, skin condition 158, expert consultation 128, and the like. Skin condition 158 is a skin data object based on test 160, pre-diagnosis 162, and monitoring 164 performed by device 108, user input, expert consultation 128, other input 112, analysis 154, algorithm 150, etc. Or it may be characterized. Skin condition 158 may be stored in skin health record 121, along with all underlying data and user information. In embodiments, the host computer 104 may have a server architecture. The host system does not have to be technology-agnostic. The host system 104 may have one or more cloud computing, service-oriented architectures, distributed objects, and so on.

In embodiments, Expert Consultation 128 may provide analysis, advice, evaluation advice, and the like. The collected skin image data and pre-diagnosis are by the user or performer to obtain analysis, advice, or evaluation advice, in addition to other relevant data such as doctor's diagnosis, insurance, blood analysis, etc. , Or may be referred to an expert by another user. Experts may be geographically separated and may have a wide variety of skills. For example, skin image data and analysis may be shared with an herbal specialist in India at the request of another user, who learns the most suitable skin care procedure from the experience of an aging specialist, France. May require that image data be shared with aging professionals in the area. Expert consultation analysis may be retained on the host system 104 as part of skin history record 121, accessed at a convenient time by the user, or shared with other users. ..

In embodiments, the system 104 is placed in home, clinical or medical environments, spas and salons, cosmetic counters and cosmetic sales, etc. to perform discrete and accurate skin analysis in a low cost, rapid and safe form. I may be killed. In embodiments, device 108 performs record maintenance for analysis 154, skin condition 158, retrieves queries / analyzes from a remote performer or algorithm 150, etc., user interface 102, online platform 129, mobile. May integrate with platform 124 etc. The home-based system 104 analyzes cosmetic or non-makeup conditions that may be acquired by an imaging device 108 or a third-party device 109 by a qualified or unqualified performer giving advice. Allows you to give advice and advice on products, prescriptions, diets, lifestyles, etc. based on questionnaires, uploaded images, etc. The system can be customized for personal businesses that allow practitioners to systematize client cosmetic skin health, track client prescriptions, advise products, become client online advisors and more. May consist of a starter website. It utilizes an analysis and equipment platform to allow practitioners to analyze comments, images, questions, and / or interests, etc., and provide advice, consultation, and tracking for lifestyle improvement. Will be done. The spa / salon installation system enables personal skin assets. For example, the spa owns this device, which may capture images for feeding to a large display suitable for displaying skin conditions, after which the practitioner may be able to simulate the effect of the procedure. The user may compare skin condition 158 with peers or other spa patrons and create advice based on what worked for them or what they purchased. Desirable improvements are the inclusions and the user's May be correlated with the most effective product / formulation 118 for the skin. Formulation 118 is a hardware-driven personal skin care rating 122 and / or a skin and product experience type determination 130 shared via ranking and rating 138, and / or comments on product efficacy and experience (eg, product efficacy and experience). , Smell, taste, feel, texture, color, etc.) may be a feature that allows the user to learn the product line that works best for their skin. Formulation 118 may be dynamic advice based on the user's collective input on the product that would best best suit the user's individual needs, as well as the expert's input.

The spa / salon installation system 104 creates product / service advice based on skin condition 158 and proposes one-click shopping based on the advice to enable SKU tracking, for example, wellness through contractual relationships. Propose packages, provide the ability to port prescriptions from spa to spa, home to spa, etc., enable prescription / advice systematization to help practitioners adjust treatment lengths, goals It enables the progress of the alleged treatment, enables clear and visual communication to the client, and creates a product / service effectiveness report. The report may be based on or include correlations with other users, feedback on prescription 118, modification of prescription 118, skin cycle monitoring, and the like. Health care performer-based systems such as dermatologists, general practitioners, metabolists, etc. enable pre-diagnosis, connect with performer scheduling systems, enable service quotes, follow-up May allow tracking. The cosmetics sales or retail store-installed system 104 may allow integration with product inventories that allow inventory to be cleared. The handheld / portable device 108 is a makeup counter that may be used in drug stores, home or commercial make-up shows / parties, and so on. Users may purchase peripherals / accessories for devices such as holsters, chargers, etc. The user may pay a fee for each use of scanning, or may receive a registration-based scanning service. System 104 may be installed in health clubs, gyms, resorts, etc. The system installed for cosmetics manufacturing / testing enables product design based on skin condition, skin care swatches targeting specific consumers, and so on. System 104 may be installed at the veterinarian to monitor livestock skin and non-skin concerns. System 104 provides hospital, ER, military environment, etc. to enable rapid evaluation of medical conditions, emergency skin care triage, etc. It may be installed anywhere. System 104 may be installed for agriculture to allow application to fruits, vegetables, and other similar produce. System 104 may be installed in battlefield scenarios or in modest environments such as space flight, flight, underwater, underwater, etc. to enable wound management, battlefield diagnostics, and triage. System 104 may be installed in the laboratory to allow comparison of any substance and the specific composition of the substance. Based on the use of readings of the electrical properties of light, the user may be able to determine similarities or differences between the imaged materials.

In embodiments, the determination of skin condition 158 may include the use of analysis 154. In embodiments, the captured data may be analyzed by performers such as doctors, dermatologists, spa employees, clinical trial performers, beauticians, cosmetologists, nutritionists, cosmetics salespeople, and the like. The practitioner may use algorithm 150, expert consultation 128, database 115, etc. to visually analyze the data at the time of capture. In embodiments, the performer may be away from the location of the data acquisition. In an embodiment, Algorithm 150 processes and analyzes reflected or re-radiated light to obtain a spectroscopically decomposed image, either automatically or under the control of the user, performer, etc. May be used for. For example, in order to obtain only a spectroscopic image of the magnetic properties of the region, the algorithm 150 uses the difference between the reflected polarized light with the electrical properties of the basin and the reflected scattered light with the electromagnetic properties of the region of interest. May be used to create an image of the area of interest. Algorithm 150 1) analyzes imaging evidence to obtain skin health, 2) contains, agents, and / or products that may be most suitable for the determined health. Correlate with, 3) Correlate skin health with peers in the skin health community, 4) Advise and design personalized products based on skin health and / or other similar user experience It may be rule-based software and processes, such as to do, 5) to observe measurable changes in skin health. Algorithm 150 may be automated. Algorithm 150 may be used to analyze medical concerns such as the degree of suspicion of cancer, rash analysis, and so on. Algorithm 150 is used to analyze non-medical concerns such as the effects of medical, non-medical, or cosmetic formulas 118, breakout avoidance formulas 118, sun protection, anti-scabies creams, etc. Sometimes. Algorithm 150 May help to correlate the desired improvement with the inclusions and most effective oil gains that improve or maintain the user's skin health. Algorithm 150 may utilize a calibration scale to determine the imaged skin structure based on the angle of incidence, the wavelength and intensity of the light source, the appearance of reflected or re-radiated light, filter parameters, and so on. Algorithm 150 may be useful for determining skin microscopic effects, luminescence effects, spectroscopic effects, and the like. For every algorithm 150, there may be input, output, and functional parameters that modulate the algorithm 150. In an embodiment, analysis 154 is a physical data and / or image of a material using scattered white light, a physical data and / or image of a material using a single wavelength or multiple single wavelengths, at a certain angle. Physical data and / or images of substances using polarized reflections or re-emissions of, generated using the difference between scattered white light and polarized reflections or re-emissions of a certain angle. Physical data of the material and / or image, physical data of the material generated using the difference between a single wavelength or multiple single wavelengths and a certain angle of polarized reflection or re-emission. And / or may include at least one inspection, such as an image. Algorithm 150 may be used with data and images created by device 108 or third-party hardware 109. Algorithm 150 uses an image capture device or technology to capture all types of incident angles such as unpolarized light, polarized light, monochromatic light, scattered light, white light, multiple single wavelength light, etc. May be used with data and images. In embodiments, the captured data or images may be subject to algorithmic analysis, as described herein. And calibration scales may be used to determine the imaged skin structure based on intensity, reflected or re-radiated light, filter parameters, and so on. Algorithm 150 may be useful for determining skin microscopic effects, luminescence effects, spectroscopic effects, and the like. For every algorithm 150, there may be input, output, and functional parameters that modulate the algorithm 150. In an embodiment, analysis 154 is a physical data and / or image of a material using scattered white light, a physical data and / or image of a material using a single wavelength or multiple single wavelengths, at a certain angle. Physical data and / or images of substances using polarized reflections or re-emissions of, generated using the difference between scattered white light and polarized reflections or re-emissions of a certain angle. Physical data of the material and / or image, physical data of the material generated using the difference between a single wavelength or multiple single wavelengths and a certain angle of polarized reflection or re-emission. And / or may include at least one inspection, such as an image. Algorithm 150 may be used with data and images created by device 108 or third-party hardware 109. Algorithm 150 uses an image capture device or technology to capture all types of incident angles such as unpolarized light, polarized light, monochromatic light, scattered light, white light, multiple single wavelength light, etc. May be used with data and images. In embodiments, the captured data or images may be subject to algorithmic analysis, as described herein. And calibration scales may be used to determine the imaged skin structure based on intensity, reflected or re-radiated light, filter parameters, and so on. Algorithm 150 may be useful for determining skin microscopic effects, luminescence effects, spectroscopic effects, and the like. For every algorithm 150, there may be input, output, and functional parameters that modulate the algorithm 150. In an embodiment, analysis 154 is a physical data and / or image of a material using scattered white light, a physical data and / or image of a material using a single wavelength or multiple single wavelengths, at a certain angle. Physical data and / or images of substances using polarized reflections or re-emissions of, generated using the difference between scattered white light and polarized reflections or re-emissions of a certain angle. Physical data of the material and / or image, physical data of the material generated using the difference between a single wavelength or multiple single wavelengths and a certain angle of polarized reflection or re-emission. And / or may include at least one inspection, such as an image. Algorithm 150 may be used with data and images created by device 108 or third-party hardware 109. Algorithm 150 uses an image capture device or technology to capture all types of incident angles such as unpolarized light, polarized light, monochromatic light, scattered light, white light, multiple single wavelength light, etc. May be used with data and images. In embodiments, the captured data or images may be subject to algorithmic analysis, as described herein. There may be functional parameters that modulate 0. In an embodiment, analysis 154 is a physical data and / or image of a material using scattered white light, a physical data and / or image of a material using a single wavelength or multiple single wavelengths, at a certain angle. Physical data and / or images of substances using polarized reflections or re-emissions of, generated using the difference between scattered white light and polarized reflections or re-emissions of a certain angle. Physical data of the material and / or image, physical data of the material generated using the difference between a single wavelength or multiple single wavelengths and a certain angle of polarized reflection or re-emission. And / or may include at least one inspection, such as an image. Algorithm 150 may be used with data and images created by device 108 or third-party hardware 109. Algorithm 150 uses an image capture device or technology to capture all types of incident angles such as unpolarized light, polarized light, monochromatic light, scattered light, white light, multiple single wavelength light, etc. May be used with data and images. In embodiments, the captured data or images may be subject to algorithmic analysis, as described herein. There may be functional parameters that modulate 0. In an embodiment, analysis 154 is a physical data and / or image of a material using scattered white light, a physical data and / or image of a material using a single wavelength or multiple single wavelengths, at a certain angle. Physical data and / or images of substances using polarized reflections or re-emissions of, generated using the difference between scattered white light and polarized reflections or re-emissions of a certain angle. Physical data of the material and / or image, physical data of the material generated using the difference between a single wavelength or multiple single wavelengths and a certain angle of polarized reflection or re-emission. And / or may include at least one inspection, such as an image. Algorithm 150 may be used with data and images created by device 108 or third-party hardware 109. Algorithm 150 uses an image capture device or technology to capture all types of incident angles such as unpolarized light, polarized light, monochromatic light, scattered light, white light, multiple single wavelength light, etc. May be used with data and images. In embodiments, the captured data or images may be subject to algorithmic analysis, as described herein. Or it may be used with data and images created by third party hardware 109. Algorithm 150 uses an image capture device or technology to capture all types of incident angles such as unpolarized light, polarized light, monochromatic light, scattered light, white light, multiple single wavelength light, etc. May be used with data and images. In embodiments, the captured data or images may be subject to algorithmic analysis, as described herein. Or it may be used with data and images created by third party hardware 109. Algorithm 150 uses an image capture device or technology to capture all types of incident angles such as unpolarized light, polarized light, monochromatic light, scattered light, white light, multiple single wavelength light, etc. May be used with data and images. In embodiments, the captured data or images may be subject to algorithmic analysis, as described herein.

In embodiments, algorithm 150 may be based on artificial neural networks, non-linear regression, or fuzzy logic. For example, Algorithm 150 may be used in skin lesion diagnosis based on an established theoretical framework for classification. Two types of data may be input to the neural network or non-linear regression: numerical data such as intensity, size, number, etc. and descriptive data such as white, gray, dark color, etc. Fuzzy logic encodes structured descriptive data directly in a numerical framework. Based on associative memory, learning algorithm 150, adaptive control system behavior, neural and fuzzy machine intelligence enable mapping between input data obtained from collected images and biophysical skin condition 158. I have something to do.

In embodiments, Algorithm 150 may be based on fractal or multi-fractal analysis of images based on biophysical and spatiotemporal data. Both digital and spectroscopic data of the skin may be analyzed using Hausdorff dimension (fractal properties) and Kolmogorov entropy (K entropy). The spectroscopic data is then divided into spatiotemporal cells and analyzed as multi-fractal objects, producing information about the level of functional discord in the skin structure (epidermis and dermis). The structural data of these two analyzes may be correlated to determine a one-to-one correspondence between the two. Once the fractal correlation is established between the digital image data of the skin and the spectroscopic data, it becomes possible to obtain information on the functional state of the skin structure by multi-fractal analysis of the digital image data.

In embodiments, algorithm 150 may be aimed at analyzing data integration 154. For example, Algorithm 150 may be able to determine if an image has been captured with sufficient detail to make subsequent analysis reliable.

In embodiments, algorithm 150 may be useful for analyzing skin characteristics, acquiring skin biophysical properties, and determining skin condition 158. Skin condition 158 may capture the connection between the underlying skin structure and time-based variability. Some deformities can be predicted, but some may be based on transient conditions such as infection, burns, and hormonal imbalance. Algorithm 150 includes melanocytes / melanin, hemoglobin, porphyrin, keratin, carotene, collagen, elastin, sebum, sebaceous gland activity, pores (sweat and sebum), wrinkles, water, and elasticity. And, it may be possible to measure lightness and appearance such as structure, morphology, concentration, number, size, state, stage, etc. of all the above morphologies such as derivatives, salts, compounds. Algorithm 150 includes moisture levels, firmness, fine wrinkles, number and steps of wrinkles, pore size, percentage of open pores, skin elasticity, skin split lines, stains, skin color, and psoriasis. , Allergic reactions, red areas, common skin diseases and infections, tumors, sun dermatitis, rashes, scratches, acne, acne, insect bites, psoriasis, bleeding, injuries, inflammation, photodamage, pigmentation, tones , Tasting, burn rate / burn classification, hokuro (mother spot group, mother spot), appearance of skin lesions (structure, color, dimensions / asymmetry), melanoma, skin appearance diseases and skin lesions, cellulite, swelling, blisters Disease, management of congenital skin syndrome, (sub) dermatomyopathy, liver plaque, vascular condition, alcohol, spider veins, texture, skin ulcer, wound healing, postoperative follow-up, melanin cell lesions, non-melanin cell Clinical, medical, such as with other skin-related concerns of the user such as lesions, basal cell carcinoma, seborrheic keratopathy, sebum (greasy), nail and / or hair-related concerns, etc. It may be used to make a quantitative assessment of non-medical and cosmetic signs. Algorithm 150 is also useful for analyzing and obtaining physical properties and compositions of hair, nails, biological substances, gaseous substances, food, wine, water, liquids, metals, non-metals, plastics, polymers, etc. Sometimes. By manual

Either a particular wavelength or multiple wavelengths may be selected for incident light, and the particular wavelength or multiple wavelengths are filtered out as described herein. There is. Algorithm 150 may determine the presence, absence, structure, morphology, etc. of unique skin structures based on the properties of reflected or re-radiated light. For example, Algorithm 150 detects the axis / angle at which the light is polarized and compares it to the labeled emission spectrum of the individual proteins beneath the skin structure. Each skin structure has a unique labeling pattern based on the electrical and magnetic contributions of the molecules present within the skin structure. Algorithm 150 may identify, analyze, and separate the electrical and magnetic components of a unique polarized signal, as described herein. The signal may correlate with the collective placement within the skin structure. By comparing this signal with a standard calibration signal, the appearance of the underlying skin structure may be determined. Standard calibration signals may be provided by a catalog of skin structures / molecules and their specific observation wavelengths. Catalogs may be produced by the techniques described herein, or by any other spectroscopic technique. For example, to determine the water level in the skin, Algorithm 150 may determine the ratio between reflected polarized light and reflected scattered light and correlate the ratio with the water level. Ideally, nearly 100% polarized light can be generated from reflected light, but if part of the reflected or re-radiated light is scattered light, such as 95% polarized light and 5% scattered light. The amount of scattered light may be correlated with the level of moisture. Incident unpolarized light can interact with the skin structure, resulting in a change in the amount of polarized light reflected or re-radiated. The intensity of this polarized reflected or re-radiated light may be measured. This polarization can be as good as 100%, but the reflected polarization intensity can be less than 100% in some cases. The angle of incidence and the material being imaged are reflected or re-radiated. It will help determine the maximum intensity possible due to the polarization of the light. There may be a maximum amount of polarization of 100% for a particular angle of incidence, but an amount of 0-100% polarized polarization may be expected from the light reflected by the skin structure. Should be understood. The root cause of the difference in reflexes may be due to the ratio of trapped water to free water in the skin. To determine elasticity, Algorithm 150 may determine the concentration of elastin per region of interest. To determine brightness, Algorithm 150 may combine moisture levels and skin color into a single objective assessment. Objective indicators may be correlated with expert rating scales or other external indicators. To determine stiffness / tightness, Algorithm 150 assesses the concentration of collagen and elastin in the area of interest (as measured by the number of glands, open / closed ratio, clogging / filling level) sebaceous glands. May be combined with the activity of. Algorithm 150 may be able to overlay varying wavelengths with intensities and spectroscopic techniques such as reflectance, excitation / radiation, and so on. Algorithm 150 may be able to process and analyze images collected by device 108 or other imaging devices using unpolarized light, polarized light, or a combination thereof. Algorithm 150 includes thermoelectromagnetic (TEM) or electromagnetic (EM) images, images collected using incident polarized light, conventional dermatological microscope images, spectroscopically decomposed images, conventional images, and harmonization. It may be possible to process and analyze a number of different types of images, such as light images. Algorithm 150 may be able to calculate variability indicators of skin condition 158 over time. Determining skin condition 158, in addition to processing and analyzing skin images for various indicators and endpoints as described herein, lifestyle, smoking history, exercise habits, diet, allergies. It may further include user input information such as reactions and third party information. Example

Referring to FIG. 35, in one embodiment, the algorithm 150 is 1) "angled white light" or white light incident at an angle sufficient to cause polarization reflection, and 2) "angleless white light" or polarized light. It has spectral convolution of a digital image taken with white light incident at an angle that causes virtually no reflection. The above discussion focuses on the skin as a primary sample, but includes shared valence effects, ionic effects, and ionic effects, including skin, hair, biological materials, foods, liquids, wines, metallic materials, non-metallic materials, etc. It should be understood that any sample, such as a substance characterized by a hydrogen bonding effect, can be a sample for algorithm 150. Briefly, sample digital images were captured with no-angle light (3502) and angled light (3504), and blue and red channel histograms were generated for each image (3508) (3508). 3510), normalized to the relative intensity of light, and color channel histograms are correlated with wavelength scales (3512, 2514). Spectral convolution proceeds in two steps. The first step involves subtracting the color channel histogram for angled light from the color channel histogram for angled light, respectively, for the red and blue channels (3518). Two composite histograms, a blue channel composite histogram and a red channel composite histogram, are generated. The second step of spectrum convolution involves subtracting the blue channel composite histogram from the red channel composite histogram (3520). Next, the various steps of the algorithm will be described in detail with reference to FIG. 35 through the discussion of FIGS. 36-43.

With reference to FIG. 36, the sample 3604, which can be any material suitable for imaging as described above, can be illuminated with angled white light 3608 and angled white light 3610. As mentioned herein, changing the angle of incidence affects the depth of light penetration through various skin structures. For each skin structure corresponding to a particular known depth within the skin, there is an angle of incidence that causes polarization reflection. By analyzing (3602) reflected or re-radiated light, polarized light (3614) and / or diffusion (3612) captured by the imaging device, information about the underlying skin structure involved in the reflection can be obtained. The term "angled white light (3610)" means incident white light directed at a sample at an angle sufficient to cause polarization reflection. The term "angleless white light" means incident white light that is not directed at a particular angle and is diffused with respect to the sample. In this case, angleless white light can cause reflected white light, polarized light, or a combination thereof. In one embodiment, the reflected polarized light produced by the angled white light may have different properties than the polarized light produced by the angled white light.

Next, referring to FIG. 37, Maxwell's color triangle in FIG. 37B can facilitate the understanding of the essence of white light. Maxwell's color triangles depict the complete visible color spectrum associated with a particular wavelength. To establish a mathematical coordinate system for the RGB color space, we use a simplified version with straight lines, shown in Figure 37A. Each vertex of the outer triangle corresponds to the ideal color, ie, clockwise from the vertex, ideal green, red, or blue. Along the sides of Maxwell's triangle, a mixture of two of the three color components occurs at every possible ratio. As we move from the sides to the center, the third primary color becomes increasingly important. Near the center at the "isoenergy" point E, a true white color is visible with a radial axis extending towards each of the three vertices. A mixture of full brightness red, green, and blue yields this true white color. Thus, each location on the triangle, including the location representing white light, is the result of a mixture of at least one of red, green, and blue. For example, the solid circle 3702 represents a color spot between pure / dark blue and pure white. Similarly, the dotted circle 3704 represents the area of color between pure / dark red and pure white. A white paper digital photograph can be used to authenticate the coordinate system, as indicated by the internal triangle 3708. The internal triangle 3708 authenticates the coordinate system if its sides are parallel to the limits of the color space lines of the original coordinate system. If they are not parallel, the coordinate system is invalid.

Next, referring to FIG. 38, RGB histograms for each color channel are generated for each image. RGB digital images have three color channels: red, green, and blue. Each of these channels can be examined and analyzed separately. A blue channel histogram is generated for an image taken with angled white light, and another blue channel histogram is generated for an image taken with angled white light. Similarly, a red channel histogram is generated for an image taken with angled white light, and another red channel histogram is generated for an image taken with angled white light. For example, as shown in FIG. 38, an automated system can be used to generate the histogram for each color channel. By simply specifying the channel that the user wants to inspect (3804), a histogram 3802 can be generated for that channel. The histogram can be normalized to the relative intensity of light. Normalizing the histogram with respect to the intensity of incident light is important to be able to process histograms generated from different images. Then, referring to FIG. 39, the RGB color channel histograms are correlated with a particular wavelength scale to generate an RGB color channel spectrum plot.

Then, referring to Figures 40A and 40B, the data from the pair of images are mathematically combined in two steps. In the first step, the blue channel spectrum plot 4004 generated from an image taken with angled white light is derived from the blue channel spectrum plot 4002 generated from an image taken with angled white light. It has been subtracted to produce a blue channel composite spectrum plot. The two spectral plots 4002, 4004 are first superimposed in FIG. 40A and then subtracted in FIG. 41A. Similarly, the red channel spectrum plot 4008 generated from an image taken with angled white light is subtracted from the red channel spectrum plot 4010 generated from an image taken with angled white light. A red channel composite spectrum plot has been generated. The two spectral plots 4008, 4010 are first superimposed in FIG. 40B and then subtracted in FIG. 41B. This subtraction can be facilitated by aligning the spectral plots by wavelength, and the normalized intensity can be mathematically reduced at each wavelength. For example, if the intensity of the blue channel spectrum plot from angled white light is 0.005 at 470 nm and the intensity of the blue channel spectrum plot from unangled white light is 0.003 at the same wavelength. The resulting spectral plot will have an intensity of -0.002 at 470 nm. The specific intensities and wavelengths in the spectral plot reflect the inherent properties of the underlying material and the angle at which the material is exposed to light.

Then, referring to FIG. 42, the two color channel composite normalized spectral plots are combined to provide the unique spectral characteristics of the sample.

The normalized composite blue channel spectrum plot is subtracted from the normalized composite red channel spectrum plot. The scale is determined as the difference in wavelength between the red and blue images and starts at the darkest part of both colors. This scale is based on Maxwell's mathematical coordinate system for color triangles. For example, with reference to FIG. 43, the lower part of Maxwell's color triangle is plotted and shown in FIG. 43B, and the corresponding part of the plot with the position on the color triangle shown in FIG. 43A is indicated by an arrow. .. Position 1 of the plot corresponds to the ideal blue in Maxwell's color triangle, position 2 corresponds to true white, and position 3 corresponds to the ideal red. Positions 1 and 3 are aligned when the composite spectral plot is convoluted to obtain spectral characteristics, so the unit scales on the convolutional histogram have different wavelengths (eg, 500-400 nm and 700-400 nm). ).

The resulting spectral characteristics can be analyzed for many features such as the number of peaks and valleys, the amplitude and shape of the peaks, and the structure and pattern of the middle part. Various mathematical, visual, and algorithmic processing methods can be used to process and analyze the spectral characteristics. The spectral characteristics obtained for the various samples are unique, for example, the spectral characteristics in FIG. 44A are for light skin, while the spectral characteristics in FIG. 44B are for dark skin. is there.

In one embodiment, the algorithm can be used to identify metal composition, purity, strength, etc. For example, the spectral properties can be used to distinguish metals. The spectral characteristics in FIG. 45A are for pure metals and aluminum, while the spectral characteristics in FIG. 45B are for metals and alloys of PbMnTe. The spectral properties can also be used to distinguish similar substances with different compositions. For example, the spectral properties in FIGS. 45B and 45C are both for the PbMnTe alloy, but the alloy in FIG. 45B has a different composition than that in FIG. 45A.

In one embodiment, Algorithm 150 can be used to analyze the water quality, composition, purity, etc. of water. For example, the spectral characteristics of filtered water are shown in FIG. 46A as compared to the spectral characteristics of high-purity water shown in FIG. 46B.

The spectral characteristics can be further improved by reducing the spectral contribution from the source light from the reflected light spectrum in order to normalize the spectral characteristics for a particular skin condition. For example, the spectral characteristics in FIGS. 51 to 54 can be normalized by subtracting the light source spectral characteristics from the reflected light spectral characteristics. By reducing the light source spectral characteristics, the resulting spectral waveform is normalized only to changes in the skin due to interaction with incident light. Thus, certain types of incident light can be used that can be susceptible to detecting certain structures, compositions, or conditions. In some embodiments, to calculate the spectral characteristics for subtraction of the RGB histogram for angled light from the RGB histogram for unangled light and subtract from the final spectral characteristics for the material. Can be used.

Convolutions for other convolutions, such as yellow channels or channels of other colors, are also possible. In addition, a predetermined convolution is also possible.

Then, referring to FIG. 51, a positive intensity 5101 represents the final reflection or emission at a particular wavelength based on the characteristics of the material, while a negative intensity 5102 is the final from the spectral characteristics of the source light. Represents a typical absorption. A negative intensity of 5102 indicates that there is no absorption of source light at a particular wavelength based on the characteristics of the material. The light source can be selected for use in examining specific biophysical or material criteria to produce a specific waveform for analysis.

Then, with reference to FIG. 52, it is possible to measure changes in skin condition 158 using the spectral characteristics of a light source specifically selected based on specific biophysical criteria. FIG. 52 shows a comparison of PB (SO) showing examples for differences in benign / normal tissue and diseased tissue. For example, changes in absorption or radiation within the spectral diagram within the range of 462 nm to 485 nm in FIG. 52 indicate additional changes in tissue processes, tissue activity, or changes in the skin of other molecules. It may correspond to existence. By measuring these changes, it is possible to determine the healthy, affected, or rough condition of the skin. A characterization of healthy tissue based on radiation and / or absorption can be determined at a particular reference wavelength of 5209, which is based on the selection of source light. For example, the spectral characteristic 5201 of a healthy tissue with a particular source light indicates that in the spectral range 5205 there is little or no absorption or radiation. The spectral diagram shows the normal spectral characteristic 5206 to the right of the reference wavelength on line 5203. In addition, the property in region 5207 to the left of the reference wavelength in line 5204 indicates re-radiation or radiation-induced morbidity, while region 5208 to the right of line 5204 exhibits absorption 5210. Region 5207, corresponding to wavelengths 462 nm to 485 nm, exhibits additional activity due to additional changes in tissue processes, activity, or the presence of other molecules that indicate a state of change in the skin. In addition, specific parts of peaks, valleys, curve sizes and shapes, frequencies, intervals, and wavelength differences also correspond to molecular concentrations, disease progression stages, skin characteristics, and the like.

In one embodiment, Algorithm 150 can only use reflected polarized light due to its increased selectivity for specific biophysical or material features. For example, referring to Figure 53, the spectral characteristics of reflected and / or radiated polarized light 5302 are significantly stronger than the simple white light convolution 5301 and may be susceptible to certain biophysical properties. There is. FIG. 53 shows the spectral characteristics in the case of malignant pigment cell lesions. The spectral diagram showing the radiation 5305 at the polarization spectral characteristic 5302 is considerably higher than the spectral diagram showing the radiation 5303 at the non-polarized spectral characteristic 5301. Similarly, the spectral diagram showing absorption 5306 at polarization spectral characteristic 5302 is considerably deeper than the spectral diagram showing radiation 5304 at unpolarized spectral characteristic 5301.

In one embodiment, Algorithm 150 can be used to analyze healthy and unhealthy, or malignant skin. For example, FIG. 54 shows spectral characteristics 5401 and 5402 for healthy and non-pigmented skin, spectral characteristics 5403 and 5404 for healthy pigmented skin, and spectral characteristics 5405 and for malignant pigmented skin. 5406 is shown. Both polarized (bottom) and white light (top) spectral characteristic convolutions are shown for comparison. The spectral characteristics of normal healthy skin 5401 and 5402 indicate that there is very little absorption or emission relative to the light source light spectrum around the referent wavelength of 485 nm.

Similarly, healthy and benign pigmented skin lesions 5403 and 5404 show very little absorption or radiation relative to the left or right side of the reference wavelength 485 nm. However, pigmented skin clearly shows the absorption and radiation effects around the referent wavelength by the large amplitudes and transitions of the peaks and valleys in the spectrum.

In embodiments, these spectroscopic methods may be useful for various analytical tests when the test substrate contains photosensitive components.

In one embodiment, corrugated elements are tagged and over time to track changes in the properties of a substance or sample, such as peaks, valleys, curves, frequencies, intervals, specific parts of wavelength differences, etc. Can be tracked.

In one embodiment, the algorithm 150 can be incorporated for automated measurement as part of an integrated device that performs surface analysis, such as a skin imaging device or a metal testing device. In one embodiment, the algorithm 150 may be part of a remote analytical system, which allows a surface imager to capture the image and send it to a processing center where the algorithm calculation is performed. be able to.

In one embodiment, Algorithm 150 can be used for hair analysis to determine the health, composition, etc. of hair follicles.

In one embodiment, Algorithm 150 can be used for counterfeit money. For example, each set of equipment and / or currency can be given unique characteristics.

In one embodiment, Algorithm 150 may be useful for the analysis of antiperspirant effects. In some cases, the axillary odor can be used as an indicator of illness or other medical condition such as lymphoma, apocrine sweat glands, hyperhidrosis, hidradenitis suppurativa, or other sweat-related medical problems. .. Algorithm 150 may be useful in determining deodorant effects based on an individual's specific sweat gland activity and type. Algorithm 150 makes it possible to measure the activity of sweat glands located under the armpits, legs, palms, etc. The algorithm analysis can enable the classification of sweat glands and also make it possible to propose suitable products / ingredients for treatment. Algorithm 150 can determine antiperspirant effects based on the effects on sweat gland activity.

In one embodiment, Algorithm 150 may be useful in determining veterinary conditions such as mad cow disease. For example, imaging the tongue, or mucosa or skin area of a potentially diseased cow allows the detection of the condition using Algorithm 150. Imaging with white light as described herein can be combined with imaging with ultraviolet light to facilitate the detection of mad cow disease.

In one embodiment, Algorithm 150 may be useful for observing postoperative appearance concerns such as stretch marks progression and shrinkage.

In one embodiment, Algorithm 150 may be useful in predicting and observing secretions from the mammary glands of lactating women. If, based on the algorithmic analysis, milk production is predicted to be low, suggestions can be made to increase milk production.

In embodiments, algorithm 150, which determines skin condition 158, facilitates measurement, tracking and monitoring of skin condition 158 and its effects such as prescription 118, topical and / or systematic therapy, avoidance routines, diets, etc. I have something to do. For example, skin condition 158 may be measured in between and the current index may be compared to the previous index to determine changes in skin health. As further described herein, the results from Algorithm 150 may enter the advisory engine to provide feedback and corrections to the situation of Formulation 118.

In embodiments, algorithm 150, which determines skin condition 158, may enable diagnosis. Diagnosis may be early diagnosis by distinguishing between significant and non-serious signs. For example, Algorithm 150 may be able to distinguish between minor burns and third-degree burns that require treatment. The use of device 108 to capture an image is that the user can easily send the image to the performer for remote evaluation, track the course of the skin condition, and make the image like the image in the skin microscope database 115. It enables immediate comparison with previous images, other user images, or third-party images, and immediate diagnosis without historical knowledge. Historical data and the results of the modeling tool 132 may be compared to images to assist analysis by either Algorithm 150, the performer, or the performer utilizing the algorithm. In addition to the image, user input in the form of audio, video, or text cases describing issues such as pain levels, heat sensations, itching, etc., analyzes the image to determine diagnosis. May be useful. Algorithm 150 may allow non-linear regression, such as principal component analysis (PCA), which may be a biomedical analysis, used in conjunction with spectroscopic analysis to analyze medical and health conditions. Algorithm 150 may allow simple pattern analysis for diagnosis. Algorithm 150 may be able to determine the thermal and conductive conditions of skin lesions. In embodiments, Algorithm 150 examines the image for the relationship between changes in collagen and porphyrins, as changes in collagen rather than porphyrins may suggest changes from normal lesions to multiple lesions, and thus melanocytes. The lesion may be diagnosed. Skin condition 158 may be compared to a table of signs of various types of lesions. In embodiments, Algorithm 150 may be able to diagnose UV damage. UV damage can be present even on wrinkle-free skin, so UV damage can be difficult to assess from the traditional superficial appearance. However, UV damage is associated with increased melanin products, global distribution of superficial vessels, damage and number, changes in hemoglobin count, changes in epidermal thickness, changes in collagen amount and global distribution, etc. It may be evaluated by examining the skin structure. In embodiments, the diagnosis may not require treatment of the lesion boundaries, as the lesion may not be a major factor in the final analysis of the skin lesion. In embodiments, Algorithm 150 may be able to diagnose oral cancer.

In embodiments, algorithm 150, which determines skin condition 158, may enable cosmetic manufacturing validation or skin clinical trials. For example, skin condition 158 may be determined prior to application of a medical, non-medical, skin care, or cosmetic product, and the time course of the image is of medical, non-medical, skin care, and cosmetic products. May be captured to track the effect.

In embodiments, there may be methods for storing, handling, integrating and analyzing skin conditions 158. The skin condition 158 may be stored in the device 108 itself, a PC, a central server, a salon record, an electronic medicine record, a medical repository, a cosmetic clinical research database 115, a mobile device, and the like. Device 108 allows the user to upload, deliver, share, and / or port images, analysis 154, skin condition 158, data, tracking history, user profiles, etc., as further described herein. May communicate with interface 102, online platform 120, mobile platform 124, etc. For example, a user may use device 108 built into a portable device to capture an image of the skin and upload this image to the mobile platform 124 for analysis 154 to determine the skin condition 158. is there. In response, the user may receive a personalized prescription 118 for sun protection given the user's skin condition 158. Other factors that may be used to determine formulation 118 may include the current UV index, date and time, location, user-preferred type of sun protection product, and the like. In the same embodiment, the user may have already acquired a skin condition 158 determination, given an already determined and memorized skin condition 158, without having to upload a new image from the mobile platform 124. It simply requests the advice of Prescription 118. Once the skin condition 158 is determined, the skin condition is accessible by any element such as user interface 102, online platform 120, mobile platform 124, and / or is integrated with any element. Sometimes. The user may choose to share the skin condition 158 as part of the performer record 180.

In embodiments, algorithm 150, which determines skin condition 158, allows analysis of differences and similarities between peers. Algorithm 150 is in terms of skin condition 158, or gender, age, ethnicity, behavior such as smoking, outdoor work, diet, prescription 118, and other criteria such as other discriminators. Determine which users are most similar. Algorithm 150 may be able to interface with online platform 120, third party database 115, or third party service provider 111 to access skin condition 158 and demographic information for comparison. For example, a user may want to know what other women in their mid-30s with the same skin color are using as a foundation. By utilizing algorithm 150, the user may be able to determine his or her own skin color, identify peers according to search criteria, view details about peer prescriptions 118, or the results of a particular search query 103. Algorithm 150 may allow skin ratings relative to peer groups. Using algorithm 150, the user's skin condition 158 is compared to a previously defined skin condition 158 to monitor the skin condition 158 over an extended period of time. The user's skin condition 158 may also be compared to the skin condition 158 of another individual or group of individuals in order for the skin condition 158 to identify the closest companion to the user. Once a companion, such as a similar individual or group, is identified, the system may display skin care products and / or skin care prescriptions that work for the companion. Similarly, comparisons between users, such as comparisons of at least one of age, gender, location, climate, skin color, ethnicity, etc., may be made by the system. In embodiments, device 108 captures data from the user and determines skin condition 158, so that information may be fed back to algorithm 150 to further enhance the peer identification and product advisory process.

In embodiments, algorithm 150, which determines skin condition 158, may enable predictive / simulation tool 132. After determining the skin condition 158, the algorithm 150 can simulate the course of aging, simulate the skin care treatment effect with the skin care and cosmetic formulation 118, simulate the course of skin condition, and so on. Referring to FIG. 6, the user may use the user interface 102 to access the simulation tool 132. In the examples, an image of the entire face may be used, but it should be understood that the simulation tool 132 is used to create areas of interest of any size. After selecting or capturing the launch image, the user may suggest the type of simulation the user wants to perform. For example, you may want to perform an aging-only simulation or a simulation of aging and treatment effects. The simulation tool 132 may return data on overall appearance, number of wrinkles, elasticity, lightness, moisture, product usage simulation, and so on. For example, the output may contain a split image with one half containing the original face and the other half containing the new simulated output.

In embodiments, algorithm 150 for determining skin condition 158 may enable skin cycle monitoring 140. By monitoring the skin at regular intervals, skin conditions with cyclical properties may be monitored, predicted, and proactively blocked. For example, skin conditions associated with season, weather, pollen count, hormone levels, environmental conditions, etc. may be identified and monitored by the skin cycle monitor 140.

In embodiments, algorithm 150 may be used to create searchable and / or indexable tags to associate with an image and may take advantage of image tagging. Images may be tagged with information related to the content of the image, such as information related to skin condition, skin condition, gender, ethnicity, age, prescription, treatment, etc. Information may be collected by algorithmic analysis, user input, visual inspection of images, and the like. Algorithm 150 may be used to perform search 103 using the information associated with the image as a search item. In embodiments, the information may be stored separately from the image or stored in association with the image, for example as an entry in the user profile. In embodiments, search 103 may be performed on information or images from another user or third party database 115 to identify similarities or differences within the image or information. For example, the user may use the information to search for peers with similar skin conditions to determine what is expected of the condition course. In another embodiment, a search 103 or inquiry for advice or advice from an expert may be performed on product information 190, wellness information 192, skin care prescription 118, third party expert 105, and the like. For example, the user may use the information to retrieve product information 190 that suggests the effect of the product on the user's skin condition. In the embodiment, the search 103 is performed to determine the availability of the product, the inventory of the product, the price of the product, and the like. For example, a user may use information to search a store catalog for a particular product that works for the user. In the embodiments, the user may be interested in identifying an inventory of tanned products formulated for pale skin, especially for pale skin. In the embodiment, the image itself is the search inquiry 1 May be used as 03. For example, the image itself may be used to search the skin image database 115. In embodiments, the images and information input to the system 104 may be used to develop a new algorithm 150 for enhanced diagnostics. For example, Algorithm 150 may be developed for certain non-skin disorders with skin expression, such as rheumatoid arthritis.

In embodiments, Algorithm 150 may be useful for analyzing product features. For example, Algorithm 150 may pick up the product inclusions and match the product with the expected effects of the unique skin condition 158.

In one embodiment, Algorithm 150 can use RGB color analysis.

The algorithm can utilize standard RGB analysis and correlation with skin structure in determining skin phototypes. The calculation of the parameters for determining the skin phototype is fast, and the skin phototype can be obtained in a very short time using a simple skin and aesthetic parameter classification routine.

Exemplary embodiments of the present invention relate to methods and systems for determining skin and aesthetic features. The methods and systems provide effective skin analysis with minimal error and speed. The method of the present invention describes a method and system for determining the skin phototype of a digital image acquired in an RGB color system.

In an exemplary embodiment of the present invention, the method of determining skin characteristics and aesthetic features using color analysis analyzes the color of the skin image pixel by pixel in an RGB color system for the acquired digital image. Includes the process of The colors obtained in the device-dependent RGB color system are converted into the device-independent standard RGB color system (sRGB) that will be used in the later color analysis. The process of analyzing the color of a skin image pixel by pixel with an sRGB color system for an acquired digital image is a part of human skin by generating a table of the most frequently appearing colors in a photograph. Has to analyze photographs.

In this embodiment of the present invention, the sRGB color system is used for image analysis. Judgment of other skin properties (eg, elasticity, melanin, oil concentration, etc.), melanoma, skin-related tumors, and skin-related diseases are YIQ, YCbCr, L * a * b *, L * u * v *, And may require image analysis based on various color systems such as HSL / HSV. The enhancement of the current algorithm 150 can include at least one of these color systems and the correlation with the presented sRGB analysis. This will lead to drastic improvements and current results as well as additional embodiments of the present invention. This method of image analysis is applicable to any element, whether it is an animal, product, plant, or any other substance whose surface needs to be analyzed by digital images, apart from human skin related problems. Is.

The method of determining skin characteristics and aesthetic features using color analysis was obtained after converting the colors obtained in the device-dependent RGB color system to the device-independent standard RGB color system (sRGB). It includes a step of generating the most frequent sRGB color sample corresponding to the pixel-by-pixel analysis of the color of the skin image in the RGB color system for the digital image. For the acquired digital image, the process of generating the most frequent sRGB color sample corresponding to the analysis of the color of the skin image with the RGB color system is to save multiple sRGB brightness. Have.

The method of determining skin and aesthetic features using color analysis is to use the Gaussian probability distribution with the estimated parameters (expected value and standard deviation) for the sRGB color sample generated for the acquired digital image, R, It includes modeling the color distribution of the G and B components, and further includes approximating the colors on the generated sRGB color sample by a Gaussian normal distribution. According to an exemplary embodiment of the invention, the step of approximating the colors on the generated sRGB color sample with a Gaussian normal distribution is to approximate the colors on the generated sRGB color sample with a plurality of Gaussian normals. It has to approximate by superimposing distributions.

The method of determining skin and aesthetic features using color analysis involves generating skin phototypes via a decision tree unit, corresponding to the estimated distribution model parameter color. The skin phototype is generated according to the corrected Fitzpatrick classification, or some other applicable color classifier. According to an exemplary embodiment of the invention, the step of producing a skin phototype according to the corrected Fitzpatrick classification produces the skin phototype according to a skin quality scale ranging from fair skin to dark skin. Including that.

According to an exemplary embodiment of the invention, a system for determining skin phototypes using photographic analysis includes subsystems for determining aesthetic features for human components and veterinary components. The aesthetic features further include features relating to hair, nails and skin.

According to an exemplary embodiment of the invention, an image of a human body skin sample can be captured by some digital camera. The acquired digital image sample of human skin can be analyzed pixel by pixel in the RGB color system. After color conversion from a device-dependent RGB color system to a device-independent standard RGB color system (sRGB), the most frequent sRGB color table that appears on the image can be generated. According to one embodiment, the generated table can consist of the most frequent 256 colors that appear on images of human skin. The color sample obtained from the image can be approximated by a Gaussian normal distribution (or a (standardized) superposition of several Gaussian normal distributions). Therefore, the expected value (using weighting means) and the standard deviation (using the unbiased (n-1) method when the exact expected value is unknown / estimated) for each of the acquired digital images is estimated. Can be evaluated. The phototype of the skin can be determined via a decision tree with estimated expected value and standard deviation. The Fitzpatrick classification can classify skin phototypes according to a skin quality scale ranging from fair to dark.

With reference to FIG. 58, Flowchart 5800 graphically illustrates the process of determining the skin phototype of an acquired digital image of a portion of human skin. The process begins with block 5810, where an image of a portion of human skin is captured. The image capture device can be a digital camera or the like. The processing flow proceeds to the logic block 5820 in which the analysis of the acquired digital image is performed for each pixel in the RGB color system. In block 5830, after converting all colors from the device-dependent RGB color system to the device-independent RGB color system (sRGB), the most frequent color table that appears on the acquired digital image is displayed. , Can be generated using the quantization method. According to one embodiment of the invention, in block 5840, multiple sRGB color values / samples generated in the range of values 0 to 255 can be stored for further analysis. This range of values has proven to be more convenient for determining skin quality than the range 0 to 1. The conversion from one to the other can be done simply by dividing the value of 255 and vice versa. In the next steps 5850 and 5860, the color approximation on the sample is done by Gaussian normal distribution, and in block 5860 the estimated expected value and standard deviation are evaluated. Finally, in block 5870, the skin phototype of the acquired digital image is determined according to the corrected Fitzpatrick classification using a decision tree.

According to an exemplary embodiment of the invention, the decision tree is an algorithm in which the estimated expected and standard deviations are equal to the values of the Fitzpatrick classification / notation in determining the phototype of the skin. Can be. The effect of this approach can be understood in studies on parametric skin distribution modeling for skin segmentation / detection.

With reference to FIG. 59, a pixelated diagram of the acquired digital image of a human skin sample is shown. Images of the person's skin sample are captured under white synchrotron radiation. The image can be captured by a digital camera or the like under white synchrotron radiation. The analyzer coupled to the image capture device can analyze the acquired digital image pixel by pixel in the RGB color system. The pixel-by-pixel analysis of acquired digital images in sRGB (after RGB to sRGB color system conversion) is not limited to determining skin phototypes, but other skin properties (eg, elasticity). , Melanin, oil concentration, etc.), melanoma, and may also be useful for other purposes such as classification of skin tumors / diseases.

Digital images captured from human skin samples are usually given in an RGB color system. In one embodiment, the method of the present invention that employs the algorithm 150 for determining the phototype of the skin depends on this color system, but is device independent due to the conversion to the sRGB color system. Calibration of the image capture device, such as a digital camera, must be taken into account so that the final color offset can be corrected. The color offset correction in the method of the present invention can be performed by some known method in the prior art, and the color offset correction can also be performed in the software used in the method of the present invention in determining the skin phototype. can do.

Referring to FIG. 60, a diagram depicting pixels of an acquired digital image of a portion of human skin after quantization is shown. Images of the person's skin sample are captured under white synchrotron radiation. The image can be captured by a digital camera or the like under white synchrotron radiation. The analyzer coupled to the image capture device can analyze the acquired digital image pixel by pixel in the RGB color system. The pixel-by-pixel analysis of acquired digital images in sRGB (after RGB to sRGB color system conversion) is not limited to determining skin phototypes, but other skin properties (eg, elasticity). , Melanin, oil concentration, etc.), melanoma, and may also be useful for other purposes such as classification of skin tumors / diseases. Color quantization or color image quantization is usually the process of reducing the number of different colors used in an image so that the new image is as visually identical as possible to the original image. is there. Color quantization is usually important for displaying images in many colors on devices that can simply display a limited number of colors due to memory limitations, and also for certain types of images. Allows for effective compression.

The image quantization method can be applied to the captured image. A sampling device combined with an analyzer can be used to generate a table of 256 colors that most often appears in digital images taken from parts of human skin. Color samples obtained from digital images can be saved in the sRGB color system. According to an exemplary embodiment of the present invention, the sRGB color system can store the generated color sample in the range of 0 to 255. It has been found that this value range is more convenient than the interval of 0 to 1 for determining the skin type.

Therefore, using an approximation device combined with a sampling device, the color of the sample is approximated by a Gaussian normal distribution (or (scale) superposition of a minority Gaussian normal distribution). In addition, an approximation device coupled to the sampling device is used to obtain the expected value estimation (using the weighted average) and standard deviation (the exact expected value is unknown / estimated, so the unbiased (n-1) method is used). It may be calculated for each image.

FIGS. 61 and 62 show the use of the algorithm 150 of this method, and FIG. 63 shows the algorithm 150 for RGB color analysis.

See Figure 61 for a histogram / distribution of standard R, G, and B colors in one of the photographs taken of a patient whose skin phototype is classified as Type III by Fitzpatrick, and its Gaussian normal approximation / inclusion. Can be seen. Related estimates are, for example, μ_R(Expected value of red) = 171.1304, μ_B(Expected value of blue) = 135.3047. To determine the skin phototype, these estimates are compared to a decision tree described below. Skin phototypes are determined according to the corrected Fitzpatrick classification. The Fitzpatrick skin type test questionnaire (skin type scale), which ranges from very fair (skin type I) to very dark (skin type VI), is often used to determine skin phototypes.

Dermatologists use the Fitzpatrick classification scale to classify a person's complexion and tolerance to sunlight. According to an exemplary embodiment of the invention, the Fitzpatrick scale classifies skin types from I to VI.

Type I-Very white or freckled skin, constantly tanned by sun exposure (very fair, often seen in people with red or golden hair and blue eyes)

Type II-white skin, usually tanned by sun exposure (fair-skinned, often found in people with red or golden hair and blue, green, or light brown eyes)

Type III-White or olive skin, may get sunburned by sun exposure (fair, regardless of hair or eye color)

Type IV-Brown skin, rarely sunburned by sun exposure (common to people of Mediterranean descent)

Type V-dark brown skin, very rare to get sunburned by sun exposure (common to people of Middle Eastern descent)

Type VI-Black skin, never sunburned by sun exposure

The skin image is taken under white light using a photographing device such as a digital camera or a video camera. The analyzer analyzes a pixel-by-pixel image of a portion / sample of human skin. A sampling device coupled to the analyzer produces a table of 256 colors that appears most often in captured images. Color samples obtained from digital images are saved in the sRGB color system. In the sRGB color system, the generated color sample is saved in the range of 0 to 255. The approximation device coupled to the sampling device is a digital image with expected value estimates (using a weighted average) and standard deviations (using the unbiased (n-1) method because the exact expected value is unknown / estimated). Calculate for each. The skin phototype is determined by a decision tree coupled to the approximator. In this image processing, it may be possible to determine the skin phototype from the expected values of R and B by the following decision tree. An exemplary embodiment of the present invention is shown below.

<maths num="1"><img id="000003" he="95" wi="127" file="JP5771007B2_D0001.tif" img-format="tif" img-content="drawing" /></maths>

<maths num="2"><img id="000004" he="9" wi="74" file="JP5771007B2_D0001.tif" img-format="tif" img-content="drawing" /></maths>

The above equation is obtained from an image analyzed using a programmed neural network.

Figure 62 is one of the photographs of a patient whose skin phototype is classified as Type VI by Fitzpatrick. It is a figure which shows the histogram / distribution of the standard R, G, and B colors in, and the Gauss normal approximation / inclusion. According to an exemplary embodiment of the invention, the relevant estimates here are μ._R(Expected value of red) = 189.7173, μ_B(Expected value of blue) = 103.537. These estimates are compared to the decision tree described above to determine the phototype of the skin.

Referring to FIG. 63, a flowchart 6300 illustrating an algorithm 150 for determining the skin phototype based on estimates of the mathematical expectations of standard R and B colors in the sRGB color system can be seen. This flowchart describes the algorithm 150 developed by this method, and in the logic block 6310, a photograph of a part of human skin is taken under white light using a digital camera or the like . In the logic block 6320, the captured digital image is analyzed in pixel units in the RGB color system. The logic block 6330 uses the quantization method to analyze the captured image on a pixel-by-pixel basis in the sRGB color system. The color sample obtained from the image can be approximated by a Gaussian normal distribution (or (scale) superposition of a minority Gaussian normal distribution). Thereby, the expected value estimation (using a weighted average) and the standard deviation unbiased (n-1) method (because the exact expected value is unknown / estimated) may be evaluated for each acquired digital image. Therefore, in the logic block 6330, the phototype of the skin is determined by the decision tree.

Those skilled in the art will appreciate that various implementations of this technique offer various benefits. First, the technique determines the phototype of the skin using ordinary low-cost digital photography equipment under standard environmental conditions. Second, the analysis performed on the captured digital images can be useful for cosmetic recommendations as well as medical or surgical purposes. Third, the image quantization algorithm, expected value estimation and standard deviation calculation are quick, and the skin phototype can be easily determined in a short time by a simple procedure. Fourth, the analysis can also be useful in classifying other skin properties (elasticity, melanin, lipid levels, etc.), melanoma, skin tumors or diseases.

In embodiments, the development of a new algorithm 150 by the executor, user, service provider 111, etc. may be enabled by a software development kit that anyone can use to develop the new algorithm 150 and API 154 for device 108. is there.

Referring to FIG. 3, in an embodiment, the steps of collecting images, performing skin analysis, communicating findings, and scheduling follow-up begin with image capture by the user using device 108, if necessary. .. The user may further answer the question and provide additional details regarding user-entered images, cosmetic formulations, areas of interest, and the like. Using user interface 102, data may be communicated to a computer for analyst 304 or analysis 154, for example, by means of communication over a network, internet, wireless method, and so on. In certain embodiments, the payment system 302 may be accessed by the user when data is collected or communicated. In the illustrated embodiment, the insurer may access the data, but the payment is a one-time payment by the user, an entity with an interest such as a membership fee by the user, a third party service provider 111, platform 120, 124, may be executed or requested by the executor, etc. The data entered may be analyzed by the analyst, in real time by the software, by an analyst assisted by Software Assistance, and the like. The initial analysis may also determine data integrity. If the data does not pass the integrity test, the data is communicated back to the user. Analyst evaluation may be assisted by software that uses algorithms to determine the type of condition and / or advised care / treatment. Historical analysis and data and modeling tools may be used to assist analysts' evaluation. Stakeholders (especially company employees, payment providers, doctors, healthcare professionals, users) receive user-specific details for analysis and / or follow-up, or other actions that may be required. Sometimes. Analysis 154 is stored by the system 308 and / or submitted to the performer for approval 310 May be done. In embodiments, memory 308 may require performer approval 310. Severity test 312 may determine the choice of the appropriate method of communication with the user. If the result of test 312 is affirmative, the user may be immediately notified by preferred communication methods such as telephone, instant messaging, etc. If the result of test 312 is negative, the user may be notified as well, but the notification may take a less urgent route, such as by email or mail. In any case, the software tool may advise on the appropriate communication method and medium based on the evaluation, and may populate the preset template with the information / message to be communicated. Moreover, the notification may further include a notification of performer availability by any means. Analysis 154 may launch an executable availability / scheduling tool. For example, performer availability may be evaluated and sent at the same time before sending the results for severity 312 to the user. The user may access availability and scheduling tools to obtain and confirm the appointment time. Means may also include additional notification of performer availability. Analysis 154 may launch an executable availability / scheduling tool. For example, performer availability may be evaluated and sent at the same time before sending the results for severity 312 to the user. The user may access availability and scheduling tools to obtain and confirm the appointment time. Means may also include additional notification of performer availability. Analysis 154 may launch an executable availability / scheduling tool. For example, performer availability may be evaluated and sent at the same time before sending the results for severity 312 to the user. The user may access availability and scheduling tools to obtain and confirm the appointment time.

In an embodiment, the user interface 102 for the skin analysis system 104 interfaces with the device 108, stores images, develops algorithm 150, and intervals between images from any number of regions of interest and image captures. And the skin condition 158 is tracked by tracking the capture date of the next projected image, the findings are communicated to the performer, the simulation tool 132, the skin type determination tool 130, the skin cycle monitor 140, and so on. May be used to interact with performer availability / scheduling tools, etc.

In embodiments, the user interface 102 may operate as an application running on an online platform 120, a mobile platform 124, etc., such as a device 108, a computer, a server, a kiosk terminal, and the like. Any aspect of the user interface 102 described herein is applicable to the user interface 102 operating in any environment.

In embodiments, the user interface 102 for the device is built into, for example, a keypad of a communication device, a series of buttons, switches, etc. located on the device 108, as further described herein. It may be integrated with device 108, or it may be outside device 108, such as software running on a computer, internet, intranet, mobile communication device, online platform 102, mobile platform 124, and the like. User interface 102 includes magnification, light source, light intensity, wavelength of light, angle of light, electrical and magnetic properties of light, sensor positioning, image capture interval, image size, data storage, data transmission, etc. May be used to change the settings of such device 108.

Referring to FIG. 5, user interface 102 may systematize and index captured images by date, region of interest, skin condition, and the like. For example, without limitation, four images captured from the same region of interest are indexed by number in the series, as shown in FIG. In embodiments, the user interface 102 may display the imaged field of view on the skin in real time and at the same time populate the user interface 102 with images acquired or submitted by the user. User interface 102 may track the first image, the latest image, the next image, and so on. The user interface 102 may allow the user to shuffle the image and use the image as the basis for simulation 132, as described herein. User interface 102 may be used to set the next image capture prompt. User interface 102 may be used to create reports of images and skin condition 158. User interface 102 may be used to send a report to the performer. In embodiments, the user interface 102 may be used to initiate a skin type test. In embodiments, the user interface 102 may draw a body shape. When the user interacts with the drawing of the body, for example using an instruction device, the imaged body part is linked to the image so that the image pops up or is otherwise accessed. May be done. User interface 102 may be adapted to retrieve data from the user in response to a prompt. User interface 102 may utilize algorithm 150 to check the integrity of the captured image. The user interface 102 may guide the user in capturing the image and providing user input in relation to the image.

In embodiments, the user interface 102 may interact with host hardware 108 or third party hardware 109. Hardware 108, 109 can be connected to computers, online platforms 120, mobile platforms 124, etc. via user interface 102 to capture images that allow users to measure various skin health, condition and type parameters. May have an imaging device. Hardware devices 108, 109 may be stand-alone devices, may be connected via a medical or non-medical computing device, or may be built into the computing device. The user interface 102 may guide the connection process for the hardware devices 108, 109. Devices 108, 109 may memorize the images, reports and advice created and maintain an entire repository of images as part of the skin health record 121. The device may allow systematic memory of skin health record 121. Third-party hardware 109 may have devices such as moisture sensors, cosmetic analyzers, skin microscopes, cameras, x-ray machines, MRIs, medical record providers and software, webcams, communication devices and the like. Third-party hardware 109 may seamlessly connect to system 104 to allow users to obtain more analysis and share such sets of data with other experts or users.

In embodiments, the user interface 102 may allow type determination 130. The features may be captured to determine the skin features and skin condition 158 of the user's skin. Extensive genetic parameters such as ethnicity, skin color, location factors, environmental factors (eg pollen count, weather, etc.), and lifestyle factors are used to determine the user's skin condition 158 images and skin health condition. May be collected in addition to the data. Skin condition 158 may be correlated with product experience ordering and rating 138 to allow the most effective product advice to be given.

User interface 102 may display prescription 118. Formulation 118 provides users with a hardware or community-driven personal skin care rating of 160 and / or type determination of 130 and a rating and ranking of product effectiveness and experience (eg, odor, taste, feel, texture, color, etc.). Allows you to learn the products and product usage patterns that work best for your skin, based on 138 and / or commented product experience sharing. Formulation 118 may also be dynamic advice based on the user's collective input and expert input on the product that would best best suit the user's individual needs.

In embodiments, the user interface 102 may enable the simulation tool 132. Users may be able to upload images, model various skin parameters (eg, water levels in the skin, collagen levels, age, etc.) and observe changes in the images. Additionally, the user may be able to model the effects of various products and formulations 118 on the image (skin care, makeup, medical, nail care, hair care, etc.). The simulation tool 132 displays a comparison of the modeled changes to the current image, allowing the user to see changes in the entire image or in split halves of the image. The user's image may be automatically or manually optimized for the best look, and a product or formulation 118 may be provided to obtain that look. Simulation tool 132 further allows consumers to model skin features or conditions 158 of other selected users, such as celebrities, celebrities, average users, or non-users.

In an embodiment, the user interface 102 enables the daily report 134. The Daily Report 134 may be a report that is highly customized and provides the most relevant user information to the user, based on the user's skin condition 158. Daily Report 134 lists skin care formulas 118 that should be followed based on user-related environmental and lifestyle factors, directs new product information 190, current skin care shelves 114 and rankings 138 or It may display changes in ranking 138 and provide feedback from the user or expert 105 about the products most relevant to the user. Daily Report 134 provides users with information on clinical trials and upcoming results, new product releases and status, events, various skin-affecting factors such as daily weather forecasts, UV index, temperature, pollen count, etc. It may contain other data that gives a sense of value. Daily Report 134 may report whether a product is nearing expiration or needs to be replenished, based on the recommended usage protocol. Daily Report 134 may be provided to the User by User Interface 102, Documents, Email, SMS, RSS, Video, or any other communication medium.

In embodiments, the user interface 102 may enable the upcoming purchase list 134. The to-purchase list 134 uses the drag-and-drop function or other selection mechanism when the user is surfing the web or otherwise accessing product information 190. It may be a function that allows you to select a product and add it to part of the skin care shelf 114. The user can share this function with other users, friends, and / or family members so that others can see the to-purchase list 134. The other user can then select the product from the planned purchase list 134, purchase the product, and send it to the user.

In embodiments, user interface 102 allows for ranking and rating 138. Rankings and Ratings 138 may be performed for different ratings and rankings for different product features. Product experience may be collected from users in simple rating and ranking 138 formats and textual comment data to be stored in the database. This ranking and rating 138 may be real-time, and similar users or peers, such as users with any of the same age, same gender, same skin type, same ethnicity, geography, moisture level, etc. May be synchronized to show what is most relevant to the user. These ratings and rankings 138 may be dynamic rankings and ratings 138. The user will see the total number of ranked / rated and / or either a weighted percentage score expression ranking or a rating of 138. The ranking and rating 138 includes any of the features such as recognized effect, odor, texture, feel, texture, ability to absorb the product, stains left by the product, ease of use, etc. It is even possible for the user to upload an image of the user and obtain an effect / appearance ranking and rating of 138 for different product advice from other users or experts 105. For example, without limitation, users may upload data and / or images and request ratings and feedback on better products from Indian herbal experts, Japanese aging experts, and so on. A user who provides various product rankings and ratings 138 may be rated by another user himself. This may allow for the most effective and impartial user selection and the specific assistance of potential experts 105. A small selection group of highly rated users is an exclusive book

In embodiments, the user interface 102 may enable a skin cycle monitor 140. This skin cycle monitor 140 indicates when the last image was collected and may count down the next scan based on a time interval, such as the time it takes for the skin to regenerate, or some other interval. is there. To date, the skin is thought to regenerate every 28 days. The skin cycle monitor 140 takes into account age, environmental changes, and other factors to direct the upcoming scanning schedule.

In embodiments, the user interface 102 may enable wellness / health 142. User interface 102 collects lifestyle data and is based on the user's unique skin condition 158 and characteristics, such as lifestyle (such as sleep, rest, exercise, etc.) and (vitamins, foods, product usage, etc.). May provide further health advice (such as). The wellness and wellness module 142 allows the user to obtain the best fit health and wellness schedule and prescription 118 for personal use.

In embodiments, the user interface 102 may enable game 148. The user may be able to play a game 148 that allows the user to model different products, try different hairstyles, model different hairstyles and clothing, and so on. Users may interact with other users or computers to make product selection a simple process. This process may also be used to collect information about user preferences and appearance.

In embodiments, the user interface 102 may enable gift guidance 144. Personal gift advice may be provided to others in the user's network based on the user's skin condition 158.

In embodiments, the user interface 102 may be embedded within touch screen user navigation. The touch screen system allows the user to get a visual appearance, go to simulation tool 132, change the picture orientation, drag and drop, and so on, going to various parts of the user interface 102. May be used to enable. Touch screen navigation can be especially useful when the hardware device 108 is connected to a computing platform. The user interface 102 collects information from other devices 109 and / or ratings such as skin microscopes, blood reports, biopsy reports, etc. to provide additional information for the skin record 121. , May make it even more possible to adjust.

In embodiments, user interface 102 may enable a purchase / sample portal. The user interface 102 may include a purchase / sample portal that allows the user to select a product and complete the purchase or request that the sample be delivered to a pre-filled address. The portal is available on various social networking platforms 188 and through various computing platforms such as online platform 120, mobile platform 124, computers, laptops, mobile phones, and other mobile and medical devices. May be available.

In embodiments, user interface 102 may enable scheduling and data sharing capabilities. Users can schedule meetings with specific experts or performers online and, if motivated, share specific parts of skin condition 158 or skin record 121 and part or all of the history with experts or performers. It is possible to do. Rated experts and performers to assist in the selection and scheduling process, availability and other criteria may be dictated by the user. Experts may be able to further share specific sets of data between performers, between doctors, between doctors and spas, between spas and spas, and so on.

Other inputs 112 such as equipment, feature shapes and data are submitted by the user to obtain a personal assessment of the user's beauty, makeup, or medical concerns related to skin, hair, nails, etc. It may be used to reinforce the data or as the main data. For example, certain devices may be marketed, purchased, and independently developed as standard products.

In embodiments, the wearable monitor 182 may be an input 112 to the system 104 and the user interface 102. The wearable skin health monitor 182 may enable real-time tracking of changes in environmental and skin health. These devices can be worn directly on the body or are integrated into clothing, clothing, and / or ornaments carried by the user. In an embodiment, the user has a device that monitors UV levels and issues an alarm when the sun protection level recognized by the product used by the user falls below a set target level. These wearable monitors 182 either have an independent user interface 102 or are programmable for personal parameters using other input devices. The wearable monitor 182 may also capture various physical parameters such as heart rate, blood pressure, exercise rate, water consumption, fat counter, calorie meter, and so on. Monitor 182 may also be able to assess hydration levels.

In embodiments, social network 188 may be input 112 to system 104 and user interface 102. The Beauty Social Network 188 may be a group of users who are interested in knowing and sharing information about their beauty or medical concerns in a personal, private, and social interactive environment. The intent is that the user invites other users to discuss such concerns, and links to other users to obtain information 190, 192, products, prescriptions, experts, performers, other rankings. Perform rankings, ratings, and reviews of rated / rated items, complete purchases, access to-purchase list 119, access gift guide 144, play game 148, daily Something like reviewing Report 134, in the meantime, creating a Beauty Social Network 188 to share experiences with other users in the network.

In embodiments, product information 190 may be input 112 to system 104 and user interface 102. The database of product information 190 includes product, name, claim, manufacturer information, ranking and rating 138, packaging information, images, usage parameters, product development history or forecast, special treatment, next change, safety information, Get efficacy information, odor, taste, color, texture, price, place of manufacture, brand information, consumer feedback and experience, as well as the best cosmetic or medical results for your skin, hair, nails, etc. In order to include other parameters that may be acquired and / or maintained to help select the best product that suits the user's individual tastes or conditions. In addition, similar information about service-oriented products such as massage, facial, hair dye, etc. can help with liposuction, wrinkle removal, laser hair removal, and improve or maintain the user's appearance and skin condition 158. It may also be obtained with information about other cosmetic, cosmetic, and / or treatment-like treatments related to it. The manufacturer registers product information 190 and contributes information about products in the treatment distribution route, products in clinical trials, and so on. Users may rank and rate products 138. The database update utility may update the database with new product information 190, retail inventory, etc.

In embodiments, the wellness information 192 may be input 112 to the system 104 and user interface 102. Health such as the effects of various products such as non-prescription drugs, supplements, and other consumables (eg, vitamins, protein shakes, supplements, etc.) that support and maintain health and wellness, primarily without limitation. And wellness information 192 may be captured. In addition, information on lifestyle advice (eg, sleep, rest, diet, and exercise advice for specific age groups / ethnic groups, etc.) is collected to optimize overall health, wellness, and beauty / makeup. It may be correlated with user preferences and characteristics to enable and provide personalized solutions and services.

In embodiments, the plug-in web capture 194 may be input 112 to system 104 and user interface 102. Software component plug-ins for Internet web browsers and baskets or repositories recognize graphic objects on browsed web pages, allow the user to select graphic objects, and page containing skin care shelf 114. It may be possible to drag and drop into a basket or repository to a page in a web browser such as. This graphic object is a standard reference, either accessed remotely, present on the user's PC as part of plug-in module 194, or as part of a resident software program on a computing platform. It will be recognized through the table. Graphic objects may include images of products such as skin care products or creams, or other objects as part of a web e-commerce site. Once recognized, the plug-in 194 may highlight the picture and notify the user that the plug-in has been recognized, or provide additional information or contact information. Plugin 194 further recognizes brand names, trade names, generic drug names, trademarks, and more.

In embodiments, the barcode scan 198 may be input 112 to system 104 and user interface 102. Barcode information on various products includes other product information 190, or other similar products, that identify similar replacement products, among other collections of tracking, identification, pricing, and other related data. May be captured to assist in correlating information, usage advice, other user experience, pricing and shipping information. The barcode scanner 198 may be a part of the handheld user device 108, a stand-alone system, a manual entry mechanism, or the like.

In embodiments, the conventional information / questionnaire 101 may be input 112 to the system 104 and user interface 102. Information 101 about users and products may be captured via dynamic and static questions. Regarding other products along parameters such as age, gender, location, personal lifestyle habits, smoking habits, sleep patterns, dry / greasy and water levels, product likes and dislikes, odors, tastes, absorption, pollution tendencies, etc. Experience is captured in a simple way using games and other interactive tools with questions and answers scattered at various points in the interaction with the user's service product, system 104, or user interface 102. May be done. Information 101 may be captured directly from the user or through an intermediary and is augmented by the expert automatically by computer data population, as the output of algorithm 150, or based on the expert's evaluation. There are times. Information 101 may be obtained through quizzes, badge-and-widget-based formats, on-the-fly, adaptive survey questions, and more. Information 101 includes "How often do you go shopping?", "When do you shop for cosmetics?", "Usually go out." "Where do you typically go?", "Why that spot?", "Who do you shop with?", "Why that spot", "Why that spot?" "Why?", "What do you ask your friends when asking for"

In embodiments, the third-party expert 105 may be input 112 to system 104 and user interface 102. System 104 includes practitioners, doctors, medical experts, beauticians, schedulers, product inclusion experts, cosmetologists, herbal, ayurveda and homeopathic experts, health and wellness experts, and media experts. Various experts, such as photo enhancement experts, may connect with and interconnect with users. The user can direct questions to such experts 105, which are located in geographically different locations, via the system to obtain personalized advice. Expert 105 may be supplied with collected user data and features, and a record of expert evaluations may be maintained at record 121. Advice provided by experts may be provided to users for purchase / sample requests, etc. Experts can warn certain cases or sets of data within the expert community or for discussion or inquiry with users.

In embodiments, the third party hardware 109 may be input 112 to system 104 and user interface 102. The system may connect to a variety of third-party hardware 109 such as existing imaging solutions, camera devices, computers, lighting systems, sports devices such as perimeters, and so on.

In embodiments, third party service provider 111 may be input 112 to system 104 and user interface 102. Third-party service provider 111 integrates into system 104 to allow users to make the best personal product or service selection for their hair, skin, nails, etc. with respect to medical or cosmetic / cosmetic needs, etc. May be done. Third-party service providers 111 include hospitals, doctors, spas, salons, beauticians, beauticians, makeup counters, drug stores, cosmetic sales representatives and websites, ranking and rating services, product information databases, laboratories, magazines and May include information providers, insurance companies, social networking sites, health and wellness services, photo enhancement services, and more. For example, based on skin concerns, a scheduling system for doctors will be integrated, scheduling options will be offered to users online, and at the same time they will connect with insurance providers to confirm coverage with users. Moreover, the availability of pre-determined historical medical and / or cosmetics, and / or advised services, either through pre-assessment of conditions, through counters, or by prescription, is for the user. May be captured to make the selection process convenient and easy.

With reference to Figure 7, a system that provides advice for skin care based on skin condition 158, skin care goals, and environmental factors that affect the skin is to obtain an individual's skin condition 158 and by skin condition 158. It has the task of classifying individuals and advising on products and formulations that are effective in achieving skin care goals. The system may be computer-based, internet-based, network-based, or the like. The system may be a community-driven facility for skin services. In embodiments, advice may be based on identifying other users with similar skin conditions and identifying products or formulations that are effective for other users. In embodiments, advice may be based on product information 190, wellness information 192, third party database 115, expert 105, service provider 111, and the like. As shown in FIG. 7, the user captures the initial image and in this case performs an analysis for a particular endpoint such as moisture. The system may automatically advise certain products based on a given moisture level, moisture level that is effective for skin condition 158, etc. Additionally, the system may perform projections of skin condition 158 based on various skin care formulas 118 such as top care, standard care, and low care. In embodiments, images may be captured using device 108 or third party hardware 109. The image uses any image capture device or technology and utilizes any incident light such as unpolarized light, polarized light, monochromatic light, scattered light, white light, multiple single wavelength light, etc. May be captured. Any captured image may be used to obtain skin condition 158.

An embodiment of the skin care advice page of a skin care system may include a report of the product the user is currently using, user input to obtain the skin condition 158, a request for advice, and the like. Reports on the products you are currently using may include a ranking or rating of 138. For example, when a user accesses user interface 102, the user uses his or her current prescription 118 and the current product or therapy used, or the product or prescription 118 used in the past. May access adaptive questionnaires to determine their experience. For example, the user may ask "How effective is it?", "How is its fragrance?", "How does it absorb?" , "Does it cause breakouts?", "How does it feel?", "Do you think this product is well worth it?" this product is of good You may be asked to answer questions such as "value)?". Of course, the ranking and rating need not be prompted by the question, it may be just an example, it may be arranged in a format other than the question, it may be arranged in a drop-down menu or the like. To obtain skin condition 158, the user may enter data related to appearance such as gender, age, ethnicity, location, skin color, environmental factors, and so on. In embodiments, analysis 154 of images obtained from device 108 or third party hardware 109 may be further used to determine skin condition 158. Based on skin condition 158 derived from user input, image analysis, or any combination of these, the user enters a database containing wellness 192, prescription 118, expert 115, service provider 111, and product information 190. By connecting, it may be possible to determine which products and formulations 118 work best for the user's skin condition 158, and the information includes product inclusions, product claims, product labels, product combinations, product usage protocols, product ratings and rankings. May include 138 and so on. By incorporating rankings and ratings 138, community-driven advice may be produced for skin-related products that are regulated with respect to age, skin color, location, ethnicity, environmental factors, and so on. In embodiments, the user has moisture, protection, cleansing, tint, beauty, anti-aging, anti-wrinkle, skin tightening, deep cleansing, pore shrinkage, alcohol treatment, peeling, bright skin, sunburn, sun protection, self-tanning, acne. Requests for advice may be performed, including selection of skin goals such as treatment, acne prevention, lightness improvement, skin regeneration, stain treatment, treatment of wrinkles at the corners of the eyes, hair loss, scar treatment, etc. In embodiments, skin goals may be automatically selected by the system 104. The automatic selection may be based on the appearance of skin condition 158. For example, if analysis 154 reveals that the skin is extremely dry, then the system is due to the extremely dry skin. Humidifying products may be advised, or the system may advise what inclusions to look for in the product. The user may be able to purchase the product directly from the advice page, for example by putting the product in the electronic shopping cart 113, or may be directed to another site for shopping. In an embodiment, the user may add the product to the to-purchase list 119 for further shopping. In embodiments, the user is in a logical form based on the user's specific skin characteristics 130, depending on the intent (eg, work, fun, etc.) of the usage scenario (eg, morning, afternoon, night, etc.). Products may be added to the interface to Formula 118, which can systematize Products and Formula 118, or to Skin Care Shelf 114, which may be drawn. The beauty shelf 114 may have multiple screens for advice by various people (eg, doctors, dermatologists, beauticians, spa specialists, entire users, experts, most similar people, etc.). The beauty shelf 114 may be a personal product arrangement. Users may drag and drop (or select to add) products as they navigate the web, find new products, and have automatically populated advice. This feature may include programs that highlight products of interest while traversing the web. Beauty Shelf 114 may be an application that can be placed independently on social networking sites and / or toolbars on other personal pages. Beauty Shelf 114 may further inform you of purchase dates and purchase history, product expiration warnings, and other usage updates. Purchases made from the website are automatically added to the user's beauty shelf 114, while also allowing manual entry for offline purchases. Sometimes. The user may be able to purchase the product directly from the advice page, for example by putting the product in the electronic shopping cart 113, or may be directed to another site for shopping. In an embodiment, the user may add the product to the to-purchase list 119 for further shopping. In embodiments, the user is in a logical form based on the user's specific skin characteristics 130, depending on the intent (eg, work, fun, etc.) of the usage scenario (eg, morning, afternoon, night, etc.). Products may be added to the interface to Formula 118, which can systematize Products and Formula 118, or to Skin Care Shelf 114, which may be drawn. The beauty shelf 114 may have multiple screens for advice by various people (eg, doctors, dermatologists, beauticians, spa specialists, entire users, experts, most similar people, etc.). The beauty shelf 114 may be a personal product arrangement. Users may drag and drop (or select to add) products as they navigate the web, find new products, and have automatically populated advice. This feature may include programs that highlight products of interest while traversing the web. Beauty Shelf 114 may be an application that can be placed independently on social networking sites and / or toolbars on other personal pages. Beauty Shelf 114 may further inform you of purchase dates and purchase history, product expiration warnings, and other usage updates. Purchases made from the website are automatically added to the user's beauty shelf 114, while also allowing manual entry for offline purchases. Sometimes. The user may be able to purchase the product directly from the advice page, for example by putting the product in the electronic shopping cart 113, or may be directed to another site for shopping. In an embodiment, the user may add the product to the to-purchase list 119 for further shopping. In embodiments, the user is in a logical form based on the user's specific skin characteristics 130, depending on the intent (eg, work, fun, etc.) of the usage scenario (eg, morning, afternoon, night, etc.). Products may be added to the interface to Formula 118, which can systematize Products and Formula 118, or to Skin Care Shelf 114, which may be drawn. The beauty shelf 114 may have multiple screens for advice by various people (eg, doctors, dermatologists, beauticians, spa specialists, entire users, experts, most similar people, etc.). The beauty shelf 114 may be a personal product arrangement. Users may drag and drop (or select to add) products as they navigate the web, find new products, and have automatically populated advice. This feature may include programs that highlight products of interest while traversing the web. Beauty Shelf 114 may be an application that can be placed independently on social networking sites and / or toolbars on other personal pages. Beauty Shelf 114 may further inform you of purchase dates and purchase history, product expiration warnings, and other usage updates. Purchases made from the website are automatically added to the user's beauty shelf 114, while also allowing manual entry for offline purchases. May be directed to. In an embodiment, the user may add the product to the to-purchase list 119 for further shopping. In embodiments, the user is in a logical form based on the user's specific skin characteristics 130, depending on the intent (eg, work, fun, etc.) of the usage scenario (eg, morning, afternoon, night, etc.). Products may be added to the interface to Formula 118, which can systematize Products and Formula 118, or to Skin Care Shelf 114, which may be drawn. The beauty shelf 114 may have multiple screens for advice by various people (eg, doctors, dermatologists, beauticians, spa specialists, entire users, experts, most similar people, etc.). The beauty shelf 114 may be a personal product arrangement. Users may drag and drop (or select to add) products as they navigate the web, find new products, and have automatically populated advice. This feature may include programs that highlight products of interest while traversing the web. Beauty Shelf 114 may be an application that can be placed independently on social networking sites and / or toolbars on other personal pages. Beauty Shelf 114 may further inform you of purchase dates and purchase history, product expiration warnings, and other usage updates. Purchases made from the website are automatically added to the user's beauty shelf 114, while also allowing manual entry for offline purchases. May be directed to. In an embodiment, the user may add the product to the to-purchase list 119 for further shopping. In embodiments, the user is in a logical form based on the user's specific skin characteristics 130, depending on the intent (eg, work, fun, etc.) of the usage scenario (eg, morning, afternoon, night, etc.). Products may be added to the interface to Formula 118, which can systematize Products and Formula 118, or to Skin Care Shelf 114, which may be drawn. The beauty shelf 114 may have multiple screens for advice by various people (eg, doctors, dermatologists, beauticians, spa specialists, entire users, experts, most similar people, etc.). The beauty shelf 114 may be a personal product arrangement. Users may drag and drop (or select to add) products as they navigate the web, find new products, and have automatically populated advice. This feature may include programs that highlight products of interest while traversing the web. Beauty Shelf 114 may be an application that can be placed independently on social networking sites and / or toolbars on other personal pages. Beauty Shelf 114 may further inform you of purchase dates and purchase history, product expiration warnings, and other usage updates. Purchases made from the website are automatically added to the user's beauty shelf 114, while also allowing manual entry for offline purchases. The product may be added to the interface to the formulation 118, which can be drawn, or to the skin care shelf 114, which may be drawn. The beauty shelf 114 may have multiple screens for advice by various people (eg, doctors, dermatologists, beauticians, spa specialists, entire users, experts, most similar people, etc.). The beauty shelf 114 may be a personal product arrangement. Users may drag and drop (or select to add) products as they navigate the web, find new products, and have automatically populated advice. This feature may include programs that highlight products of interest while traversing the web. Beauty Shelf 114 may be an application that can be placed independently on social networking sites and / or toolbars on other personal pages. Beauty Shelf 114 may further inform you of purchase dates and purchase history, product expiration warnings, and other usage updates. Purchases made from the website are automatically added to the user's beauty shelf 114, while also allowing manual entry for offline purchases. The product may be added to the interface to the formulation 118, which can be drawn, or to the skin care shelf 114, which may be drawn. The beauty shelf 114 may have multiple screens for advice by various people (eg, doctors, dermatologists, beauticians, spa specialists, entire users, experts, most similar people, etc.). The beauty shelf 114 may be a personal product arrangement. Users may drag and drop (or select to add) products as they navigate the web, find new products, and have automatically populated advice. This feature may include programs that highlight products of interest while traversing the web. Beauty Shelf 114 may be an application that can be placed independently on social networking sites and / or toolbars on other personal pages. Beauty Shelf 114 may further inform you of purchase dates and purchase history, product expiration warnings, and other usage updates. Purchases made from the website are automatically added to the user's beauty shelf 114, while also allowing manual entry for offline purchases. · Networking sites and other personal pages, and / or applications that can be placed independently on the toolbar. Beauty Shelf 114 may further inform you of purchase dates and purchase history, product expiration warnings, and other usage updates. Purchases made from the website are automatically added to the user's beauty shelf 114, while also allowing manual entry for offline purchases. · Networking sites and other personal pages, and / or applications that can be placed independently on the toolbar. Beauty Shelf 114 may further inform you of purchase dates and purchase history, product expiration warnings, and other usage updates. Purchases made from the website are automatically added to the user's beauty shelf 114, while also allowing manual entry for offline purchases.

In embodiments, the user may be able to obtain a sample of advisory or non-advisory products directly from the advisory page. The shopping cart 113 may be a function integrated with the skin care shelf 114. Users may be able to use personalized advice to choose between products for purchase or sample delivery. The user may be requested for personal information such as address, shipping method, credit card number, etc., which information may be retained by the shopping cart 113. The shopping cart 113 may be present on the toolbar as part of the user interface 102 or as a program on a web page so that the product is highlighted and dragged into the shopping cart 113 for later purchase. It may be a separate program, similar in format to the skin care shelf 114. Dragging a product into Cart 113 is for the best price, location, and availability of the product, consumer experience, ranking and rating, etc., across the database and across various websites. May start further inquiries.

Refer to Figure 9 for a product rating page for skin care systems. To obtain advice, users are required to respond to their experience with medical, non-medical, cosmetic, and skin care products, thereby expanding data collection at low cost. For example, a user may identify a product and provide an efficacy assessment and an ordering and rating of 138 for the product, case information, usage information, and so on. This information may be stored in the wellness 192, prescription 118, and product information 190 databases for further refinement of advice. In embodiments, the user response to the product experience may be shared with friends and / or other users automatically or at the time of request.

With reference to FIG. 10, the home page 1000 of the user interface 102 of the skin care system 104 is depicted. Demos such as name, gender, age, occupation, ID, address, phone number, email address, payment information, new related users, etc., stored in the user profile or as part of skin record 121 You may be prompted to enter graphic information. The home page may display a list of skin records 121, or imaged areas, imaged dates, and analysis states. When the task finishes in Skin History / Record 121, an icon may appear near Status. Users may be able to start a new Skin Health Test from Home Page 1000 or submit new skin concerns. The user can transfer the analysis 154 to a third party of interest, ask the expert questions about skin condition, skin history / record 121, image analysis, etc., and view payment information and history.

With reference to Figure 11, the welcome page 1100 for the skin health test is depicted. The welcome page may provide information about skin health tests, endpoints to be tested such as elasticity, wrinkles / wrinkles, light damage, brilliance / brightness, etc. Using the analysis of skin health tests, the system may provide a personalized assessment of the user's skin prescription 118. The user may start the skin health test from welcome page 1100.

With reference to Figure 12, the skin care system questionnaire page 1200 is depicted. The questionnaire may capture relevant skin history that may be useful for subsequent image analysis. Questions may be asked in multiple choice formats or as open-ended questions. For example, the question may be "Where do you use your product?" With a response that includes the face, hands, neck, feet, torso, and so on. Another question is "Why are you using your product?" With a response that includes protection, healing, moisturizing, and other skin care goals. Sometimes. Another question is "Why are you going to use the product?" To remove wrinkles / fine wrinkles, to improve shine / brightness, to increase softness / elasticity, and with a response that includes other skin care goals ("Why are you going to use the product?" Why are / will you be using your product)? " Other questions are "How long have you been using your product?" And "How often do you apply the product?" "How often do you apply your product?", "When do you apply your product?", And so on. Other information collected may include how the user chooses notifications, where the product was purchased, whether the user has adopted seasonal usage of the product, and so on. From Questionnaire page 1200, the user may start a skin health test.

With reference to Figure 13, the skin image capture page 1300 of the skin care system is depicted. In an embodiment, it should be understood that the user interface 102 may access device 108 to capture images, but it may be convenient for other devices 109 to be used in the system. is there. Page 1300 may display a real-time view of the area to be imaged. The user may have access to a positioning tool to obtain an accurate image of the previously imaged area. Once the image is captured and submitted, Algorithm 150 may verify the integrity of the image. Once a suitable image has been captured for analysis, the user may go to analysis page 1400.

See Figure 14 for a results page for a skin care system with a bar chart. Algorithm 150 may be used to analyze images and provide measurements of wrinkles, elasticity, lightness, stiffness, tightness, etc., as already described herein. In the embodiment, the index may be a quantitative index. The first analysis may be considered a baseline for tracking purposes. For each indicator, users may be compared to baselines for their age, skin condition, gender, ethnicity, or other categories. For example, the graph draws a reading for the user on the first bar on each graph and an average baseline for people of the same age on the second bar. As is apparent from the visual eye, the user is better than average in this case. These results may be color coded for brevity. Results page 1400 may include a description of each indicator. For each of the indicators, the user has more information (More) such as what causes a certain condition, tips and secrets for improving skin condition. Information) may be requested. The user may be instructed when to rescan the area, which product to use, which formulation 118 to use, and so on. Desirable improvements may be correlated with the inclusions and the most effective product for the user's skin may be advised. The user accesses and / or edits the skin record 121, which may contain information about the user, images, chronological order of images, information derived from the images, advice, products, formulations 118, etc. Sometimes. The user may access the reporting facility to retrieve the report.

See Figure 15 for a results page for a skin care system with trend analysis. The way to track the effectiveness of a skin care product or prescription is to obtain a baseline skin health assessment and to advise monitoring intervals based on at least one of the skin care goals, products, and prescriptions, and second. Obtaining a skin health assessment of the skin, comparing a second assessment with a baseline assessment to determine the course towards a skin care goal, and selectively prescribing to improve the skin health assessment 118 Or it may have to optimize the product. Trend analysis may be performed when subsequent images are captured and submitted to System 104. Subsequent images may be used to track the effects of the product and / or formulation 118 and ultimately advise the user and optimize the user's skin formulation 118, product and / or condition. Trend analysis 1502 may be useful in determining intermediate skin condition 158 during formulation 118. Trend analysis 1502 may display baseline readings, average readings for healthy skin of people of the same age as the user, and individual indicators by type of skin condition. The course may be shown over a long period of time. Time-series images, such as over a 28-day skin cycle, over a treatment timeframe, seasonally, periodically over a year, etc., may be captured to track the course of skin condition 158. is there. The data may be represented in a diagram representing a picture containing data in a picture, a diagram representing a graph, a diagram representing a trend, a diagram representing numerical values, a diagram representing text, and the like. The course may be sorted by the interests / skin care goals specified by the user at the beginning of the test. When the user should obtain the next image, he / she will be notified of the length of time that the prescription 118 should be continued, how to change the prescription 118, re-guaranteed about the effect of the product or prescription 118, and receive useful secrets etc. I have something to do. The user views skin record 121 and / or , May be edited. The user may be able to view past images and perform a simulation 132 of the future course. The user may access the reporting facility to retrieve the report.

With reference to Figure 16, an overview screen of the skin care system is drawn. An overall analysis over time intervals of current indicators, progress towards skin care goals, product evaluation, evaluation of prescription 118, and advice on continuation, modification or discontinuation of prescription 118 or product use is presented. The user may view the step-by-step analysis or get a complete report. At intervals such as the last of the proposed prescription 118, the report shows how the user's skin condition 158 changed over time and whether the user's skin was healthier than when prescription 118 was initiated. May include information on whether the product or formulation 118 has achieved initial goals, feedback on formulation 118 / product efficacy, etc. Given the current skin condition 158, a new product or formulation 118 may be advised. For example, the system may advise looking for specific inclusions to increase the brightness of the user given the current skin condition 158. Reports may be displayed on screen, printed, outsourced, and so on. The report may be shared with the performer for ongoing treatment and consultation.

With reference to Figure 17, the elastic overview page 1700 of the skin care system is depicted. Step-by-step analysis of each label may be performed. For example, a step-by-step analysis of the elasticity index is shown in FIG. The summary page 1700 may draw all of the captured data over a period of time, for example, in a bar chart for each display on a separate summary page 1700. Although Figure 17 depicts an elastic summary page, it should be understood that the summary page summarizes data related to all kinds of concerns. The progress towards achieving skin care goals may be communicated by data and analysis of the data or by user input. The user's product or formulation 118 may be evaluated in achieving the skin care goals. Products or formulations 118 that allow future needs to be met may be informed. The system may also inform the product used by another user or the formulation 118 used in achieving a defined skin care goal.

In one embodiment, data obtained at one point or over a period of time can be shared with other skin care system users, practitioners, and the like. In one embodiment, the data can be shared as a data object with users of the skin care system's online platform 120 or mobile platform 124, posted on a blog, or emailed to a third party. In some embodiments, the data is a data object that can be dragged and dropped. For example, you can share the wrinkle trend analysis 1502 shown in Figure 15 with your friends as shown in Figure 68, post it on a blog or forum and have users discuss the data as shown in Figure 69, or one of the contents as shown in Figure 70. As a department the user can discuss this.

In some embodiments, a system that provides advice on skin care based on skin condition 158, skin care goals, and environmental factors affecting the skin includes online platforms 120, mobile platforms 124, social networking interfaces, and the like. The interaction of the tools and algorithms 150 allows you to receive product and prescription advice and track the effects of products and prescriptions 118. The system connects geographically distant consumers, manufacturers, product information, experts, service providers, and beauty and medical professionals to personalize their skin, hair, or nail inquiries and concerns. It offers an online 120 or mobile 124 communication platform. The online platform 120, mobile platform 124, or social networking interface has a user interface 102. In some embodiments, without using data or images from device 108, algorithm 150 running on online platform 120 provides skin care assessment. That is, the user does not need the data from device 108 to join the online platform 120. This online platform 120 is the sole skin health assessment and skin care advisory tool. However, in some embodiments, image data may also be used to provide skin health assessments and skin care advice on the online platform 120. The user interface 102 works with the online platform 120. For example, users access the system's online platform 120 for skin health analysis, monitoring and advice, monitor skin health and download, process, analyze and track data from imaging device 108 or other device 109 or monitor 182. Accumulate and receive product and / or prescription advice from Analytical / API 154 or from peers and compare skin condition 158 with prescription 118 with peers And receive product information 190, purchase products, add advice to skin care shelves 114, organize skin care shelves 114 by prescription 118, ranking, expiration date, cost, skin care goals, time, frequency, friends, etc. View product / prescription community ratings, rankings, comments on skin care shelves 114, rank / rate products, leave comments on products, prescriptions, fellow products and / or prescriptions, and new products. Receive notifications and product recalls, receive daily reports 134, and interact with social network 188. User interface 102 allows users to easily take and submit images, enter data, track history, get advice and analysis, and shop for skin, hair, and / or nail beauty / makeup or medical issues. can do. The online platform 120 has a user interface 102, which guides the user while acting as a data repository and history tracking tool for storing skin records 121, as well as for the user to logically organize information about his or her condition. Useful for.

The user interface has a skin care shelf 114 in one embodiment. This skin care shelf 114 allows users to use products and formulas 118 based on their specific skin characteristics 130 / skin condition 158 usage scenarios (morning, afternoon, night, etc.), intentions (work, fun, etc.), skin care goals (work, fun, etc.) It is a structure for logically organizing by moisturizing, shining, protection, etc.). The skin care shelf 114 may have multiple "pages" for advice from a variety of individuals (practitioners, doctors, dermatologists, spa specialists, general users, experts, most similar people, etc.). The Skin Care Shelf 114 allows you to place products, formulations 118, and / or information 190, 192 on your own. Users can drag and drop (or select and add) products as they discover new products as they navigate the web, and advice is automatically inserted. It includes the ability to highlight products of interest while navigating the web. For example, plugin 194 allows users to retrieve information from anywhere on the Internet. For example, a user may want to visit a web page of a makeover article published in a cosmetology magazine and put the makeover product in their skin care shelf 114 and / or shopping cart 113. The user clicks on the product name to obtain additional product information 190, add to prescription 118, purchase, request a sample, and drag the product to at least one of the skin care shelf 114 and the shopping cart 113. .. Skin Care Shelf 114 may be an application that resides alone on social networking sites 188 and other personal pages and / or toolbars. Skin Care Shelf 114 may also display purchase dates, purchase history, product expiration notices, and other up-to-date information about use. In one embodiment, purchases made outside the website are automatically made by the user.

The user interface 102 links with the mobile platform 124 in one embodiment. The user interface 102 supports plug-and-play of various mobile devices 184 such as mobile phones, laptops, digital cameras and medical devices. For example, mobile phones have wearable or built-in features that allow users to take images of their skin, enter / capture data, connect to user interface 102 over the web wirelessly or via cable, and enable seamless connection and data transfer. Have. With mobile devices, you can get images and data in different places and get different information from the community (for example, measuring the effect of sunscreen on the beach, product feedback, best price, nearest physical sales location, etc. Specific location images, product images, barcode images) to get coupons etc. Users can also share data and instantly ask other users questions about the product. The mobile device can take an image using the battery power and the light source of the device by the built-in lens system that is internally charged or the lens system that is mounted independently, and can transmit the image by using the built-in communication means.

With reference to FIG. 18, the user interface of the online platform 120 is illustrated as a map. The home page can change the theme and atmosphere according to the user's profile, user's taste, and other criteria. For example, there are interesting things, serious things, hospital-like things, and so on. From this user interface, users can review products, contribute anecdotes, report, review reports, review blogs by product, skin type, and visit their beauty shelf 114. Information is freely accessible, accessible by registration, or partially free and partially accessible by registration. All products and pages can be linked through Beauty Shelf 114.

For example, FIG. 19 illustrates a review page of the skin care system user interface. Users can view Reviews, Experinece, Recommendations, and Info For from a menu that spans the top of the user interface. You can access Me), Checkout, etc. The user interface can display parts of the user profile, such as the user's age, gender, location, skin type, skin color, skin goals, and photos. You can also view the products and formulations 118 that users are using and their reviews, ratings, and comments in the user interface. Other users who access the user profile may comment on the product or prescription 118 in use, rate the product or prescription 118, and recommend another product or prescription 118. The user interface can present tools to assist the user in selecting a product or formulation 118. For example, the tool may take the form of a questionnaire or wizard that guides the user in describing his or her skin. The user can provide age, gender, skin type (greasy, sensitivity), skin color, goals, current brand or product, current prescription 118, and the like. In some embodiments, the user interface works with the imaging device 108 to automatically detect skin type and / or color. Users can also access their beauty shelves 114 from the user interface.

With reference to Figure 20, a review page of the skin care system user interface is illustrated. This review page is displayed in a layout different from the compact display shown in FIG.

With reference to FIG. 21, the experience page of the skin care system user interface is illustrated. Users can report their product and prescription 118 experiences in detail on this experience page. The user can mention the effectiveness of the product or formulation 118, for example by answering a question. The questions are, for example, "How effective is it?", "How does it feel?", "How is its fragrance?", "Absorption". How does it absorb? , Does it cause breakouts? , And so on. On the experience page, users can also update their user profile such as age, gender, nickname, location, photo, skin type, goals, etc. Users can make general inquiries by asking other users about their experiences or by making requests to email, MMS, SMS, phone numbers, mobile devices, social networks, and more.

With reference to Figure 22, the advisory page for the skin care system user interface is illustrated. This advice page can display products and formulations 118 that are expected to be effective in achieving a given goal. Brands and products or formulations 118 can be displayed with ratings from the user community and comments from users. The user can point out a product that is currently in use or that it considers to be superior to Formulation 118. If the user considers the product or prescription 118 to be better than the one currently in use, the product or prescription 118 can be stored on the beauty shelf 114 for later consideration.

See Figure 23 for the Info For Me page of the skin care system user interface. Use the People Like Me algorithm 150 to sort the user community of the skin care system. The algorithm 150 determines the most similar users along all criteria based on the content of the user profile, optionally selected criteria, or a combination of skin color and skin type. Once the subset 150 that most closely resembles the user in the user community is determined by algorithm 150, the user can see the community data. For example, you can find the product that works best for the entire subset, or the product that works best for a particular problem, a particular time zone, a particular season, and so on. You can also view the weather, UV rating, and location / weather / environment-based advice on the Info For Me page for the location specified in your user profile. Your own information (Info For) You can also notify users of new product launches on the Me) page. Users can sort products based on effectiveness.

See Figure 24 for an example of the 114 part of the beauty shelf in the user interface of a skin care system. The product or prescription 118 used by the user can be categorized by time zone, effect, cost, expiration date, etc. Click each item for effects, ingredients, recommended uses, expiration dates, links for additional purchases, links to blog about products or formulas 118, links to read and write reviews, links to the manufacturer's site, You'll see more details about the product and prescription 118, including links to store-only coupons. Figure 25 illustrates another example of the 114 portion of the beauty shelf of the skin care system user interface. FIG. 26 illustrates an alternative display of the beauty shelf 114 in the user interface of a skin care system. In this example, a friend can comment on a product or prescription 118 or suggest an alternative product or prescription 118. Users can also choose to receive price notifications, new product launch notifications, new user comment notifications, and more.

Referring to FIG. 27, the registration page of the skin care system user interface is illustrated. Users can enter information, specify goals, enter security codes, enter skin problems, colors, and / or types, and register samples. In addition, the user can direct the intention to add a feed from the skin care system to the RSS feed and the application from the skin care system to the social networking site. Users can optionally opt for sample and product notifications.

Referring to FIG. 28, another embodiment of the advice page of the skin care system user interface can be seen. This page can display people who fall into the user's category, such as the number of people of the same sex, age group, and similar skin types and worries. You can recommend the most popular products, the most popular products, the reviewed products, the rated products, the products written on the blog, etc. by goal.

As shown in Figure 64, the user interface can also have a friend toolbar. The Friend Toolbar floats on the current website or any website, for example by using a plugin. Friends can upload images, and image 6408 appears in the Friend Toolbar 6402. The home key 6404 is part of the toolbar 6402, where you can shrink the entire toolbar to the home key. When there is a friend-related notification, such as adding a new product to a friend's beauty shelf 114 or writing a new review, a flag notification 6410 appears next to the friend's image on the toolbar 6402. The bottom bar 6412 is used to shuffle friends and access other options related to Toolbar 6402. As shown in Figure 65, the toolbar 6402 can be auto-scrolled 6502 by scrolling the web page the user is viewing. As shown in Figure 66, the Friend Toolbar 6402 allows you to share objects with your friends using the drag-and-drop feature 6602. For example, you can share a blog post by dragging the blog title to a friend's image and dropping it, as shown in Figure 66. Similarly, as shown in Figure 67, you can drag the product to a friend's image and drop it to 6702, recommending the product to a friend. Hover over a friend's image to see more information about the friend in the form of pop-ups, dialogs, etc., such as the friend's user profile, beauty shelf 114, reviews, and blogs.

Referring to FIG. 29, a mobile content map of the mobile user interface of the skin care system on mobile platform 124 is illustrated. The illustrated content map shows an example of content accessible from the mobile platform 124 home page. For example, starting from the home page, you can identify or scan a product from a list and search using the Internet on your mobile device. For example, scanning a product's barcode will return the product's price, reviews, ratings, and more. You can help users find what they are looking for, such as items for themselves or gifts for friends. Products can be searched based on goals, problems, skin type, skin color, etc. The mobile skin care system can return a list of products such as the top 10 products, as well as information about the product such as rating, goal impact, safety and reviews. Accessing the Suncheck application provides UV information based on location and advice, as well as UV information based on images taken with the imager 108 built into the mobile device, as already mentioned.

With reference to Figure 30, the flow of the "How Good Is This Product message" is illustrated. In this example, you can scan the barcode for product information, enter the barcode numbers manually, or select a product from the list. The system returns product information such as product name, rating, ingredients, general rating, rating for a particular problem, friend's rating, price, where to find the product, and more. If a mobile device is available, you can start purchasing on Mobile Platform 124.

With reference to Figure 31, the flow of the "What Should I Look For message" is illustrated. The message flow begins by telling the user whether the item they are searching for is a gift or for the user, and giving the user the option to update the picklist. For gifts, you can either select a recipient from a pre-listed list of recipients or specify a new recipient. You can specify the time. Based on the recipient, time of day, and other criteria entered, the product is recommended along with information about the product, price, location, and options to purchase on mobile platform 124. The user can specify a goal from a drop-down menu or the like when searching and receive a list of recommended products. Users who select a product can request that the product be placed in a store or initiate a purchase on mobile platform 124.

See Figure 32 to illustrate the flow of Suncheck messages. The first message contains information about the user's location, weather, UV index, sunlight impact rating, maximum exposure time indication, and a timer for measuring the current time in sunlight. Advice can be generated based on information such as the applicable solar protection index level and maximum recommended exposure time.

Referencing Figure 33, a warning message flow is depicted. The user may link to another user on the mobile platform 124, which allows a warning to be sent to the user when the other user requests a product review or evaluation. The user may respond using review, rating, chat message, SMS, MMS, telephone, voice mail, etc.

See Figure 34 for an optional message flow. From Mobile Platform 124 Home Page 3402, you may choose an option. Option 3404 may be a friend list, pick list, alert, address / location, etc. For example, you may access the friend list 3408 to select friends to follow, receive alerts, and so on. The friends list may indicate if a friend is online. Warning 3410 may be configured on mobile platform 124, for example to notify a user when a friend purchases something new or when a new product that is good for the friend becomes available. And so on. Address / location / payment setups may allow users to initiate purchases from mobile platform 124.

The methods and systems described herein may be partially or wholly deployed by machines that execute computer software, program code, and / or instructions on the processor. The processor may be part of a server, client, network infrastructure, mobile computing platform, stationary computing platform, or other computing platform. The processor may be any kind of computing or processing device capable of executing program instructions, code, binary instructions, and the like. A processor is a signal processor, digital processor, embedded processor, microprocessor, or coprocessor (mathematical coprocessor, graphic) that can facilitate the execution of stored program code or program instructions directly or indirectly. Any variant, such as coprocessor, communication coprocessor, etc.), or may include these. In addition, the processor may enable execution of multiple programs, threads, and code. Threads may run concurrently to improve processor performance and facilitate concurrent application operations. As an implementation method, the methods, program codes, program instructions, etc. described herein may be implemented in one or more threads. A thread may spawn a plurality of other threads, which may have priorities associated with each other. The processor may then execute these threads based on priority or other order based on the instructions given in the program code. The processor may include memory for storing the methods, codes, instructions, and programs described herein or elsewhere. The processor may access the storage medium through an interface capable of storing the methods, codes, and instructions described herein or elsewhere. Computational device

The processor may include one or more cores capable of improving the speed and performance of the multiprocessor. In embodiments, the process may be a combination of two or more independent cores (referred to as a die), a dual core processor, a quad core processor, other chip level multiprocessors, and the like.

The methods and systems described herein, in part or in whole, by a server, client, firewall, gateway, hub, router, or other machine running computer software on such computers and / or networking hardware. It may be expanded as a target. Software programs may be associated with servers, which include file servers, print servers, domain servers, internet servers, intranet servers, and other variants such as secondary servers, host servers, distributed servers, and the like. Good. Servers include one or more memories, processors, computer-readable media, storage media, ports (physical and visual), communication devices, and other servers, clients, machines, via wired or wireless media. And an interface that can access the device and the like. The methods, programs, or codes described herein and elsewhere may be executed by the server. In addition, other devices required to perform the methods described in this application may be considered part of the infrastructure associated with the server.

The server may provide an interface to other devices including, but not limited to, clients, other servers, printers, database servers, print servers, file servers, communication servers, distributed servers, and the like. In addition, this coupling and / or connection can facilitate remote execution of programs across the network. Networking some or all of these devices can facilitate parallel processing of programs or methods in one or more locations without departing from the scope of the invention. In addition, any device attached to the server via an interface may include at least one storage medium capable of storing methods, programs, codes, and / or instructions. The central repository may provide program instructions to be executed on various devices. In this practice, the remote repository may serve as a storage medium for program code, instructions, and programs.

A software program may be associated with a client, which client may include a file client, a print client, a domain client, an internet client, an intranet client, and other variants such as a secondary client, a host client, a distributed client, and the like. .. Clients include one or more memory, processors, computer readable media, storage media, ports (physical and visual), communication devices, and other clients, servers, machines, and other clients, servers, machines, and over wired or wireless media. It may include an interface that can access the device and the like. The methods, programs, or code described herein and elsewhere may be executed by the client. In addition, other devices required to perform the methods described in this application may be considered part of the infrastructure associated with the client.

The client may provide an interface to other devices including, but not limited to, servers, other clients, printers, database servers, print servers, file servers, communication servers, distributed servers, and the like. In addition, this coupling and / or connection can facilitate remote execution of programs across the network. Networking some or all of these devices can facilitate parallel processing of programs or methods at one or more locations without departing from the scope of the invention. In addition, any of the devices attached to the client via the interface may include at least one storage medium capable of storing methods, programs, applications, codes, and / or instructions. The central repository may provide program instructions to be executed on various devices. In this practice, the remote repository may serve as a storage medium for program code, instructions, and programs.

The methods and systems described herein may be partially or wholly deployed by the network infrastructure. Network infrastructure includes computing devices, servers, routers, hubs, firewalls, clients, personal computers, communication devices, routing devices, and other active and passive devices, modules, and / or those known in the art. It may include elements such as components. Computational and / or non-computing devices (s) associated with the network infrastructure may include storage media such as flash memory, buffers, stacks, RAM, ROM, etc., apart from other components. The processes, methods, program codes, and instructions described herein and elsewhere may be performed by one or more elements of the network infrastructure.

The methods, program codes, and instructions described herein and elsewhere may be implemented on a cellular network with multiple cells. The cellular network can be either a frequency division multiple access (FDMA) network or a code division multiple access (CDMA) network. The cellular network may include mobile devices, cell sites, base stations, repeaters, antennas, towers and the like. The cell network may be of GSM, GPRS, 3G, EVDO, mesh, or other network type.

The methods, program codes, and instructions described herein and elsewhere may be implemented on or through a mobile device. The mobile device may include a navigation device, a cell-type mobile phone, a mobile phone, a personal digital assistant, a laptop, a palmtop, a netbook, a pager, an electronic book terminal, a music player, and the like. These devices, apart from other components, may include storage media such as flash memory, buffers, RAM, ROM, and one or more computing devices. Computational devices associated with mobile devices may be enabled to execute stored program code, methods, and instructions. Alternatively, the mobile device may be configured to execute instructions in collaboration with other devices. The mobile device may communicate with a base station that is configured to work with the server and execute program code. Mobile devices may communicate over peer-to-peer networks, mesh networks, or other communication networks. The program code may be stored on a storage medium that is associated with the server and is executed by a computing device built into the server. The base station may include a computing device and a storage medium. The storage device may store program code and instructions executed by the computing device associated with the base station.

Computer software, program code, and / or instructions may be stored on a machine-readable medium and / or these may be accessed to a machine-readable medium, which machine-readable medium may include: .. That is, computer components, devices, recording media that hold digital data used to calculate some time interval; random access memory. Semiconductor storage devices known as memory: RAM; mass storage for usually more permanent storage, such as optical disks and forms of magnetic storage devices such as hard disks, tapes, drums, cards, and other types; processors. Registers, cache memory, volatile memory, non-volatile memory; optical storage devices such as CDs, DVDs; flash memory (eg USB stick or USB key), floppy disk, magnetic tape, perforated tape, punch card, stand-alone RAM disk, Zip Detachable media such as drives, removable mass storage, offline; dynamic memory, static memory, read / write storage, updatable storage, read-only, random access, sequential access, location viewable, file viewable, content Other computer memory such as referenceable, network attached storage, storage area network, bar code, magnetic ink, etc.

The methods and systems described herein may transform physical and / or intangible items from one state to another. The methods and systems described herein may transform data representing physical and / or intangible items from one state to another.

The elements described and depicted herein, including those in flowcharts and block diagrams throughout the drawing, imply logical boundaries between the elements. However, according to software or hardware engineering practices, the depicted elements and their functions may be performed on the machine by a computer executable medium with a processor, which is a stand-alone software as a monolithic software structure. -It is possible to execute program instructions stored as a module, as a module that uses an external routine, code, service, etc., or as a combination of any of these. All such implementations may be included in the disclosures of the present application. Examples of such machines are, but are not limited to, personal digital assistants, laptops, personal computers, mobile phones, other handheld computing devices, medical equipment, wired or wireless communication devices, transducers, chips, computers. , Satellites, tablet PCs, electronic books, gadgets, electronic devices, devices with artificial intelligence, computing devices, networking equipment, servers, routers and the like. In addition, the elements depicted in flowcharts and block diagrams or any other logical component may be implemented on a machine capable of executing program instructions. As such, the drawings and description described above describe the functional aspects of the disclosed system, but are the specific arrangements of software for implementing these functional aspects explicitly stated? , Or unless it is clear from the context, should not be inferred from these explanations. Similarly, it is understood that the various steps specified and described above are deformable and the order of the steps is adaptable to the particular application of the technology disclosed herein. Let's go. All such modifications and modifications are intended to be within the scope of this disclosure. Therefore, a depiction and / or description of the order of the various steps may be required by the particular application.

The methods and / or processes described above, as well as the steps thereof, may be implemented in hardware, software, or a combination of hardware and software suitable for a particular application. The hardware may include a general purpose computer and / or a dedicated computing device, or a specialized computing device, or a specific aspect or component of the specialized computing device. Processing may be implemented with internal and / or external memory in one or more microprocessors, microcontrollers, embedded microcontrollers, programmable digital signal processors, or other programmable devices. Processing may be further or instead materialized in application-specific integrated circuits, programmable gate arrays, programmable logic arrays, or any other device or combination of devices that can be configured to process electronic signals. Good. It will also be appreciated that one or more operations can be implemented as computer executable code that can be executed on machine readable media.

Computer executable code in any one of the above devices and heterogeneous combinations of processors, processor architectures, or different hardware and software combinations, or any other machine capable of executing programming instructions. A structured programming language such as C, an object-oriented programming language such as C ++, or another high-level or low-level programming language (assembly language,) that can be stored, edited, or interpreted to work in one. It may be generated using a hardware description language, as well as a database programming language and technology).

Thus, in one aspect, each of the methods described above and combinations thereof may be materialized in computer executable code in which these steps are performed in the execution of one or more computing devices. In other embodiments, the method may be materialized in the system performing the process, distributed throughout the device in a number of ways, or all functionality to a dedicated stand-alone device or other hardware. May be integrated. In other embodiments, the means for performing the steps associated with the processes described above may include any of the hardware and / or software described above. All such permutations and combinations are intended to be included within the scope of the disclosures of this application.

Further, the embodiment can take the form of a computer program product on a computer readable storage medium having computer readable program instructions (eg, computer software) embodied in the storage medium. Some of the embodiments may take the form of web-execution computer software. Any suitable computer-readable storage medium can be used, including hard disks, CD-ROMs, optical storage devices, magnetic storage devices, and the like.

It will be appreciated that each block of the block diagram and flowchart drawing, and the combination of blocks in the block diagram and flowchart drawing, can be implemented by computer program instructions, respectively. These computer program instructions are loaded into a general purpose computer, a special purpose computer, or another programmable data processing device to manufacture a machine, and the instructions realized on this computer or other programmable data processing device are a single number of flowcharts or Means may be generated to perform a function identified in a plurality of blocks.

These computer program instructions may be stored in computer-readable memory that can guide a computer or other programmable data processing device to function in a particular way. Thereby, the instructions stored in the computer-readable memory generate a product containing computer-readable instructions for performing a function identified in one or more blocks of the flowchart. Computer program instructions may be loaded into a computer or other programmable data processing device so that a series of operating steps performed on the computer or other programmable device spawns a computer execution process. Thereby, the instructions implemented on the computer or other programmable device provide a step for performing the function specified in one or more blocks of the flowchart.

Therefore, the blocks in the block diagram and the flowchart drawing support a combination of means for performing the specified function, a combination of steps for performing the specified function, a program command means for performing the specified function, and the like. Each block of the block diagram and flowchart drawing, and the combination of blocks in the block diagram and flowchart drawing, are combined by the specified function or process, or a combination of special purpose hardware and computer instructions by a special purpose hardware computer system. It will also be understood that it can be done.

Although the present invention has been disclosed in connection with preferred embodiments illustrated and described in detail, those skilled in the art will readily appreciate various modifications and improvements. Therefore, the spirit and scope of the present invention should be understood in the broadest possible sense by law, not limited to the examples described above.

All references referenced herein are incorporated herein by reference.