Method and system for intelligently mining data during communication streams to present context-sensitive advertisements using background substitution

摘要

The present invention mines or extracts data present during interaction between at least two participants, for example in a chat session, a video session, etc. via the Internet. The data, which can include participant web camera generated video, audio, keyboard typed information, handwriting recognized information, is analyzed. Based upon the analysis, content-dependent information is determined and may be displayed to one or more participants in the chat session. In one aspect, a video foreground based upon a participant's generated video is combined with a customized computer generated background that is based upon data mined from the chat session. The customized background preferably is melded seamlessly with the participant's foreground data, preferably via background substitution that combines RGB video with depth data that predicts what background may substituted with new imagery. Content-based targeted information can include advertisement(s).