Merge branch 'main' into fix-delta

README.md

@@ -2,7 +2,9 @@
 
 The Intelligence Toolkit is a suite of interactive workflows for creating AI intelligence reports from real-world data sources. It helps users to identify patterns, themes, relationships, and risks within complex datasets, with generative AI ([GPT models](https://platform.openai.com/docs/models/)) used to create reports on findings of interest.
 
-The project page can be found at [github.com/microsoft/intelligence-toolkit](https://github.com/microsoft/intelligence-toolkit/). Instructions on how to run and deploy Intelligence Toolkit can be found [here](https://github.com/microsoft/intelligence-toolkit/blob/main/DEVELOPING.md).
+The project page can be found at [github.com/microsoft/intelligence-toolkit](https://github.com/microsoft/intelligence-toolkit/) or [aka.ms/itk](https://aka.ms/itk).
+
+Instructions on how to run and deploy Intelligence Toolkit can be found [here](https://github.com/microsoft/intelligence-toolkit/blob/main/DEVELOPING.md).
 
 ## Transparency FAQ
 

app/workflows/detect_entity_networks/variables.py

@@ -28,6 +28,7 @@ def __init__(self, prefix):
 
     def create_session(self, prefix):
         self.network_max_rows_to_process = SessionVariable(0, prefix)
+        self.network_flag_paths = SessionVariable(True, prefix)
         self.network_uploaded_files = SessionVariable([], prefix)
         self.network_selected_file_name = SessionVariable("", prefix)
         self.network_attribute_links = SessionVariable([], prefix)

app/workflows/detect_entity_networks/workflow.py

@@ -499,6 +499,11 @@ def on_inferring_batch_change(
                     show_groups = st.checkbox(
                         "Show groups", value=sv.network_last_show_groups.value
                     )
+                    flag_paths = st.checkbox(
+                        "Show flag paths",
+                        value=sv.network_flag_paths.value,
+                        disabled=not show_entities
+                    )
                     graph_type = st.radio(
                         "Graph type", ["Full", "Simplified"], horizontal=False
                     )
@@ -645,7 +650,7 @@ def on_inferring_batch_change(
                 else:
                     render_graph = network_entities_simplified_graph
 
-                if not show_entities:
+                if not show_entities or not flag_paths:
                     network_vis = st.container()
                 else:
                     network_pane, path_pane = st.columns([2, 1])
@@ -709,14 +714,14 @@ def on_inferring_batch_change(
                         directed=default_config['directed'],
                         physics=default_config['physics'],
                         hierarchical=default_config['hierarchical'],
-                        width = 1200 if show_entities else 1400
+                        width = 1200 if show_entities and flag_paths else 1400
                     )
                     agraph(
                         nodes=nodes_agraph,
                         edges=edges_agraph,
                         config=config,
                     )
-                if show_entities:
+                if show_entities and flag_paths:
                     with path_pane:
                         st.markdown(sv.network_risk_exposure.value)
                 sv.network_merged_links_df.value = merged_links_df

example_outputs/detect_entity_networks/company_grievances/company_grievances_example_report_1.md

@@ -1,39 +1,17 @@
-##### Evaluation of Innovative Machines in Network 2
+##### Evaluation of Entertainment Hub in Network 408
 
-**Entity Overview:**
+In the analysis of the entity network 408, we focus on the entity "Entertainment Hub" and its exposure to flags within the network. The entity "Entertainment Hub" itself does not have any direct flags. However, it is indirectly linked to a total of 12 flags through two distinct paths involving related entities.
 
-The selected entity, Innovative Machines, is part of a network that includes various other entities connected through shared attributes such as city, address, and phone number. Innovative Machines itself does not have any direct flags associated with it.
+**Path 1:**
 
-**Connections and Potential Overlaps:**
+The first path involves the entity "Entertainment World," which is directly linked to 5 flags. This entity is connected to "Entertainment Hub" through a shared owner, "Fun Master." The owner "Fun Master" is associated with both "Entertainment World" and "Entertainment Hub," suggesting a potential business or operational relationship between these entities. This connection raises the flag exposure for "Entertainment Hub" due to its association with "Entertainment World," which has a significant number of flags.
 
-1. **City Connection:**
-   - Innovative Machines is located in Techville, a city that also hosts Forge Industries and a group of entities collectively referred to as CraftTech Solutions, TechnoCraft, TechnoCraft Industires, TechnoCraft Industries, TechnoCraft Innovations, TechnoCraft Solutions, and Techno Solutions. This connection suggests a geographical proximity but does not inherently imply a direct relationship or risk.
+**Path 2:**
 
-2. **Address Connection:**
-   - The address 123 Industrial Ave is shared by Innovative Machines and the aforementioned group of entities. This shared address indicates a stronger potential overlap or relationship, as it suggests that these entities may operate from the same physical location.
+The second path involves the entity "EntertainmentHub," which is linked to 7 flags. This entity appears to be a variant of the name "Entertainment Hub," suggesting they might be the same real-world entity. The similarity in names and the direct connection between "EntertainmentHub" and "Entertainment Hub" implies that the flags associated with "EntertainmentHub" should be considered when evaluating the flag exposure of "Entertainment Hub."
 
-3. **Phone Connection:**
-   - The phone number 1234567890 is also shared between Innovative Machines and the group of entities. This shared contact information further strengthens the likelihood of a relationship or overlap between these entities.
+**Conclusion:**
 
-**Flag Exposure and Risk Analysis:**
+The entity "Entertainment Hub" is indirectly exposed to a total of 12 flags through its connections with "Entertainment World" and "EntertainmentHub." The shared ownership by "Fun Master" and the similarity in names between "EntertainmentHub" and "Entertainment Hub" suggest that these entities are likely interconnected, either as the same entity or through significant business relationships. This interconnectedness increases the level of interest and potential risk associated with "Entertainment Hub" due to the flags present in its network. 
 
-Innovative Machines is indirectly linked to a total of 16 flags through its connections with the group of entities mentioned above. These flags are distributed across three paths:
-
-- **Path 1:** Through the city of Techville, connecting to multiple flagged entities.
-- **Path 2:** Through the shared address, connecting to flagged entities.
-- **Path 3:** Through the shared phone number, connecting to flagged entities.
-
-The flagged entities in the network have a mean flag count of 16.38, with the maximum being 248. The indirect connection to 16 flags suggests a moderate level of risk exposure for Innovative Machines, primarily due to its shared attributes with flagged entities.
-
-**Risk Mitigation Suggestions:**
-
-1. **Clarify Relationships:**
-   - Investigate the nature of the relationship between Innovative Machines and the group of entities sharing the same address and phone number. Understanding whether these entities are part of the same corporate group or have other business relationships can help assess the risk more accurately.
-
-2. **Monitor Flagged Entities:**
-   - Keep track of any developments or changes in the status of the flagged entities. This can provide early warnings of potential risks that might indirectly affect Innovative Machines.
-
-3. **Review Internal Controls:**
-   - Ensure that Innovative Machines has robust internal controls and compliance measures in place to mitigate any potential risks arising from its indirect connections to flagged entities.
-
-By taking these steps, Innovative Machines can better understand and manage its exposure to risks within this network.
+For context, the maximum number of flags for a single flagged entity in this network is 248, and the mean number of flags is 16.38. While "Entertainment Hub" does not reach these levels, its indirect exposure through related entities is noteworthy and warrants attention.

example_outputs/detect_entity_networks/company_grievances/company_grievances_example_report_2.md

@@ -1,33 +1,27 @@
-##### Evaluation of Soundwave Studios in Network 57
+##### Evaluation of Innovative Machines in Network 0
 
 **Entity Overview:**
 
-Soundwave Studios is an entity located in Media City, connected to various other entities through shared attributes such as city, address, and ownership. It does not have any direct flags associated with it, indicating no immediate risks or concerns. However, it is indirectly linked to flagged entities through a network of connections.
+The selected entity, Innovative Machines, is part of a network where it is connected to other entities through shared attributes such as phone numbers and addresses. Innovative Machines itself does not have any direct flags but is indirectly linked to flagged entities through these connections.
 
-**Flag Exposure Analysis:**
+**Connections and Flag Exposure:**
 
-Soundwave Studios is indirectly connected to a total of 169 flags through 54 different paths involving 16 related entities. These connections are primarily through shared city (Media City) and ownership (Jordan Media) attributes. The flagged entities in these paths have varying levels of flags, with some having significant numbers, such as MediaWave Productions with 25 flags and Media Masters with 31 flags.
+1. **Shared Phone Number:**
+   - Innovative Machines shares the phone number 1234567890 with several other entities, including TechnoCraft Industires, TechnoCraft Industries, TechnoCraft Innovations, and TechnoCraft Solutions. These entities collectively have a total of 15 flags.
+   - This shared phone number creates a path of indirect flag exposure for Innovative Machines, as it is linked to these flagged entities.
 
-**Key Connections:**
+2. **Shared Address:**
+   - The address 123 Industrial Ave is another point of connection for Innovative Machines. This address is also associated with TechnoCraft Industries, TechnoCraft Innovations, and TechnoCraft Solutions, which together have 12 flags.
+   - This shared address further contributes to the indirect flag exposure for Innovative Machines.
 
-1. **City Connection:** Soundwave Studios shares the city attribute with several entities, including MediaWave Productions and Broadcast Innovators, which are linked to multiple flags. This connection suggests a potential risk exposure due to the shared location.
+3. **Shared Ownership:**
+   - The owner, Alex Forge, is linked to Forge Industries and CraftTech Solutions. CraftTech Solutions is connected to TechnoCraft Solutions, which has 2 flags. This connection through shared ownership adds another layer of indirect flag exposure.
 
-2. **Ownership Connection:** The entity is linked through ownership to Jordan Media, which connects it to other flagged entities like MediaWave Productions and Broadcast Innovators. This ownership link is a significant pathway for indirect flag exposure.
+**Analysis of Entity Similarity:**
 
-3. **Address Connection:** Soundwave Studios shares an address with Broadcast Innovations, which is linked to 11 flags. This shared address could indicate a potential risk if the flagged activities are related to the location.
+- The entities TechnoCraft Industires, TechnoCraft Industries, TechnoCraft Innovations, and TechnoCraft Solutions appear to be variations or closely related entities, given their similar names and shared connections. This suggests that they might be part of the same business group or network.
+- CraftTech Solutions, while having fewer flags, is also connected through shared attributes, indicating a potential business relationship or overlap with the TechnoCraft entities.
 
-**Risk Exposure:**
+**Conclusion:**
 
-The indirect connections to flagged entities suggest a moderate level of risk exposure for Soundwave Studios. The most significant risks arise from shared city and ownership attributes, which connect it to entities with higher flag counts.
-
-**Suggested Actions:**
-
-1. **Due Diligence:** Conduct thorough due diligence on the entities connected through shared attributes, especially those with high flag counts, to understand the nature of the flags and assess any potential impact on Soundwave Studios.
-
-2. **Monitor Connections:** Regularly monitor the network for any changes in connections or flag status of related entities to stay informed about potential risks.
-
-3. **Engage with Stakeholders:** Engage with stakeholders, such as owners and partners, to discuss any concerns related to the flagged entities and explore ways to mitigate potential risks.
-
-4. **Review Operations:** Review internal operations and compliance measures to ensure that Soundwave Studios is not inadvertently involved in activities that could lead to flagging.
-
-By taking these actions, Soundwave Studios can better understand and manage its indirect risk exposure within the network.
+Innovative Machines, while not directly flagged, is exposed to a significant number of flags (16 in total) through its connections with other entities in the network. The shared phone number and address are key points of indirect exposure, linking it to entities with multiple flags. The potential overlap or relationship between the TechnoCraft entities and CraftTech Solutions further amplifies this exposure. This analysis suggests that while Innovative Machines itself is not flagged, its associations within the network warrant attention due to the indirect flag exposure.

example_outputs/detect_entity_networks/company_grievances/company_grievances_example_report_3.md

@@ -1,33 +1,35 @@
-##### Evaluation of Blue Sky Airways in Network 353
+##### Evaluation of Construction Masterz in Network 264
 
-**Entity Identification and Network Overview**
+In this analysis, we focus on the entity "Construction Masterz" within Network 264. This entity does not have any direct flags but is indirectly linked to a total of 259 flags through connections with other entities. We will explore these connections and assess the potential flag exposure for Construction Masterz.
 
-In the network, the entity "Blue Sky Airways" appears to be the same as "Blue Sky Airlines," "Blue Skye Airlines," "BlueSky Airlines," and "BlueSky Aviation." This conclusion is based on the similarity of names, which suggests they represent the same real-world entity. This entity is connected to several other entities and attributes within the network, including an owner named Taylor Wing, a phone number (1122334455), and a city (Aero City).
+**Indirect Flag Exposure Paths:**
 
-**Flag Exposure Analysis**
+1. **Path through BuildRight Construction:**
+   - BuildRight Construction is linked to 160 flags.
+   - This entity is connected to BuildRight, which has an additional 39 flags.
+   - Both entities share the address 606 Build St, which is also associated with Construction Masterz.
+   - This path suggests a significant indirect exposure due to the high number of flags associated with BuildRight Construction.
 
-Blue Sky Airways itself does not have any direct flags. However, it is indirectly linked to a total of 58 flags through 12 different paths involving 7 related entities. These paths highlight connections to entities with varying levels of flags, indicating potential risks:
+2. **Path through Construction Masters:**
+   - Construction Masters is directly linked to 45 flags.
+   - It is directly connected to Construction Masterz, indicating a direct relationship between these two entities.
+   - This path highlights a moderate level of indirect exposure due to the flags associated with Construction Masters.
 
-1. **AeroLift Services** is linked to 1 flag.
-2. **SkyBound Airlines** is linked to 35 flags, which is the most significant source of indirect flags.
-3. **SkyBound Flights** and **SkyBound Flightz** are each linked to 2 flags.
-4. **SkyBound Flitez** is linked to 2 flags.
-5. **AeroLink Services** is linked to 2 flags.
+3. **Path through BuildRight:**
+   - BuildRight is linked to 39 flags.
+   - It shares the address 606 Build St with Construction Masterz.
+   - This path reinforces the indirect exposure through the shared address and the flags associated with BuildRight.
 
-The connections are primarily through shared attributes such as the owner (Taylor Wing), phone number, and city, which link Blue Sky Airways to these flagged entities.
+4. **Path through Construction Giants:**
+   - Construction Giants is linked to 15 flags.
+   - It shares the phone number 9012345678 with Construction Masterz.
+   - This path indicates a lower level of indirect exposure compared to the other paths but still contributes to the overall flag exposure.
 
-**Risk Exposure and Recommendations**
+**Assessment of Entity Similarity:**
 
-The overall risk exposure for Blue Sky Airways is moderate to high due to the significant number of indirect flags, particularly from SkyBound Airlines. The presence of multiple paths through shared attributes like the owner and contact information suggests a network of closely related entities, which could amplify the risk if any of these entities are involved in adverse activities.
+- The entity "Construction Masterz" appears to be the same as "Construction Masters" based on the direct connection and shared attributes.
+- The shared address and phone number connections suggest that Construction Masterz may have operational or ownership ties with BuildRight Construction, BuildRight, and Construction Giants.
 
-To clarify and potentially mitigate these risks, the following actions are recommended:
+**Conclusion:**
 
-1. **Conduct Due Diligence**: Investigate the flagged entities, especially SkyBound Airlines, to understand the nature of the flags and assess any potential impact on Blue Sky Airways.
-
-2. **Verify Connections**: Confirm the accuracy of shared attributes, such as ownership and contact details, to ensure that the connections are legitimate and not due to data errors.
-
-3. **Monitor Network Changes**: Regularly review the network for any changes in flag status or new connections that could affect risk exposure.
-
-4. **Enhance Compliance Measures**: Implement or strengthen compliance and risk management protocols to address any identified risks and prevent future issues.
-
-By taking these steps, Blue Sky Airways can better understand its position within the network and take proactive measures to manage its risk exposure effectively.
+Construction Masterz, while not directly flagged, is significantly exposed to flags through its connections with other entities in the network. The most substantial exposure comes from its association with BuildRight Construction and BuildRight, which together account for a large number of flags. The shared attributes, such as addresses and phone numbers, indicate potential operational or ownership links that contribute to this exposure. It is important for stakeholders to consider these indirect connections when assessing the risk and reputation of Construction Masterz.