Apostle

 

About

The production of intelligence from a broad range of data sources is seen by many agencies as an increasingly important capability. When combined, data sources offer a rich information resource for defence, national security and law enforcement agencies. However, it remains a very labour intensive process to search the data, extract relevant information and produce insights.

The objective of the Apostle™ program is to provide the analyst with a set of tools that greatly reduces the workload for this process. Specifically, it seeks to develop, integrate and evaluate technology so that analysts can search and interrogate multimedia data (text, image, video) to quickly identify all relevant data and have it presented to the analyst in an easily understandable manner. The Apostle program will concentrate on automated development of entity summaries and event summaries.

Streams

Development and Operations

Ross Buglak (Project Lead)

Data to Decisions CRC

Apostle

The Apostle™ engineering team supports research streams by collecting and curating various data sets. The team also provides researchers with tools and interfaces for querying and analysing data, integrates the output of the research streams into a cohesive demonstrator application, supports and maintains cloud-hosted environments for agencies to trial new capabilities and collects user feedback. The feedback is used it to drive the research and development roadmaps.

Picturing Knowledge

Associate Professor Lexing Xie

Australian National University

Apostle

This stream aims to develop core techniques to learn image-centric knowledge graphs by connecting large collections of image/video and their descriptions to existing knowledge bases. Knowledge graphs have become powerful sources for web search, but an equivalent source about things and their relations in pictures and videos does not exist yet. This project will help analysts understand ongoing news and social events constructing high-quality multi-media knowledge graphs that are specifically relevant and adapted to such events. This knowledge graph will link long-tailed (less obvious or rare) multimedia content to further enrich the knowledge graph. The ultimate aim is to help semi-automatically generate multimedia event summaries for analysts and decision makers.

Knowledge Graph Construction

Associate Professor Wei Wang

University of New South Wales

Apostle

This stream will focus on transforming the ‘noisy’ data found on the internet into a structured form. This is done by creating domain specific knowledge graphs. The knowledge graph links people to other elements including objects, locations, events and other people. By organising this data, analysts are able to find information faster. It will allow for easy and accurate reporting, automatic document or entity summary and question answering.

Knowledge Graph Query

Associate Professor Wei Wang

University of New South Wales

Apostle

This streams aims to build intelligent and efficient retrieval systems on a Knowledge Graph. This allows the analyst to visualise the Knowledge Graph and in turn see only the important and useful information to their task at hand. The visualisation system will enable an analyst to quickly gain a succinct yet accurate summary of the relationships between two entities of interest. The semantic-level zoom-in and –out support gives the analyst full control to perform explorative data visualization.

Semantic Indexing of Large Scale Video Archives

Professor Yi Yang

University of Technology Sydney

Apostle

This stream seeks novel methods for semantic concept detection in videos and will develop an effective system for semantic indexing of videos. Identifying semantic content in videos has long been a goal of multimedia analysis and retrieval, and has broad impact on many real world applications, ranging from our daily life to security. The outcome of this project will provide analysts with hassle free analytical tools for big video data management and utilisation.

Knowledge Mining

Associate Professor Wayne Wobcke

University of New South Wales

Apostle

This stream aims to develop techniques for extracting knowledge (events and their associated entities) from a broad range of data sources of mainly unstructured rich text. The research has three aims, mining events and their associated entities, mapping events to an existing knowledge graph and summarising events and political sentiment analysis. This capability will provide insight into significant people and events for each country.

Exploiting Contextual Cues in Large Scale Machine Learning - Project Complete

Professor Anton van den Hengel

University of Adelaide

Apostle

This stream aims to develop technologies able to accurately detect specific objects in images and to allow these technologies to operate efficiently, and with minimal training data. When complete the technology will allow the detection of specific objects in large volumes of imagery. It will be able to process millions of images for thousands of types of objects, thus allowing analysts to focus their attention on a small number of images of interest.

Visual Question Answering - Project Complete

Professor Anton van den Hengel

University of Adelaide

Apostle

This stream aims to develop image understanding technologies capable of answering relatively general questions about previously unseen images as well as develop sophisticated methods for integrating and exploiting information from both text and images.  When complete the technology will allow analysts to access information in images as easily as text information. It will allow users to ask questions of databases that include images and receive answers that involve both text and images.

Participants

PhD Profiles

Adrian Johnston

University of Adelaide

Topic

Large Scale Geospatial Image Understanding and Visualisation

Apostle

George Stamatescu

University of Adelaide

Topic

Modelling Intelligent Agents Using Hidden Reciprocal Chains

Apostle

Hayden Faulkner

University of Adelaide

Topic

Scene Interpretation from Video

Apostle

John Steven Calvo Martinez

University of New South Wales

Topic

Distributed Stream Mining

Apostle

Linchao Zhu

University of Technology Sydney

Topic

Semantic Indexing of Large Scale Video

Apostle

Sandeepa Kannangara

University of New South Wales

Topic

Opinion Polarity Classification Using Unstructured Texts

Apostle

Zishou Ding

University of New South Wales

Topic

Semantic Search with Knowledge Graphs

Apostle

Shifeng Liu

University of New South Wales

Topic

Fine Grained Named Entity Recognition in Social Networks

Apostle

Asif Ali (Muhammad)

University of New South Wales

Topic

Personal Profiling via Interlinked Spatiotemporal Networks––Crime Prevention and Control

Apostle

Alexander Mathews

Australian National University

Topic

Automatic Sentence Re-writing/Generation and Building Visual Knowledge Graphs

Apostle

Zhedong Zheng

University of Technology Sydney

Topic

Face Detection and Recognition

Apostle

Yukai (Kevin) Miao

University of New South Wales

Topic

Open Relation Extraction and Refinement

Apostle

Xuanyi Dong

University of Technology Sydney

Topic

Logo Detection

Apostle

Umanga Bista

Australian National University

Topic

Learning Knowledge Graph on Massive Data Streams

Apostle

Yanbin Liu

University of Technology Sydney

Topic

Efficient Object Detection and Vision-Language Joint Modelling

Apostle

Alasdair Train

Australian National University

Topic

Active Learning with Multimedia Knowledge Graphs

Pingbo Pan

University Technology Sydney

Topic

Efficient and Effective Logo Detection in Large Scale Images and Videos

Alexander Long

University of New South Wales

Topic

Adaptive Querying for Knowledge Graph Construction via Deep Reinforcement Learning

Yufei Wang

University of New South Wales

Topic

Improving Information Extraction Using Linguistic and Knowledge Base Information

Formal Publications

Local Similarity Search for Unstructured Text, P Wang, C Xiao, J Qin, W Wang, X Zhang and Y Ishikawa,

Data mining for building knowledge bases: techniques, architectures and applications,  A Krzywicki, W Wobcke, M Bain and J Calvo Martinez

Avoiding Optimal Mean Robust PCA/2DPCA with Non-greedy `1-norm Maximization, M Luo, F Nie, X Chang, Y Yang, A Hauptmann and Q Zheng

A Convex Sparse PCA for Feature Analysis, X Chang, F Nie, Y Yang and H Huang

You Lead, We Exceed: Labor-Free Video Concept Learning by Jointly Exploiting Web Videos and Images, C Gan, T Yao, K Yang, Y Yang, T Mei

They Are Not Equally Reliable: Semantic Event Search using Differentiated Concept Classifiers, X Chang, Y Yu, Y Yang and E Xing

A Framework of Online Learning with Imbalanced Streaming Data, Y Yan, T Yang, Y Yang, J Chen

An Adaptive Semisupervised Feature Analysis for Video Semantic Recognition, M Luo, X Chang, L Nie, Y Yang, A Hauptmann, Q Zheng

Image Classification by Cross-Media Active Learning With Privileged Information,  Y Yan, F Nie , W Li,  C Gao,  YYang,  D Xu

The Many Shades of Negativity, Z Ma,  X Chang, Y Yang, N Sebe, A Hauptmann

Probabilistic Knowledge Graph Construction: Compositional and Incremental Approaches, D Kim, L Xie and  S Ong

A Framework of Online Learning with Imbalanced Streaming Data, Y Yan, T Yang, Y Yang and J Chen

Unlabeled Samples Generated by GAN Improve the Person Re-identification Baseline in vitro, Z Zheng, L Zheng and Y Yang

Visual Question Answering: A Survey of Methods and Datasets, Q Wu, D Teney, P Wang, C Shen, A Dick and A van den Hengel

Wider or Deeper: Revisiting the ResNet Model for Visual Recognition, Z Wu, C Shen and A van den Hengel

An Adaptive Semisupervised Feature Analysis for Video Semantic Recognition, M Luo, X Chang, L Nie, YYang, A G. Hauptmann, and Q Zheng

Image Classification by Cross-Media Active Learning With Privileged Information, YYan, F Nie, W Li, C Gao, Y Yang, D Xu and Senior Member, IEEE

The Many Shades of Negativity, Z Ma, X Chang, Y Yang, N Sebe, Senior Member, IEEE, and A G. Hauptmann