SBSAnimoji - 🐵 Animoji app using Apples AvatarKit

•    Objective-C

Fooling around with Apples private framework AvatarKit, the framework used in Messages.app for recording Animoji videos. If you are looking to create your own Animoji, take a look at SBSCustomAnimoji. This project relies heavily on Apples private API and you should therefore not try to submit this code to App Store.

Awesome-ARKit - A curated list of awesome ARKit projects and resources. Feel free to contribute!

•    Swift

ARKit is a new framework that allows you to easily create unparalleled augmented reality experiences for iPhone and iPad. By blending digital objects and information with the environment around you, ARKit takes apps beyond the screen, freeing them to interact with the real world in entirely new ways. Your contributions are always welcome! To add, remove, or change things on the list: Submit a pull request. See contribution.md for guidelines.

three

•    Javascript

A helper three.js library for building AR web experiences that run in WebARonARKit and WebARonARCore. See three.ar.js API documentation for details.

react-native-arkit - React Native binding for iOS ARKit

•    Objective-C

React Native binding for iOS ARKit. Note: ARKit is only supported by devices with A9 or later processors (iPhone 6s/7/SE/8/X, iPad 2017/Pro) on iOS 11. You also need Xcode 9 to build the project.

ARKit-CoreLocation - Combines the high accuracy of AR with the scale of GPS data.

•    Swift

ARKit: Uses camera and motion data to map out the local world as you move around. CoreLocation: Uses wifi and GPS data to determine your global location, with a low degree of accuracy.

webxr - Repository for the WebXR Device API Specification.

•    CSS

The WebXR device API is for accessing virtual reality (VR) and augmented reality (AR) devices, including sensors and head-mounted displays on the Web. The WebXR Device API Specification is the repository of the Immersive Web Working Group.

NextLevel - ⬆️ Rad Media Capture in Swift

•    Swift

NextLevel is a Swift camera system designed for easy integration, customized media capture, and image streaming in iOS. Integration can optionally leverage AVFoundation or ARKit. Alternatively, drop the NextLevel source files or project file into your Xcode project.

Objectron - Objectron is a dataset of short, object-centric video clips

•    Jupyter

Objectron is a dataset of short object centric video clips with pose annotations. The Objectron dataset is a collection of short, object-centric video clips, which are accompanied by AR session metadata that includes camera poses, sparse point-clouds and characterization of the planar surfaces in the surrounding environment. In each video, the camera moves around the object, capturing it from different angles. The data also contain manually annotated 3D bounding boxes for each object, which describe the object’s position, orientation, and dimensions. The dataset consists of 15K annotated video clips supplemented with over 4M annotated images in the following categories: bikes, books, bottles, cameras, cereal boxes, chairs, cups, laptops, and shoes. In addition, to ensure geo-diversity, our dataset is collected from 10 countries across five continents. Along with the dataset, we are also sharing a 3D object detection solution for four categories of objects — shoes, chairs, mugs, and cameras. These models are trained using this dataset, and are released in MediaPipe, Google's open source framework for cross-platform customizable ML solutions for live and streaming media.

engine - Fast and lightweight WebGL game engine

•    Javascript

PlayCanvas is an open-source game engine. It uses HTML5 and WebGL to run games and other interactive 3D content in all modern browsers without the need for a plugin. You can see more games on the PlayCanvas website.

ARShooter - A demo Augmented Reality shooter made with ARKit in Swift (iOS 11)

•    Swift

ARShooter is an open source Augmented Reality shooter made with ARKit and written in Swift. Hence, it is only useable with iOS 11. For more details on how to get started with ARKit and make your own AR Shooter, take a look at the complementary (and complimentary) tutorial.

CoreML-in-ARKit - Simple project to detect objects and display 3D labels above them in AR

•    Swift

This simple project detects objects in Augmented Reality and displays 3D labels on top of them. This serves as a basic template for an ARKit project to use CoreML. Note: SceneKit can achieve a 60 FPS on iPhone7+ - though when it gets hot, it'll drop to 30 FPS.

ARCharts - Lovely Augmented Reality Charts for iOS - Built with ARKit

•    Swift

ARCharts is a library making it easy to create beautiful charts tailored for augmented reality. There are three different ways of adding ARCharts to your project.

jeelizFaceFilter - Javascript/WebGL lightweight face tracking library designed for augmented reality webcam filters

•    Javascript

This JavaScript library detects and tracks the face in real time from the webcam video feed captured with WebRTC. Then it is possible to overlay 3D content for augmented reality applications. We provide various demonstrations using main WebGL 3D engines. We have included in this repository the release versions of the 3D engines to work with a determined version (they are in /libs/<name of the engine>/). This library is lightweight and it does not include any 3D engine or third party library. We want to keep it framework agnostic so the outputs of the library are raw: if the a face is detected or not, the position and the scale of the detected face and the rotation Euler angles. But thanks to the featured helpers, examples and boilerplates, you can quickly deal with a higher level context (for motion head tracking, for face filter or face replacement...). We continuously add new demontrations, so stay tuned ! Also, feel free to open an issue if you have any question or suggestion.

ARPaint - Draw with bare fingers in the air using ARKit

•    Swift

ARPaint demonstrates how to draw in the air with bare fingers using ARKit and Vision libraries introduced in iOS 11. Read this article: iOS ARKit Tutorial: Drawing in the Air with Bare Fingers for detailed description of how this code work and how to get started with ARKit.

jsartoolkit5 - Javascript ARToolKit v5.x

•    Javascript

Emscripten port of ARToolKit to JavaScript. During development, you can run npm run watch, it will rebuild the library everytime you change ./js/ directory.

arkit-by-example - Apple ARKit example app

•    Objective-C

NOTE: Once you have detected the planes you want, disable the plane detection so that the planes don't continue to resize and move around. NOTE: The thre dots "..." in the bottom right open a settings menu with some debug options.

jeelizWeboji - JavaScript/WebGL real-time face tracking and expression detection library

•    Javascript

With this library, you can build your own animoji embedded in Javascript/WebGL applications. You do not need any specific device except a standard webcam. By default a webcam feedback image is displayed with the face detection frame. The face detection is quite robust to all lighting conditions, but the evaluation of expression can be noisy if the lighting is too directional, too weak or if there is an important backlight. So the webcam feedback image is useful to see the quality of the input video feed.

OpenXR-SDK - Generated headers and sources for OpenXR loader.

•    C++

This repository contains OpenXR headers, as well as source code and build scripts for the OpenXR loader. It contains all generated source files and headers pre-generated for minimum dependencies. The authoritative public repository for this project is located at https://github.com/KhronosGroup/OpenXR-SDK.

Enables map services on top of existing map providers like Google Maps

Services include Map visualization services, Map decoration services, Spot registration services and Spot naming services.

SplashOn

3D UI and AR project