Graph database solution for higher-order spatial statistics in the era of big 
data

Sabiu, Cristiano G.; Hoyle, B.; Kim, Juhan; Li, Xiao-Dong

doi:10.3847/1538-4365/ab22b5

Item

ITEM ACTIONSEXPORT

Add to Basket

Local TagsRelease HistoryDetailsSummary

Released

Journal Article

Graph database solution for higher-order spatial statistics in the era of big data

MPS-Authors

/persons/resource/persons226789

Hoyle, B.
Optical and Interpretative Astronomy, MPI for Extraterrestrial Physics, Max Planck Society;

External Resource

No external resources are shared

Fulltext (restricted access)

There are currently no full texts shared for your IP range.

Fulltext (public)

There are no public fulltexts stored in PuRe

Supplementary Material (public)

There is no public supplementary material available

Citation

Sabiu, C. G., Hoyle, B., Kim, J., & Li, X.-D. (2019). Graph database solution for higher-order spatial statistics in the era of big data. The Astrophysical Journal Supplement Series, 242(2): 29. doi:10.3847/1538-4365/ab22b5.

Cite as: https://hdl.handle.net/21.11116/0000-0004-800F-B

Abstract

We present an algorithm for the fast computation of the general N-point spatial correlation functions of any discrete point set embedded within an Euclidean space of Rⁿ . Utilizing the concepts of kd-trees and graph databases, we describe how to count all possible N-tuples in binned configurations within a given length scale, e.g., all pairs of points or all triplets of points with side lengths < r _MAX. Through benchmarking, we show the computational advantage of our new graph-based algorithm over more traditional methods. We show measurements of the three-point correlation function up to scales of ~200 Mpc (beyond the baryon acoustic oscillation scale in physical units) using current Sloan Digital Sky Survey (SDSS) data. Finally, we present a preliminary exploration of the small-scale four-point correlation function of 568,776 SDSS Constant (stellar) Mass (CMASS) galaxies in the northern Galactic cap over the redshift range of 0.43 < z < 0.7. We present the publicly available code GRAMSCI (GRAph Made Statistics for Cosmological Information; bitbucket.org/csabiu/gramsci), under a Gnu is Not Unix (GNU) General Public License.