Abstract:The development and application of big data technology has a deep influence on the national governance model

corporate decision-making architecture

business strategy and personal lifestyle.The data aggretation not only increases the risk of user privacy leaks

but the huge information and potential value contained in big data also attract more potential attackers.Moreover

the big data application is a cross-disciplinary application

which introduces not only a lot of new technologies but more and higher risks.The definition and characteristics of big data is reviewed

and the big data architecture and big data security system are put forward in this paper.Based on this system

the security challenges facing the current big data and research progress of big data security technologies are analyzed from four perspectives:laws and regulations

standards

data life cycle protection and big data platform key technology.Laws and regulations in America

European Union

China and the research status of big data security standarlization of International Organization for Standardization

America

China and so on was introduced.Big data platform is needed to realize the collection

transmission

storage and analysis and so on in big data lifecycle.In this paper

the security problems and key technologies of big data are analyzed from two dimensions of big data lifecycle and big data platform.The lifecycle includes collection

storage

usage

distribution and deletion five phases.Data value is determined by the data quality of the collection phase.Data and model inconsistency detection and data cleaning are the main technical means to improve data quality.The processed big data is transmit to external entities in big data distribution phase

so the protection of privacy and sensitive information is essential.The retalted key technologies are data anonymity

privacy-protecting data retrieval and analysis.The big data management support the effective use of big data and ensure big data security

which mainly contains metadata management and data lineage.The problems of authentication

data isolation

data encryption storage

big data platform border protection and audit between big data components can be solved by the big data platform security with the key technologies such as authentication

access control

data encryption and audit.At present

a perfect big data security standard system is still lacking in the world.The norms and guidance for privacy protection

data sharing

cross-border data transmission from standards are urgent needed.With the rapid development of big data analysis technology

it’s difficult to predict the challenge of privacy protection and sensitive information protection from big data association analysis in the future.The existing data masking and privacy protection technology will face a great challenge.The data analysis without exposure to data privacy and sensitive information can be achieved by data homomorphic encryption

but the existing homomorphic encryption algorithm is far from mature.The current authentication

data encryption and access control in the big data platform use the traditional technology

which can’t adapt to the new environment with large scale of data

complex processing logic and huge amount of users.Some of the big data security key technologies are also worthy of indepth study in the performance and availability for early practical application.In addition

using big data pro-cessing technology to develop security applications such as network security situation perception

intrusion detection and network threat intelligence analysis

and using big data technology to resist attacks against big data have become a new research trend in the field of big data security.The development of big data security requires the united support and promotion of laws and regulations

standards and key technologies.