Symmetric and asymmetric algorithms
Symmetric algorithms use a secret key/password (along with an Initialisation Vector IV) to encrypt and decrypt data. A number of these algorithms have been described and documented. Secret key needs to be stored safely as whoever gets hold of the key can encrypt/decrypt the data. These algorithms are efficient and fast and can encrypt/decrypt large amount of data - they can even encrypt streams of data.
Initialisation Vector is used for encrypting the first block of data. It is generally not considered to be a secret and can be passed as plain text. However, the same IV needs to be used for both encryption and decryption. More information can be found here.
Algorithms available in .NET Framework:
Performance of these algorithms are compared here (code to re-produce this can be found on GitHub):
As can be seen, AES and Rinjdael provide the best performance, partly due to the fact that they are purely managed. RC2, DES and 3DES are older algorithms and in terms of security not the most reliable so best to be avoided. So when it comes to choosing between an algorithm, use AES or Rijndael.
HMACSHA1 is a symmetric algorithm but is not used for encryption. This is mainly used for creating hash-based message authentication code which is a kind of signing.
Asymmetric algorithms on the other hand use a public/private key pair. These algorithms can be used for encryption as well as signing. Public key is used for encryption and verifying signatures while private key is used for decryption and generating signatures. So the idea is that the public key is shared publicly while the private key has to be stored securely. X509 certificates are a common type of public/private key pairs and usually installed on the machine's keystore so the operating system (and resource ACL) is responsible for its security.
Asymmetric algorithms are used for encrypting small pieces of data. So unlike symmetric algos, they cannot be used for encrypting large data or streams. So they are usually used to encrypt symmetric algo secret keys. Signing is an important use of asymmetric algorithms. .NET Framework itself uses it for signing assemblies (strong naming assemblies).
The most widely used algorithm is RSA which is implemented in.NET framework.
For producing numbers with cryptography-level randomness use RNG:
I have seen many cases where the secret key is hard-coded within the code, usually as a string. First of all, such secret keys can be easily retrieved using reverse engineering tools such as Reflector. Also, these strings are commonly meaningful strings, that usually can be guessed easily.
One way to have a secure secret key is to:
Initialisation Vector is used for encrypting the first block of data. It is generally not considered to be a secret and can be passed as plain text. However, the same IV needs to be used for both encryption and decryption. More information can be found here.
Algorithms available in .NET Framework:
- DES: One of the oldest. Uses 8-byte keys.
- RC2: Can use keys of 5-16 bytes.
- TripleDES or 3DES: An advanced and more secure DES. Uses keys of 16 or 24 bytes.
- Rijndael: A purely managed implementation. Can use keys of 16, 24 or 32 bytes.
- AES: A purely managed implementation. Uses 16-byte keys. [Please see @leastprivilege comment at the end as AES is an alternative Rijndael implementation]
Performance of these algorithms are compared here (code to re-produce this can be found on GitHub):
As can be seen, AES and Rinjdael provide the best performance, partly due to the fact that they are purely managed. RC2, DES and 3DES are older algorithms and in terms of security not the most reliable so best to be avoided. So when it comes to choosing between an algorithm, use AES or Rijndael.
HMACSHA1 is a symmetric algorithm but is not used for encryption. This is mainly used for creating hash-based message authentication code which is a kind of signing.
Asymmetric algorithms on the other hand use a public/private key pair. These algorithms can be used for encryption as well as signing. Public key is used for encryption and verifying signatures while private key is used for decryption and generating signatures. So the idea is that the public key is shared publicly while the private key has to be stored securely. X509 certificates are a common type of public/private key pairs and usually installed on the machine's keystore so the operating system (and resource ACL) is responsible for its security.
Asymmetric algorithms are used for encrypting small pieces of data. So unlike symmetric algos, they cannot be used for encrypting large data or streams. So they are usually used to encrypt symmetric algo secret keys. Signing is an important use of asymmetric algorithms. .NET Framework itself uses it for signing assemblies (strong naming assemblies).
The most widely used algorithm is RSA which is implemented in.NET framework.
An example of using symmetric and asymmetric algorithms
SSL/TLS is an example of using both symmetric and asymmetric algorithms in the same security context session. In this protocol, client and server negotiate a size for the encryption key (as well as other aspects including the algorithm to use) and then client generates a random secret key of the agreed size for symmetric encrypting the communication. Then it uses public key of the server to encrypt the secret key and sends it to the server. Server, being the only entity in possession of the private key, decrypts the secret key. This secret key is used for the lifetime of the secure transmission to symmetrically encrypt (and decrypt) the data.Other cryptography services
Random generation
Most likely you have used the class Random in the .NET Framework. This class is capable of generating random bytes that can be used as secret keys:var random = new Random(); var buffer = new byte[1024]; random.NextBytes(buffer);While this code works, Random class is incapable of generating completely random values, i.e. the values it produces are pseudo-random as it chooses from a finite set of numbers.
For producing numbers with cryptography-level randomness use RNG:
var buffer = new byte[1024]; using (var rng = new RNGCryptoServiceProvider()) { rng.GetBytes(buffer); }
Hashing
Hashing is the process by which a signature of small fixed size is created for a much larger piece of data. Hashing algorithms such as MD5 or SHA can be used to generate such hashes. Hashing algorithms can also use a secret key which can be used while generating the hash. Ability to produce the hash with a given secret key can be used as a sign of the ownership of the secret without having to send the secret. This technique is used in OAuth using HMACSHA1 algorithm. [OAuth2 is different as per @leastprivilege comment. Please see comments]
There are a number of algorithms implemented in .NET Framework. MD5 is best to be avoided and one of the alternatives of SHA algo should be used. In case of a need for key-based hashing, use HMACSHA1.
How to store the secret key of the encryption
We are commonly in need of encrypting pieces of sensitive data and storing them. These could include content of cookies, user sensitive information, etc. For using a symmetric encryption, we need to use a secret key. So where should we store the secret key?I have seen many cases where the secret key is hard-coded within the code, usually as a string. First of all, such secret keys can be easily retrieved using reverse engineering tools such as Reflector. Also, these strings are commonly meaningful strings, that usually can be guessed easily.
One way to have a secure secret key is to:
- Create a random secret key (of required size) using algorithms such as RNG
- Install an X509 certificate on the servers (private and public keys)
- Use asymmetric encryption to encrypt the key and store it for example as a file
- At the time of using the key, use the private key to decrypt the secret key and then use the key for symmetric encryption/decryption
Conclusion
Avoid older encryption or hashing algorithms such as MD5, DES, RC2 or 3DES. Use newer and managed-only implementations such as AES, Rijndael (and SHA for hasing). AES provides the best performance out of all symmetric encryption algorithms. Use combination of symmetric and asymmetric algorithms for secure encryption. Use RNG if you need crypto-level randomness.
Special thanks to Dominick Baier @leastprivilege for reviewing this article and posting comments which you can read in the comments section.
Special thanks to Dominick Baier @leastprivilege for reviewing this article and posting comments which you can read in the comments section.
Hi,
ReplyDeletejust some quick comments...
Streaming - only stream cipher work on streams, they are not exposed in .NET at all (only block ciphers) - even if CryptoStream gives us that illusion.
IV is not for encrypting - but to start the feedback chain (e.g. in CBC mode). They are not used in other modes, e.g. ECB.
AES and Rijndael are the same (except for some block length requirements). AES is just the NSA/NIST name - Rijndael the original name.
OAuth2 does not specify a hashing algo - it is rather the tokens you transport with OAUth2 - in JWT it is e.g. HMACSHA256 - don't use SHA1 anymore.
Recommendation - i don't agree. If you can store the key somewhere secretly (e.g. on a server) why introduce the X509 hassle? It opens other issues around management. On the client, you cannot store a secret key anyways.
Asymmetric makes the most sense in key exchange, not necessarily in storage.
... and managed impl might not be certified in your scenario (FIPS). And since any other algo besides AES is not acceptable anymore - it might make more sense to compare the perf of Aes, AesCng and AesCryptoServiceProvider.
my 2c ;)